-- Logs begin at Mon 2022-09-19 13:52:09 UTC, end at Mon 2022-09-19 16:29:26 UTC. -- Sep 19 14:26:32.376901 n-d-858384-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 14:26:32.386862 n-d-858384-1 devstack@n-api.service[106432]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:26:32 2022] *** Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: nodename: n-d-858384-1 Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: machine: x86_64 Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: clock source: unix Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: pcre jit disabled Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: detected number of CPU cores: 4 Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: current working directory: / Sep 19 14:26:32.388325 n-d-858384-1 devstack@n-api.service[106432]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: your processes number limit is 47680 Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: your memory page size is 4096 bytes Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: detected max file descriptor number: 2048 Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: lock engine: pthread robust mutexes Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: thunder lock: enabled Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 14:26:32.388916 n-d-858384-1 devstack@n-api.service[106432]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:26:32.427880 n-d-858384-1 devstack@n-api.service[106432]: Python main interpreter initialized at 0x5573da0469c0 Sep 19 14:26:32.427880 n-d-858384-1 devstack@n-api.service[106432]: python threads support enabled Sep 19 14:26:32.427880 n-d-858384-1 devstack@n-api.service[106432]: your server socket listen backlog is limited to 100 connections Sep 19 14:26:32.427880 n-d-858384-1 devstack@n-api.service[106432]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:26:32.428248 n-d-858384-1 devstack@n-api.service[106432]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:26:32.428341 n-d-858384-1 devstack@n-api.service[106432]: *** Operational MODE: preforking *** Sep 19 14:26:32.428550 n-d-858384-1 devstack@n-api.service[106432]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:26:32.428550 n-d-858384-1 devstack@n-api.service[106432]: spawned uWSGI master process (pid: 106432) Sep 19 14:26:32.428746 n-d-858384-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 19 14:26:32.431525 n-d-858384-1 devstack@n-api.service[106432]: spawned uWSGI worker 1 (pid: 106433, cores: 1) Sep 19 14:26:32.431525 n-d-858384-1 devstack@n-api.service[106432]: spawned uWSGI worker 2 (pid: 106434, cores: 1) Sep 19 14:26:32.431525 n-d-858384-1 devstack@n-api.service[106432]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:26:33.089880 n-d-858384-1 devstack@n-api.service[106434]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:26:33.090493 n-d-858384-1 devstack@n-api.service[106433]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:26:34.182279 n-d-858384-1 devstack@n-api.service[106433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:26:34.182279 n-d-858384-1 devstack@n-api.service[106433]: from cryptography.utils import int_from_bytes Sep 19 14:26:34.183002 n-d-858384-1 devstack@n-api.service[106433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:26:34.183002 n-d-858384-1 devstack@n-api.service[106433]: from cryptography.utils import int_from_bytes Sep 19 14:26:34.189577 n-d-858384-1 devstack@n-api.service[106434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:26:34.189577 n-d-858384-1 devstack@n-api.service[106434]: from cryptography.utils import int_from_bytes Sep 19 14:26:34.190046 n-d-858384-1 devstack@n-api.service[106434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:26:34.190046 n-d-858384-1 devstack@n-api.service[106434]: from cryptography.utils import int_from_bytes Sep 19 14:26:36.709442 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:26:36.710075 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:26:36.710440 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:26:36.710533 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:26:36.710619 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:26:36.710711 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:26:36.710829 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:26:36.710914 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:26:36.711010 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:26:36.711091 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:26:36.711169 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.711308 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.711407 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.711634 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.711734 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.711957 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.712050 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.712274 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.712372 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.712607 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.712713 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.712914 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713008 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713236 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713332 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713555 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713642 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713813 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.713899 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.714129 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.714226 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.714446 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.714533 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.714795 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.714897 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.715108 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.715206 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.715416 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.715504 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.715726 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.715820 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716027 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716113 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716334 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716425 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716640 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716725 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.716947 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.717143 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.717540 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.717684 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.717829 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.717954 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.718139 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.718261 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.718449 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.718562 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.718805 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.718912 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.719116 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.719204 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.719420 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.719511 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.719730 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.719818 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.720035 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.720131 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.720342 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.720436 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.720650 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.720736 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.721038 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.721124 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.721351 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.721432 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.721660 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.721744 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.722019 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.722158 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.722393 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.722551 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.722807 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.722952 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723043 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723181 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723345 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723448 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723653 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723748 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.723978 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.724072 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.724296 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.724395 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.724614 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.724709 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.724935 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725029 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725234 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725331 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725541 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725643 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725848 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.725943 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.726161 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.726257 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.726462 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.726548 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.726785 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.726921 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727028 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727124 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727327 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727419 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727630 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727718 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.727952 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728047 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728272 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728368 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728524 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728688 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728805 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.728948 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.729078 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.729198 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.729398 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.729504 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.729703 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.729825 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730011 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730131 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730318 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730440 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730623 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730764 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.730961 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731079 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731266 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731385 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731570 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731690 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731874 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.731995 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.732191 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.732302 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.732505 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.732619 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.732829 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.732917 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.733135 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.733222 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.733453 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.733547 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.733837 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.733938 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.734097 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.734234 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.734402 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.734489 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.734767 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.734872 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.735084 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.735171 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.735391 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.735500 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.735714 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.735831 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736030 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736124 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736332 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736418 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736637 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736738 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.736939 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737024 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737245 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737332 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737585 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737674 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737892 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.737986 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.738236 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.738334 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.738487 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.738581 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.738809 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.738913 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.739117 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.739207 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.739437 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.739525 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.739742 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.739837 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740049 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740135 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740347 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740434 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740653 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740738 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.740956 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741043 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741260 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741353 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741564 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741649 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741869 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.741974 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.742173 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.742266 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.742473 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.742567 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.742789 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.742924 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.743099 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.743195 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.743402 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.743487 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.743704 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.743799 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744024 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744112 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744327 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744413 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744632 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744732 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.744934 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745023 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745233 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745320 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745534 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745632 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745847 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.745962 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.746148 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.746235 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.746454 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.746550 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.746767 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.746868 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747081 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747174 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747385 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747487 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747691 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747779 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.747995 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748082 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748299 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748398 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748599 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748685 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748903 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.748990 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.749205 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.749294 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.749511 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.749597 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.749813 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.749907 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.750113 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.750199 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.750413 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.750500 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.750714 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.750818 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751039 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751126 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751339 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751425 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751640 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751724 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.751935 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752033 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752231 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752316 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752549 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752645 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752859 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.752945 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.753165 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.753752 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.754017 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.754112 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.754323 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.754433 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.754645 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:26:36.754732 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755005 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755102 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755340 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755427 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755655 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755741 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.755988 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.756097 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.756314 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.756399 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.756634 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.756728 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.756947 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757035 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757259 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757344 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757574 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757718 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757883 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.757970 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.758193 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.758287 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.758502 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.758596 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.758841 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.758931 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.759159 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.759256 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.759475 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.759561 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.759791 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.759878 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.760106 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.760200 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.760421 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.760507 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.760729 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.760822 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761044 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761129 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761360 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761447 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761675 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761763 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.761985 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.762072 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.762300 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.762442 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.762634 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.762722 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.762984 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.763071 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.763309 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.763407 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.763629 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.763722 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.763943 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764033 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764253 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764349 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764564 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764652 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764873 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.764959 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.765210 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.765301 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.765520 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.765606 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.765830 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.765930 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.766139 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.766237 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.766447 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.766533 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.766780 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.766881 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.767097 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.767189 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.767406 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.767492 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.767716 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.767803 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.768025 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.768147 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.768338 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.768425 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.768658 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.768751 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.769536 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.769634 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.769853 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.769939 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.770167 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.770269 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.770479 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.770571 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.770813 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.770901 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.771128 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.771228 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.771438 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.771531 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.771740 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.771825 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.772044 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.772143 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.772348 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.772436 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.772650 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.772736 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.773208 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.773315 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.773510 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.773596 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.773831 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.773924 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.774135 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.774230 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.774453 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.774547 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.774786 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.774876 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.775092 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.775180 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.775402 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.775489 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.775711 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.775797 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776013 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776100 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776318 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776413 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776625 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776712 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.776930 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777019 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777233 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777318 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777549 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777635 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777853 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.777941 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.778156 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.778287 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.778467 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.778562 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.778790 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.778908 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.779104 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.779205 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.779415 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.779515 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.779726 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.779830 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780033 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780121 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780340 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780435 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780649 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780735 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.780957 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.781043 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.781266 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.781354 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.781574 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.781664 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.781910 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782005 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782211 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782298 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782533 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782619 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782876 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.782965 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.783198 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.783292 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.783499 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.783586 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.783803 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.783889 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.784103 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.784189 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.784403 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.784516 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.784726 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.784928 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785016 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785278 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785379 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785555 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785650 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785859 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.785948 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.786165 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.786300 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.786468 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.786555 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.786793 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.786883 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.787101 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.787198 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.787400 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.787487 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.787704 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.787793 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788005 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788110 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788305 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788405 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788608 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788703 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.788951 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.789038 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.789252 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.789347 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.789590 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.789676 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.789916 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790020 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790228 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790324 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790541 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790636 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790876 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.790978 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.791188 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.791286 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.791497 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.791591 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.791804 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.791889 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.792110 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.792204 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.792419 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.792506 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.792734 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.792819 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793041 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793128 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793356 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793451 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793664 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793751 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.793981 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.794111 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.794287 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.794385 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.794599 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.794686 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.794927 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795018 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795245 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795333 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795584 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795678 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795906 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.795995 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.796217 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.796318 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.796534 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.796716 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.796841 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.796929 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.797148 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.797234 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.797456 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.797551 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.797762 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.797848 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.798071 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.798169 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.798379 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.798491 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.798692 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.798809 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799027 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799114 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799346 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799442 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799654 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799742 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.799971 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.800105 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.800324 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.800433 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.800643 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.800859 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.800955 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.801196 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.801292 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.801534 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.801632 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.801849 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.801936 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.802164 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.802261 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.802487 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.802575 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.802893 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.802997 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.803207 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.803302 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.803520 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.803608 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.803825 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.803912 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.804130 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.804225 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.804436 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.804533 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.804746 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.804834 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805057 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805144 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805364 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805449 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805668 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805760 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.805972 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.806059 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.806310 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.806403 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.806586 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.806675 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.806910 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807000 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807216 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807311 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807526 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807614 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807836 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.807923 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.808147 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.808233 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.808470 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.808613 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.808774 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.808860 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.809079 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.809174 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.809380 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.809475 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.809701 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.809787 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810006 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810093 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810310 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810413 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810612 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810698 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.810944 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811031 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811282 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811378 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811587 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811682 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811891 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.811978 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.812211 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.812300 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.812521 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.812608 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.812833 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.812919 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.813144 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.813231 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.813454 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.813541 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.813765 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.813851 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.814080 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.814167 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.814394 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.814481 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.814703 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.814809 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.815038 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.815127 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.815349 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.815446 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.815659 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.816277 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.816511 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.816602 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.816826 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.816953 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.817136 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.817237 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.817445 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.817534 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.817752 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.817841 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.818057 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.818152 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.818371 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.818483 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.818690 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.818960 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.819277 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.819380 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.819607 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.819694 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.819924 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.820024 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.820251 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.820358 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.820580 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.820678 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.820904 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821001 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821235 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821329 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821551 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821717 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821860 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.821949 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.822167 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.822253 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.822473 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.822573 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.822800 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.822892 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.823112 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.823212 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.823419 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.823507 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.823728 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.823823 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824037 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824151 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824345 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824442 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824649 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824735 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.824953 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825039 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825256 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825343 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825559 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825644 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825867 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.825961 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.826170 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.826269 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.826477 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.826564 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.826804 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.826978 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.827120 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.827253 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.827418 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.827554 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.827744 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.827930 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828077 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828258 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828418 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828608 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828608 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828921 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.828921 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.829233 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.829233 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.829535 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.829535 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.829862 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830010 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830181 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830279 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830431 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830617 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830789 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.830972 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.831128 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.831292 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.831986 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.832175 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.832341 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.832499 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.832645 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.832816 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.832816 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.833138 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.833306 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.833477 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.833636 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.833804 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.833943 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.834122 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.834302 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.834482 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.834633 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.834815 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.834916 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835044 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835145 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835240 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835372 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835464 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835569 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835705 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835808 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.835894 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.836081 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.836217 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.836386 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.836529 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.836698 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.836837 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837018 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837148 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837300 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837460 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837608 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837772 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.837908 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.838077 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.838227 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.838390 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.838531 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.838694 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.838872 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839039 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839157 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839344 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839468 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839655 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839775 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.839958 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840102 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840267 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840393 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840577 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840716 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840881 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.840989 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.841204 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.841320 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.841523 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.841645 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.841827 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.841916 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.842127 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.842221 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.842436 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.842542 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.842738 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.842847 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843062 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843150 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843372 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843476 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843679 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843767 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.843988 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.844075 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.844291 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.844439 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.844596 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.844702 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.844899 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845010 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845203 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845317 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845502 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845635 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845798 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.845924 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.846102 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.846211 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.846404 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.846490 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.846711 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.846841 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.847076 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.847190 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.847448 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.847573 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.847756 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.847854 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.848063 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.848152 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.848412 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.848509 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.848721 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.848858 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849030 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849128 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849370 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849457 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849672 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849768 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.849990 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.850085 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.850302 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.850398 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.850617 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.850834 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.850955 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851052 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851258 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851346 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851589 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851682 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851883 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.851977 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.852185 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.852271 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.852486 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.852581 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.852790 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.852886 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.853104 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.853190 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.853408 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.853496 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.853714 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.853801 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854037 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854132 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854348 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854450 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854662 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854777 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.854989 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.855076 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.855301 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.855398 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.855612 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.855700 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.855920 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856005 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856228 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856316 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856537 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856623 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856846 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.856941 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.857154 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.857249 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.857462 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.857549 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.857768 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.857862 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.858077 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.858162 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.858383 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.858469 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.858759 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.858870 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859020 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859106 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859325 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859419 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859638 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859735 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.859944 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860027 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860265 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860360 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860555 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860760 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860847 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.860927 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.861154 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.861249 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.861458 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.861559 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.861759 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.861884 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.862068 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.862194 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.862392 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.862577 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.862882 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.863194 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.863286 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.863505 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.863614 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.863810 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.863899 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.864122 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.864209 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.864434 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.864555 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.864747 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.864854 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.865060 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.865192 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.865364 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.865507 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.865787 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.865875 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.866101 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.866197 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.866410 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.866505 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.866717 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.866832 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867045 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867144 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867350 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867439 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867660 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867754 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.867987 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.868083 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.868290 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.868385 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.868594 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.868689 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.868899 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869007 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869215 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869303 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869516 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869636 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869837 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.869934 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.870242 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.870337 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.870554 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.870661 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.870884 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.870987 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.871296 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.871382 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.871612 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.871726 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.871927 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872027 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872247 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872343 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872554 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872642 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872872 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.872959 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.873173 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.873268 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.873490 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.873578 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.873802 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.873889 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.874111 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.874200 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.874430 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.874518 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.874737 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.874852 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.875073 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.875161 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.875379 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.875467 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.875694 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.875789 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.876016 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.876104 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.876332 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.876419 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.876656 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.876752 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877030 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877117 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877355 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877450 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877677 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877773 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.877982 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.878076 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.878848 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.878962 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.879168 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.879342 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.879474 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.879674 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.879762 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.879984 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.880072 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.880311 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.880401 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.880618 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.880706 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.880932 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881028 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881245 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881333 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881557 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881656 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881861 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.881973 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.882167 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.882265 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.882470 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.882559 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.882795 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.882898 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.883109 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.883197 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.883427 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.883514 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.883741 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.883838 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884060 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884156 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884366 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884455 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884671 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884766 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.884992 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.885088 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.885298 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.885414 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.885602 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.885708 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.885904 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886002 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886209 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886311 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886541 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886649 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886870 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.886980 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.887191 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.887299 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.887517 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.887612 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.887826 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.887922 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.888148 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.888248 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.888477 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.888565 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.888802 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.888889 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.889111 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.889222 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.889427 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.889533 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.889743 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.889832 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890047 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890143 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890353 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890441 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890655 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890741 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.890984 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891126 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891288 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891376 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891592 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891680 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891893 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.891981 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.892198 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.892317 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.892500 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.892598 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.892801 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.892909 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.893103 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.893197 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.893412 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.893507 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.893721 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.894374 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.894643 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.894905 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895060 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895161 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895243 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895323 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895498 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895588 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895803 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.895903 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.896150 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.896239 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.896458 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.896545 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.896786 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.896882 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.897100 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.897197 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.897428 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.897516 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.897749 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.897845 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.898317 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.898406 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.898633 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.898719 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.898961 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899047 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899274 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899364 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899590 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899689 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899900 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.899989 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.900209 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.900296 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.900520 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.900606 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.900832 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.900927 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.901154 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.901358 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.901689 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.901832 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902005 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902141 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902321 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902455 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902634 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902823 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.902973 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903070 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903287 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903375 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903600 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903695 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903911 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.903999 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.904220 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.904314 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.904533 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.904634 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.904842 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.904930 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.905170 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.905257 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.905492 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.905587 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.905819 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.905907 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.906135 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.906222 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.906451 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.906544 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.906788 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.906879 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.907099 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.907203 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.907413 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.907500 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.907758 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.907846 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.908069 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.908166 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.908376 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.908464 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.908692 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.908781 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909005 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909101 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909318 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909435 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909652 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909802 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.909981 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.910161 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.910270 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.910358 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.910586 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.910691 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.910920 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911030 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911225 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911381 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911533 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911621 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911845 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.911935 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.912174 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.912300 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.912492 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.912629 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.912804 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.912938 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.913117 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.913233 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.913431 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.913528 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.913745 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.913949 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.914261 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.914349 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.914577 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.914673 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.914937 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915027 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915261 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915347 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915579 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915677 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915896 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.915986 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.916216 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.916303 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.916522 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.916609 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.916829 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.916916 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.917135 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.917222 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.917443 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.917536 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.917747 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.917844 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.918050 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.918144 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.918369 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.918464 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.918674 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.918781 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.919003 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.919102 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.919318 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.919406 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.919626 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.919851 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.920156 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.920260 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.920494 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.920581 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.920809 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.920896 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.921134 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.921229 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.921452 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.921547 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.921759 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.921847 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.922065 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.922161 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.922374 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.922462 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.922681 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.922795 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923012 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923101 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923321 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923409 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923628 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923717 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.923932 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924021 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924239 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924328 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924552 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924640 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924855 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.924943 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.925181 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.925362 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.925492 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.925652 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.925938 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926027 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926269 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926357 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926577 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926678 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926905 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.926995 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.927214 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.927311 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.927519 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.927615 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.927823 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.927910 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.928126 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.928212 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.928429 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.928525 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.928735 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.928824 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929037 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929124 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929340 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929436 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929642 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929736 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.929947 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.930045 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.930257 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.930354 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.930587 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.930674 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.930917 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931008 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931243 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931340 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931548 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931645 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931853 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.931944 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.932166 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.932255 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.932478 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.932567 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.932802 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.932899 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.933115 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.933203 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.933424 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.933511 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.933733 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.933828 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.934074 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.934160 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.934390 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.934612 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.934953 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.935063 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.935285 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.935385 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.935613 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.935708 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.935946 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936111 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936255 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936352 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936565 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936653 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936870 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.936966 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.937177 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.937265 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.937492 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.937580 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.937801 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.937889 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.938109 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.938197 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.938417 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.938503 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.938725 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.938876 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.939058 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.939145 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.939366 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.939454 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.939674 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.939762 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.940015 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.940114 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.940284 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.940382 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.940591 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.941192 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.941464 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.941564 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.941777 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.941957 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.942089 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.942291 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.942388 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.942609 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.942734 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.942955 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.943081 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.943300 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.943389 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.943622 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.943719 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.943942 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944030 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944260 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944349 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944578 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944674 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944891 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.944979 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.945202 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.945296 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.945509 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.945616 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.945820 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.945908 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.946136 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.946223 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.946441 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.946543 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.946797 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.947097 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.947194 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.947437 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.947759 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.947847 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.948075 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.948163 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.948386 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.948484 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.948710 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.948805 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949025 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949112 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949333 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949420 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949656 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949746 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.949967 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.950070 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.950295 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.950404 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.950608 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.950699 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.950964 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.951053 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.951288 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.951388 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.951595 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.951684 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.951902 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952001 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952206 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952305 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952515 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952650 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952821 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.952907 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.953127 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.953222 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.953431 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.953518 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.953733 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.953820 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954033 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954121 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954335 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954431 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954637 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954725 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.954965 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955056 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955269 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955357 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955573 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955662 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955875 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.955966 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.956179 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.956275 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957033 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957148 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957331 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957489 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957638 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957779 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.957925 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.958088 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.958234 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.958394 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.958535 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.958698 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.958864 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959035 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959168 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959342 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959516 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959649 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959773 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.959953 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.960105 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.960317 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.960438 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.960559 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.960751 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.960893 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.961075 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.961230 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.961383 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.961550 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.961704 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.961886 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962006 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962206 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962322 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962531 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962633 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962864 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.962975 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.963191 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.963291 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.963510 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.963613 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.963824 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.963912 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.964133 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.964221 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.964466 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.964555 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.964776 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.964864 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.965084 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.965171 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.965393 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.965488 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.965702 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.965791 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966013 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966108 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966315 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966405 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966638 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966725 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.966977 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.967082 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.967280 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.967368 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.967595 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.967681 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.967905 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968011 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968223 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968318 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968531 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968620 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968838 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.968933 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.969144 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.969231 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.969452 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.969541 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.969761 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.969857 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.970068 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.970155 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.970386 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.970489 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.970682 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.970809 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971018 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971107 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971329 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971424 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971641 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971731 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.971987 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.972157 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.972315 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.972484 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.972605 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.972795 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.972932 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.973124 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.973228 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.973472 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.973573 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.973784 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.973876 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.974127 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.974215 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.974456 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.974546 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.974791 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.974882 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.975111 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.975200 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.975421 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.975536 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.975665 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:26:36.975767 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.976058 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:26:36.976300 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:26:37.130682 n-d-858384-1 devstack@n-api.service[106433]: INFO dbcounter [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Registered counter for database nova_api Sep 19 14:26:37.134897 n-d-858384-1 devstack@n-api.service[106434]: INFO dbcounter [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Registered counter for database nova_api Sep 19 14:26:37.151404 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_db.sqlalchemy.engines [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.154774 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_db.sqlalchemy.engines [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.158131 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writer thread running {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.161675 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writer thread running {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.216132 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.context [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=106433) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:26:37.219030 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.context [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=106434) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:26:37.219965 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:26:37.220438 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:26:37.222053 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:26:37.222806 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:26:37.223205 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_concurrency.lockutils [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:26:37.223320 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:26:37.223678 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_concurrency.lockutils [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:26:37.225227 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:26:37.225329 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_concurrency.lockutils [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:26:37.225943 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_concurrency.lockutils [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:26:37.226391 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_concurrency.lockutils [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:26:37.227251 n-d-858384-1 devstack@n-api.service[106433]: INFO dbcounter [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Registered counter for database nova_cell0 Sep 19 14:26:37.229084 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_concurrency.lockutils [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:26:37.231110 n-d-858384-1 devstack@n-api.service[106434]: INFO dbcounter [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Registered counter for database nova_cell0 Sep 19 14:26:37.231340 n-d-858384-1 devstack@n-api.service[106433]: INFO dbcounter [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Registered counter for database nova_cell1 Sep 19 14:26:37.235349 n-d-858384-1 devstack@n-api.service[106434]: INFO dbcounter [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Registered counter for database nova_cell1 Sep 19 14:26:37.239719 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_db.sqlalchemy.engines [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.246772 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_db.sqlalchemy.engines [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.247058 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_db.sqlalchemy.engines [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.247167 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_db.sqlalchemy.engines [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.249619 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writer thread running {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.249961 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writer thread running {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.251488 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writer thread running {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.254931 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writer thread running {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.396291 n-d-858384-1 devstack@n-api.service[106433]: INFO dbcounter [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Registered counter for database nova_cell0 Sep 19 14:26:37.400930 n-d-858384-1 devstack@n-api.service[106434]: INFO dbcounter [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Registered counter for database nova_cell0 Sep 19 14:26:37.403555 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_db.sqlalchemy.engines [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.408509 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writer thread running {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.411507 n-d-858384-1 devstack@n-api.service[106434]: DEBUG oslo_db.sqlalchemy.engines [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:26:37.416356 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writer thread running {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:26:37.749147 n-d-858384-1 devstack@n-api.service[106434]: WARNING keystonemiddleware.auth_token [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:26:37.750283 n-d-858384-1 devstack@n-api.service[106433]: WARNING keystonemiddleware.auth_token [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:26:37.757229 n-d-858384-1 devstack@n-api.service[106434]: WARNING keystonemiddleware.auth_token [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:26:37.758248 n-d-858384-1 devstack@n-api.service[106433]: WARNING keystonemiddleware.auth_token [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:26:38.101542 n-d-858384-1 devstack@n-api.service[106434]: WARNING keystonemiddleware.auth_token [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:26:38.103796 n-d-858384-1 devstack@n-api.service[106433]: WARNING keystonemiddleware.auth_token [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:26:38.107501 n-d-858384-1 devstack@n-api.service[106434]: WARNING keystonemiddleware.auth_token [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:26:38.109768 n-d-858384-1 devstack@n-api.service[106433]: WARNING keystonemiddleware.auth_token [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:26:38.113827 n-d-858384-1 devstack@n-api.service[106434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573da0469c0 pid: 106434 (default app) Sep 19 14:26:38.115683 n-d-858384-1 devstack@n-api.service[106433]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573da0469c0 pid: 106433 (default app) Sep 19 14:26:38.115941 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:26:38.117139 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-efe8dd6b-75be-4556-a182-267a08c06369 None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Sep 19 14:26:38.117546 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Mon Sep 19 14:26:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:00.832998 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:00.834205 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Sep 19 14:28:00.834597 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:00.845846 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_api:SELECT=3 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:00.847921 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_cell0:SELECT=3 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:00.849939 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_cell1:SELECT=3 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:00.850801 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:01.738641 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-b379ee24-c578-4a11-8bc7-24b3605635e9 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:01.771624 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-b379ee24-c578-4a11-8bc7-24b3605635e9 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930934 Sep 19 14:28:01.772367 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 2/3] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:28:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:04.458117 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:04.459208 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-7da5b662-4bd6-413d-bc9e-fcba797682e7 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 19 14:28:04.459620 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 2/4] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:04.923217 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-7c3192f4-2e70-4a7c-886c-324aa757c9d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:04.970398 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-7c3192f4-2e70-4a7c-886c-324aa757c9d5 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504009 Sep 19 14:28:04.970998 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 3/5] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:28:04.985412 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_api:SELECT=3 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:04.986225 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_cell1:SELECT=3 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:04.988384 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_cell0:SELECT=3 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:04.989172 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:05.200836 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-63dc9d75-a026-437b-99b5-b7a2cbc47339 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:05.270713 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-63dc9d75-a026-437b-99b5-b7a2cbc47339 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290470 Sep 19 14:28:05.271629 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 3/6] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 14:28:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:07.974361 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-7c3192f4-2e70-4a7c-886c-324aa757c9d5 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:07.975487 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-7c3192f4-2e70-4a7c-886c-324aa757c9d5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Sep 19 14:28:07.976006 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 4/7] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:08.831782 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-d868acab-2708-411e-9377-321231380ca3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:08.888510 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-d868acab-2708-411e-9377-321231380ca3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.905818 Sep 19 14:28:08.889074 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 4/8] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:08.904103 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-73d92739-76b7-4c2c-8d10-1ebc4f1a75b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:08.961832 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-73d92739-76b7-4c2c-8d10-1ebc4f1a75b0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063269 Sep 19 14:28:08.964165 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 5/9] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 14:28:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:12.000062 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-d868acab-2708-411e-9377-321231380ca3 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:12.001244 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-d868acab-2708-411e-9377-321231380ca3 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Sep 19 14:28:12.007176 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:12.484457 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-3acdcc48-a39b-48e1-ba5e-e9628c69da57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "swap": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:12.505268 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-3acdcc48-a39b-48e1-ba5e-e9628c69da57 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495414 Sep 19 14:28:12.505815 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 6/11] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:12.519259 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-f82d24d7-5e1e-4dda-be64-de6665e3bb44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:12.549917 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-f82d24d7-5e1e-4dda-be64-de6665e3bb44 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035273 Sep 19 14:28:12.550560 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 6/12] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 14:28:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:28:15.197700 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-3acdcc48-a39b-48e1-ba5e-e9628c69da57 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:15.198715 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-3acdcc48-a39b-48e1-ba5e-e9628c69da57 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 19 14:28:15.199158 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 7/13] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:15.689046 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-12be2d5f-ea2b-40ba-bbf1-f7df6cc0cb54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "ram": 2048, "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:15.718242 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-12be2d5f-ea2b-40ba-bbf1-f7df6cc0cb54 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511926 Sep 19 14:28:15.719507 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 7/14] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:28:15.731483 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-ce2e6ea8-530c-48a5-b90d-d3f608ac6a9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:15.763361 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-ce2e6ea8-530c-48a5-b90d-d3f608ac6a9f admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035535 Sep 19 14:28:15.763985 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 8/15] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 14:28:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:28:18.552770 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-12be2d5f-ea2b-40ba-bbf1-f7df6cc0cb54 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:18.554426 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-12be2d5f-ea2b-40ba-bbf1-f7df6cc0cb54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Sep 19 14:28:18.565599 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 8/16] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:18.990892 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-d723cf38-32fa-4249-89eb-6eeee63e5735 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "vcpus": 4}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:19.014302 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-d723cf38-32fa-4249-89eb-6eeee63e5735 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452877 Sep 19 14:28:19.015811 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 9/17] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:19.028069 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-24b78614-eb32-4be6-9b21-059c61ff9753 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:19.054010 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-24b78614-eb32-4be6-9b21-059c61ff9753 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030150 Sep 19 14:28:19.054620 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 9/18] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 14:28:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:21.781199 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-d723cf38-32fa-4249-89eb-6eeee63e5735 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:21.782309 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-d723cf38-32fa-4249-89eb-6eeee63e5735 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Sep 19 14:28:21.782591 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 10/19] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:22.360881 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-c24d3a29-9ed4-424b-bf37-be05d1952545 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:22.395846 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-c24d3a29-9ed4-424b-bf37-be05d1952545 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.605307 Sep 19 14:28:22.396621 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 10/20] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:28:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:28:25.420886 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-d723cf38-32fa-4249-89eb-6eeee63e5735 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:25.422184 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-d723cf38-32fa-4249-89eb-6eeee63e5735 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Sep 19 14:28:25.422716 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 11/21] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:25.912745 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-3d7d8964-1144-4114-9d8b-5f66815a1257 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "ram": 512, "vcpus": 1, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:25.939147 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-3d7d8964-1144-4114-9d8b-5f66815a1257 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.508229 Sep 19 14:28:25.940446 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 11/22] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:28:25.957104 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-435ec2d4-4529-40a0-ac4c-34ecefc45b17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:25.998903 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-435ec2d4-4529-40a0-ac4c-34ecefc45b17 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044941 Sep 19 14:28:25.998903 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 12/23] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 14:28:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:29.004399 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-3d7d8964-1144-4114-9d8b-5f66815a1257 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:29.005323 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-3d7d8964-1144-4114-9d8b-5f66815a1257 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001897 Sep 19 14:28:29.005721 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 12/24] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:29.413938 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-5496953a-1c02-4a78-911c-faa556f77aa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:29.436774 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-5496953a-1c02-4a78-911c-faa556f77aa0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422409 Sep 19 14:28:29.436774 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 13/25] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:29.448179 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-4afa18e8-3c6f-4646-b198-03257c69f89e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:29.473958 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-4afa18e8-3c6f-4646-b198-03257c69f89e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029549 Sep 19 14:28:29.474648 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 13/26] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 14:28:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:32.109526 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-5496953a-1c02-4a78-911c-faa556f77aa0 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:32.110668 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-5496953a-1c02-4a78-911c-faa556f77aa0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Sep 19 14:28:32.111291 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 14/27] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:32.552461 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-4317c62e-4d2f-4048-b43b-d6957a7b38c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3", "rxtx_factor": 1.0}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:32.576708 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-4317c62e-4d2f-4048-b43b-d6957a7b38c3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.458566 Sep 19 14:28:32.577777 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 14/28] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:32.591124 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-0d26b036-3071-4cbc-a204-e8f67fe97765 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:32.596585 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:32.622497 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-0d26b036-3071-4cbc-a204-e8f67fe97765 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035406 Sep 19 14:28:32.623248 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 15/29] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 14:28:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:28:35.332317 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-4317c62e-4d2f-4048-b43b-d6957a7b38c3 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:35.334016 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-4317c62e-4d2f-4048-b43b-d6957a7b38c3 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Sep 19 14:28:35.339100 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 15/30] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:35.794185 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-3b2d2de3-164a-45da-974b-5c6800065472 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "name": "m1.large", "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:35.815743 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-3b2d2de3-164a-45da-974b-5c6800065472 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473901 Sep 19 14:28:35.817065 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 16/31] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:35.828869 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-52fd89f7-e6bf-448a-b5a8-4e42b8fd0ab8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:35.834017 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:28:35.856596 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-52fd89f7-e6bf-448a-b5a8-4e42b8fd0ab8 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031187 Sep 19 14:28:35.857490 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 16/32] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 14:28:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:28:38.551874 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-3b2d2de3-164a-45da-974b-5c6800065472 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:28:38.553449 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-3b2d2de3-164a-45da-974b-5c6800065472 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Sep 19 14:28:38.553846 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 17/33] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:28:39.058028 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-ea1e864f-c459-491e-8058-ca54e6e38750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "swap": 0, "id": "5", "ram": 16384}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:39.094619 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-ea1e864f-c459-491e-8058-ca54e6e38750 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.533826 Sep 19 14:28:39.098075 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 17/34] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 14:28:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:28:39.110175 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-283e5083-2f5e-4075-b04a-44063228cec3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:28:39.139382 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-283e5083-2f5e-4075-b04a-44063228cec3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032864 Sep 19 14:28:39.140182 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 18/35] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 14:28:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:29:00.284335 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-ea1e864f-c459-491e-8058-ca54e6e38750 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:00.285283 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-ea1e864f-c459-491e-8058-ca54e6e38750 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Sep 19 14:29:00.285689 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 18/36] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:00.297050 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:29:00.687569 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-8633fcb2-3cca-4b6d-b72a-39a725579a41 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:00.707329 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-8633fcb2-3cca-4b6d-b72a-39a725579a41 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415380 Sep 19 14:29:00.707867 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 19/37] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:29:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:29:02.086487 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-ea1e864f-c459-491e-8058-ca54e6e38750 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:02.087562 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-ea1e864f-c459-491e-8058-ca54e6e38750 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 19 14:29:02.087968 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 19/38] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:29:02.640525 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-0c6e6583-75c3-47d1-b71a-e3429233f08a admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:02.646567 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.wsgi [None req-0c6e6583-75c3-47d1-b71a-e3429233f08a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-0c6e6583-75c3-47d1-b71a-e3429233f08a admin admin] Request method failure captured: Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Accept: application/json Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Accept-Encoding: gzip, deflate Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Connection: keep-alive Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Content-Length: 0 Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Host: 10.222.0.81 Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Openstack-Api-Version: compute 2.92 Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: Openstack-System-Scope: None Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: User-Agent: python-novaclient Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Auth-Token: gAAAAABjKHytVA6n3JZJrceKZ_3buWFDKXtVXM07oSsnb-7G4xv_xYn_DVXkJwciwbpXvmK9W5hvkys5YB-HN2BruKZyt3f9BJR5lnk9j7Eoooss7D2Z4MktXx7L9K7MHCs9R7xAvVMde6yXqH6VHZRdmx1ZCVF2VyN1kHYyeyK0aOgNb3-weCY Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Domain-Id: None Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Domain-Name: None Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Identity-Status: Confirmed Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Is-Admin-Project: True Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Domain-Id: default Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Domain-Name: Default Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Name: admin Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Role: reader,member,admin Sep 19 14:29:02.650011 n-d-858384-1 devstack@n-api.service[106434]: X-Roles: reader,member,admin Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f5dc1a4044d7461e90e5314ff05b2d55"}]}] Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant: admin Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant-Name: admin Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-User: admin Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-User-Domain-Id: default Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-User-Domain-Name: Default Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-User-Id: d1c8de5c6a3c4bbeab8f28deacdc0b0b Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: X-User-Name: admin Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: method: > Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: exception: Flavor 42 could not be found. Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: action_args: {'id': '42'} Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:29:02.651744 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:02.653076 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.654548 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-0c6e6583-75c3-47d1-b71a-e3429233f08a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:29:02.655919 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-0c6e6583-75c3-47d1-b71a-e3429233f08a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.408949 Sep 19 14:29:02.655919 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 20/39] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 14:29:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:29:02.662151 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-f8e20f49-b9a4-4acb-989b-687e9c624cc5 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:02.666315 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:29:02.685124 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-f8e20f49-b9a4-4acb-989b-687e9c624cc5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027086 Sep 19 14:29:02.685680 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 20/40] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 14:29:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:29:02.715424 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-7f65b882-d49e-466b-805b-86e633e96ecc admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:02.741276 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-7f65b882-d49e-466b-805b-86e633e96ecc admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030906 Sep 19 14:29:02.741937 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 21/41] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 14:29:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:29:02.752268 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-56b857de-9655-4b8c-aa67-ab424a924d7f admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:02.758032 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.wsgi [None req-56b857de-9655-4b8c-aa67-ab424a924d7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-56b857de-9655-4b8c-aa67-ab424a924d7f admin admin] Request method failure captured: Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Accept: application/json Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Accept-Encoding: gzip, deflate Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Connection: keep-alive Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Content-Length: 0 Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Host: 10.222.0.81 Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Openstack-Api-Version: compute 2.92 Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: Openstack-System-Scope: None Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: User-Agent: python-novaclient Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Auth-Token: gAAAAABjKHytVA6n3JZJrceKZ_3buWFDKXtVXM07oSsnb-7G4xv_xYn_DVXkJwciwbpXvmK9W5hvkys5YB-HN2BruKZyt3f9BJR5lnk9j7Eoooss7D2Z4MktXx7L9K7MHCs9R7xAvVMde6yXqH6VHZRdmx1ZCVF2VyN1kHYyeyK0aOgNb3-weCY Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Domain-Id: None Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Domain-Name: None Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Identity-Status: Confirmed Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Is-Admin-Project: True Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Domain-Id: default Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Domain-Name: Default Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Name: admin Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Role: reader,member,admin Sep 19 14:29:02.761308 n-d-858384-1 devstack@n-api.service[106433]: X-Roles: reader,member,admin Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f5dc1a4044d7461e90e5314ff05b2d55"}]}] Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant: admin Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant-Name: admin Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-User: admin Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-User-Domain-Id: default Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-User-Domain-Name: Default Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-User-Id: d1c8de5c6a3c4bbeab8f28deacdc0b0b Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: X-User-Name: admin Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: method: > Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: exception: Flavor 42 could not be found. Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: action_args: {'id': '42'} Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:29:02.762891 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:02.763942 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:02.765257 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-56b857de-9655-4b8c-aa67-ab424a924d7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:29:02.766301 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-56b857de-9655-4b8c-aa67-ab424a924d7f admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014006 Sep 19 14:29:02.766301 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 21/42] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 14:29:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 14:29:04.047005 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-7f65b882-d49e-466b-805b-86e633e96ecc admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:04.048024 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-7f65b882-d49e-466b-805b-86e633e96ecc admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 19 14:29:04.048422 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 22/43] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:04.570800 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-82130ab8-8ddf-48e9-b57c-533479d0a3ed admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:04.575873 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.wsgi [None req-82130ab8-8ddf-48e9-b57c-533479d0a3ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-82130ab8-8ddf-48e9-b57c-533479d0a3ed admin admin] Request method failure captured: Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Accept: application/json Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Accept-Encoding: gzip, deflate Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Connection: keep-alive Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Content-Length: 0 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Host: 10.222.0.81 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Openstack-Api-Version: compute 2.92 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: Openstack-System-Scope: None Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: User-Agent: python-novaclient Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Auth-Token: gAAAAABjKHyvW8PK3eXYMz63Ch5nqh27ZcN39a_4ui4eWIbgMZajzFjYi2xDMH6YFwkbdDNc7f-kWnCYAV-mR9xtUA6gtjbUfNWx01SECd-GWs9QoamTAyisWg6tU2zvKIfjV3e4vD-u_IDTxE3vRbnJHC_llTNTMqN0KL9Fxc1WJoIKJmuKXp4 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Domain-Id: None Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Domain-Name: None Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Identity-Status: Confirmed Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Is-Admin-Project: True Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Domain-Id: default Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Domain-Name: Default Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Name: admin Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Role: reader,member,admin Sep 19 14:29:04.577385 n-d-858384-1 devstack@n-api.service[106433]: X-Roles: reader,member,admin Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f5dc1a4044d7461e90e5314ff05b2d55"}]}] Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant: admin Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant-Name: admin Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-User: admin Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-User-Domain-Id: default Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-User-Domain-Name: Default Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-User-Id: d1c8de5c6a3c4bbeab8f28deacdc0b0b Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: X-User-Name: admin Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: method: > Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: exception: Flavor 84 could not be found. Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: action_args: {'id': '84'} Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:29:04.579064 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:04.579912 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.581104 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-82130ab8-8ddf-48e9-b57c-533479d0a3ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:29:04.583020 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-82130ab8-8ddf-48e9-b57c-533479d0a3ed admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394315 Sep 19 14:29:04.583020 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 22/44] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 14:29:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:29:04.589988 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-81d6bb1b-3dd2-4c77-9cbe-415d2b810570 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:04.605959 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-81d6bb1b-3dd2-4c77-9cbe-415d2b810570 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019823 Sep 19 14:29:04.606538 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 23/45] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 14:29:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:29:04.616480 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-23fd6c6a-7da5-4041-b1f3-f1c63dd47572 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:04.633510 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-23fd6c6a-7da5-4041-b1f3-f1c63dd47572 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020740 Sep 19 14:29:04.634048 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 23/46] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 14:29:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:29:04.644096 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-42d1d468-b25d-4b1f-a9a2-e6b8ddab533a admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:04.649330 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.wsgi [None req-42d1d468-b25d-4b1f-a9a2-e6b8ddab533a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-42d1d468-b25d-4b1f-a9a2-e6b8ddab533a admin admin] Request method failure captured: Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Accept: application/json Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Accept-Encoding: gzip, deflate Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Connection: keep-alive Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Content-Length: 0 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Host: 10.222.0.81 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Openstack-Api-Version: compute 2.92 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: Openstack-System-Scope: None Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: User-Agent: python-novaclient Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Auth-Token: gAAAAABjKHyvW8PK3eXYMz63Ch5nqh27ZcN39a_4ui4eWIbgMZajzFjYi2xDMH6YFwkbdDNc7f-kWnCYAV-mR9xtUA6gtjbUfNWx01SECd-GWs9QoamTAyisWg6tU2zvKIfjV3e4vD-u_IDTxE3vRbnJHC_llTNTMqN0KL9Fxc1WJoIKJmuKXp4 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Domain-Id: None Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Domain-Name: None Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Identity-Status: Confirmed Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Is-Admin-Project: True Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Domain-Id: default Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Domain-Name: Default Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Name: admin Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Role: reader,member,admin Sep 19 14:29:04.650903 n-d-858384-1 devstack@n-api.service[106434]: X-Roles: reader,member,admin Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f5dc1a4044d7461e90e5314ff05b2d55"}]}] Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant: admin Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant-Name: admin Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-User: admin Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-User-Domain-Id: default Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-User-Domain-Name: Default Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-User-Id: d1c8de5c6a3c4bbeab8f28deacdc0b0b Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: X-User-Name: admin Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: method: > Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: exception: Flavor 84 could not be found. Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: action_args: {'id': '84'} Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:29:04.653062 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:04.654237 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:04.655845 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-42d1d468-b25d-4b1f-a9a2-e6b8ddab533a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:29:04.657401 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-42d1d468-b25d-4b1f-a9a2-e6b8ddab533a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012411 Sep 19 14:29:04.657401 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 24/47] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 14:29:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:29:05.886546 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-23fd6c6a-7da5-4041-b1f3-f1c63dd47572 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:05.887687 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-23fd6c6a-7da5-4041-b1f3-f1c63dd47572 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Sep 19 14:29:05.888117 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 24/48] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:06.461300 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-344f05e8-cdfa-40f7-b7f5-e3f1998d5627 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:06.467548 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.wsgi [None req-344f05e8-cdfa-40f7-b7f5-e3f1998d5627 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-344f05e8-cdfa-40f7-b7f5-e3f1998d5627 admin admin] Request method failure captured: Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Accept: application/json Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Accept-Encoding: gzip, deflate Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Connection: keep-alive Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Content-Length: 0 Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Host: 10.222.0.81 Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Openstack-Api-Version: compute 2.92 Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: Openstack-System-Scope: None Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: User-Agent: python-novaclient Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Auth-Token: gAAAAABjKHyx2IeLf-_GBd9OPy1jVN7drheIokwh0Rkc2y762E5ZyrSpVaVNIO0y7XvJVl2Aa_PbGel5vUkK69vE4loytyv7A4lcL_0hyGf0LQyKOBrVosmxDxJgg2Ai7dCJp8h34BLt8sjZeC-mTr7soqag6A3MJigVsKy8eh3GICilHWizgmA Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Domain-Id: None Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Domain-Name: None Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Identity-Status: Confirmed Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Is-Admin-Project: True Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Domain-Id: default Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Domain-Name: Default Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Project-Name: admin Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Role: reader,member,admin Sep 19 14:29:06.469207 n-d-858384-1 devstack@n-api.service[106434]: X-Roles: reader,member,admin Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f5dc1a4044d7461e90e5314ff05b2d55"}]}] Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant: admin Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-Tenant-Name: admin Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-User: admin Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-User-Domain-Id: default Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-User-Domain-Name: Default Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-User-Id: d1c8de5c6a3c4bbeab8f28deacdc0b0b Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: X-User-Name: admin Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: method: > Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: exception: Flavor 451 could not be found. Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: action_args: {'id': '451'} Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:29:06.470876 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:06.472794 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.474153 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-344f05e8-cdfa-40f7-b7f5-e3f1998d5627 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:29:06.475523 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-344f05e8-cdfa-40f7-b7f5-e3f1998d5627 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.429965 Sep 19 14:29:06.475523 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 25/49] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:29:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:29:06.481462 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-bda683e7-009d-41f0-b5d2-601e8ef047c5 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:06.496369 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-bda683e7-009d-41f0-b5d2-601e8ef047c5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018565 Sep 19 14:29:06.496925 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 25/50] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 14:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:29:06.506803 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:06.523845 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021124 Sep 19 14:29:06.524410 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 26/51] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 14:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:29:06.535973 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-2569f5dc-56e1-4562-a0cf-5f801ad81aaa admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:06.541160 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.wsgi [None req-2569f5dc-56e1-4562-a0cf-5f801ad81aaa admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-2569f5dc-56e1-4562-a0cf-5f801ad81aaa admin admin] Request method failure captured: Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Accept: application/json Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Accept-Encoding: gzip, deflate Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Connection: keep-alive Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Content-Length: 0 Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Host: 10.222.0.81 Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Openstack-Api-Version: compute 2.92 Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: Openstack-System-Scope: None Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: User-Agent: python-novaclient Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Auth-Token: gAAAAABjKHyx2IeLf-_GBd9OPy1jVN7drheIokwh0Rkc2y762E5ZyrSpVaVNIO0y7XvJVl2Aa_PbGel5vUkK69vE4loytyv7A4lcL_0hyGf0LQyKOBrVosmxDxJgg2Ai7dCJp8h34BLt8sjZeC-mTr7soqag6A3MJigVsKy8eh3GICilHWizgmA Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Domain-Id: None Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Domain-Name: None Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Identity-Status: Confirmed Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Is-Admin-Project: True Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Domain-Id: default Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Domain-Name: Default Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Project-Name: admin Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Role: reader,member,admin Sep 19 14:29:06.542758 n-d-858384-1 devstack@n-api.service[106433]: X-Roles: reader,member,admin Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f5dc1a4044d7461e90e5314ff05b2d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f5dc1a4044d7461e90e5314ff05b2d55"}]}] Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant: admin Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant-Id: f5dc1a4044d7461e90e5314ff05b2d55 Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-Tenant-Name: admin Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-User: admin Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-User-Domain-Id: default Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-User-Domain-Name: Default Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-User-Id: d1c8de5c6a3c4bbeab8f28deacdc0b0b Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: X-User-Name: admin Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: method: > Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: exception: Flavor 451 could not be found. Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: action_args: {'id': '451'} Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:29:06.544485 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:06.546501 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: ERROR nova.api.openstack.wsgi Sep 19 14:29:06.547966 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-2569f5dc-56e1-4562-a0cf-5f801ad81aaa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:29:06.549291 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-2569f5dc-56e1-4562-a0cf-5f801ad81aaa admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013431 Sep 19 14:29:06.549291 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 26/52] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:29:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:29:07.829557 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:07.830568 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 19 14:29:07.831000 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 27/53] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:08.366006 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-8e4f2e8a-ce33-4fee-b62d-a7ac6838fdd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:29:08.385699 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-8e4f2e8a-ce33-4fee-b62d-a7ac6838fdd2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.417197 Sep 19 14:29:08.386240 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 27/54] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 14:29:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:29:09.649124 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:09.650171 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 19 14:29:09.650600 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 28/55] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:10.216852 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-396bede3-e39a-4fdc-b5ee-8cfc373d127f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:29:10.236546 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-396bede3-e39a-4fdc-b5ee-8cfc373d127f admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.433353 Sep 19 14:29:10.237099 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 28/56] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 14:29:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:29:11.505559 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:11.506566 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 19 14:29:11.507011 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 29/57] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:29:12.046340 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-5646f297-b6b1-4fe0-94d3-9056c270a1fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:29:12.065268 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-5646f297-b6b1-4fe0-94d3-9056c270a1fd admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.422197 Sep 19 14:29:12.065809 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 29/58] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 14:29:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:29:13.320068 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:13.321135 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 19 14:29:13.321463 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 30/59] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:13.867098 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-f553c722-bd67-4e57-8f96-cbbfb12457a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:29:13.886022 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-f553c722-bd67-4e57-8f96-cbbfb12457a2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.427183 Sep 19 14:29:13.886585 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 30/60] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 14:29:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:29:15.140068 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:15.141071 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 19 14:29:15.141469 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 31/61] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:29:15.690565 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-584c562f-42eb-4fc9-9b89-2f31381da323 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:29:15.713259 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-584c562f-42eb-4fc9-9b89-2f31381da323 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.432300 Sep 19 14:29:15.713833 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 31/62] 10.222.0.81 () {60 vars in 1202 bytes} [Mon Sep 19 14:29:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:30:14.545571 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:30:14.546581 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-a8352eb3-7a7d-487e-bf51-3aabbe71438e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 19 14:30:14.547026 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 32/63] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 14:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:30:14.558358 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:30:14.953186 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-df64b5b0-7660-4969-bbbf-c506c41dbcdc admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:30:14.973917 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-df64b5b0-7660-4969-bbbf-c506c41dbcdc admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420512 Sep 19 14:30:14.975290 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 32/64] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:30:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:30:14.996424 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_api:SELECT=14 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:30:15.000195 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-8335fb5c-69e8-4003-b17e-5f4458853874 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:30:15.007705 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-8335fb5c-69e8-4003-b17e-5f4458853874 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012732 Sep 19 14:30:15.008241 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 33/65] 10.222.0.81 () {60 vars in 1283 bytes} [Mon Sep 19 14:30:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:30:15.020102 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-98488d5f-2ce8-4960-ae2f-d6c78aa396ef admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:30:15.029057 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-98488d5f-2ce8-4960-ae2f-d6c78aa396ef admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012488 Sep 19 14:30:15.030025 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 33/66] 10.222.0.81 () {60 vars in 1286 bytes} [Mon Sep 19 14:30:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:30:15.042909 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-f3c25a94-8591-4c6d-b60e-06b6f3b69cb7 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:30:15.050264 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-f3c25a94-8591-4c6d-b60e-06b6f3b69cb7 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 Sep 19 14:30:15.050822 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 34/67] 10.222.0.81 () {60 vars in 1286 bytes} [Mon Sep 19 14:30:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:30:15.062698 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-73595794-b130-4465-8528-0a8069330119 admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:30:15.072343 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-73595794-b130-4465-8528-0a8069330119 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013182 Sep 19 14:30:15.072875 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 34/68] 10.222.0.81 () {60 vars in 1283 bytes} [Mon Sep 19 14:30:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:35:32.433140 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-f3c25a94-8591-4c6d-b60e-06b6f3b69cb7 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:35:32.434196 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-f3c25a94-8591-4c6d-b60e-06b6f3b69cb7 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 19 14:35:32.435376 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 35/69] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:35:32.577040 n-d-858384-1 devstack@n-api.service[106433]: DEBUG dbcounter [-] [106433] Writing DB stats nova_api:SELECT=6 {{(pid=106433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:35:32.719185 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:35:32.723886 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:35:32.724356 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:35:32.724778 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:35:32.725478 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:35:32.725918 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:35:32.726331 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:35:32.764556 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-02f83c02-cf53-44c9-9c25-1921872eb00f admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189770 Sep 19 14:35:32.765112 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 35/70] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:35:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:35:33.857386 n-d-858384-1 devstack@n-api.service[106434]: DEBUG nova.api.openstack.wsgi [None req-f3c25a94-8591-4c6d-b60e-06b6f3b69cb7 admin admin] Calling method '>' {{(pid=106434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:35:33.858384 n-d-858384-1 devstack@n-api.service[106434]: INFO nova.api.openstack.requestlog [None req-f3c25a94-8591-4c6d-b60e-06b6f3b69cb7 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Sep 19 14:35:33.858812 n-d-858384-1 devstack@n-api.service[106434]: [pid: 106434|app: 0|req: 36/71] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 14:35:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:35:34.050423 n-d-858384-1 devstack@n-api.service[106433]: DEBUG nova.api.openstack.wsgi [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Calling method '>' {{(pid=106433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:35:34.053958 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:35:34.054438 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:35:34.054924 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:35:34.055663 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:35:34.056111 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:35:34.056526 n-d-858384-1 devstack@n-api.service[106433]: DEBUG oslo_concurrency.lockutils [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:35:34.079343 n-d-858384-1 devstack@n-api.service[106433]: INFO nova.api.openstack.requestlog [None req-7951a247-0073-4db1-9df9-15a6414ff12e admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.081632 Sep 19 14:35:34.079827 n-d-858384-1 devstack@n-api.service[106433]: [pid: 106433|app: 0|req: 36/72] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:35:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:36:21.844574 n-d-858384-1 devstack@n-api.service[106432]: Mon Sep 19 14:36:21 2022 - graceful shutdown triggered... Sep 19 14:36:21.844705 n-d-858384-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 14:36:21.845903 n-d-858384-1 devstack@n-api.service[106433]: Gracefully killing worker 1 (pid: 106433)... Sep 19 14:36:21.846668 n-d-858384-1 devstack@n-api.service[106434]: Gracefully killing worker 2 (pid: 106434)... Sep 19 14:36:21.975326 n-d-858384-1 devstack@n-api.service[106434]: DEBUG dbcounter [-] [106434] Writing DB stats nova_api:SELECT=4 {{(pid=106434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:36:22.846637 n-d-858384-1 devstack@n-api.service[106432]: worker 1 buried after 1 seconds Sep 19 14:36:22.846637 n-d-858384-1 devstack@n-api.service[106432]: worker 2 buried after 1 seconds Sep 19 14:36:22.846637 n-d-858384-1 devstack@n-api.service[106432]: goodbye to uWSGI. Sep 19 14:36:22.848293 n-d-858384-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 19 14:36:22.848878 n-d-858384-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 14:36:22.851612 n-d-858384-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 14:36:22.870786 n-d-858384-1 devstack@n-api.service[128722]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:36:22 2022] *** Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: nodename: n-d-858384-1 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: machine: x86_64 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: clock source: unix Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: pcre jit disabled Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: detected number of CPU cores: 4 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: current working directory: / Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: your processes number limit is 47680 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: your memory page size is 4096 bytes Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: detected max file descriptor number: 2048 Sep 19 14:36:22.892720 n-d-858384-1 devstack@n-api.service[128722]: lock engine: pthread robust mutexes Sep 19 14:36:22.893899 n-d-858384-1 devstack@n-api.service[128722]: thunder lock: enabled Sep 19 14:36:22.893899 n-d-858384-1 devstack@n-api.service[128722]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 14:36:22.893899 n-d-858384-1 devstack@n-api.service[128722]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:36:22.932758 n-d-858384-1 devstack@n-api.service[128722]: Python main interpreter initialized at 0x55ee6e42b9c0 Sep 19 14:36:22.932758 n-d-858384-1 devstack@n-api.service[128722]: python threads support enabled Sep 19 14:36:22.932758 n-d-858384-1 devstack@n-api.service[128722]: your server socket listen backlog is limited to 100 connections Sep 19 14:36:22.932758 n-d-858384-1 devstack@n-api.service[128722]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:36:22.933172 n-d-858384-1 devstack@n-api.service[128722]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:36:22.933172 n-d-858384-1 devstack@n-api.service[128722]: *** Operational MODE: preforking *** Sep 19 14:36:22.933432 n-d-858384-1 devstack@n-api.service[128722]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:36:22.933432 n-d-858384-1 devstack@n-api.service[128722]: spawned uWSGI master process (pid: 128722) Sep 19 14:36:22.933637 n-d-858384-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 19 14:36:22.936513 n-d-858384-1 devstack@n-api.service[128722]: spawned uWSGI worker 1 (pid: 128730, cores: 1) Sep 19 14:36:22.936513 n-d-858384-1 devstack@n-api.service[128722]: spawned uWSGI worker 2 (pid: 128731, cores: 1) Sep 19 14:36:22.936513 n-d-858384-1 devstack@n-api.service[128722]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:36:23.598895 n-d-858384-1 devstack@n-api.service[128731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:36:23.601495 n-d-858384-1 devstack@n-api.service[128730]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:36:24.795087 n-d-858384-1 devstack@n-api.service[128730]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:36:24.795087 n-d-858384-1 devstack@n-api.service[128730]: from cryptography.utils import int_from_bytes Sep 19 14:36:24.795838 n-d-858384-1 devstack@n-api.service[128730]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:36:24.795838 n-d-858384-1 devstack@n-api.service[128730]: from cryptography.utils import int_from_bytes Sep 19 14:36:24.800193 n-d-858384-1 devstack@n-api.service[128731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:36:24.800193 n-d-858384-1 devstack@n-api.service[128731]: from cryptography.utils import int_from_bytes Sep 19 14:36:24.800667 n-d-858384-1 devstack@n-api.service[128731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:36:24.800667 n-d-858384-1 devstack@n-api.service[128731]: from cryptography.utils import int_from_bytes Sep 19 14:36:27.277340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:36:27.278634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:36:27.279026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:36:27.279401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:36:27.279662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:36:27.280057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.280388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.280713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.281035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.281372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.281686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.282015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.282339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.282671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.282961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.283281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.283766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.284092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.284403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.284719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.285040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.285347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.285677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.285988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.286493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.286976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.287291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.287754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.287936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.288253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.288570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.288908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.289210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.289800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.290115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.290517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.290878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.291255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.291576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.291996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.292309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.292624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.292949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.293287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.294204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.294541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.294892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.295248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.295541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.295719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:36:27.296156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.296255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:36:27.296360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.296458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.296555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:36:27.296756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.296860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:36:27.297065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.297173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:36:27.297374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.297478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.297625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.297806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.297922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.298132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.298300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.298443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.298576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.298796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.298976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.299122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.299227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.299391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.299536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.299714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.299824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.300942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.301073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.301251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.301400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.301561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.301711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.301871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.302028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.302182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.302353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.302493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.302661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.302882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.303017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.303149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.303327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.303476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.303787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.303889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.304110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.304213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.304432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.304547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.304748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.304866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.305052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.305154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.305393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.305518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.305706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.305826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.306983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.307092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.307293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.307395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.307603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.307706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.307924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.308972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.309698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.309915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.310052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.310366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.310502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.310813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.310937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.311961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.312984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.313197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.313300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.313505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.313610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.313812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.313915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.314119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.314223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.314382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.314476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.314695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.314875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.315931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.316964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.317151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.317268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.317463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.317567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.317777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.317897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.318088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.318201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.318399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.318509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.318710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.318861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.319981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.320127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.320311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.320474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.320575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.320673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.320893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.321909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.322111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.322217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.322416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.322522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.322725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.322865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.323061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.323168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.323364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.323473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.323686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.323791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.324003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.324108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.324313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.324416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.324653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.325256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.325500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.325791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.325895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.326152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.326254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.326422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.326514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.326731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.326875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.327066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.327175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.327392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.327494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.327704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.327799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.328016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.328111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.328329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.328431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.328634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.328736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.328945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.329044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.329259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.329384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.329566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.329671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.329875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.329970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.330185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.330292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.330505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.330696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.330894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.331001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.331199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.331305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.331506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.331627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.331813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.331908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.332125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.332228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.332445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.332550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.332755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.332859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.333062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.333170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.333371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.333475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.333681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.333788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.334002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.334107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.334309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.334420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.334618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.334728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.334969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.335062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.335262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.335390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.335570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.335673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.335889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.335984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.336197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.336308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.336504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.336599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.336829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.337002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.337236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.337386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.337539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.337717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.337855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.338004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.338158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.338310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.338482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.338631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.338823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.338932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.339029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.339131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.339225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.339330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.339510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.339636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.339815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.339954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.340124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.340354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.340709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.340821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.341025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.341149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.341350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.341464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.341661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.341811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.342001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.342169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.342327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.342481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.342630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.342845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:36:27.342991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.343187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.343329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.343510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.343652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.343794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.343946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.344115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.344270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.344446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.344590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.344740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.344903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.345078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.345223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.345373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.345546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.345694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.345879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.346024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.346223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.346365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.346554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.346706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.346909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.347965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.348184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.348279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.348493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.348603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.348818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.348921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.349127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.349220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.349437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.349548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.349755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.349852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.350068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.350172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.350382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.350478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.350775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.350894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.351986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.352094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.352322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.352425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.352654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.352755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.352961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.353055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.353285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.353388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.353611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.353713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.353931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.354999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.355192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.355321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.355497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.355660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.355813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.356530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.356745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.356964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.357329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.357506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.357662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.357824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.357978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.358921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.359988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.360085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.360280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.360407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.360603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.360705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.360926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.361999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.362191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.362296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.362501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.362595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.362838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.362950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.363155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.363258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.363475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.363581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.363789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.363897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.364113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.364218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.364428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.364529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.364748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.364919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.365060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.365153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.365380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.365481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.365687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.365787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.366005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.366113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.366342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.366443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.366668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.366788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.367967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.368068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.368276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.368369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.368588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.368682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.368898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.369992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.370156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.370288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.370466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.370572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.370813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.370926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.371130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.371255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.371446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.371601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.372347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.372591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.372838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.373927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.374074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.374212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.374358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.374507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.374686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.374893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.375925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.376945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.377958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.378976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.379112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.379213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.379425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.379530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.379753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.379878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.380077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.380183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.380386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.380506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.380695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.380810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.381947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.382041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.382253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.382347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.382598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.382704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.382938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.383989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.384199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.384293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.384514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.384615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.384830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.384999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.385145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.385286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.385436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.385581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.385753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.385888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.386065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.386174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.386377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.386532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.386673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.386844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.387016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.387158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.387382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.387538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.387695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.387855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.388956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.389062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.389268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.389361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.389591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.389684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.389919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.390174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.390287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.390510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.390616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.390863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.390978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.391189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.391308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.391536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.391689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.391844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.391995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.392173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.392325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.392497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.392725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.392882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.393987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.394129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.394270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.394427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.394574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.394715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.394899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.395857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.396962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.397135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.397282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.397456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.397600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.397790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.397931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.398125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.398268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.398420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.398559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.398722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.398847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.399993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.400093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.400311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.400414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.400670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.400770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.400973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.401067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.401288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.401403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.401595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.401727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.401921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.402024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.402228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.402324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.402535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.402626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.402905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.403974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.404202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.404306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.404525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.404619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.404835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.404929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.405149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.405249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.405474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.405574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.405767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.405862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.406136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.406249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.406391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.406483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.406701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.406837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.407973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.408242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.408327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.408575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.408657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.408882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.408966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.409205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.409288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.409514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.409686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.409821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.409924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.410129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.410234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.410441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.410592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.410778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.410868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.411083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.411181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.411411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.411497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.411726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.411830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.412956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.413101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.413260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.413422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.413575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.413716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.413870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.414019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.414169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.414311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.414459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.417955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.418050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.418184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.418273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.418359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.419938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.420951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.421942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.422161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.422253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.422479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.422587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.422873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.422984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.423155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.423278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.423445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.423549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.423767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.423864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.424083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.424182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.424392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.424559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.424694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.424787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.425944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.426036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.426257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.426363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.426576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.426670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.426908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.427943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.428154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.428246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.428464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.428566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.428776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.428867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.429086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.429187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.429400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.429502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.429711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.429804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.430997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.431091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.431306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.431405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.431623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.431786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.431960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.432068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.432235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.432329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.432549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.432658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.432931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.433060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.433672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.433802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.433888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.434015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.434015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.434874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.434963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.435892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.436941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.437073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.437365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.437495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.437681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.437811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.437997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.438173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.438303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.438508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.438630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.438864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.439000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.439180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.439311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.439499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.439631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.440290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.440553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.440650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.440738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.440835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.440922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.441821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.442050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.442154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.442368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.442463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.442679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.442809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.443102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.443225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.443416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.443511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.443735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.443899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.444058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.444168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.444377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.444475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.444704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.444802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.445967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.446077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.446289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.446382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.446599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.446691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.446948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.447059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.447260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.447352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.447629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.447728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.447905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.448961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.449179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.449272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.449502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.449597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.450380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.450566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.450828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.450987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.451995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.452117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.452309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.452423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.452649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.452746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.452934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.453058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.453255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.453429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.453567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.453681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.453880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.454047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.454196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.454347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.454498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.454717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.454888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.455930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.456070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.456288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.456392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.456617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.456716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.456940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.457962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.458175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.458283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.458511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.458604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.458856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.458954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.459174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.459285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.459493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.459587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.459830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.459932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.460152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.460255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.460487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.460580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.460818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.460936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.461142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.461240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.461454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.461552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.461777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.461949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.462104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.462273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.462412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.462595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.462719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.462958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.463095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.463335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.463482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.463626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.463731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.463954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.464955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.465166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.465341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.466094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.466209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.466418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.466597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.466740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.466860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.467079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.467185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.467388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.467484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.467703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.467798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.468011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.468113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.468359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.468536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.468668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.468877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.469984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.470211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.470306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.470532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.470635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.470885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.470993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.471200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.471302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.471518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.471618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.471835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.471935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.472150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.472244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.472474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.472646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.472794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.472945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.473091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.473233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.473409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.473644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.473787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.473975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.474116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.474294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.474450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.474614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.474796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.474989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.475142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.475285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.475433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.475573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.475721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.475872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.476996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.477092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.477214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.477384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.477538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.477720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.477865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.478060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.478211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.478372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.478524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.478673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.478837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.479037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.479182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.479358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.479504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.479720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.479869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.480985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.481090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.481365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.481513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.503764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.504188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.505461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.505554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.505614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.505933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.506019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.506201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.506358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.506448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.506691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.506936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.507703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.507824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.507966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.508778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.510381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.510531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.510677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.510835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.511903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.512040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.512733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.512916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.513078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.513205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.513679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.513933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.514256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.514427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.514582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.514723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.515638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.515786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.516851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.517921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.518882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.519813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.520823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.521001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.521130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.521436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.521581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.521796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.521959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.522095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.522095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.522350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.522444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.522590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.522691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.523962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.524019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.524671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.524828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.524910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.525858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.526141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.526229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.526350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.526439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.526502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.526787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.527003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.527356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.527517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.527653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.527890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.528508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.528585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.528855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.528963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.529925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.530944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.531968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.532976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.533930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.534938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.535959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.536953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.537976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.538939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.539990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.540945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.541987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.542943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.543944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.544972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.545950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.546944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.547966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.548924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.549977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.550066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.550325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.550406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.550659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.550740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.550997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.551091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.551310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.551389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.551622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.551702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.551866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:36:27.551946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.552244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.552561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.552875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.553187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.553499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.553845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.554193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.554520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.554893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.555225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.555557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.555879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.556213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.556549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.556872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.557195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.557542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.557865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.558189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.558515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.558866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.559229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.559555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.559902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.560241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.560560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.560896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.561224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.561554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.561880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.562203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.562544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.562901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.563229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.563549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.563872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.564194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.564522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.564840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.565162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.565493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.565816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.566152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.566489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.566847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.567186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.567525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.567887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.568210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.568565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.568906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.569230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.569551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.569872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:36:27.570124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:36:27.613635 n-d-858384-1 devstack@n-api.service[128731]: INFO dbcounter [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Registered counter for database nova_api Sep 19 14:36:27.633191 n-d-858384-1 devstack@n-api.service[128730]: INFO dbcounter [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Registered counter for database nova_api Sep 19 14:36:27.634426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.641699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writer thread running {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.655227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_db.sqlalchemy.engines [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.661840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writer thread running {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.698509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.context [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=128731) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:36:27.703168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:36:27.703648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:36:27.705253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:36:27.706187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:36:27.706702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:36:27.708809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:36:27.710913 n-d-858384-1 devstack@n-api.service[128731]: INFO dbcounter [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Registered counter for database nova_cell0 Sep 19 14:36:27.716094 n-d-858384-1 devstack@n-api.service[128731]: INFO dbcounter [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Registered counter for database nova_cell1 Sep 19 14:36:27.721153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.context [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=128730) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:36:27.724192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.725091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.725343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:36:27.725836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:36:27.727511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:36:27.728284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:36:27.728729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:36:27.730351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writer thread running {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.730764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:36:27.733446 n-d-858384-1 devstack@n-api.service[128730]: INFO dbcounter [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Registered counter for database nova_cell0 Sep 19 14:36:27.737723 n-d-858384-1 devstack@n-api.service[128730]: INFO dbcounter [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Registered counter for database nova_cell1 Sep 19 14:36:27.746304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_db.sqlalchemy.engines [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.747681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_db.sqlalchemy.engines [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.753030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writer thread running {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.756135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writer thread running {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.873416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writer thread running {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.883737 n-d-858384-1 devstack@n-api.service[128731]: INFO dbcounter [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Registered counter for database nova_cell0 Sep 19 14:36:27.891360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_db.sqlalchemy.engines [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.896868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writer thread running {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:27.908217 n-d-858384-1 devstack@n-api.service[128730]: INFO dbcounter [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Registered counter for database nova_cell0 Sep 19 14:36:27.917206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_db.sqlalchemy.engines [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:36:27.922396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writer thread running {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:36:28.244010 n-d-858384-1 devstack@n-api.service[128731]: WARNING keystonemiddleware.auth_token [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:36:28.249671 n-d-858384-1 devstack@n-api.service[128730]: WARNING keystonemiddleware.auth_token [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:36:28.251700 n-d-858384-1 devstack@n-api.service[128731]: WARNING keystonemiddleware.auth_token [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:36:28.257051 n-d-858384-1 devstack@n-api.service[128730]: WARNING keystonemiddleware.auth_token [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:36:28.613367 n-d-858384-1 devstack@n-api.service[128730]: WARNING keystonemiddleware.auth_token [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:36:28.616823 n-d-858384-1 devstack@n-api.service[128731]: WARNING keystonemiddleware.auth_token [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:36:28.619465 n-d-858384-1 devstack@n-api.service[128730]: WARNING keystonemiddleware.auth_token [None req-30035e99-5dbd-40d8-bdbd-90200b96db8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:36:28.622967 n-d-858384-1 devstack@n-api.service[128731]: WARNING keystonemiddleware.auth_token [None req-79166f83-5c31-426b-a58e-8c8e21b4704a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:36:28.625092 n-d-858384-1 devstack@n-api.service[128730]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee6e42b9c0 pid: 128730 (default app) Sep 19 14:36:28.628304 n-d-858384-1 devstack@n-api.service[128731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee6e42b9c0 pid: 128731 (default app) Sep 19 14:37:10.025557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.026665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.028048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.029514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.698330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.699303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.700270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:10.701546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:11.500030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1485094078", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:11.899546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4934da9-2e1d-4ff0-8a14-0fa6af644131 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1456453956", "ram": 512, "vcpus": 1, "disk": 10, "id": 1712400388, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:11.956713 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4934da9-2e1d-4ff0-8a14-0fa6af644131 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.263587 Sep 19 14:37:11.957571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:10 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:12.193629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:37:12.229546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:12.234771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.235279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.235803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.236493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.236991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.237794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.284482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70209153-0b95-46e5-a253-8beb75f78ed5 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.325647 Sep 19 14:37:12.285324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2/2] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:37:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:12.444670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:37:12.445083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:37:12.445797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:37:12.446375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:37:12.447005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:37:12.463680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.464162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.464591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.465483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.465941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.466352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.499761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Getting quotas for project 1e3e4615693f4560a776dc976ad302c1. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:37:12.501766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '.version_select at 0x7fde2b8693a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:12.507327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Getting quotas for user cd897005fef7483089f784339187e08f and project 1e3e4615693f4560a776dc976ad302c1. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:37:12.513663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=128731) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 19 14:37:12.513663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.513663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.513663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.522049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:37:12.524916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:37:12.544287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.544794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.545228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.557553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.558156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.558586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.565953 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12bd8f50-c6d7-4487-bfb0-fdd328f322fc tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.279456 Sep 19 14:37:12.566560 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3/3] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 14:37:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:12.619902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6536ca77-56ef-4c6d-a536-b99edfbb0da2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.602321 Sep 19 14:37:12.621059 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1/4] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:37:12.772848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32860248-2c1e-45d9-be5e-3d44a17bc1a7 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-287116009", "id": 509317525, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:12.794619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32860248-2c1e-45d9-be5e-3d44a17bc1a7 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.226961 Sep 19 14:37:12.795533 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 4/5] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:12 2022] POST /compute/v2.1/flavors => generated 426 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:12.838736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-93d8fd15-52a4-4f0e-810d-9902d321db1b tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1371200043", "ram": 512, "vcpus": 1, "disk": 10, "id": 291953923, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:12.876875 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-93d8fd15-52a4-4f0e-810d-9902d321db1b tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.253751 Sep 19 14:37:12.877791 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2/6] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:12 2022] POST /compute/v2.1/flavors => generated 413 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:12.925684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Calling method '.version_select at 0x7fde2b817f70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:12.929485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.930084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.930955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.950359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.950903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.952010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.963500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:12.963993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:12.964433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:12.971624 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b9e4bcd-3642-4470-b0c8-c72350c521b9 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.174895 Sep 19 14:37:12.985899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 5/7] 10.222.0.81 () {60 vars in 1208 bytes} [Mon Sep 19 14:37:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:37:12.985899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91c02476-4fa9-4f93-aa1d-62c59160e17a tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1191389633"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:12.985899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-91c02476-4fa9-4f93-aa1d-62c59160e17a tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid bd833d8c-91c3-4978-9524-07c2d50bd3a0 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:13.052456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91c02476-4fa9-4f93-aa1d-62c59160e17a tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079146 Sep 19 14:37:13.055441 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 6/8] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:13.062949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b23bb61-48f8-4645-979e-5353cd022577 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.063721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b23bb61-48f8-4645-979e-5353cd022577 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:13.113724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2aa53387-a9a7-4dcf-aa20-45bc63dc55b9 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.124063 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-2aa53387-a9a7-4dcf-aa20-45bc63dc55b9 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] HTTP exception thrown: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2aa53387-a9a7-4dcf-aa20-45bc63dc55b9 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Request method failure captured: Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/flavors/1712400388/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TbOQIpEgoQ27fNyEYup7kWGZLElBO4TtFP06CMxpfN92moeAJnvCSMub0iUhXTIPeB82TjLeEDnyYbgaa1CHj0oJG2-xjRFDGHxm7_CCDkmUSOYtP8p8uKYtzphfYSeYF_OrRicxqJTm_jD9BB5OBVBSU0E2drQ6QCME_glKa5Bs Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:13.126671 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23989d59ebb4451caa43ffdcfe20586e"}]}] Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 4d354676b22742419a5cd56cd0781be9 Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:13.127755 n-d-858384-1 devstack@n-api.service[128730]: exception: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'flavor_id': '1712400388', 'id': 'hw:cpu_thread_policy'} Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.128404 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:13.129719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.132595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2aa53387-a9a7-4dcf-aa20-45bc63dc55b9 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Returning 404 to user: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:13.133733 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2aa53387-a9a7-4dcf-aa20-45bc63dc55b9 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] 10.222.0.81 "GET /compute/v2.1/flavors/1712400388/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.254954 Sep 19 14:37:13.141593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3/9] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 14:37:12 2022] GET /compute/v2.1/flavors/1712400388/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:13.147330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29499e91-23a1-4045-aa2c-01cd8d34d890 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.178009 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-29499e91-23a1-4045-aa2c-01cd8d34d890 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/509317525" status: 202 len: 0 microversion: 2.1 time: 0.035177 Sep 19 14:37:13.178616 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 4/10] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:37:13 2022] DELETE /compute/v2.1/flavors/509317525 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:13.185828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5771788-7ac1-43aa-8adf-5f3712d05c5f tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.232844 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5771788-7ac1-43aa-8adf-5f3712d05c5f tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051886 Sep 19 14:37:13.238583 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 5/11] 10.222.0.81 () {60 vars in 1221 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/flavors/291953923/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:13.239365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b1074a8-7b81-4577-bd6b-61b71cd33010 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.282721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1074a8-7b81-4577-bd6b-61b71cd33010 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:13.284399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1074a8-7b81-4577-bd6b-61b71cd33010 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:13.285202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1074a8-7b81-4577-bd6b-61b71cd33010 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:13.513472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b23bb61-48f8-4645-979e-5353cd022577 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:13.530247 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b23bb61-48f8-4645-979e-5353cd022577 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1220 microversion: 2.1 time: 0.473475 Sep 19 14:37:13.530907 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 7/12] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:13 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1220 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:13.536671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e30ed86-924d-415a-919b-c5c2e7e5d3fd tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.540713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e30ed86-924d-415a-919b-c5c2e7e5d3fd tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '4d354676b22742419a5cd56cd0781be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23989d59ebb4451caa43ffdcfe20586e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e30ed86-924d-415a-919b-c5c2e7e5d3fd tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Request method failure captured: Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/flavors/1712400388/os-extra_specs HTTP/1.1 Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 66 Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6TbOQIpEgoQ27fNyEYup7kWGZLElBO4TtFP06CMxpfN92moeAJnvCSMub0iUhXTIPeB82TjLeEDnyYbgaa1CHj0oJG2-xjRFDGHxm7_CCDkmUSOYtP8p8uKYtzphfYSeYF_OrRicxqJTm_jD9BB5OBVBSU0E2drQ6QCME_glKa5Bs Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:37:13.546018 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23989d59ebb4451caa43ffdcfe20586e"}]}] Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4d354676b22742419a5cd56cd0781be9 Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 19 14:37:13.547758 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'flavor_id': '1712400388', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:13.548633 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 19 14:37:13.549707 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.552517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e30ed86-924d-415a-919b-c5c2e7e5d3fd tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:13.553897 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e30ed86-924d-415a-919b-c5c2e7e5d3fd tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] 10.222.0.81 "POST /compute/v2.1/flavors/1712400388/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.021235 Sep 19 14:37:13.561410 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 8/13] 10.222.0.81 () {60 vars in 1224 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/flavors/1712400388/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:13.565038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8339fad-f74f-4ad8-8c43-ba12dcfc0b77 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.618689 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8339fad-f74f-4ad8-8c43-ba12dcfc0b77 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5800 microversion: 2.1 time: 0.062091 Sep 19 14:37:13.619607 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 9/14] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:13 2022] GET /compute/v2.1/flavors/detail => generated 5800 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:13.713962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b1074a8-7b81-4577-bd6b-61b71cd33010 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.478646 Sep 19 14:37:13.714774 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 6/15] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:13.751249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94f49c32-382a-47cf-8a52-b2f36bd75fc0 tempest-FlavorsExtraSpecsTestJSON-1008616142 tempest-FlavorsExtraSpecsTestJSON-1008616142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.774401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94f49c32-382a-47cf-8a52-b2f36bd75fc0 tempest-FlavorsExtraSpecsTestJSON-1008616142 tempest-FlavorsExtraSpecsTestJSON-1008616142-project] 10.222.0.81 "GET /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.153457 Sep 19 14:37:13.775151 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 10/16] 10.222.0.81 () {58 vars in 1200 bytes} [Mon Sep 19 14:37:13 2022] GET /compute/v2.1/flavors/291953923/os-extra_specs => generated 66 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:13.787906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7c90241e-b6f6-4eb9-9d4c-18a322d92891 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.832109 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7c90241e-b6f6-4eb9-9d4c-18a322d92891 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1712400388/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047809 Sep 19 14:37:13.837939 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 11/17] 10.222.0.81 () {60 vars in 1224 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/flavors/1712400388/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:13.842944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ae58afd-5fc5-4d94-8c29-d3332fbc2a13 tempest-AZAdminNegativeTestJSON-434771344 tempest-AZAdminNegativeTestJSON-434771344-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.843687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ff33b41-b479-462d-b71c-2c126ae94e0f tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1928756012", "id": 2062898274, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.844562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5ae58afd-5fc5-4d94-8c29-d3332fbc2a13 tempest-AZAdminNegativeTestJSON-434771344 tempest-AZAdminNegativeTestJSON-434771344-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '63ef030f71424bdab367e48c96ccbbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d9f13b9d9247dcb57778138c3b308a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ae58afd-5fc5-4d94-8c29-d3332fbc2a13 tempest-AZAdminNegativeTestJSON-434771344 tempest-AZAdminNegativeTestJSON-434771344-project] Request method failure captured: Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6YqHx4USJor87B_D-VKgvEK3p10e5AKmLO6kV6aXVQ3yGGOR-eU9rP5qah-Jx-aJrsQFETnzWU3v1T5eF6irsW8ZGwKA56yznUvLQAUKdfKGKEQgLhTPNovvFqnbpCu0LLRWltN2LOiAWn3DVHhfuFN2bKVdm7hSpmMaoJCObTg-M Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 21d9f13b9d9247dcb57778138c3b308a Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AZAdminNegativeTestJSON-434771344 Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:13.847795 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_21d9f13b9d9247dcb57778138c3b308a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/21d9f13b9d9247dcb57778138c3b308a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/21d9f13b9d9247dcb57778138c3b308a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/21d9f13b9d9247dcb57778138c3b308a"}]}] Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AZAdminNegativeTestJSON-434771344 Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 21d9f13b9d9247dcb57778138c3b308a Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-434771344 Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AZAdminNegativeTestJSON-434771344-project Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 63ef030f71424bdab367e48c96ccbbb7 Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AZAdminNegativeTestJSON-434771344-project Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 19 14:37:13.848847 n-d-858384-1 devstack@n-api.service[128730]: action_args: {} Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:13.849490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.850398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ae58afd-5fc5-4d94-8c29-d3332fbc2a13 tempest-AZAdminNegativeTestJSON-434771344 tempest-AZAdminNegativeTestJSON-434771344-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:13.851348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ae58afd-5fc5-4d94-8c29-d3332fbc2a13 tempest-AZAdminNegativeTestJSON-434771344 tempest-AZAdminNegativeTestJSON-434771344-project] 10.222.0.81 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.126117 Sep 19 14:37:13.854384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 7/18] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 14:37:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 139 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:13.860545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.867931 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ff33b41-b479-462d-b71c-2c126ae94e0f tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.028805 Sep 19 14:37:13.868673 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 12/19] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/flavors => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:13.874509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:13.875342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:13.875822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:13.881015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04d3a8a8-f5df-4cff-bc16-d58cb0d3cce3 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.906517 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-858384-1. Sep 19 14:37:13.915597 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04d3a8a8-f5df-4cff-bc16-d58cb0d3cce3 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039151 Sep 19 14:37:13.917559 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 13/20] 10.222.0.81 () {60 vars in 1221 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/flavors/291953923/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 39 Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:37:13.921283 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: {"add_host": {"host": "n-h2-858384-1"}} Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:13.922408 n-d-858384-1 devstack@n-api.service[128730]: exception: Aggregate 1 already has host n-h2-858384-1. Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-858384-1'}}} Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result.read() Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:37:13.923699 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858384-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi session.flush() Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:37:13.924787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:37:13.925785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:37:13.926895 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result.read() Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858384-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 19, 14, 37, 13, 892806), 'updated_at': None, 'host': 'n-h2-858384-1', 'aggregate_id': 1}] Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.928278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6651, in add_host_to_aggregate Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-858384-1. Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.930086 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-858384-1. Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:13.932279 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:13.936560 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-858384-1. Sep 19 14:37:13.936560 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81067193-5dde-416c-b006-47c413a7a905 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-81067193-5dde-416c-b006-47c413a7a905 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '4d354676b22742419a5cd56cd0781be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23989d59ebb4451caa43ffdcfe20586e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81067193-5dde-416c-b006-47c413a7a905 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Request method failure captured: Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:13.936789 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6TbOQIpEgoQ27fNyEYup7kWGZLElBO4TtFP06CMxpfN92moeAJnvCSMub0iUhXTIPeB82TjLeEDnyYbgaa1CHj0oJG2-xjRFDGHxm7_CCDkmUSOYtP8p8uKYtzphfYSeYF_OrRicxqJTm_jD9BB5OBVBSU0E2drQ6QCME_glKa5Bs Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23989d59ebb4451caa43ffdcfe20586e"}]}] Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:13.938327 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4d354676b22742419a5cd56cd0781be9 Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'flavor_id': '1712400388', 'id': 'hw:numa_nodes'} Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:13.940003 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:13.942378 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:13.945461 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 19 14:37:13.945461 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:13.945461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81067193-5dde-416c-b006-47c413a7a905 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:13.945461 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81067193-5dde-416c-b006-47c413a7a905 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] 10.222.0.81 "DELETE /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010721 Sep 19 14:37:13.945461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 14/21] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 14:37:13 2022] DELETE /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:13.945883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-858384-1. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:13.945969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cd27821a-83cf-485f-8491-331217fa0a0e tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.946063 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f632f7a3-f9fd-4364-b125-96eda4758117 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.079199 Sep 19 14:37:13.946199 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 8/22] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 19 14:37:13.952061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48f6e4b8-1ac6-422d-8ce9-18b8c116e5e0 tempest-FlavorsExtraSpecsTestJSON-1008616142 tempest-FlavorsExtraSpecsTestJSON-1008616142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:13.965495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48f6e4b8-1ac6-422d-8ce9-18b8c116e5e0 tempest-FlavorsExtraSpecsTestJSON-1008616142 tempest-FlavorsExtraSpecsTestJSON-1008616142-project] 10.222.0.81 "GET /compute/v2.1/flavors/291953923/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017827 Sep 19 14:37:13.966555 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 9/23] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:37:13 2022] GET /compute/v2.1/flavors/291953923/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:13.971539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d24ab07-e413-4381-a00e-96b8e7c8da0b tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:13.971690 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cd27821a-83cf-485f-8491-331217fa0a0e tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6207 microversion: 2.1 time: 0.038908 Sep 19 14:37:13.973654 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 15/24] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:13 2022] GET /compute/v2.1/flavors/detail => generated 6207 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:13.996589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3a78193-2998-480d-8ef2-26524a37ba7e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.008873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a78193-2998-480d-8ef2-26524a37ba7e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:14.009384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a78193-2998-480d-8ef2-26524a37ba7e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:14.009836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a78193-2998-480d-8ef2-26524a37ba7e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:14.027317 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d24ab07-e413-4381-a00e-96b8e7c8da0b tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1712400388/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058865 Sep 19 14:37:14.031679 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 10/25] 10.222.0.81 () {60 vars in 1224 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/flavors/1712400388/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:14.042764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d94a3640-c7cf-412d-bdf9-f93a80a27f39 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.069450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d94a3640-c7cf-412d-bdf9-f93a80a27f39 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033087 Sep 19 14:37:14.069555 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 11/26] 10.222.0.81 () {60 vars in 1221 bytes} [Mon Sep 19 14:37:14 2022] POST /compute/v2.1/flavors/291953923/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:14.074017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf0fa6dd-a877-4b38-9001-9384e8567cb9 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.095927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf0fa6dd-a877-4b38-9001-9384e8567cb9 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/2062898274" status: 202 len: 0 microversion: 2.1 time: 0.025275 Sep 19 14:37:14.096562 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 12/27] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/2062898274 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:14.101533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91c4dff9-7ee1-467a-a35b-dbc8c21bff42 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.106486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91c4dff9-7ee1-467a-a35b-dbc8c21bff42 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '4d354676b22742419a5cd56cd0781be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23989d59ebb4451caa43ffdcfe20586e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91c4dff9-7ee1-467a-a35b-dbc8c21bff42 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Request method failure captured: Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 22 Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TbOQIpEgoQ27fNyEYup7kWGZLElBO4TtFP06CMxpfN92moeAJnvCSMub0iUhXTIPeB82TjLeEDnyYbgaa1CHj0oJG2-xjRFDGHxm7_CCDkmUSOYtP8p8uKYtzphfYSeYF_OrRicxqJTm_jD9BB5OBVBSU0E2drQ6QCME_glKa5Bs Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:14.108645 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23989d59ebb4451caa43ffdcfe20586e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23989d59ebb4451caa43ffdcfe20586e"}]}] Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 23989d59ebb4451caa43ffdcfe20586e Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 4d354676b22742419a5cd56cd0781be9 Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: {"hw:numa_nodes": "1"} Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:14.109931 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'flavor_id': '1712400388', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:14.110574 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 19 14:37:14.111585 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.112537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91c4dff9-7ee1-467a-a35b-dbc8c21bff42 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:14.113727 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91c4dff9-7ee1-467a-a35b-dbc8c21bff42 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506 tempest-FlavorsExtraSpecsNegativeTestJSON-986194506-project] 10.222.0.81 "PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015291 Sep 19 14:37:14.115152 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 13/28] 10.222.0.81 () {60 vars in 1265 bytes} [Mon Sep 19 14:37:14 2022] PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:14.125235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab2350cc-6005-4acf-b929-385a6e532538 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.136120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab2350cc-6005-4acf-b929-385a6e532538 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020045 Sep 19 14:37:14.137931 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 14/29] 10.222.0.81 () {58 vars in 1200 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/291953923/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:14.142770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8874c6c4-aae8-4b7c-b8db-c0cd9d0dac8f tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.179662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8874c6c4-aae8-4b7c-b8db-c0cd9d0dac8f tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5800 microversion: 2.1 time: 0.040631 Sep 19 14:37:14.180248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 15/30] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/detail => generated 5800 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:14.184902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14b209c9-ff9a-47aa-b0ea-6dd6e52e6a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.192419 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-14b209c9-ff9a-47aa-b0ea-6dd6e52e6a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] HTTP exception thrown: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14b209c9-ff9a-47aa-b0ea-6dd6e52e6a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Request method failure captured: Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/flavors/1712400388/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6Wtmnku9Mfyy5ti8W00ZWMP1laGYYGMj0QGZp3XGTc1gc6CMgcWgQ8zbQ7e9m4r1NsVSywiIEIes7SP5F_50T2Vo6fbhVJT_E72r2Y7gNjdRwy9O7tgSCCZBxcBb1-Hfqq-Rgp3xkhxqS8YJUU124Rzr9bMAzSurmsnH-xA1S7kZ0 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 15123eaf0d634464969ad537d666f8d1 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:37:14.196341 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_15123eaf0d634464969ad537d666f8d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15123eaf0d634464969ad537d666f8d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15123eaf0d634464969ad537d666f8d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/15123eaf0d634464969ad537d666f8d1"}]}] Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 15123eaf0d634464969ad537d666f8d1 Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6d4cda97bbe244f484f62282ec968962 Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:14.197687 n-d-858384-1 devstack@n-api.service[128730]: exception: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'flavor_id': '1712400388', 'id': 'hw:cpu_thread_policy'} Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:14.198234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. Sep 19 14:37:14.200159 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.201387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14b209c9-ff9a-47aa-b0ea-6dd6e52e6a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Returning 404 to user: Flavor 1712400388 has no extra specs with key hw:cpu_thread_policy. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:14.202234 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14b209c9-ff9a-47aa-b0ea-6dd6e52e6a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1712400388/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.021074 Sep 19 14:37:14.202800 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 16/31] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/1712400388/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:14.208089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3aea9fa4-938d-4e7d-9a63-0dfa1003d885 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.240349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=8,nova_api:DELETE=6,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:14.247876 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3aea9fa4-938d-4e7d-9a63-0dfa1003d885 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/291953923/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.043426 Sep 19 14:37:14.248672 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 17/32] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:37:14 2022] PUT /compute/v2.1/flavors/291953923/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:14.253427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-308b50da-b5c9-46db-9aeb-fdf14688e007 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-469488807", "id": 1735796589, "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.287553 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-308b50da-b5c9-46db-9aeb-fdf14688e007 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.037579 Sep 19 14:37:14.288377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 18/33] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:14 2022] POST /compute/v2.1/flavors => generated 428 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:14.296763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4e7ce3b-2a75-4d1d-ac53-7ecd6d149f3a tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.302040 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f4e7ce3b-2a75-4d1d-ac53-7ecd6d149f3a tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4e7ce3b-2a75-4d1d-ac53-7ecd6d149f3a tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Request method failure captured: Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 27 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6Wtmnku9Mfyy5ti8W00ZWMP1laGYYGMj0QGZp3XGTc1gc6CMgcWgQ8zbQ7e9m4r1NsVSywiIEIes7SP5F_50T2Vo6fbhVJT_E72r2Y7gNjdRwy9O7tgSCCZBxcBb1-Hfqq-Rgp3xkhxqS8YJUU124Rzr9bMAzSurmsnH-xA1S7kZ0 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 15123eaf0d634464969ad537d666f8d1 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:37:14.303861 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_15123eaf0d634464969ad537d666f8d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15123eaf0d634464969ad537d666f8d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15123eaf0d634464969ad537d666f8d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/15123eaf0d634464969ad537d666f8d1"}]}] Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 15123eaf0d634464969ad537d666f8d1 Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6d4cda97bbe244f484f62282ec968962 Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: {"hw:cpu_policy": "shared"} Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:14.305197 n-d-858384-1 devstack@n-api.service[128730]: exception: Request body and URI mismatch Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'flavor_id': '1712400388', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.306010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.307289 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:14.307289 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:14.307289 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 19 14:37:14.307289 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.307289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4e7ce3b-2a75-4d1d-ac53-7ecd6d149f3a tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:14.307992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4e7ce3b-2a75-4d1d-ac53-7ecd6d149f3a tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016699 Sep 19 14:37:14.309568 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 19/34] 10.222.0.81 () {60 vars in 1265 bytes} [Mon Sep 19 14:37:14 2022] PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:37:14.315094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-705051f1-f17b-4a2e-bc54-5a64a3e04334 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.326062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-705051f1-f17b-4a2e-bc54-5a64a3e04334 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014941 Sep 19 14:37:14.327950 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 20/35] 10.222.0.81 () {58 vars in 1200 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/291953923/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:14.332898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3090b3f4-3930-41b1-ba79-64a9e641fb11 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.369659 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3090b3f4-3930-41b1-ba79-64a9e641fb11 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1735796589" status: 202 len: 0 microversion: 2.1 time: 0.040452 Sep 19 14:37:14.374840 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 21/36] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/1735796589 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:14.385451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-997074f9-4753-4428-842b-2659a715c906 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-997074f9-4753-4428-842b-2659a715c906 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Request method failure captured: Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 49 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6Wtmnku9Mfyy5ti8W00ZWMP1laGYYGMj0QGZp3XGTc1gc6CMgcWgQ8zbQ7e9m4r1NsVSywiIEIes7SP5F_50T2Vo6fbhVJT_E72r2Y7gNjdRwy9O7tgSCCZBxcBb1-Hfqq-Rgp3xkhxqS8YJUU124Rzr9bMAzSurmsnH-xA1S7kZ0 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 15123eaf0d634464969ad537d666f8d1 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:37:14.390885 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_15123eaf0d634464969ad537d666f8d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15123eaf0d634464969ad537d666f8d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15123eaf0d634464969ad537d666f8d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/15123eaf0d634464969ad537d666f8d1"}]}] Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 15123eaf0d634464969ad537d666f8d1 Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6d4cda97bbe244f484f62282ec968962 Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 19 14:37:14.392268 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'flavor_id': '1712400388', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance: Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 19 14:37:14.393062 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.394661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-997074f9-4753-4428-842b-2659a715c906 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:14.395927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-997074f9-4753-4428-842b-2659a715c906 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016994 Sep 19 14:37:14.398117 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 22/37] 10.222.0.81 () {60 vars in 1265 bytes} [Mon Sep 19 14:37:14 2022] PUT /compute/v2.1/flavors/1712400388/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:37:14.402525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12600415-c37e-4eb9-8089-bef2be8e8fd2 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.435634 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12600415-c37e-4eb9-8089-bef2be8e8fd2 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/291953923/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.036367 Sep 19 14:37:14.436525 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 23/38] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/291953923/os-extra_specs/hw:numa_nodes => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:14.442112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-88b1e321-3aee-4298-aece-b0ddd7f860db tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.470964 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3a78193-2998-480d-8ef2-26524a37ba7e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.494945 Sep 19 14:37:14.471805 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-88b1e321-3aee-4298-aece-b0ddd7f860db tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5800 microversion: 2.1 time: 0.032868 Sep 19 14:37:14.472639 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 24/39] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/detail => generated 5800 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:14.477298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6da97bfc-c4ea-4f96-8915-56370256d843 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.478981 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 16/40] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:14.498886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-beb10a5b-391a-48a6-8106-e4d46e6dea29 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.504495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6da97bfc-c4ea-4f96-8915-56370256d843 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1712400388" status: 202 len: 0 microversion: 2.1 time: 0.030574 Sep 19 14:37:14.505597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 25/41] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/1712400388 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:14.517210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6acf8620-2737-4ae7-bdf3-1398b1218f58 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.531062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-beb10a5b-391a-48a6-8106-e4d46e6dea29 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/291953923/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.050574 Sep 19 14:37:14.532322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 17/42] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/291953923/os-extra_specs/hw:cpu_policy => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:14.549164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c45206f5-193a-40b0-b9e7-813112b36031 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-391467816", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.552456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6acf8620-2737-4ae7-bdf3-1398b1218f58 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.045192 Sep 19 14:37:14.553225 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 26/43] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:14.558000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0cfdf73-f4d2-46da-a0d7-d451a1393b98 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.572486 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c45206f5-193a-40b0-b9e7-813112b36031 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.036348 Sep 19 14:37:14.580938 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 18/44] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:14 2022] POST /compute/v2.1/flavors => generated 506 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:14.580938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9d02459b-6edc-45cc-82c0-e7f801f0db77 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.583463 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0cfdf73-f4d2-46da-a0d7-d451a1393b98 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182 tempest-FlavorsExtraSpecsNegativeTestJSON-1692026182-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5890 microversion: 2.1 time: 0.029322 Sep 19 14:37:14.584348 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 27/45] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/detail => generated 5890 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:14.588873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.589617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:14.604458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:14.604973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:14.605531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:14.607029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:14.607565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:14.608128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:14.618003 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9d02459b-6edc-45cc-82c0-e7f801f0db77 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/291953923/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042482 Sep 19 14:37:14.620204 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 19/46] 10.222.0.81 () {58 vars in 1200 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/291953923/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:14.629331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-899ccdc4-137d-4830-8f74-9eea3a2c1191 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1227222030"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.632618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-899ccdc4-137d-4830-8f74-9eea3a2c1191 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid 4e273d01-49c3-42e4-8dce-eda5db944ab8 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:14.663680 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-899ccdc4-137d-4830-8f74-9eea3a2c1191 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042386 Sep 19 14:37:14.664334 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 20/47] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:14.673375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b389af6a-edc0-48a7-9e48-b2751096ad76 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.714072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b389af6a-edc0-48a7-9e48-b2751096ad76 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/57a78e23-527f-4619-85fb-e4552f3bece7" status: 202 len: 0 microversion: 2.1 time: 0.046031 Sep 19 14:37:14.714570 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 21/48] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/57a78e23-527f-4619-85fb-e4552f3bece7 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:14.728032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-55296593-9d76-4406-8c84-556ed4046ce3 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.740647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:14.749337 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-55296593-9d76-4406-8c84-556ed4046ce3 tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/291953923" status: 202 len: 0 microversion: 2.1 time: 0.027842 Sep 19 14:37:14.749919 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 22/49] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:37:14 2022] DELETE /compute/v2.1/flavors/291953923 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:14.758651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c5f76cb-4d65-4a8a-9ca4-1dc4cd91ad3a tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2083802756", "name": "tempest-test_aggregate-654427426"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:14.781606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-2c5f76cb-4d65-4a8a-9ca4-1dc4cd91ad3a tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid b8ddedc7-5e25-4f00-8d5b-e7df6fb2e91a for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:14.815796 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c5f76cb-4d65-4a8a-9ca4-1dc4cd91ad3a tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.061152 Sep 19 14:37:14.816743 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 23/50] 10.222.0.81 () {60 vars in 1165 bytes} [Mon Sep 19 14:37:14 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:14.842007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:14.874453 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b7d8a01-0494-450b-a2f6-5931e2c1114f tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1272 microversion: 2.1 time: 0.289014 Sep 19 14:37:14.890945 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 28/51] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:14.890945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a17dbd61-b990-4ab0-a359-b6b87bdffff4 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.912482 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a17dbd61-b990-4ab0-a359-b6b87bdffff4 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035655 Sep 19 14:37:14.913252 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 29/52] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:14.933496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6a16951d-ed61-49b8-8a0f-2deaa08c0fda tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.962709 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6a16951d-ed61-49b8-8a0f-2deaa08c0fda tempest-FlavorsExtraSpecsTestJSON-853753562 tempest-FlavorsExtraSpecsTestJSON-853753562-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047579 Sep 19 14:37:14.963561 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 30/53] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:14.969404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4dda9715-50b0-4227-997e-043b1d7cf630 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:14.999891 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4dda9715-50b0-4227-997e-043b1d7cf630 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.035031 Sep 19 14:37:15.008654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 31/54] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:37:14 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.014631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a792b4f4-afcf-46e0-9b47-259ae1d5bb44 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1112051404", "id": "b705bf97-e499-44fc-b5db-356ee98b824d", "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.047462 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a792b4f4-afcf-46e0-9b47-259ae1d5bb44 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.037737 Sep 19 14:37:15.048070 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 32/55] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.053134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56458b34-85e8-43e4-a459-9aa267993bab tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.064928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56458b34-85e8-43e4-a459-9aa267993bab tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:15.065434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56458b34-85e8-43e4-a459-9aa267993bab tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:15.065895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56458b34-85e8-43e4-a459-9aa267993bab tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:15.154372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-daf67b7f-8ea7-432a-ad2f-7e4377c23a53 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.161710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-daf67b7f-8ea7-432a-ad2f-7e4377c23a53 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'f21b78021bd5451f9b06c49095c01bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158aa1288b9c416bb768e640aaae5074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-daf67b7f-8ea7-432a-ad2f-7e4377c23a53 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Request method failure captured: Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 39 Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6UNPJ-S6IdDX7s3_cNCP-7QD-TDzGYgKsZ5c7Tb9Db3PCFliEfIjozPsbSuYDYQLGygWvnvd8u2NvQQDUazVSUYGgCc6695-ikE-3ruPee4mexxoBmjT5eabc0GYZxRguDbH2XFRHY7Ykh2gnJ5lw4XKsZEXNGn8RfzN8105-Ogtc Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:37:15.163850 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_158aa1288b9c416bb768e640aaae5074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/158aa1288b9c416bb768e640aaae5074"}]}] Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f21b78021bd5451f9b06c49095c01bc8 Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: {"add_host": {"host": "n-h2-858384-1"}} Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:15.165376 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-858384-1'}}} Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:15.166394 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 19 14:37:15.167395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.173329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-daf67b7f-8ea7-432a-ad2f-7e4377c23a53 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:15.174414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-daf67b7f-8ea7-432a-ad2f-7e4377c23a53 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] 10.222.0.81 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.356519 Sep 19 14:37:15.180767 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 24/56] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 363 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:15.187262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dce6f58b-1d7f-4424-8093-512b39564b0d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:15.230378 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dce6f58b-1d7f-4424-8093-512b39564b0d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/b705bf97-e499-44fc-b5db-356ee98b824d" status: 202 len: 0 microversion: 2.1 time: 0.047552 Sep 19 14:37:15.232144 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 25/57] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:37:15 2022] DELETE /compute/v2.1/flavors/b705bf97-e499-44fc-b5db-356ee98b824d => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:15.239611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7fe1eef5-dc78-4384-9f1f-827b991c4146 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:15.265003 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56458b34-85e8-43e4-a459-9aa267993bab tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 0.215874 Sep 19 14:37:15.267504 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 33/58] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.282567 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7fe1eef5-dc78-4384-9f1f-827b991c4146 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.049022 Sep 19 14:37:15.283476 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 26/59] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:15 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:15.303721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9146a3f-663c-4c4d-9f5b-122e28bfaa47 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:15.307912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06af307a-3c92-4b5e-8acf-ed55525dc0e6 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1018833629"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.314218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-06af307a-3c92-4b5e-8acf-ed55525dc0e6 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid aab9fb70-8b15-4ebb-9286-47345ca71a98 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:15.353009 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9146a3f-663c-4c4d-9f5b-122e28bfaa47 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082810 Sep 19 14:37:15.354257 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 34/60] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:15.378504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90e8919c-79af-4313-92bb-75fc50721c21 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-824327748", "id": 437363770, "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.380130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06af307a-3c92-4b5e-8acf-ed55525dc0e6 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083913 Sep 19 14:37:15.381678 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 27/61] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.394388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2019950579"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.415400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:15.416488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:15.417152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:15.425966 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90e8919c-79af-4313-92bb-75fc50721c21 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.051500 Sep 19 14:37:15.426971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:15.427798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:15.428602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:15.439153 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 35/62] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/flavors => generated 410 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.440557 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2019950579 could not be found. Sep 19 14:37:15.447148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ba91c3d-6cf4-4ad0-989d-6a0c0f3f18c7 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 58 Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:37:15.447509 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: {"add_host": {"host": "tempest-nonexist_host-2019950579"}} Sep 19 14:37:15.448660 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: exception: Compute host tempest-nonexist_host-2019950579 could not be found. Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2019950579'}}} Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2019950579' is not mapped to any cell Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.449330 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6015, in _get_service_in_cell_by_host Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6631, in add_host_to_aggregate Sep 19 14:37:15.451145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _get_service_in_cell_by_host Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2019950579 could not be found. Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2019950579 could not be found. Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.452170 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2019950579 could not be found. Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2019950579 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23bea937-b1c1-4c38-9e4d-4bdb6b24815d tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.059170 Sep 19 14:37:15.454906 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 28/63] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:37:15.459348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e8902f8-2838-489d-87f1-7eb3cfbc50c1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:15.461009 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ba91c3d-6cf4-4ad0-989d-6a0c0f3f18c7 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/437363770" status: 200 len: 410 microversion: 2.1 time: 0.020669 Sep 19 14:37:15.461597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 36/64] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:37:15 2022] GET /compute/v2.1/flavors/437363770 => generated 410 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.492385 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e8902f8-2838-489d-87f1-7eb3cfbc50c1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.036622 Sep 19 14:37:15.502238 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 29/65] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:15 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:15.508168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61ea9141-85b2-468a-8b97-483bc8ae80c1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61ea9141-85b2-468a-8b97-483bc8ae80c1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 283 Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:37:15.513560 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.514872 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:37:15.515406 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:15.515918 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.516764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.517508 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:37:15.517508 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:37:15.517508 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:37:15.517508 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.519353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61ea9141-85b2-468a-8b97-483bc8ae80c1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:15.521057 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61ea9141-85b2-468a-8b97-483bc8ae80c1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016765 Sep 19 14:37:15.521890 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 30/66] 10.222.0.81 () {60 vars in 1165 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:37:15.532867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ddb774e-e9ff-4f2e-9521-7837b9404c0b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ddb774e-e9ff-4f2e-9521-7837b9404c0b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 27 Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:37:15.537032 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: {"aggregate": {"name": ""}} Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:15.538130 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi '' Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:15.538807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 19 14:37:15.539921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.543542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ddb774e-e9ff-4f2e-9521-7837b9404c0b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:15.544677 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ddb774e-e9ff-4f2e-9521-7837b9404c0b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016804 Sep 19 14:37:15.549976 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 31/67] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:37:15.557049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09fa1720-34e3-4008-b8a0-d44a5e933353 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330262168"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.561118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-09fa1720-34e3-4008-b8a0-d44a5e933353 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'f21b78021bd5451f9b06c49095c01bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158aa1288b9c416bb768e640aaae5074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09fa1720-34e3-4008-b8a0-d44a5e933353 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Request method failure captured: Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 59 Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6UNPJ-S6IdDX7s3_cNCP-7QD-TDzGYgKsZ5c7Tb9Db3PCFliEfIjozPsbSuYDYQLGygWvnvd8u2NvQQDUazVSUYGgCc6695-ikE-3ruPee4mexxoBmjT5eabc0GYZxRguDbH2XFRHY7Ykh2gnJ5lw4XKsZEXNGn8RfzN8105-Ogtc Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:37:15.562820 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_158aa1288b9c416bb768e640aaae5074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/158aa1288b9c416bb768e640aaae5074"}]}] Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f21b78021bd5451f9b06c49095c01bc8 Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: {"aggregate": {"name": "tempest-test_aggregate-330262168"}} Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:15.563930 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-330262168'}}} Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:15.564579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:15.566195 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 19 14:37:15.567215 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.567215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09fa1720-34e3-4008-b8a0-d44a5e933353 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:15.567215 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09fa1720-34e3-4008-b8a0-d44a5e933353 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012650 Sep 19 14:37:15.567215 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 32/68] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:15.573585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-806d4a78-e850-4d00-b76a-e41540efffe4 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1195659485"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.578270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-806d4a78-e850-4d00-b76a-e41540efffe4 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid f2bc6229-689b-4504-b2af-7d4ea10f6479 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:15.608409 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-806d4a78-e850-4d00-b76a-e41540efffe4 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038209 Sep 19 14:37:15.615386 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 33/69] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:15.626796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc0c2169-5034-48da-816a-fa87fa7115e1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1195659485"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:15.631447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-cc0c2169-5034-48da-816a-fa87fa7115e1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid efd69107-447b-43af-b8cf-7c55bf5eb420 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:15.657905 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-cc0c2169-5034-48da-816a-fa87fa7115e1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1195659485 already exists. Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc0c2169-5034-48da-816a-fa87fa7115e1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 60 Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:37:15.660071 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: {"aggregate": {"name": "tempest-test_aggregate-1195659485"}} Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:37:15.661250 n-d-858384-1 devstack@n-api.service[128731]: exception: Aggregate tempest-test_aggregate-1195659485 already exists. Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1195659485'}}} Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6468, in create_aggregate Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 19 14:37:15.661903 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1195659485 already exists. Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:15.663093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1195659485 already exists. Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1195659485 already exists. Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc0c2169-5034-48da-816a-fa87fa7115e1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1195659485 already exists. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:15.664071 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc0c2169-5034-48da-816a-fa87fa7115e1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.041634 Sep 19 14:37:15.665600 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 34/70] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:37:15.682637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1653a57-01b9-4213-bfb1-9f645e1660d8 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:15.717125 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1653a57-01b9-4213-bfb1-9f645e1660d8 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.044555 Sep 19 14:37:15.720459 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 35/71] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:15 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:15.980038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e48be13-5333-4ac7-a6b5-81bb6942088f tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.018532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e48be13-5333-4ac7-a6b5-81bb6942088f tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.542703 Sep 19 14:37:16.019384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 37/72] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:15 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:16.049510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f3e9ad2-2fae-4782-be63-5fb754cc832e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1136610929"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:16.053221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-6f3e9ad2-2fae-4782-be63-5fb754cc832e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid 72fca6e0-748c-4ff9-a286-9505a4a5cc9c for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:16.091223 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f3e9ad2-2fae-4782-be63-5fb754cc832e tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069558 Sep 19 14:37:16.091843 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 38/73] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:16.098907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.099766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:16.119565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:16.121090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:16.125949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:16.126966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:16.127661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:16.128265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:16.295640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:16.301888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-742932936", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "availability_zone": "tempest-test_az-2083802756"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:16.306836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-84bb9fe8-65f6-4e36-8b62-b4f8df0dc228 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1278 microversion: 2.1 time: 0.213000 Sep 19 14:37:16.316987 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 39/74] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:16 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:16.327208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eac3b16d-730b-4476-9107-05023fa79bd2 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.342481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:16.346950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:16.351308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:16.355011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:16.358292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:16.359492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:16.383604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eac3b16d-730b-4476-9107-05023fa79bd2 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/437363770" status: 202 len: 0 microversion: 2.1 time: 0.061681 Sep 19 14:37:16.388536 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 40/75] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:37:16 2022] DELETE /compute/v2.1/flavors/437363770 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:16.395036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c6c4be1-61f1-496e-b831-76b14a4dc6ae tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.398082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c6c4be1-61f1-496e-b831-76b14a4dc6ae tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'f21b78021bd5451f9b06c49095c01bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158aa1288b9c416bb768e640aaae5074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c6c4be1-61f1-496e-b831-76b14a4dc6ae tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Request method failure captured: Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6UNPJ-S6IdDX7s3_cNCP-7QD-TDzGYgKsZ5c7Tb9Db3PCFliEfIjozPsbSuYDYQLGygWvnvd8u2NvQQDUazVSUYGgCc6695-ikE-3ruPee4mexxoBmjT5eabc0GYZxRguDbH2XFRHY7Ykh2gnJ5lw4XKsZEXNGn8RfzN8105-Ogtc Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:16.400509 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_158aa1288b9c416bb768e640aaae5074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/158aa1288b9c416bb768e640aaae5074"}]}] Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f21b78021bd5451f9b06c49095c01bc8 Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 19 14:37:16.401912 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6'} Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:16.403707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 19 14:37:16.404958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.407972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c6c4be1-61f1-496e-b831-76b14a4dc6ae tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:16.409638 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c6c4be1-61f1-496e-b831-76b14a4dc6ae tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.019379 Sep 19 14:37:16.410909 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 41/76] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:16 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:16.420900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68429f57-1563-4741-bdad-68174ad9e737 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.452453 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68429f57-1563-4741-bdad-68174ad9e737 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037522 Sep 19 14:37:16.453403 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 42/77] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:16.469330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70648b1b-85c2-4a08-9077-15a85efb87d6 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.504421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70648b1b-85c2-4a08-9077-15a85efb87d6 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.049449 Sep 19 14:37:16.508219 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 43/78] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:16 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:16.525369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-99fbb020-a02a-4142-b98c-9ee78ca1fc55 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-695636398", "id": 1607474619, "os-flavor-access:is_public": "False"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:16.531026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:37:16.571103 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-99fbb020-a02a-4142-b98c-9ee78ca1fc55 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.050946 Sep 19 14:37:16.572217 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 44/79] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:16 2022] POST /compute/v2.1/flavors => generated 429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:16.584560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50f5a12c-a43d-4ea1-b2ed-7f4e00ef8648 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.603934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=14,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:16.614249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-50f5a12c-a43d-4ea1-b2ed-7f4e00ef8648 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50f5a12c-a43d-4ea1-b2ed-7f4e00ef8648 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:37:16.622827 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: exception: Aggregate -1 could not be found. Sep 19 14:37:16.624152 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '-1'} Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 19 14:37:16.624937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.626164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50f5a12c-a43d-4ea1-b2ed-7f4e00ef8648 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-50f5a12c-a43d-4ea1-b2ed-7f4e00ef8648 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.051176 Sep 19 14:37:16.627544 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 45/80] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:37:16 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:37:16.635183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d3210d2e-9e1c-417f-b4b3-870729da0812 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "1607474619"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:16.649128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d3210d2e-9e1c-417f-b4b3-870729da0812 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] HTTP exception thrown: Flavor 1607474619 could not be found. Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d3210d2e-9e1c-417f-b4b3-870729da0812 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] Request method failure captured: Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 107 Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6UZXPeGAD6nmv_nzTUbVOqIDFy9Ppmm9i1JnINL4UGUupnlJHZ-teegz5CH4ij6dd9McXhBg7tL8vpYrqFzduKMcAypUlU000fRcQ6Dny67UwIU35dnlDR9bRRMU1YZGgNBR5llAs1z0HOK2eCQecxXLuY8zwNwPMl0HCx1krn2eI Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d1ba02992df14982bdf79ff8352af4b6 Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsAdminTestJSON-2034810562 Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:16.654935 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d1ba02992df14982bdf79ff8352af4b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d1ba02992df14982bdf79ff8352af4b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d1ba02992df14982bdf79ff8352af4b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d1ba02992df14982bdf79ff8352af4b6"}]}] Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsAdminTestJSON-2034810562 Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d1ba02992df14982bdf79ff8352af4b6 Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2034810562 Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsAdminTestJSON-2034810562-project Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: da594fc261c14cb3bb13fceaf0452bb6 Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsAdminTestJSON-2034810562-project Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "test", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "1607474619"}} Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:16.656347 n-d-858384-1 devstack@n-api.service[128730]: exception: Flavor 1607474619 could not be found. Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '1607474619'}}} Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1607474619 could not be found. Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.657130 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1607474619 could not be found. Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.658308 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.659457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.659457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:16.659457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:16.659457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1607474619 could not be found. Sep 19 14:37:16.659457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.660910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d3210d2e-9e1c-417f-b4b3-870729da0812 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] Returning 400 to user: Flavor 1607474619 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:16.662829 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d3210d2e-9e1c-417f-b4b3-870729da0812 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.033512 Sep 19 14:37:16.664116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 46/81] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:16 2022] POST /compute/v2.1/servers => generated 81 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:37:16.670691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47d6002a-d463-4910-9647-68b28890e104 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1418326052"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:16.674679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-47d6002a-d463-4910-9647-68b28890e104 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid 7f823a0e-8f7a-4fa5-a420-2752c0fc7b0c for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:16.710773 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-47d6002a-d463-4910-9647-68b28890e104 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044046 Sep 19 14:37:16.712724 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 47/82] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:16.722496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-518b410a-835c-4b33-a7c8-d935f707fca0 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.769524 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-518b410a-835c-4b33-a7c8-d935f707fca0 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1607474619" status: 202 len: 0 microversion: 2.1 time: 0.055536 Sep 19 14:37:16.771530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 48/83] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:37:16 2022] DELETE /compute/v2.1/flavors/1607474619 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:16.785521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf74078c-ec6e-441e-b06f-9095110e217f tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.787557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf74078c-ec6e-441e-b06f-9095110e217f tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'f21b78021bd5451f9b06c49095c01bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158aa1288b9c416bb768e640aaae5074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf74078c-ec6e-441e-b06f-9095110e217f tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Request method failure captured: Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6UNPJ-S6IdDX7s3_cNCP-7QD-TDzGYgKsZ5c7Tb9Db3PCFliEfIjozPsbSuYDYQLGygWvnvd8u2NvQQDUazVSUYGgCc6695-ikE-3ruPee4mexxoBmjT5eabc0GYZxRguDbH2XFRHY7Ykh2gnJ5lw4XKsZEXNGn8RfzN8105-Ogtc Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:16.789127 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_158aa1288b9c416bb768e640aaae5074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/158aa1288b9c416bb768e640aaae5074"}]}] Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f21b78021bd5451f9b06c49095c01bc8 Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 19 14:37:16.790351 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '7'} Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:16.791267 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:16.792355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf74078c-ec6e-441e-b06f-9095110e217f tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:16.793905 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf74078c-ec6e-441e-b06f-9095110e217f tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] 10.222.0.81 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.017063 Sep 19 14:37:16.795724 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 49/84] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:37:16 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:16.822405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31914a9d-0fa6-42a5-96d5-33b9730e31e8 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.883742 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-31914a9d-0fa6-42a5-96d5-33b9730e31e8 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084697 Sep 19 14:37:16.885031 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 50/85] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:16.901148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7bdb27c-963b-486e-bcc3-bb1958ea5837 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:16.933476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7bdb27c-963b-486e-bcc3-bb1958ea5837 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.044938 Sep 19 14:37:16.939696 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 51/86] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:16 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:16.958997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c04d569-cfef-4ea8-9c59-cc44f5704024 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2063544252", "id": 1630584903, "os-flavor-access:is_public": "False"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:17.004402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c04d569-cfef-4ea8-9c59-cc44f5704024 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.062675 Sep 19 14:37:17.006412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 52/87] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:16 2022] POST /compute/v2.1/flavors => generated 415 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:17.025129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8e20084-ef24-4203-9fc4-1307e0eb1b96 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.048499 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e8e20084-ef24-4203-9fc4-1307e0eb1b96 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8e20084-ef24-4203-9fc4-1307e0eb1b96 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:37:17.058704 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: exception: Aggregate -1 could not be found. Sep 19 14:37:17.059961 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '-1'} Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:17.060710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 19 14:37:17.061788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.064415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8e20084-ef24-4203-9fc4-1307e0eb1b96 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:17.066555 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8e20084-ef24-4203-9fc4-1307e0eb1b96 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.048609 Sep 19 14:37:17.067585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 53/88] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:37:17.073871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b592c865-b0b3-4434-83e4-e6e1595266eb tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1376495054", "id": 842511443, "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:17.106919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b592c865-b0b3-4434-83e4-e6e1595266eb tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.037076 Sep 19 14:37:17.108721 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 54/89] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:17 2022] POST /compute/v2.1/flavors => generated 411 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:17.113638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e48c912-70f4-419d-9fd1-0a8bec4425e9 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.115664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4e48c912-70f4-419d-9fd1-0a8bec4425e9 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'f21b78021bd5451f9b06c49095c01bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158aa1288b9c416bb768e640aaae5074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e48c912-70f4-419d-9fd1-0a8bec4425e9 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Request method failure captured: Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6UNPJ-S6IdDX7s3_cNCP-7QD-TDzGYgKsZ5c7Tb9Db3PCFliEfIjozPsbSuYDYQLGygWvnvd8u2NvQQDUazVSUYGgCc6695-ikE-3ruPee4mexxoBmjT5eabc0GYZxRguDbH2XFRHY7Ykh2gnJ5lw4XKsZEXNGn8RfzN8105-Ogtc Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:17.118897 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_158aa1288b9c416bb768e640aaae5074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/158aa1288b9c416bb768e640aaae5074"}]}] Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f21b78021bd5451f9b06c49095c01bc8 Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 19 14:37:17.120088 n-d-858384-1 devstack@n-api.service[128730]: action_args: {} Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:37:17.120782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 19 14:37:17.122381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:17.125558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e48c912-70f4-419d-9fd1-0a8bec4425e9 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:17.127084 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4e48c912-70f4-419d-9fd1-0a8bec4425e9 tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016839 Sep 19 14:37:17.129222 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 55/90] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:17.139459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-084f565e-09bb-4471-86e3-da4b46748f41 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.178540 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-084f565e-09bb-4471-86e3-da4b46748f41 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.048008 Sep 19 14:37:17.182082 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 56/91] 10.222.0.81 () {58 vars in 1169 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:17.198620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6dd40d99-2297-4bc5-9c79-dd42c399b2bc tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.226292 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6dd40d99-2297-4bc5-9c79-dd42c399b2bc tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.035426 Sep 19 14:37:17.229927 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 57/92] 10.222.0.81 () {58 vars in 1177 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:17.253994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9be9670f-a521-4f43-abd8-2d4793a9c7f0 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.280041 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9be9670f-a521-4f43-abd8-2d4793a9c7f0 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.041119 Sep 19 14:37:17.285766 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 58/93] 10.222.0.81 () {58 vars in 1171 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:17.316322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c9cf36f-4389-4dd8-8fa7-d9d8837ee1ca tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.359369 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c9cf36f-4389-4dd8-8fa7-d9d8837ee1ca tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.061603 Sep 19 14:37:17.360026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 59/94] 10.222.0.81 () {58 vars in 1169 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:17.386391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.390241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:17.423920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:17.424447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:17.424916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:17.426242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:17.440847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:17.441480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:17.483093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:37:17.488675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:37:17.489509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:37:17.490258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:37:17.491858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:37:17.549938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:17.554959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:17.557139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:17.559466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:17.562973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:17.564697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:17.690057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Getting quotas for project 67ef09f168d94b27b71c60f11a4c3470. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:37:17.699451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Getting quotas for user 42a5f30f7b2f4d90ba19ed8e523f0ff8 and project 67ef09f168d94b27b71c60f11a4c3470. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:37:17.721939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:37:17.732724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:37:17.807097 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04f29416-0237-4aaf-b44c-77b6b3defea6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085277 Sep 19 14:37:17.808030 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 36/95] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:37:17.814458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9bd960e-166b-43da-852f-b1cda7ed5e7b tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.907833 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e9bd960e-166b-43da-852f-b1cda7ed5e7b tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.095336 Sep 19 14:37:17.935762 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 37/96] 10.222.0.81 () {58 vars in 1169 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:17.945981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a33b4d6f-6fab-4e5b-b404-ae8726b51e2f tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:17.952845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a33b4d6f-6fab-4e5b-b404-ae8726b51e2f tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:17.981724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:18.006710 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38b9b0b7-e9be-4e32-a614-32d48be65ad8 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.641418 Sep 19 14:37:18.030272 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 60/97] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.047132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4386bbd7-1a92-4dab-ad57-16d704b2e335 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.135777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4386bbd7-1a92-4dab-ad57-16d704b2e335 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.103458 Sep 19 14:37:18.145871 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 61/98] 10.222.0.81 () {58 vars in 1175 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.169929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eb857a7b-9cd8-455c-b855-97f632ad2ffe tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.170943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a33b4d6f-6fab-4e5b-b404-ae8726b51e2f tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:18.182331 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a33b4d6f-6fab-4e5b-b404-ae8726b51e2f tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1242 microversion: 2.1 time: 0.250664 Sep 19 14:37:18.190368 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 38/99] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:17 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1242 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.208921 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eb857a7b-9cd8-455c-b855-97f632ad2ffe tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.044031 Sep 19 14:37:18.210043 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 62/100] 10.222.0.81 () {58 vars in 1173 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.234805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-262522e4-d1f9-4571-a150-af65c6277a0b tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.308060 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-262522e4-d1f9-4571-a150-af65c6277a0b tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.079804 Sep 19 14:37:18.334818 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 39/101] 10.222.0.81 () {58 vars in 1169 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.338320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f0b1a068-df14-4526-8720-28df5040508c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.375407 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f0b1a068-df14-4526-8720-28df5040508c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/842511443" status: 202 len: 0 microversion: 2.1 time: 0.041179 Sep 19 14:37:18.376606 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 63/102] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:37:18 2022] DELETE /compute/v2.1/flavors/842511443 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:18.385481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f1b6f32-31fd-4d2b-9161-a94142c553cf tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.413999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f1b6f32-31fd-4d2b-9161-a94142c553cf tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032321 Sep 19 14:37:18.446673 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 40/103] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.452226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a338e97-d2a6-474d-a2c7-4824a9dbc21d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.500556 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a338e97-d2a6-474d-a2c7-4824a9dbc21d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1630584903" status: 202 len: 0 microversion: 2.1 time: 0.055861 Sep 19 14:37:18.501164 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 64/104] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:37:18 2022] DELETE /compute/v2.1/flavors/1630584903 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:18.509516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5297eeef-2126-4e01-9b43-db3785fafb1d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.554795 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5297eeef-2126-4e01-9b43-db3785fafb1d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041569 Sep 19 14:37:18.557980 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 41/105] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.583204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-230d3d07-b88c-4f4a-97a6-a4a56e4c915d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-800971161", "id": 1591599824, "os-flavor-access:is_public": "False"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:18.622291 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-230d3d07-b88c-4f4a-97a6-a4a56e4c915d tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.043095 Sep 19 14:37:18.628364 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 65/106] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:18.635447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-22da86c6-17b9-4dcb-8ab3-9efc87a6d22c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.682172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-22da86c6-17b9-4dcb-8ab3-9efc87a6d22c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050458 Sep 19 14:37:18.683477 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 42/107] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:18.704613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb92bb96-8d8d-4c76-aacc-782547504152 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.743528 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb92bb96-8d8d-4c76-aacc-782547504152 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045902 Sep 19 14:37:18.744442 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 66/108] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.772864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03bbed5e-f71d-4c2f-a7b8-9eae9c7ca32c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.839495 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03bbed5e-f71d-4c2f-a7b8-9eae9c7ca32c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1591599824" status: 202 len: 0 microversion: 2.1 time: 0.078770 Sep 19 14:37:18.844279 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 43/109] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:37:18 2022] DELETE /compute/v2.1/flavors/1591599824 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:18.852753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d9f357b-4351-41e1-b3ca-2e99ed2ca767 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:18.899979 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d9f357b-4351-41e1-b3ca-2e99ed2ca767 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050939 Sep 19 14:37:18.905746 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 67/110] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:18.943264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59346e9a-c477-400f-9dfd-fdb6c03c16d8 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-54061134", "id": 177963883, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:19.004542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59346e9a-c477-400f-9dfd-fdb6c03c16d8 tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.079151 Sep 19 14:37:19.008951 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 44/111] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:19.026649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65aa91c9-863f-4643-a44b-b5900657b473 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:19.045833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:19.077819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:19.103993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:19.108156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:19.109574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:19.112860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:19.115855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:19.119729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:19.127893 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-65aa91c9-863f-4643-a44b-b5900657b473 tempest-FlavorsAdminTestJSON-2034810562 tempest-FlavorsAdminTestJSON-2034810562-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.107857 Sep 19 14:37:19.129348 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 68/112] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:19 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:19.148350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ce7b23c5-d684-4e71-9fce-95708fd3898c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:19.188193 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ce7b23c5-d684-4e71-9fce-95708fd3898c tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/177963883" status: 202 len: 0 microversion: 2.1 time: 0.044184 Sep 19 14:37:19.196488 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 69/113] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:37:19 2022] DELETE /compute/v2.1/flavors/177963883 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:37:19.211526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14b16242-e2b1-4d11-82ce-ac40cac5075e tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:19.285443 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14b16242-e2b1-4d11-82ce-ac40cac5075e tempest-FlavorsAdminTestJSON-748320439 tempest-FlavorsAdminTestJSON-748320439-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087316 Sep 19 14:37:19.290543 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 70/114] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:19.310120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1112ce1-4d23-4f3b-80e4-cc42eb471b9d tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:19.316810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1112ce1-4d23-4f3b-80e4-cc42eb471b9d tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:19.495170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e1112ce1-4d23-4f3b-80e4-cc42eb471b9d tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:19.537470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1112ce1-4d23-4f3b-80e4-cc42eb471b9d tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1242 microversion: 2.1 time: 0.245178 Sep 19 14:37:19.541284 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 71/115] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:19 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:19.637592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:19.665608 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-35845e63-12c7-48da-9ad8-74209bcb5ad2 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.628275 Sep 19 14:37:19.667622 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 45/116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:19 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:20.578217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:20.578966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:20.585921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:20.591444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:20.592312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:20.593118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:20.593693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:20.594532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:20.696957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:20.709936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:20.725047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:20.744973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:20.745342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6c00d6f-33b7-4a69-ab41-b9eb93367afa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1290 microversion: 2.1 time: 0.171246 Sep 19 14:37:20.748724 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 72/117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:20 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1290 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:20.753561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:20.754520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:20.757808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:20.758787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:20.763744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:21.109248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:21.120904 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c7a7862f-87a0-47ef-b323-1bba9b2afac9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.432537 Sep 19 14:37:21.123073 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 46/118] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:20 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:21.771996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:21.773033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:21.790687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:21.792326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:21.792901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:21.794072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:21.794620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:21.800091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:21.947576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:21.968766 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d6d05fb-bf67-4757-8f83-944a54b0e4af tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1296 microversion: 2.1 time: 0.201020 Sep 19 14:37:21.979835 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 47/119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:21 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1296 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:22.115890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c31f7d67-a73a-4543-98ce-9edbf0fd020a", "tag": "d2041ae6-0614-4ec7-99f8-59b39b11692d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:22.151756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:22.152927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:22.153712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:22.154264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:22.154563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:22.171205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:22.172279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:22.173156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:22.175205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:22.176859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:22.177976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:22.241604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Creating event network-changed:d2041ae6-0614-4ec7-99f8-59b39b11692d for instance c31f7d67-a73a-4543-98ce-9edbf0fd020a on n-h1-858384-1 Sep 19 14:37:22.243130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:37:22.248242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14430531-67bc-4ecf-9557-471d96587055 req-3cb1a566-681c-44e2-a35d-5747fe29e1fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:37:22.249872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:22.250639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:22.251370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:22.252975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:22.255890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:22.256591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:22.272912 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.compute.rpcapi [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 14:37:22.274299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] Releasing lock "compute-rpcapi-router" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:37:22.319963 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-930afcce-c8b9-4351-bf8b-fb337b6888af None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.597623 Sep 19 14:37:22.322591 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 73/120] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:22.691051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:22.703521 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31e0ea7c-a497-4043-897d-696b6e8cf458 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.557867 Sep 19 14:37:22.704985 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 48/121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:22 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:23.016590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:23.019665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:23.056137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:23.056652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:23.057684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:23.060054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:23.064865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:23.066079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:23.730584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:23.733416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:23.783087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:23.792608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:23.796870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:23.802447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:23.804250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:23.811288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:23.812812 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e4d42dea-e115-429b-bd1d-ae8d5a8af0fa tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1296 microversion: 2.1 time: 0.806878 Sep 19 14:37:23.815482 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 74/122] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:23 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1296 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:23.827631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:23.837981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.687929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2aa56e50>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:24.698931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=128730) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 19 14:37:24.701876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.703369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.704228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.739071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:24.749341 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e2fc99c-dae2-4ca4-9729-976c66dc4556 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 1.023437 Sep 19 14:37:24.750170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.750674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.751364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.754788 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 49/123] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:23 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:24.812529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.813036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.813488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.837473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:24.838093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:24.842072 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1279eec8-70d2-40eb-9a9c-9ca49ebde117 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.847489 Sep 19 14:37:24.848618 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 75/124] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:37:24.866639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.867187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.867636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.868352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.869252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2aafee50>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:24.871863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.877003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.877678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.881177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.881694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:24.918663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:24.919618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:24.956533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.000677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.001179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.001621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.034610 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f164c0d-b837-410c-90a3-10dfbd37e3d0 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.173871 Sep 19 14:37:25.054810 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 76/125] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 14:37:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:25.062322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:25.069077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2ab214c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.073247 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c93d786-10fa-47a1-bc14-6d45576f8cca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1296 microversion: 2.1 time: 0.239424 Sep 19 14:37:25.081643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.083042 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 50/126] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:24 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1296 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:25.083972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.086358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.143595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:25.162196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.166809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.169461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.212013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.213939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.215689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.235599 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-57009683-08b6-4d33-ab94-3b486c9022bc tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.175558 Sep 19 14:37:25.237701 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 77/127] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:25.248757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2aca9940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.250955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.251509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.252189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.294572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.295541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.298777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.317020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3397d0b-6fc4-448a-8fea-05f8e5b3625b tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.073014 Sep 19 14:37:25.335768 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 51/128] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:25.345070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8ec18ab-795c-4a4c-a06f-8d949e94f004 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2aa80f70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.349633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ec18ab-795c-4a4c-a06f-8d949e94f004 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.351351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ec18ab-795c-4a4c-a06f-8d949e94f004 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.355016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ec18ab-795c-4a4c-a06f-8d949e94f004 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.448405 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8ec18ab-795c-4a4c-a06f-8d949e94f004 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.110802 Sep 19 14:37:25.452807 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 78/129] 10.222.0.81 () {58 vars in 1179 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:25.468259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2ac7fa60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.470511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.471326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.472063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.505355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.512778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.513474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.538934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.539908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.543795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.566047 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ddeddf67-5f6c-4194-af81-98c4c6deba36 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102666 Sep 19 14:37:25.573806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 52/130] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:25.580822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2aa710d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.584027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.587376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.589493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.674574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.675129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.675606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.690566 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f84fcab3-4d71-472c-a674-74f8ff5ca089 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.114774 Sep 19 14:37:25.700956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 79/131] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:25.711725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2ac00ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.714152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.715531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.716191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.730191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.731789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.732481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.739728 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1b8f3282-aa3f-4182-8237-62e227556cb7 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.036977 Sep 19 14:37:25.751519 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 53/132] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:25.759737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Calling method '.version_select at 0x7fde2a9efee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.769171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.769969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.770541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.789179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:25.790540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:25.804498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.806186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.807247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.809043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.809786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.810945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.836265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.837013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.837300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.886111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:25.887240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:25.887890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:25.976068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4ae4304-4a6a-4ab0-a4f1-3fb7d9d67155 tempest-HypervisorAdminTestJSON-1650347297 tempest-HypervisorAdminTestJSON-1650347297-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.222128 Sep 19 14:37:25.978803 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 80/133] 10.222.0.81 () {58 vars in 1173 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:26.117287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:26.120053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:26.172443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:26.173283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:26.176717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:26.178663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:26.182183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:26.184811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:26.861702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:26.875528 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-830233d7-5740-47e5-92cc-3c9c7bcddfc7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 1.099483 Sep 19 14:37:26.895610 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 54/134] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:25 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:27.807934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:27.835246 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f1dcb5e-544a-437c-bd96-5e90286992ed tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 1.723589 Sep 19 14:37:27.851242 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 81/135] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:26 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:27.910662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:27.912100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:27.936123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:27.971255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:27.976153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:27.977712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:27.979115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:27.983420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:27.986329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:28.178238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:28.894517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:28.896346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:28.910271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:28.911062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:28.911650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:28.914788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:28.915841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:28.917824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:29.538091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:30.046616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:30.067774 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3c66f93-df70-404f-a97f-38ac798d4720 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 2.170935 Sep 19 14:37:30.075148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 55/136] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:27 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:30.700724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2ac7fd30>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:30.705223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:30.710103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:30.710807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:30.718460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:30.731663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:30.732410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:30.794261 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56af6ac7-4572-41c3-aa82-316422d870be tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.717655 Sep 19 14:37:30.795514 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 56/137] 10.222.0.81 () {58 vars in 1128 bytes} [Mon Sep 19 14:37:30 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:30.817258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2ac7f940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:30.836217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:30.836999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:30.837606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:30.838507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:30.842003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:30.842697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:30.962493 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d5dd517f-4043-4d98-9738-2b37c5013a45 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.155767 Sep 19 14:37:30.978801 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 57/138] 10.222.0.81 () {58 vars in 1139 bytes} [Mon Sep 19 14:37:30 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:37:31.021752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2ac7fe50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:31.061370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:31.062123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:31.062297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:31.068687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:31.076863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:31.083976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:31.142103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:31.162635 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-803f866e-17e1-4d26-910f-eb870952a2db tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 2.288846 Sep 19 14:37:31.172181 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 82/139] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:28 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:31.187364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:31.191618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:31.198435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c24d0bfe-16fc-47ec-ae23-e28a7378e6eb tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.214049 Sep 19 14:37:31.200004 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 58/140] 10.222.0.81 () {58 vars in 1145 bytes} [Mon Sep 19 14:37:30 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:31.222344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:31.222666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:31.237436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:31.238463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:31.239795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:31.245294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:32.200373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:32.201849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:32.213037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:32.217019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:32.218436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:32.222261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:32.223402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:32.224462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:32.273140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:32.648989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:32.658709 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-69ef3fd5-1222-47c9-9189-8673c74b7d63 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 1.483087 Sep 19 14:37:32.686779 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 83/141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:31 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:32.853297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7852d045-fad6-4c2d-8af3-76e76fe6a4a8 req-1593f8f0-f358-4104-a476-8cecac33d982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d7e855-eebb-4a5f-b467-9e31e5fecf2f", "tag": "84678dd8-e87d-4e5a-be9e-abd7319edaf5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:32.887444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7852d045-fad6-4c2d-8af3-76e76fe6a4a8 req-1593f8f0-f358-4104-a476-8cecac33d982 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:32.888454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7852d045-fad6-4c2d-8af3-76e76fe6a4a8 req-1593f8f0-f358-4104-a476-8cecac33d982 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:32.889570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7852d045-fad6-4c2d-8af3-76e76fe6a4a8 req-1593f8f0-f358-4104-a476-8cecac33d982 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:32.931435 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7852d045-fad6-4c2d-8af3-76e76fe6a4a8 req-1593f8f0-f358-4104-a476-8cecac33d982 service nova] Creating event network-changed:84678dd8-e87d-4e5a-be9e-abd7319edaf5 for instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f on n-h2-858384-1 Sep 19 14:37:32.952356 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7852d045-fad6-4c2d-8af3-76e76fe6a4a8 req-1593f8f0-f358-4104-a476-8cecac33d982 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278794 Sep 19 14:37:32.952999 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 84/142] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:33.066356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:33.080693 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-463686c9-ddac-444f-aa83-d6d7f4e911ec tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 0.884766 Sep 19 14:37:33.086561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 59/143] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:32 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:33.702797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:33.704180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:33.726063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:33.726860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:33.727445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:33.732593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:33.733582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:33.734176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:33.814452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:34.122247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:34.123646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:34.137198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:34.140177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:34.141928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:34.145074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:34.147213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:34.151114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:34.176869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:35.360904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:35.379745 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a818c4e-aefe-4fa0-92d3-aa30661f7477 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 1.263818 Sep 19 14:37:35.380628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 60/144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:34 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:36.233559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:36.249894 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c243014-f75a-45d3-8f62-8368010b81ec tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 2.552052 Sep 19 14:37:36.253177 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 85/145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:33 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:36.410718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:36.411652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:36.431171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.431911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.433183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.436488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.437193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.439043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.536015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Calling method '.version_select at 0x7fde2adc85e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:36.543731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.544822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.548874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.584027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.584959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.585799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.601373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.602122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.603706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.617021 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2093c74d-58f3-47d7-934c-156d989e96c0 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.398498 Sep 19 14:37:36.623548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 61/146] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:36.637496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Calling method '.version_select at 0x7fde2adc8dc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:36.641969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.642486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.644910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.696383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.696912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.697362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.794836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.795548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.796064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.816927 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ce5acf1-a4c8-40e2-979c-f0aaa4a07eac tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/n-h2-858384-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.190683 Sep 19 14:37:36.819552 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 62/147] 10.222.0.81 () {58 vars in 1212 bytes} [Mon Sep 19 14:37:36 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-1/servers => generated 196 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:36.832920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Calling method '.version_select at 0x7fde2abd7ca0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:36.834999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.841053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.842500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.881536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.882332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.882826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.916387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.917286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.918536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.933082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2ea7bf3-adf6-4df9-917f-0a3269cd446d tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.103163 Sep 19 14:37:36.940014 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 63/148] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:37:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:36.954098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Calling method '.version_select at 0x7fde2ac00a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:36.956013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.956508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.956950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:36.994425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:36.995049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:36.995481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:37.018591 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b14b6fd7-6020-4e4b-bfc2-4b7652a2c399 tempest-HypervisorAdminUnderV252Test-524856869 tempest-HypervisorAdminUnderV252Test-524856869-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/n-h2-858384-1/search" status: 200 len: 104 microversion: 2.1 time: 0.070418 Sep 19 14:37:37.023197 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 64/149] 10.222.0.81 () {58 vars in 1209 bytes} [Mon Sep 19 14:37:36 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-1/search => generated 104 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:37.287429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:37.288978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:37.315270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:37.327507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:37.329367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:37.330519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:37.332468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:37.335543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:37.660871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:37.673412 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0bf024c9-9384-4b86-a5d8-145effc64892 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 1.265056 Sep 19 14:37:37.676050 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 86/150] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:36 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:38.257573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:38.275705 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-647b1ce2-0405-4b1a-8557-853ff59791ba tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 1.003484 Sep 19 14:37:38.276310 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 65/151] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:37 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:38.706021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:38.707495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:38.717494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:38.723725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:38.724971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:38.732357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:38.736721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:38.737507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:39.300481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:39.301098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:39.313430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:39.313934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:39.314374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:39.315109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:39.322967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:39.323579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:39.460288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:39.476333 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8b30c3d-2dee-4893-8ba2-07517f8c66a8 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 0.774355 Sep 19 14:37:39.480828 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 87/152] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:38 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:39.630920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:39.639476 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7193fe14-85c2-42f2-aac8-380163a23f10 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.342921 Sep 19 14:37:39.644806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 66/153] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:39 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:40.512749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:40.515152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:40.526225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:40.529718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:40.530070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:40.531015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:40.532969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:40.533485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:40.670443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:40.671116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:40.680044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:40.680630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:40.681063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:40.681830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:40.682299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:40.688282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:41.006730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:41.018107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6138b425-bff8-4bc0-a6cb-da85f4b11fdd tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 0.517509 Sep 19 14:37:41.044837 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 88/154] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:40 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:41.091933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:41.104668 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f936bfa-516b-475e-afa8-513cd9276db7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.438977 Sep 19 14:37:41.107579 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 67/155] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:40 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:42.049692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:42.051055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:42.060644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:42.067516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:42.068203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:42.069145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:42.072102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:42.073251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:42.133008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:42.134243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:42.137268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:42.153316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:42.158133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:42.166901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:42.168111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:42.168847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:42.169536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:42.573007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:42.588372 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0523624e-3bb5-4fbd-a320-e9c253de0425 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 0.538325 Sep 19 14:37:42.589237 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 89/156] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:42 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:42.647736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:42.661350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f8ae496f-e0a8-4296-9fb1-482da9e830f5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.531477 Sep 19 14:37:42.662271 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 68/157] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:42 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:43.590709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Calling method '.version_select at 0x7fde2a9ba790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:43.592602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.593237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.593681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:43.615894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:43.616523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:43.632163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.632700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.633149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:43.633882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.634337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.634790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:43.647988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.648495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.648937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:43.670583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.671109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.671547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:43.685417 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-770f94fd-26aa-45a2-a39f-39898b388bd5 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.340193 Sep 19 14:37:43.705778 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 90/158] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:37:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:37:43.710627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:43.711289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:43.717946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.718445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.718920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:43.719703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:43.720167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:43.720585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:44.147727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:44.166239 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb61c985-b5a6-490c-a1df-ef29842b1291 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.459264 Sep 19 14:37:44.168228 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 91/159] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:43 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:44.176695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Calling method '.version_select at 0x7fde2a949b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:44.179050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:44.185144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:44.186033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:44.225476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:44.226156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:44.226697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:44.244575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9236b574-c8cc-4a66-8825-0c7381887d91 tempest-HypervisorAdminV228Test-1620137842 tempest-HypervisorAdminV228Test-1620137842-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.075089 Sep 19 14:37:44.246824 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 92/160] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:37:44 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:37:44.352000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7380e84c-65a2-4d0a-82ff-a61b4e6f0fdc req-9a889e5b-9ebd-40b1-8577-e9c221b149f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d7e855-eebb-4a5f-b467-9e31e5fecf2f", "name": "network-vif-plugged", "status": "completed", "tag": "84678dd8-e87d-4e5a-be9e-abd7319edaf5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:44.385696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:44.386033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7380e84c-65a2-4d0a-82ff-a61b4e6f0fdc req-9a889e5b-9ebd-40b1-8577-e9c221b149f6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:44.389772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7380e84c-65a2-4d0a-82ff-a61b4e6f0fdc req-9a889e5b-9ebd-40b1-8577-e9c221b149f6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:44.391075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7380e84c-65a2-4d0a-82ff-a61b4e6f0fdc req-9a889e5b-9ebd-40b1-8577-e9c221b149f6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:44.403148 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09a9cdf3-ba4c-4105-8b12-bbde5f224bee tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 0.790905 Sep 19 14:37:44.423166 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 69/161] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:43 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:44.444934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7380e84c-65a2-4d0a-82ff-a61b4e6f0fdc req-9a889e5b-9ebd-40b1-8577-e9c221b149f6 service nova] Creating event network-vif-plugged:84678dd8-e87d-4e5a-be9e-abd7319edaf5 for instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f on n-h2-858384-1 Sep 19 14:37:44.452734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7380e84c-65a2-4d0a-82ff-a61b4e6f0fdc req-9a889e5b-9ebd-40b1-8577-e9c221b149f6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204331 Sep 19 14:37:44.453699 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 93/162] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:45.192232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:45.194107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:45.208300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:45.209201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:45.209801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:45.211507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:45.212546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:45.215135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:45.432147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:45.433991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:45.450388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:45.451148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:45.451766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:45.452658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:45.453276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:45.453854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:46.084902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:46.098319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e6e0a31-576c-4761-90ac-53a226a281a5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.911083 Sep 19 14:37:46.117710 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 70/163] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:45 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:46.245111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:46.255624 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c6afb996-d6aa-4351-9a96-077bcdd96b17 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1338 microversion: 2.1 time: 0.828452 Sep 19 14:37:46.260352 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 94/164] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:45 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1338 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:47.125755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:47.126379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:47.165797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:47.167068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:47.168806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:47.169724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:47.175637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:47.177675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:47.196531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1118129480", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "eb86d89b-8fd6-474f-a09d-aade8cfee6cf"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:47.336390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] validate_networks() for [('eb86d89b-8fd6-474f-a09d-aade8cfee6cf', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:37:48.063460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:48.073293 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5ffbb7a-a55e-45da-b1ea-7a1257a18789 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.952523 Sep 19 14:37:48.078448 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 95/165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:47 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:48.083418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:48.084969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:48.098741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:48.099868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:48.100598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:48.101746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:48.102738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:48.103589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:48.604638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:48.615316 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-571d1a87-d8ce-4d41-bd09-75e5c57e2e60 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1488 microversion: 2.1 time: 0.535510 Sep 19 14:37:48.615912 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 96/166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:48 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1488 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:48.646460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:48.648168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:48.671672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:48.672759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:48.674286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:48.675922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:48.678258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:48.681809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:49.483620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:37:49.485096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:37:49.485816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:37:49.486586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:37:49.487262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:37:49.509239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:49.511504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:49.514191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:49.517244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:49.518029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:49.519628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:49.569320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:37:49.578708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for user a989536b40ed41ddaa1554bf40378758 and project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:37:49.617610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:37:49.620899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:37:49.773725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2603ccc-1df9-49f7-849d-29e65d297a8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.045114 Sep 19 14:37:49.788406 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 71/167] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:37:49.823537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:49.825457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:49.836499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:49.844794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:49.848252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:49.849969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:49.850470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:49.851807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:50.268141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:50.276492 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5e1ae0c-c675-4684-a590-481d3bc8a4e3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.483642 Sep 19 14:37:50.277454 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 72/168] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:49 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:50.293998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d03fc30-f115-445b-b477-f8d3c424e6d9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:50.293998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d03fc30-f115-445b-b477-f8d3c424e6d9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:50.514465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d03fc30-f115-445b-b477-f8d3c424e6d9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:50.531892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d03fc30-f115-445b-b477-f8d3c424e6d9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1211 microversion: 2.1 time: 0.241639 Sep 19 14:37:50.547324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 73/169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:50 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1211 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:50.553275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31f7d67-a73a-4543-98ce-9edbf0fd020a", "name": "network-vif-plugged", "status": "completed", "tag": "d2041ae6-0614-4ec7-99f8-59b39b11692d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:50.556931 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-efa301f0-56e7-4c61-a8d8-0cf172e593a0 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1639 microversion: 2.1 time: 1.913160 Sep 19 14:37:50.560488 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 97/170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:48 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1639 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:50.599437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:50.602369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:50.604654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:50.607934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:50.610194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:50.635357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:50.639352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:50.643201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:50.644531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:50.645228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:50.647095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:50.673318 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Creating event network-vif-plugged:d2041ae6-0614-4ec7-99f8-59b39b11692d for instance c31f7d67-a73a-4543-98ce-9edbf0fd020a on n-h1-858384-1 Sep 19 14:37:50.673882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:37:50.674277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ac558bdb-8c16-41a6-9b71-441ae066e088 req-da362416-a23f-485b-8aa3-fb2f83a82e6b service nova] Acquired lock "compute-rpcapi-router" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:37:50.675383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:50.675844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:50.676281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:50.677005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:50.677459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:50.691756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:50.730472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.rpcapi [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 14:37:50.731554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] Releasing lock "compute-rpcapi-router" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:37:50.753380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:37:50.778033 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f36b19e-f5d8-4c21-b442-2e197be82be2 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229356 Sep 19 14:37:50.779013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 74/171] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:51.076126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-17807731", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:51.183579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:37:51.343156 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c5882d5-ff7a-463a-8629-2660992983dc tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 204 len: 0 microversion: 2.1 time: 0.758980 Sep 19 14:37:51.347301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 98/172] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:37:50 2022] DELETE /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 0 bytes in 764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:37:51.363201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:51.364929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:51.389332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.390981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.392322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.394795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.397295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.400602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.746486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:37:51.748156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:37:51.748694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:37:51.749372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:37:51.749654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:51.750062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:37:51.757572 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eef23c78-24ae-40d5-9470-8511e4fa617e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.406792 Sep 19 14:37:51.758168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 99/173] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:51 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:51.760850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.765884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.766520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:51.766644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.766986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:51.768034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.769107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.769501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.780207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.781059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.787894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.790142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.790485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.795475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.800046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Getting quotas for project 4fd2d5f8c1714de28793c3771dd456be. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:37:51.807535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Getting quotas for user ae9bb35019914295aaca2034121e3dcd and project 4fd2d5f8c1714de28793c3771dd456be. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:37:51.834178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:37:51.837982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:37:51.918453 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca54a4e1-b31b-4913-80c8-22399a25799e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116117 Sep 19 14:37:51.919552 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 75/174] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:37:51.931743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:51.932978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:51.954269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.954780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.955246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:51.956592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:51.957127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:51.957584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:52.060644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:52.074644 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df8284a9-2ee9-4ca3-b432-a94e95c565d8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1285 microversion: 2.1 time: 0.146515 Sep 19 14:37:52.076476 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 76/175] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:51 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:52.081792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64b1126a-a010-4117-83b8-a11e9d92e2aa tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:52.082400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-64b1126a-a010-4117-83b8-a11e9d92e2aa tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:52.087947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:52.177151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-64b1126a-a010-4117-83b8-a11e9d92e2aa tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:52.188535 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64b1126a-a010-4117-83b8-a11e9d92e2aa tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1217 microversion: 2.1 time: 0.110688 Sep 19 14:37:52.189264 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 77/176] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:52 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:52.227639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:52.237656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-718663b3-7473-44f1-9557-34fb2238eeca tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1494 microversion: 2.1 time: 0.478410 Sep 19 14:37:52.238244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 100/177] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:51 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1494 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:52.649636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a316246-1021-4177-a797-d19a09af4e40 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:52.659868 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a316246-1021-4177-a797-d19a09af4e40 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.174685 Sep 19 14:37:52.660472 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 78/178] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:37:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:52.743131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56bf1b32-154c-46e0-9acb-32da89dedb7c tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-306563029", "id": 1927601974, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:52.763572 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56bf1b32-154c-46e0-9acb-32da89dedb7c tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.092264 Sep 19 14:37:52.772297 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 101/179] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:52 2022] POST /compute/v2.1/flavors => generated 424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:52.776360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-15575eb3-4ebc-4d55-a66d-3205d45cfed8 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:52.784788 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-15575eb3-4ebc-4d55-a66d-3205d45cfed8 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012355 Sep 19 14:37:52.786667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:52.787540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:52.790601 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 79/180] 10.222.0.81 () {58 vars in 1182 bytes} [Mon Sep 19 14:37:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 14:37:52.796550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f35aef61-5306-4b5b-b9f8-5e1b1004e74a tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1117816262", "id": 1122109653, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:52.797532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:52.798610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:52.799285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:52.813664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:52.815444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:52.817412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:52.848817 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f35aef61-5306-4b5b-b9f8-5e1b1004e74a tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.057053 Sep 19 14:37:52.859349 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 80/181] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:52 2022] POST /compute/v2.1/flavors => generated 425 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:52.869971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bec693dc-ef4b-4b1f-8b86-3fe38348e818 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:52.881184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bec693dc-ef4b-4b1f-8b86-3fe38348e818 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020613 Sep 19 14:37:52.882008 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 81/182] 10.222.0.81 () {58 vars in 1182 bytes} [Mon Sep 19 14:37:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:37:52.888404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:52.911116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-533854fb-36e9-4121-aee3-75672e3235d2 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Action: 'create', calling method: .version_select at 0x7fde2ab87550>, body: {"keypair": {"name": "tempest-keypair-1907518306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYtWAvC5hsb8kvJofo97l7E7Ct+sn9Jjf0OaczU7waEUfWbP0rj5udTFdlWVDLrAF5CYw5+kO2j1G6sEiG6LgjgHcx6l6xiGdlWj0h9axvzPuuVWRrNzsa7UP1pbsg5kw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:52.969292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-533854fb-36e9-4121-aee3-75672e3235d2 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Getting quotas for project 2ea30ac65a7f47cb8c41480e5b4a1e3f. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:37:52.974332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-533854fb-36e9-4121-aee3-75672e3235d2 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Getting quotas for user c20e5e13d7af46ad87d0c7bb66ec5a19 and project 2ea30ac65a7f47cb8c41480e5b4a1e3f. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:37:53.032498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-533854fb-36e9-4121-aee3-75672e3235d2 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129623 Sep 19 14:37:53.033276 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 82/183] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:37:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:53.106030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:53.107051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:53.122089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:53.123185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:53.125586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:53.126797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:53.127853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:53.131116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:53.269984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:53.279074 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4436bf19-022c-4a50-8e68-0b7f7b66a744 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1303 microversion: 2.1 time: 0.178128 Sep 19 14:37:53.294888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 83/184] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:53 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:53.294888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:53.295189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:53.305121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:53.310390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:53.314364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:53.315375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:53.315927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:53.316436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:53.568144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:53.578816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:53.582862 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-66295fa3-0963-4141-b781-f0c9c4d561f0 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1320 microversion: 2.1 time: 0.800606 Sep 19 14:37:53.584348 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 102/185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:52 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1320 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:53.594594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:53.595529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:53.602876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:53.603671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:53.604465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:53.607241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:53.607999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:53.608651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:53.610449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d0e6c8a-170c-4da5-bf37-4993792d5cf2 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1291 microversion: 2.1 time: 0.325086 Sep 19 14:37:53.624780 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 84/186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:53 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1291 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:54.311298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:54.311915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:54.322392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:54.326656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:54.327344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:54.329789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:54.330426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:54.335378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:54.374094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:54.581339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:54.598972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-50b829f3-0384-4939-83a4-3d8272c8acf6 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1494 microversion: 2.1 time: 1.009710 Sep 19 14:37:54.607208 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 103/187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:53 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1494 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:54.627030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:54.629152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:54.641936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:54.647176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:54.648179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:54.649284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:54.651630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:54.653997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.264912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:55.283413 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-643ef5f0-6121-4f5b-8ae2-2055f4f01c8a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1333 microversion: 2.1 time: 0.976222 Sep 19 14:37:55.284774 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 85/188] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:54 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1333 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:55.291523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:55.293693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:55.303731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.305844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.306704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.309146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.310469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.311370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.514369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:55.520750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:55.538836 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-866558a3-f5b1-4e5d-a6d7-fc6076955e3e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1297 microversion: 2.1 time: 0.250014 Sep 19 14:37:55.539905 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 86/189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:55 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:55.565157 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1bf8783b-bc01-424e-8157-4b51e97ea7e9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1469 microversion: 2.1 time: 0.952945 Sep 19 14:37:55.568456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0a38c3a8-4dce-48be-abd3-419a6c1e3b6d req-ac3e09cd-f680-45fd-b36a-d1efd3965fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36015b1d-9daa-4b76-bb72-48bb7a834641", "tag": "b7b08c8e-f338-40b2-9a9f-5815386907da"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:55.577481 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 104/190] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:54 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1469 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:55.584902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3d9aec71-2270-45f2-b8a8-698909425f86 req-86b0e19c-014d-4b01-ab36-c55870bb5734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d7e855-eebb-4a5f-b467-9e31e5fecf2f", "name": "network-vif-deleted", "tag": "84678dd8-e87d-4e5a-be9e-abd7319edaf5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:55.594714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:55.601879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3d9aec71-2270-45f2-b8a8-698909425f86 req-86b0e19c-014d-4b01-ab36-c55870bb5734 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.602133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a38c3a8-4dce-48be-abd3-419a6c1e3b6d req-ac3e09cd-f680-45fd-b36a-d1efd3965fef service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.604302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a38c3a8-4dce-48be-abd3-419a6c1e3b6d req-ac3e09cd-f680-45fd-b36a-d1efd3965fef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.605699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a38c3a8-4dce-48be-abd3-419a6c1e3b6d req-ac3e09cd-f680-45fd-b36a-d1efd3965fef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.613919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3d9aec71-2270-45f2-b8a8-698909425f86 req-86b0e19c-014d-4b01-ab36-c55870bb5734 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.615246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3d9aec71-2270-45f2-b8a8-698909425f86 req-86b0e19c-014d-4b01-ab36-c55870bb5734 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.628928 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0a38c3a8-4dce-48be-abd3-419a6c1e3b6d req-ac3e09cd-f680-45fd-b36a-d1efd3965fef service nova] Creating event network-changed:b7b08c8e-f338-40b2-9a9f-5815386907da for instance 36015b1d-9daa-4b76-bb72-48bb7a834641 on n-h2-858384-1 Sep 19 14:37:55.636187 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0a38c3a8-4dce-48be-abd3-419a6c1e3b6d req-ac3e09cd-f680-45fd-b36a-d1efd3965fef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093940 Sep 19 14:37:55.641815 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 87/191] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:55.674739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3d9aec71-2270-45f2-b8a8-698909425f86 req-86b0e19c-014d-4b01-ab36-c55870bb5734 service nova] Creating event network-vif-deleted:84678dd8-e87d-4e5a-be9e-abd7319edaf5 for instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f on n-h2-858384-1 Sep 19 14:37:55.688653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3d9aec71-2270-45f2-b8a8-698909425f86 req-86b0e19c-014d-4b01-ab36-c55870bb5734 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100979 Sep 19 14:37:55.689435 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 105/192] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:55.695969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:55.696866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:55.706212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.707106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.708305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.709209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.709835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.710408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.792434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:55.793636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:55.800686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.801176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.801825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.802530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:55.803024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:55.803614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:55.875240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:37:55.891670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a5f30f7b2f4d90ba19ed8e523f0ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ef09f168d94b27b71c60f11a4c3470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:55.907525 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0ea844cd-0458-4ba4-80ed-ea0d65d8da1b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 200 len: 1323 microversion: 2.1 time: 0.216567 Sep 19 14:37:55.922788 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 106/193] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:55 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:56.032057 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9eff6360-3cad-4e1c-90fa-0a92c45fa4a9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] 10.222.0.81 "DELETE /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 204 len: 0 microversion: 2.1 time: 0.388552 Sep 19 14:37:56.032694 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 88/194] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:37:55 2022] DELETE /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:37:56.042608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:56.043428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:56.050235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.051026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.051471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.052192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.052809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.053426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.314784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:56.315554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:56.333125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.333622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.338738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.340877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.341625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.344958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.490805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:56.512176 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6095e320-7956-42fc-a832-f57a83efc2f6 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1475 microversion: 2.1 time: 0.474366 Sep 19 14:37:56.516697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 107/195] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:56 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1475 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:56.565502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:56.566143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:56.576327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.578370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.580148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.581964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.583462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.585172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.751474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:56.766516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3df72412-5c40-4f5e-aea2-974439b01118 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1297 microversion: 2.1 time: 0.203700 Sep 19 14:37:56.769866 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 108/196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:56 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1297 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:56.937916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:56.938789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:56.948641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:56.963163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.963685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.964129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.964988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:56.965412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:56.965846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:56.973624 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c0b0f3e-3c43-4f14-8749-a3c65e68173f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1333 microversion: 2.1 time: 0.664226 Sep 19 14:37:56.986790 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 89/197] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:56 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1333 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:37:56.998186 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] HTTP exception thrown: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Request method failure captured: Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f HTTP/1.1 Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6U1PPYmpaJjX-SgUzCU18EEt_r28NrMsXbhpaZd-w1w-MwjNHj2b-Q8cRALI6jUKB9XWX6pwV763keTj5GdaCF7-eEvtUDXF16b6b6QzX1yxGsFAts-6DEGGi535YrNUmtTznlKLa0m0sJD8bcHKI_IDXTjKkuDIT8JvaMLeyBN2w Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 67ef09f168d94b27b71c60f11a4c3470 Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:57.007951 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67ef09f168d94b27b71c60f11a4c3470"}]}] Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 67ef09f168d94b27b71c60f11a4c3470 Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminTestJSON-733714972-project Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 42a5f30f7b2f4d90ba19ed8e523f0ff8 Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminTestJSON-733714972-project Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:37:57.009257 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c1d7e855-eebb-4a5f-b467-9e31e5fecf2f'} Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:57.009970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:37:57.011116 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:57.014277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Returning 404 to user: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:57.014277 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a0b98dc-1002-401e-ae2a-9aab12273776 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 404 len: 111 microversion: 2.1 time: 0.076306 Sep 19 14:37:57.014277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 109/198] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:56 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:57.022264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87b293da-97e9-40c2-885a-928cd2dca82f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:57.035716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b293da-97e9-40c2-885a-928cd2dca82f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:57.036222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b293da-97e9-40c2-885a-928cd2dca82f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:57.036819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b293da-97e9-40c2-885a-928cd2dca82f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:57.279703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-182418484", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "1122109653", "adminPass": "***", "networks": [{"uuid": "43492a9f-0461-4247-9e52-67b0bf35451a"}], "security_groups": [{"name": "tempest-securitygroup--2056380407"}], "key_name": "tempest-keypair-1907518306", "user_data": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:57.328398 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87b293da-97e9-40c2-885a-928cd2dca82f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.312774 Sep 19 14:37:57.329401 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 90/199] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:57.348807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3324d631-fcd9-4a21-9df7-ca7165e1cc00 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:57.394172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3324d631-fcd9-4a21-9df7-ca7165e1cc00 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.055966 Sep 19 14:37:57.395453 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 91/200] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:57.410493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcf8da48-134e-4589-941a-e11a0dbbfacd tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1278059870"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:57.422165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-dcf8da48-134e-4589-941a-e11a0dbbfacd tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid 223fdc40-ca05-4663-97d1-4ee5052d6bc6 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:57.465827 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcf8da48-134e-4589-941a-e11a0dbbfacd tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061931 Sep 19 14:37:57.467050 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 92/201] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:57.480315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8279ac60-2f0b-4359-a540-254037e412e9 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:57.496626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] validate_networks() for [('43492a9f-0461-4247-9e52-67b0bf35451a', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:37:57.498068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8279ac60-2f0b-4359-a540-254037e412e9 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:57.498630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8279ac60-2f0b-4359-a540-254037e412e9 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:57.499176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8279ac60-2f0b-4359-a540-254037e412e9 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:57.657828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8279ac60-2f0b-4359-a540-254037e412e9 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.182470 Sep 19 14:37:57.658615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 93/202] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:57 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:57.663414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:57.664031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:57.672472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:57.672967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:57.673399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:57.674109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:57.674559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:57.675010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:58.028499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:58.043308 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2600c149-067c-4f77-985e-46e866b1c8ad tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 200 len: 1475 microversion: 2.1 time: 0.378613 Sep 19 14:37:58.044524 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 94/203] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:57 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:58.052780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7770d284-7e4a-4903-8e8e-da59cfb5f787 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:58.070258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7770d284-7e4a-4903-8e8e-da59cfb5f787 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.022999 Sep 19 14:37:58.078813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 95/204] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:37:58 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:58.085744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:58.086613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:58.098267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:58.099525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:58.103572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:58.104372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:58.106915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:58.109254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:58.860539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:58.873157 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2eb758f5-86de-459f-a91b-a626a4c17e11 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1317 microversion: 2.1 time: 0.799437 Sep 19 14:37:58.874992 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 96/205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:58 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:58.880463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:58.881338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:58.895695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:58.896480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:58.897077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:58.898365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:58.899023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:58.899652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.184786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:37:59.185513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:37:59.186122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:37:59.186631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:37:59.187214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:37:59.196940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.197573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.198234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.199669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.200359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.200879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.223488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Getting quotas for project 2ea30ac65a7f47cb8c41480e5b4a1e3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:37:59.231608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Getting quotas for user c20e5e13d7af46ad87d0c7bb66ec5a19 and project 2ea30ac65a7f47cb8c41480e5b4a1e3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:37:59.254560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:37:59.257224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:37:59.285743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:59.296235 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5a228f2-6d98-4e04-bbe7-706a14ba1b0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1311 microversion: 2.1 time: 0.419759 Sep 19 14:37:59.297119 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 97/206] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:58 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1311 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:59.302008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd2b2b72-3cc3-4e30-b6e0-9a1f0ce1aa77 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:59.326017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd2b2b72-3cc3-4e30-b6e0-9a1f0ce1aa77 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.326666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd2b2b72-3cc3-4e30-b6e0-9a1f0ce1aa77 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.327143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd2b2b72-3cc3-4e30-b6e0-9a1f0ce1aa77 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.363367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac1100fe-f765-4fbc-8030-f1948858f4a5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.086728 Sep 19 14:37:59.368730 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 110/207] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:37:59.375747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-81e38f12-9949-424d-a5d0-04ae5813b193 req-a98c4ff1-dda7-4808-812b-d1c4d3857934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31f7d67-a73a-4543-98ce-9edbf0fd020a", "name": "network-vif-deleted", "tag": "d2041ae6-0614-4ec7-99f8-59b39b11692d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:59.394937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81e38f12-9949-424d-a5d0-04ae5813b193 req-a98c4ff1-dda7-4808-812b-d1c4d3857934 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.396627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81e38f12-9949-424d-a5d0-04ae5813b193 req-a98c4ff1-dda7-4808-812b-d1c4d3857934 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.397306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81e38f12-9949-424d-a5d0-04ae5813b193 req-a98c4ff1-dda7-4808-812b-d1c4d3857934 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.412744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-81e38f12-9949-424d-a5d0-04ae5813b193 req-a98c4ff1-dda7-4808-812b-d1c4d3857934 service nova] Creating event network-vif-deleted:d2041ae6-0614-4ec7-99f8-59b39b11692d for instance c31f7d67-a73a-4543-98ce-9edbf0fd020a on n-h1-858384-1 Sep 19 14:37:59.420238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-81e38f12-9949-424d-a5d0-04ae5813b193 req-a98c4ff1-dda7-4808-812b-d1c4d3857934 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049806 Sep 19 14:37:59.421918 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 111/208] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:59.428591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:59.429797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:59.438085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.439090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.439973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.441843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.443412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.445121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.465297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] HTTP exception thrown: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Request method failure captured: Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a HTTP/1.1 Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TKHd9I1Fp1E6SMOSI5e7Lbvf8DolUYdJwqsPMtjUOYRmjnDwHjxHEv8GKpm6JUOQOlgYTQIL3Wkid1yyIZahQmG3sD_sfjkwLkGpa8jvZiTOQZQLYb00jJYOCAg2g4okPC1uiFtTzBdjdz42HSKMGhWTq9l93ipGG5nPICACVnpI Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:37:59.467974 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e3e4615693f4560a776dc976ad302c1"}]}] Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: cd897005fef7483089f784339187e08f Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:37:59.469160 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c31f7d67-a73a-4543-98ce-9edbf0fd020a'} Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:37:59.469826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:37:59.470945 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:37:59.473609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Returning 404 to user: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:37:59.474684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd0e6922-4e99-4961-8a44-35c1e59a72c5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 404 len: 111 microversion: 2.1 time: 0.051411 Sep 19 14:37:59.475877 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 112/209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:59 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:37:59.487203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51724e0c-c9a8-43bf-a028-52c2914de5e5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:59.488329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51724e0c-c9a8-43bf-a028-52c2914de5e5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:37:59.625982 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd2b2b72-3cc3-4e30-b6e0-9a1f0ce1aa77 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.327810 Sep 19 14:37:59.626601 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 98/210] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:59 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:59.647572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8d3db4cd-0655-417f-8458-b0da3bb3d46f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:37:59.711086 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8d3db4cd-0655-417f-8458-b0da3bb3d46f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.075510 Sep 19 14:37:59.712242 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 99/211] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:37:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:37:59.725236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-51724e0c-c9a8-43bf-a028-52c2914de5e5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:37:59.727672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f881da6b-d148-47a7-bc64-fc724f3a1d4f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1068984530"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:59.731239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-f881da6b-d148-47a7-bc64-fc724f3a1d4f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid 046bddfc-cf43-4d43-a656-4e3c5fd31663 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:37:59.734772 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51724e0c-c9a8-43bf-a028-52c2914de5e5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1264 microversion: 2.1 time: 0.257672 Sep 19 14:37:59.772045 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 113/212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:37:59 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:37:59.778625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1288127309", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:59.780900 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f881da6b-d148-47a7-bc64-fc724f3a1d4f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061523 Sep 19 14:37:59.783900 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 100/213] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:37:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:37:59.800844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2aee2c65-a074-4879-9a47-dfdf334e2993 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:37:59.809076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:37:59.815200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2aee2c65-a074-4879-9a47-dfdf334e2993 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:37:59.816648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2aee2c65-a074-4879-9a47-dfdf334e2993 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:37:59.817303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2aee2c65-a074-4879-9a47-dfdf334e2993 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:37:59.919321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:38:00.087174 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2aee2c65-a074-4879-9a47-dfdf334e2993 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.292020 Sep 19 14:38:00.097003 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 101/214] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:37:59 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:00.103433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:00.104194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:00.133619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.135043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.135497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.136219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.137364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.137990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.542691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:00.553111 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8ea90b5-c4ae-4c0f-9ada-e983bd6faf75 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1317 microversion: 2.1 time: 0.454680 Sep 19 14:38:00.554084 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 102/215] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:00 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:00.559465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-162ea3c9-838f-4227-bbfe-397983e2a51b req-28c778dd-0e10-4b23-b4bd-d824dc0f0f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6952ef11-b28e-44c5-8fe2-490862dbaf42", "tag": "21277d18-1b4b-4f3b-a543-777b8edd7fed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:00.571033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-162ea3c9-838f-4227-bbfe-397983e2a51b req-28c778dd-0e10-4b23-b4bd-d824dc0f0f14 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.571609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-162ea3c9-838f-4227-bbfe-397983e2a51b req-28c778dd-0e10-4b23-b4bd-d824dc0f0f14 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.572458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-162ea3c9-838f-4227-bbfe-397983e2a51b req-28c778dd-0e10-4b23-b4bd-d824dc0f0f14 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.585287 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-162ea3c9-838f-4227-bbfe-397983e2a51b req-28c778dd-0e10-4b23-b4bd-d824dc0f0f14 service nova] Creating event network-changed:21277d18-1b4b-4f3b-a543-777b8edd7fed for instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 on n-h2-858384-1 Sep 19 14:38:00.591636 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-162ea3c9-838f-4227-bbfe-397983e2a51b req-28c778dd-0e10-4b23-b4bd-d824dc0f0f14 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036118 Sep 19 14:38:00.593063 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 103/216] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:00.598876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e590f244-0947-43ff-86cb-0fe07948c336 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:00.611262 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e590f244-0947-43ff-86cb-0fe07948c336 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.016793 Sep 19 14:38:00.611855 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 104/217] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:38:00 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:00.612742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:00.613222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:00.613631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:00.614075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:00.614511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:00.624428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a9f19807-6660-4c8c-998c-4b74ab7753a3 req-f3da5855-aef8-426b-a496-a98d12eea9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36015b1d-9daa-4b76-bb72-48bb7a834641", "name": "network-vif-plugged", "status": "completed", "tag": "b7b08c8e-f338-40b2-9a9f-5815386907da"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:00.631447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.632277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.632715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.633469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.633918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.634339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.647743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a9f19807-6660-4c8c-998c-4b74ab7753a3 req-f3da5855-aef8-426b-a496-a98d12eea9fd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.648225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a9f19807-6660-4c8c-998c-4b74ab7753a3 req-f3da5855-aef8-426b-a496-a98d12eea9fd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.648649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a9f19807-6660-4c8c-998c-4b74ab7753a3 req-f3da5855-aef8-426b-a496-a98d12eea9fd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.665568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Getting quotas for project 1e3e4615693f4560a776dc976ad302c1. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:00.673605 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a9f19807-6660-4c8c-998c-4b74ab7753a3 req-f3da5855-aef8-426b-a496-a98d12eea9fd service nova] Creating event network-vif-plugged:b7b08c8e-f338-40b2-9a9f-5815386907da for instance 36015b1d-9daa-4b76-bb72-48bb7a834641 on n-h2-858384-1 Sep 19 14:38:00.673851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Getting quotas for user cd897005fef7483089f784339187e08f and project 1e3e4615693f4560a776dc976ad302c1. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:00.680326 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a9f19807-6660-4c8c-998c-4b74ab7753a3 req-f3da5855-aef8-426b-a496-a98d12eea9fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064152 Sep 19 14:38:00.690350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:00.693902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:00.699641 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 105/218] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:00.709074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:00.710664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:00.725639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.726544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.727210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.728086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.728770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.729204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:00.783796 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3d88fb6-5f01-4ec0-8491-25b61a7628bb tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006911 Sep 19 14:38:00.785184 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 114/219] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:37:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:38:00.794612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f15e664-9fe1-4527-8c74-3494f33c1faf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:00.810385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f15e664-9fe1-4527-8c74-3494f33c1faf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:00.810991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f15e664-9fe1-4527-8c74-3494f33c1faf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:00.811431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f15e664-9fe1-4527-8c74-3494f33c1faf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.131465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:01.146406 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5edd39ce-f053-4528-a953-251f79c36691 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1311 microversion: 2.1 time: 0.445038 Sep 19 14:38:01.147266 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 106/220] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:00 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:01.158990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c698148-0e11-4d53-bc21-62a146350b9d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:01.158990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c698148-0e11-4d53-bc21-62a146350b9d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:01.231356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0c698148-0e11-4d53-bc21-62a146350b9d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:01.238105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f15e664-9fe1-4527-8c74-3494f33c1faf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.451011 Sep 19 14:38:01.239472 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 115/221] 10.222.0.81 () {60 vars in 1191 bytes} [Mon Sep 19 14:38:00 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:01.246542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:01.247557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:01.255158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c698148-0e11-4d53-bc21-62a146350b9d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1220 microversion: 2.1 time: 0.106725 Sep 19 14:38:01.257063 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 107/222] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:01 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:01.262183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c0e1b20f-6dba-4091-ae0b-f8ef24d0af84 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:01.274794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:01.275557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:01.276109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.277035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:01.277787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:01.278424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.313655 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c0e1b20f-6dba-4091-ae0b-f8ef24d0af84 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.055239 Sep 19 14:38:01.315097 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 108/223] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:38:01 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:01.329515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1902904b-a539-4199-9252-65a3c2c248e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-223980885"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:01.331981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-1902904b-a539-4199-9252-65a3c2c248e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid 30f8976e-cfbd-4e2a-a012-ee7fc331b9d9 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:01.367149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:01.373307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1902904b-a539-4199-9252-65a3c2c248e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051954 Sep 19 14:38:01.376481 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8382a23-379e-4e22-b9b2-f115ef775688 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1322 microversion: 2.1 time: 0.135699 Sep 19 14:38:01.377418 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 109/224] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:38:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:01.386397 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 116/225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:01 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:01.396414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8d92864-a630-43b8-abbe-cb7a6e9d13a2 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:01.417466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8d92864-a630-43b8-abbe-cb7a6e9d13a2 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:01.418834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8d92864-a630-43b8-abbe-cb7a6e9d13a2 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:01.419381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8d92864-a630-43b8-abbe-cb7a6e9d13a2 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.585825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:01.586128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8d92864-a630-43b8-abbe-cb7a6e9d13a2 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.193742 Sep 19 14:38:01.586680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:01.586955 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 117/226] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:01.599419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e196dfa7-5d3e-4eaf-929f-714939459c18 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:01.601206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:01.601986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:01.602654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.603619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:01.604315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:01.604841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.612988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e196dfa7-5d3e-4eaf-929f-714939459c18 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:01.614282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e196dfa7-5d3e-4eaf-929f-714939459c18 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:01.614832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e196dfa7-5d3e-4eaf-929f-714939459c18 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:01.783902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e196dfa7-5d3e-4eaf-929f-714939459c18 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.188261 Sep 19 14:38:01.785531 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 118/227] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:01.787793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:01.798237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-176c88a3-1a7b-4036-b686-4747a634a56f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:01.828169 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-176c88a3-1a7b-4036-b686-4747a634a56f tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.034444 Sep 19 14:38:01.828869 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 119/228] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:01 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 19 14:38:01.845460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-93bc1374-b88d-4047-af2b-85137fc97819 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-925437724"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:01.856417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-93bc1374-b88d-4047-af2b-85137fc97819 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid bfe93a9f-1384-410d-a0ea-9955f847f726 for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:01.903170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:01.923881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ef77f9a-0be3-4566-8a1e-d904f1d6291a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1317 microversion: 2.1 time: 0.344572 Sep 19 14:38:01.924801 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 110/229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:01 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:01.929896 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-93bc1374-b88d-4047-af2b-85137fc97819 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092411 Sep 19 14:38:01.933692 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 120/230] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:38:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:01.937112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9d9065ea-2ddf-433e-80cd-e656d925e572 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-104588573"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:01.947614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-776df144-86d4-44c8-a4d0-ef260f840b7d tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:01.951256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-9d9065ea-2ddf-433e-80cd-e656d925e572 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Generated uuid 7bd89a2c-d046-4bfa-a33e-8530acefef2f for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:01.996458 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-776df144-86d4-44c8-a4d0-ef260f840b7d tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.054959 Sep 19 14:38:01.997961 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 121/231] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:01 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:02.002642 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9d9065ea-2ddf-433e-80cd-e656d925e572 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.074766 Sep 19 14:38:02.005449 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 111/232] 10.222.0.81 () {62 vars in 1205 bytes} [Mon Sep 19 14:38:01 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:02.022546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba4ce6d2-4a51-434f-9380-63a939b15275 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-223141231"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:02.023860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1fc99041-d0a7-48f9-afa7-76a6001c8392 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.046946 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1fc99041-d0a7-48f9-afa7-76a6001c8392 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1fc99041-d0a7-48f9-afa7-76a6001c8392 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Request method failure captured: Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6XyScjcqsQ_I_xdnpZHjWEVV7OyB6PpcWzvlixz5lzB5pENkEMBc39KcrhUJhZSvecKq589h6NdDqAT6_dEhN6KGBHIa-l_XCXeJMxvpNM9ytZiiHESftXJJBPpO3uI2c_XWIXVw4qLISGVPux8Xr-Y8iraV-J5CWVsaqwOJYC--Y Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:02.050999 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_63e32339302c42d68ec87d14bf71178f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/63e32339302c42d68ec87d14bf71178f"}]}] Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 64f4b95ed5714bafacd07902aaf80230 Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: exception: Aggregate 11 could not be found. Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '11'} Sep 19 14:38:02.052438 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.053319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 19 14:38:02.054737 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.056175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1fc99041-d0a7-48f9-afa7-76a6001c8392 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:02.056175 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1fc99041-d0a7-48f9-afa7-76a6001c8392 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.050719 Sep 19 14:38:02.059212 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 122/233] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 19 14:38:02.071530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d991c27-91ba-4b9c-a80a-4d6182fedadf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.096009 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9d991c27-91ba-4b9c-a80a-4d6182fedadf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d991c27-91ba-4b9c-a80a-4d6182fedadf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Request method failure captured: Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6XyScjcqsQ_I_xdnpZHjWEVV7OyB6PpcWzvlixz5lzB5pENkEMBc39KcrhUJhZSvecKq589h6NdDqAT6_dEhN6KGBHIa-l_XCXeJMxvpNM9ytZiiHESftXJJBPpO3uI2c_XWIXVw4qLISGVPux8Xr-Y8iraV-J5CWVsaqwOJYC--Y Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:02.097707 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_63e32339302c42d68ec87d14bf71178f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/63e32339302c42d68ec87d14bf71178f"}]}] Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 64f4b95ed5714bafacd07902aaf80230 Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: exception: Aggregate 11 could not be found. Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '11'} Sep 19 14:38:02.099492 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:02.100363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.101753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d991c27-91ba-4b9c-a80a-4d6182fedadf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:02.103554 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d991c27-91ba-4b9c-a80a-4d6182fedadf tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.039707 Sep 19 14:38:02.108471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 123/234] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:02 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:02.115497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3efec298-f69c-4543-8615-5e6b0ea06c44 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1492582381", "name": "tempest-test_aggregate-1846437378"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:02.157396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-3efec298-f69c-4543-8615-5e6b0ea06c44 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid c9679c24-16b6-4eee-8cac-4254ec9b974f for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:02.176353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=10,nova_api:DELETE=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:02.198218 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3efec298-f69c-4543-8615-5e6b0ea06c44 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.087972 Sep 19 14:38:02.198828 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 124/235] 10.222.0.81 () {60 vars in 1165 bytes} [Mon Sep 19 14:38:02 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:02.239621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.240566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:02.259558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.259978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.261135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.262693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.263198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.263684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.270321 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba4ce6d2-4a51-434f-9380-63a939b15275 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.256692 Sep 19 14:38:02.271404 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 112/236] 10.222.0.81 () {62 vars in 1213 bytes} [Mon Sep 19 14:38:02 2022] PUT /compute/v2.1/os-aggregates/12 => generated 299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:02.287019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0dc1e17e-efdb-4257-a6d8-e31ac18ba93a tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.325719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0dc1e17e-efdb-4257-a6d8-e31ac18ba93a tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.051507 Sep 19 14:38:02.348147 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 113/237] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:02 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:02.360469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.361115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:02.379957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.387452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.388266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.388959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.389451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.391075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.549558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:02.566354 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3455dd76-7024-4384-9604-31463feef189 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1272 microversion: 2.1 time: 0.208895 Sep 19 14:38:02.567364 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 114/238] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:02.573804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b650743-2248-4ae0-ab08-d5f5cd597b77 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.590520 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b650743-2248-4ae0-ab08-d5f5cd597b77 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.021888 Sep 19 14:38:02.594437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 115/239] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/os-aggregates/12 => generated 299 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:02.603820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e06b2c0-364b-401f-bc86-c316580d7828 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.606677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:02.619851 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab22f1c7-f8b7-437b-a217-86e553e3da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1311 microversion: 2.1 time: 0.412126 Sep 19 14:38:02.620525 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6e06b2c0-364b-401f-bc86-c316580d7828 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 19 14:38:02.623612 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 125/240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1311 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e06b2c0-364b-401f-bc86-c316580d7828 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Request method failure captured: Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XyScjcqsQ_I_xdnpZHjWEVV7OyB6PpcWzvlixz5lzB5pENkEMBc39KcrhUJhZSvecKq589h6NdDqAT6_dEhN6KGBHIa-l_XCXeJMxvpNM9ytZiiHESftXJJBPpO3uI2c_XWIXVw4qLISGVPux8Xr-Y8iraV-J5CWVsaqwOJYC--Y Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:02.632005 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_63e32339302c42d68ec87d14bf71178f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/63e32339302c42d68ec87d14bf71178f"}]}] Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 64f4b95ed5714bafacd07902aaf80230 Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: exception: Aggregate 13 could not be found. Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '13'} Sep 19 14:38:02.633472 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.634366 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 19 14:38:02.635690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.638292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e06b2c0-364b-401f-bc86-c316580d7828 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:02.638292 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e06b2c0-364b-401f-bc86-c316580d7828 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.041697 Sep 19 14:38:02.638907 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 116/241] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:02.641033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.642076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:02.646536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bf113ddd-09ff-48f5-b6ad-5fdfece47c3a tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:02.652451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.653249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.654624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.655631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.656253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.656865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.661115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf113ddd-09ff-48f5-b6ad-5fdfece47c3a tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.661616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf113ddd-09ff-48f5-b6ad-5fdfece47c3a tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.662062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf113ddd-09ff-48f5-b6ad-5fdfece47c3a tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.847364 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bf113ddd-09ff-48f5-b6ad-5fdfece47c3a tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 314 microversion: 2.41 time: 0.206536 Sep 19 14:38:02.855327 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 117/242] 10.222.0.81 () {62 vars in 1235 bytes} [Mon Sep 19 14:38:02 2022] POST /compute/v2.1/os-aggregates/12/action => generated 314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:02.860548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b04d409a-1f04-4c6a-9509-10cf3a02d8e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.878735 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b04d409a-1f04-4c6a-9509-10cf3a02d8e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b04d409a-1f04-4c6a-9509-10cf3a02d8e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Request method failure captured: Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XyScjcqsQ_I_xdnpZHjWEVV7OyB6PpcWzvlixz5lzB5pENkEMBc39KcrhUJhZSvecKq589h6NdDqAT6_dEhN6KGBHIa-l_XCXeJMxvpNM9ytZiiHESftXJJBPpO3uI2c_XWIXVw4qLISGVPux8Xr-Y8iraV-J5CWVsaqwOJYC--Y Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:02.880478 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_63e32339302c42d68ec87d14bf71178f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/63e32339302c42d68ec87d14bf71178f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/63e32339302c42d68ec87d14bf71178f"}]}] Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 63e32339302c42d68ec87d14bf71178f Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1623209104 Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 64f4b95ed5714bafacd07902aaf80230 Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminTestJSON-1623209104-project-admin Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: exception: Aggregate 13 could not be found. Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '13'} Sep 19 14:38:02.881615 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:02.882318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:02.883898 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b04d409a-1f04-4c6a-9509-10cf3a02d8e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b04d409a-1f04-4c6a-9509-10cf3a02d8e1 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.025178 Sep 19 14:38:02.884968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 118/243] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:02 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:02.888292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3d9638d-b523-436c-9b69-15c543108569 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:02.900594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3d9638d-b523-436c-9b69-15c543108569 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:02.901102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3d9638d-b523-436c-9b69-15c543108569 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:02.901538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3d9638d-b523-436c-9b69-15c543108569 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:02.909641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:02.917901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:02.926627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6efed8d7-cc1c-4e0e-81c0-b2b7526da25a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1390 microversion: 2.1 time: 0.300866 Sep 19 14:38:02.935411 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 126/244] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1390 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:02.940595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df3995d7-3245-4ff2-aa6b-91a736b80584 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1934241043"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:02.944411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-df3995d7-3245-4ff2-aa6b-91a736b80584 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid 1265c8eb-ba42-4e28-88f5-f8fbc74a10cf for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:02.989081 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df3995d7-3245-4ff2-aa6b-91a736b80584 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051859 Sep 19 14:38:02.996408 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 127/245] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:38:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:02.998611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:02.999580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:03.012829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.013351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.013785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.014847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.015547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.016150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.099904 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3d9638d-b523-436c-9b69-15c543108569 tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 299 microversion: 2.41 time: 0.215439 Sep 19 14:38:03.100990 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 119/246] 10.222.0.81 () {62 vars in 1235 bytes} [Mon Sep 19 14:38:02 2022] POST /compute/v2.1/os-aggregates/12/action => generated 299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:03.108163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d20c1aa-1e31-4321-a8a3-442bd5b424da tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.117507 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d20c1aa-1e31-4321-a8a3-442bd5b424da tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.015324 Sep 19 14:38:03.118408 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 120/247] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:38:03 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.124485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bccefac0-1f69-46c7-821b-07d5e74ea10c tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.161072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bccefac0-1f69-46c7-821b-07d5e74ea10c tempest-AggregatesAdminTestV241-1317464336 tempest-AggregatesAdminTestV241-1317464336-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.041524 Sep 19 14:38:03.164341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 121/248] 10.222.0.81 () {60 vars in 1196 bytes} [Mon Sep 19 14:38:03 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.173121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aed72cd6-2f9c-4a26-9327-c1239d879975 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.224363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aed72cd6-2f9c-4a26-9327-c1239d879975 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.058948 Sep 19 14:38:03.226552 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 122/249] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:03 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.233750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba2da376-c1a2-4b89-b547-5d35b8915df7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1348543569"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.241209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-ba2da376-c1a2-4b89-b547-5d35b8915df7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid ea5d229b-9155-4b65-8f82-7d73e697e11a for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:03.290314 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba2da376-c1a2-4b89-b547-5d35b8915df7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059176 Sep 19 14:38:03.293742 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 123/250] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:38:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.307052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bcfc0a40-a405-45ca-9f66-3e8f44c2b5e8 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.330475 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bcfc0a40-a405-45ca-9f66-3e8f44c2b5e8 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.032940 Sep 19 14:38:03.331476 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 124/251] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:38:03 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.336598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e36a8615-6167-417b-a821-a6d92ad8aa1f tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.351556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e36a8615-6167-417b-a821-a6d92ad8aa1f tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.352099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e36a8615-6167-417b-a821-a6d92ad8aa1f tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.352540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e36a8615-6167-417b-a821-a6d92ad8aa1f tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.391966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:03.431083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:03.453343 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f860cad4-88a1-4d06-8db0-ae12a1734903 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1317 microversion: 2.1 time: 0.462042 Sep 19 14:38:03.455633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 128/252] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:02 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:03.460521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b96e593-14b2-441d-b037-4d6738fdfce4 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.501888 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b96e593-14b2-441d-b037-4d6738fdfce4 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.044122 Sep 19 14:38:03.502798 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 129/253] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:03 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:03.515292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-580ab311-7e91-4641-9bf5-9ae0edb2a22c tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373927962", "availability_zone": "tempest-test_az-526266498"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.521106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-580ab311-7e91-4641-9bf5-9ae0edb2a22c tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid 61b6e0c7-78fd-472c-a9ff-968215ec9716 for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:03.565340 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-580ab311-7e91-4641-9bf5-9ae0edb2a22c tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.057162 Sep 19 14:38:03.568273 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 130/254] 10.222.0.81 () {60 vars in 1165 bytes} [Mon Sep 19 14:38:03 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:03.578971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b68a1d2-7e5b-412f-9156-f92270252033 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373927962_new", "availability_zone": "tempest-test_az-526266498_new"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.583662 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e36a8615-6167-417b-a821-a6d92ad8aa1f tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 243 microversion: 2.1 time: 0.251108 Sep 19 14:38:03.591511 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 125/255] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:03 2022] POST /compute/v2.1/os-aggregates/15/action => generated 243 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.599546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.600828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:03.609700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.609999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.610666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.611579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.612034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.612619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.690235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:03.701467 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e24ab21-d827-4804-b054-f49807fa327b tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1278 microversion: 2.1 time: 0.108817 Sep 19 14:38:03.702782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 126/256] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:03 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:03.702895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b68a1d2-7e5b-412f-9156-f92270252033 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.703387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b68a1d2-7e5b-412f-9156-f92270252033 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.703983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b68a1d2-7e5b-412f-9156-f92270252033 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.710323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-accf4169-4b34-43a6-ad0d-b471e053d3ef tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.715675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-accf4169-4b34-43a6-ad0d-b471e053d3ef tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'f21b78021bd5451f9b06c49095c01bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158aa1288b9c416bb768e640aaae5074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-accf4169-4b34-43a6-ad0d-b471e053d3ef tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Request method failure captured: Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 42 Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6UNPJ-S6IdDX7s3_cNCP-7QD-TDzGYgKsZ5c7Tb9Db3PCFliEfIjozPsbSuYDYQLGygWvnvd8u2NvQQDUazVSUYGgCc6695-ikE-3ruPee4mexxoBmjT5eabc0GYZxRguDbH2XFRHY7Ykh2gnJ5lw4XKsZEXNGn8RfzN8105-Ogtc Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:03.718016 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_158aa1288b9c416bb768e640aaae5074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/158aa1288b9c416bb768e640aaae5074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/158aa1288b9c416bb768e640aaae5074"}]}] Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 158aa1288b9c416bb768e640aaae5074 Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768376289 Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f21b78021bd5451f9b06c49095c01bc8 Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768376289-project Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: {"remove_host": {"host": "n-h2-858384-1"}} Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:38:03.719257 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h2-858384-1'}}} Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:03.720054 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 19 14:38:03.721050 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:03.727192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-accf4169-4b34-43a6-ad0d-b471e053d3ef tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:03.727192 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-accf4169-4b34-43a6-ad0d-b471e053d3ef tempest-AggregatesAdminNegativeTestJSON-768376289 tempest-AggregatesAdminNegativeTestJSON-768376289-project] 10.222.0.81 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.015141 Sep 19 14:38:03.727192 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 127/257] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:03 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:03.728948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.729160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:03.737528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.738029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.738470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.739229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.739700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.740279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.749609 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b68a1d2-7e5b-412f-9156-f92270252033 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.174198 Sep 19 14:38:03.751868 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 131/258] 10.222.0.81 () {60 vars in 1173 bytes} [Mon Sep 19 14:38:03 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.765941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcc8f0d5-3200-4053-a8ae-282c9ad6bdd7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:03.788415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc8f0d5-3200-4053-a8ae-282c9ad6bdd7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:03.789699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc8f0d5-3200-4053-a8ae-282c9ad6bdd7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:03.790687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc8f0d5-3200-4053-a8ae-282c9ad6bdd7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:03.944756 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcc8f0d5-3200-4053-a8ae-282c9ad6bdd7 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 228 microversion: 2.1 time: 0.191148 Sep 19 14:38:03.946239 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 132/259] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:03 2022] POST /compute/v2.1/os-aggregates/15/action => generated 228 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.952496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5478611e-633c-4be8-aca6-b69f78e95da7 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:03.963864 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5478611e-633c-4be8-aca6-b69f78e95da7 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 553 microversion: 2.1 time: 0.015801 Sep 19 14:38:03.966174 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 133/260] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:38:03 2022] GET /compute/v2.1/os-aggregates => generated 553 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:03.978529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f53dad2-f401-471f-afdf-3b18900590d1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.009098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:04.021244 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca08bab1-89fc-4106-9e36-cbd05c45f11b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1494 microversion: 2.1 time: 0.298322 Sep 19 14:38:04.022209 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f53dad2-f401-471f-afdf-3b18900590d1 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.046436 Sep 19 14:38:04.023841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 128/262] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:03 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:04.023978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 134/262] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:03 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:04.044518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.047389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:04.063242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.063776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.064231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.064954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.066217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c34fc1d4-fd27-437d-acf2-cd381514bab7 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.069363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.069824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.143987 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c34fc1d4-fd27-437d-acf2-cd381514bab7 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.117825 Sep 19 14:38:04.145058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 135/263] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:04 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:04.156590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d720902-3115-4562-bcb5-139f9d4ad175 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1673706696"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:04.163759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-1d720902-3115-4562-bcb5-139f9d4ad175 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Generated uuid abdd2ff6-9bd3-48e5-b1ae-561d4382b52e for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:04.205169 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d720902-3115-4562-bcb5-139f9d4ad175 tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058306 Sep 19 14:38:04.212767 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 136/264] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:38:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.380841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:04.393726 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbc7f88d-6b23-4987-a328-11c5dd816fea tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1390 microversion: 2.1 time: 0.365548 Sep 19 14:38:04.395629 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 129/265] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:04.411262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-13ad1e5b-bb66-4efd-9d6c-e9e0573743f4 req-9e788829-8d29-448e-b481-a57ac5bd9294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2236703-317f-4c8f-95c0-5cf482587fd7", "tag": "f7fbf092-ba33-4794-890e-184b77c5dc6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:04.432875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13ad1e5b-bb66-4efd-9d6c-e9e0573743f4 req-9e788829-8d29-448e-b481-a57ac5bd9294 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.436021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13ad1e5b-bb66-4efd-9d6c-e9e0573743f4 req-9e788829-8d29-448e-b481-a57ac5bd9294 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.439150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13ad1e5b-bb66-4efd-9d6c-e9e0573743f4 req-9e788829-8d29-448e-b481-a57ac5bd9294 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.466896 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-13ad1e5b-bb66-4efd-9d6c-e9e0573743f4 req-9e788829-8d29-448e-b481-a57ac5bd9294 service nova] Creating event network-changed:f7fbf092-ba33-4794-890e-184b77c5dc6f for instance f2236703-317f-4c8f-95c0-5cf482587fd7 on n-h1-858384-1 Sep 19 14:38:04.475691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-13ad1e5b-bb66-4efd-9d6c-e9e0573743f4 req-9e788829-8d29-448e-b481-a57ac5bd9294 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077582 Sep 19 14:38:04.476697 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 130/266] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.484705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2aa98a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.489347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.489839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.491083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.491838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.492298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.492712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.523931 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00e45907-cd47-4021-9749-609e21e9e4ff tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.045006 Sep 19 14:38:04.530902 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 131/267] 10.222.0.81 () {58 vars in 1128 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.531069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.531069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:04.533700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-105cdd6e-32ec-496b-91e4-b0c5a1c2b283 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1049456188"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:04.538077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.aggregate [None req-105cdd6e-32ec-496b-91e4-b0c5a1c2b283 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Generated uuid 32e581e0-4bc2-4f71-b542-ab109b3bd970 for aggregate {{(pid=128731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 14:38:04.538703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.539479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.539936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.540667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.541140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.541705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.571890 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-105cdd6e-32ec-496b-91e4-b0c5a1c2b283 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046272 Sep 19 14:38:04.573037 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 132/268] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 14:38:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.581564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fee1903b-9329-4467-a913-86a300aef596 req-764c92ab-4971-4eb1-9d7d-ded6820f4ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952ef11-b28e-44c5-8fe2-490862dbaf42", "name": "network-vif-plugged", "status": "completed", "tag": "21277d18-1b4b-4f3b-a543-777b8edd7fed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:04.594387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fee1903b-9329-4467-a913-86a300aef596 req-764c92ab-4971-4eb1-9d7d-ded6820f4ee1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.595007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fee1903b-9329-4467-a913-86a300aef596 req-764c92ab-4971-4eb1-9d7d-ded6820f4ee1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.595664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fee1903b-9329-4467-a913-86a300aef596 req-764c92ab-4971-4eb1-9d7d-ded6820f4ee1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.608022 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fee1903b-9329-4467-a913-86a300aef596 req-764c92ab-4971-4eb1-9d7d-ded6820f4ee1 service nova] Creating event network-vif-plugged:21277d18-1b4b-4f3b-a543-777b8edd7fed for instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 on n-h2-858384-1 Sep 19 14:38:04.613104 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fee1903b-9329-4467-a913-86a300aef596 req-764c92ab-4971-4eb1-9d7d-ded6820f4ee1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037573 Sep 19 14:38:04.614013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 133/269] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.620844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:04.633205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.634080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.634689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.642206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.643130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.643733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.653645 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.compute.aggregates [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 19 14:38:04.655485 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Request method failure captured: Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 42 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6XUotAoQiP5JtqqjI8cuplwvS-bAj2C7Tk1y7s7gOd-VJYyPAQIb6W7k2O5JRFZACA7KefD0AUI5Lh9tRPBJg__IvgZ3V-EM6naAzW7eL-qrBO7v6rs_IjEds2TR-cBmPcmUafrHkBP6B8GY-nrkTS7ZiOilxcW-26P67WVbeVH3k Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:04.656674 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_38a17b7f72544033b5b394fc3f811470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/38a17b7f72544033b5b394fc3f811470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/38a17b7f72544033b5b394fc3f811470"}]}] Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 38a17b7f72544033b5b394fc3f811470 Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045 Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 2215aa11c4f4496fb77110c3e39020c5 Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: {"remove_host": {"host": "nonexist_host"}} Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:38:04.657966 n-d-858384-1 devstack@n-api.service[128731]: exception: Cannot remove host nonexist_host in aggregate 17 Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6015, in _get_service_in_cell_by_host Sep 19 14:38:04.658718 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6693, in remove_host_from_aggregate Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 19 14:38:04.659867 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _get_service_in_cell_by_host Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.662986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7d4f8da-ee57-4d60-97d3-bf7b6d31ba2b tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.042614 Sep 19 14:38:04.666650 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 134/270] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 14:38:04 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:04.669421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.669421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:04.675192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.675687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.676124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.676892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.677355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.677780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.725366 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74ca3ce1-aa63-4a79-9951-c54fee0ac8c6 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1645 microversion: 2.1 time: 0.516175 Sep 19 14:38:04.725944 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 137/271] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1645 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:04.748332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2a9ef3a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.752204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.752935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.753569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.754502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.755183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.755813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.788998 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-212135a8-01c7-40f2-8268-743fe5bcc362 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.045038 Sep 19 14:38:04.797071 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 138/272] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.797687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76f50193-1a65-41e1-9cfc-5cb32af08261 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.806575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76f50193-1a65-41e1-9cfc-5cb32af08261 tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.014487 Sep 19 14:38:04.807341 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 139/273] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:04.817087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-917c1169-7cea-4065-844f-b2bdb9d246dc tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.841544 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-917c1169-7cea-4065-844f-b2bdb9d246dc tempest-AggregatesAdminNegativeTestJSON-1462279045 tempest-AggregatesAdminNegativeTestJSON-1462279045-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.030427 Sep 19 14:38:04.847365 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 140/274] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:04 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:04.852873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:04.853738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:04.862038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.862973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.863626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:04.864579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:04.865282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:04.865961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.254966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:05.257489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:05.270496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:05.289794 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e65bea1-2e43-4287-9093-315aed635f30 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1317 microversion: 2.1 time: 0.629636 Sep 19 14:38:05.294181 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 135/275] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:05.297937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf30b3b2-c11f-46c9-adf2-a585451d0617 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1320 microversion: 2.1 time: 0.449058 Sep 19 14:38:05.314550 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 141/276] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:04 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:05.314550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2a82aaf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.315411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.315411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:05.320793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.321363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.321802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.322483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.323030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.323139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.323475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.323581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.324014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.324226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.324659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.325088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.384092 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f416b9d8-a420-4e0a-b782-fb6ba61582c8 tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.081929 Sep 19 14:38:05.392165 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 142/277] 10.222.0.81 () {58 vars in 1128 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:05.396845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7464094c-f39b-4524-9341-0e9ae95da69d tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.438899 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7464094c-f39b-4524-9341-0e9ae95da69d tempest-AggregatesAdminTestJSON-1623209104 tempest-AggregatesAdminTestJSON-1623209104-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.045277 Sep 19 14:38:05.439928 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 143/278] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:05 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 14:38:05.449987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2a88adc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.461896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.462773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.463759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.481772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.487085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.488125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.536390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bfe6445b-7276-471e-9ade-7586567994bd tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-h2-858384-1" status: 200 len: 598 microversion: 2.1 time: 0.093125 Sep 19 14:38:05.536960 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 144/279] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/os-hosts/n-h2-858384-1 => generated 598 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:05.542775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.544017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:05.553766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.562026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.562620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.565486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.566145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.566739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.634641 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dfb11e99-3da8-42ac-a1bc-51acb48ff17d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1645 microversion: 2.1 time: 0.338623 Sep 19 14:38:05.635236 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 136/280] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1645 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:05.640731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.641224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:05.655050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.655544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.656274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.657216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.657610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.658345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.681645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] HTTP exception thrown: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Request method failure captured: Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f HTTP/1.1 Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6U1PPYmpaJjX-SgUzCU18EEt_r28NrMsXbhpaZd-w1w-MwjNHj2b-Q8cRALI6jUKB9XWX6pwV763keTj5GdaCF7-eEvtUDXF16b6b6QzX1yxGsFAts-6DEGGi535YrNUmtTznlKLa0m0sJD8bcHKI_IDXTjKkuDIT8JvaMLeyBN2w Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 67ef09f168d94b27b71c60f11a4c3470 Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:05.690610 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67ef09f168d94b27b71c60f11a4c3470"}]}] Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 67ef09f168d94b27b71c60f11a4c3470 Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AggregatesAdminTestJSON-733714972-project Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 42a5f30f7b2f4d90ba19ed8e523f0ff8 Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AggregatesAdminTestJSON-733714972-project Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.692060 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c1d7e855-eebb-4a5f-b467-9e31e5fecf2f'} Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:05.692725 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.694109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.697058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Returning 404 to user: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:05.698100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e098246-bff2-4394-b42e-2bf335ea6083 tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 404 len: 111 microversion: 2.1 time: 0.061822 Sep 19 14:38:05.703184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 137/281] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:05 2022] DELETE /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:05.711687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Calling method '.version_select at 0x7fde2abb18b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.730989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.733110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.735823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.766920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.768313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.768949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.798013 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1452a2b-065f-43f3-9597-2801249510ea tempest-HostsAdminTestJSON-2136328195 tempest-HostsAdminTestJSON-2136328195-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-h1-858384-1" status: 200 len: 598 microversion: 2.1 time: 0.093219 Sep 19 14:38:05.798968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 138/282] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/os-hosts/n-h1-858384-1 => generated 598 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:05.803748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.809617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.810767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.811556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.812533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.813368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.814018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.820316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:05.832518 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7899ae7a-7903-4ff7-830e-bb72a4ed89fd tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1390 microversion: 2.1 time: 0.293709 Sep 19 14:38:05.833501 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 145/283] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1390 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:05.847833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:05.853287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] [instance: c1d7e855-eebb-4a5f-b467-9e31e5fecf2f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:05.860319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-077ac109-bd37-48e8-ba5d-0814cedb08f8 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060097 Sep 19 14:38:05.861177 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 139/284] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:05.876906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.877440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.880185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.881482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:05.882589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.884682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.885338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.886800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:05.897123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.897789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.898306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.899125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:05.899668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:05.900191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:05.906040 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] HTTP exception thrown: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Request method failure captured: Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f HTTP/1.1 Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6U1PPYmpaJjX-SgUzCU18EEt_r28NrMsXbhpaZd-w1w-MwjNHj2b-Q8cRALI6jUKB9XWX6pwV763keTj5GdaCF7-eEvtUDXF16b6b6QzX1yxGsFAts-6DEGGi535YrNUmtTznlKLa0m0sJD8bcHKI_IDXTjKkuDIT8JvaMLeyBN2w Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 67ef09f168d94b27b71c60f11a4c3470 Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:05.908306 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67ef09f168d94b27b71c60f11a4c3470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67ef09f168d94b27b71c60f11a4c3470"}]}] Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 67ef09f168d94b27b71c60f11a4c3470 Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-733714972 Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AggregatesAdminTestJSON-733714972-project Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 42a5f30f7b2f4d90ba19ed8e523f0ff8 Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AggregatesAdminTestJSON-733714972-project Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.909882 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c1d7e855-eebb-4a5f-b467-9e31e5fecf2f'} Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:05.910554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. Sep 19 14:38:05.911690 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:05.914070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] Returning 404 to user: Instance c1d7e855-eebb-4a5f-b467-9e31e5fecf2f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:05.915848 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74e81714-d596-4d3a-8ddd-94a038baf83b tempest-AggregatesAdminTestJSON-733714972 tempest-AggregatesAdminTestJSON-733714972-project] 10.222.0.81 "GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f" status: 404 len: 111 microversion: 2.1 time: 0.081200 Sep 19 14:38:05.916654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 146/285] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:05 2022] GET /compute/v2.1/servers/c1d7e855-eebb-4a5f-b467-9e31e5fecf2f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:06.028438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lazy-loading 'flavor' on Instance uuid 36015b1d-9daa-4b76-bb72-48bb7a834641 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:06.089492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Going to try to live migrate instance to n-h1-858384-1 {{(pid=128731) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:38:06.317506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:06.318100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:06.322469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:06.345060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:06.345568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:06.353607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:06.359799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:06.360634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:06.361090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:06.697200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:06.721300 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8428ae3f-6b04-4299-9811-a09ed8b054ca tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1466 microversion: 2.1 time: 0.407513 Sep 19 14:38:06.722127 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 147/286] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:06 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1466 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:06.749123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:06.749756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:06.757316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:06.757817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:06.758262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:06.759513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:06.760285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:06.760723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:06.943744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:06.956476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1bcd6798-cbfa-4754-bc78-4b16e0c015b3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1320 microversion: 2.1 time: 0.217355 Sep 19 14:38:06.958163 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 148/287] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:06 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:06.984239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c3ff1cad-8697-426e-9b53-22c1ffe86377 req-8ed1eb4c-a524-4cff-a0a4-9c0eddfea7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c67153c-5556-4895-a2e8-b37f7c0823a2", "tag": "ac81d484-fc82-4101-a1b6-72778e9093be"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:06.998055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c3ff1cad-8697-426e-9b53-22c1ffe86377 req-8ed1eb4c-a524-4cff-a0a4-9c0eddfea7b8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:07.000270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c3ff1cad-8697-426e-9b53-22c1ffe86377 req-8ed1eb4c-a524-4cff-a0a4-9c0eddfea7b8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:07.000995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c3ff1cad-8697-426e-9b53-22c1ffe86377 req-8ed1eb4c-a524-4cff-a0a4-9c0eddfea7b8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:07.020248 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c3ff1cad-8697-426e-9b53-22c1ffe86377 req-8ed1eb4c-a524-4cff-a0a4-9c0eddfea7b8 service nova] Creating event network-changed:ac81d484-fc82-4101-a1b6-72778e9093be for instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 on n-h1-858384-1 Sep 19 14:38:07.028570 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c3ff1cad-8697-426e-9b53-22c1ffe86377 req-8ed1eb4c-a524-4cff-a0a4-9c0eddfea7b8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053463 Sep 19 14:38:07.031063 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 149/288] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:07.501898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1391360371", "block_migration": true, "disk_over_commit": false}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:07.504825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:07.517188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:07.520449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:07.522590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:07.524892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:07.525526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:07.527490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:07.629488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lazy-loading 'flavor' on Instance uuid 6952ef11-b28e-44c5-8fe2-490862dbaf42 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:07.713052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Going to try to live migrate instance to tempest-host-1391360371 {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:38:07.723852 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] HTTP exception thrown: Compute host tempest-host-1391360371 could not be found. Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Request method failure captured: Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42/action HTTP/1.1 Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 107 Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6-OVQBSo1Yl7q5cuo5RJ9YZc6v_lQnyQ626VgPBABgEwgZi4fMhTnpQcfovEGBO7H3EG2h4SUKgpakOcfZuS6cEVdhecBGqFd0YXv35y6TomPD8EVUfQ86XiJwM5VuBcaJK6-aGquPQ9qosjLIG3TI45RuIgaQdnILcgfoSOEug_A Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 998758a221b846a2a493d281c0bfe186 Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveMigrationNegativeTest-748570144 Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:07.728749 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_998758a221b846a2a493d281c0bfe186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/998758a221b846a2a493d281c0bfe186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/998758a221b846a2a493d281c0bfe186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/998758a221b846a2a493d281c0bfe186"}]}] Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveMigrationNegativeTest-748570144 Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 998758a221b846a2a493d281c0bfe186 Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-748570144 Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveMigrationNegativeTest-748570144-project-admin Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 52a5200010304dfdb2ed2129bec96779 Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveMigrationNegativeTest-748570144-project-admin Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: {"os-migrateLive": {"host": "tempest-host-1391360371", "block_migration": true, "disk_over_commit": false}} Sep 19 14:38:07.730217 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: exception: Compute host tempest-host-1391360371 could not be found. Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6952ef11-b28e-44c5-8fe2-490862dbaf42', 'body': {'os-migrateLive': {'host': 'tempest-host-1391360371', 'block_migration': True, 'disk_over_commit': False}}} Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:07.731240 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1391360371 could not be found. Sep 19 14:38:07.733045 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1391360371 could not be found. Sep 19 14:38:07.734467 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1391360371 could not be found. Sep 19 14:38:07.736653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:07.739529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Returning 400 to user: Compute host tempest-host-1391360371 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:07.740783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ff8a7f0-80d8-4c91-9228-edb93452f954 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42/action" status: 400 len: 100 microversion: 2.1 time: 0.708193 Sep 19 14:38:07.741937 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 150/289] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Sep 19 14:38:07 2022] POST /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42/action => generated 100 bytes in 710 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:38:07.753502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:07.754506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:07.776073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:07.778321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:07.779245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:07.780299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:07.780970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:07.781740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:07.997722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:08.008528 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-355368be-f34c-4868-92bd-045735fdfd4a tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1390 microversion: 2.1 time: 0.265057 Sep 19 14:38:08.012167 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 151/290] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:07 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1390 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:08.018536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:08.019266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:08.025957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:08.026515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:08.027792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:08.028664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:08.029309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:08.029730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:08.233864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:08.246165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7556cd5f-3e0e-44f9-85e9-b5923c0d07db tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1466 microversion: 2.1 time: 0.231610 Sep 19 14:38:08.259396 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 152/291] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:08 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1466 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:08.273835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:08.274881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:08.301645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:08.302604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:08.303626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:08.305673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:08.306813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:08.307730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:08.711911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:08.730475 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-45e806ad-022e-482c-b366-e1c105b21943 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1320 microversion: 2.1 time: 0.476654 Sep 19 14:38:08.731299 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 153/292] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:08 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:08.739965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1120532925", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:08.851937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:38:09.572238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:09.573747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:09.575327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:09.575898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:09.576572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:09.589696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:09.590326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:09.590982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:09.591992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:09.592702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:09.593540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:09.618070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Getting quotas for project 4fd2d5f8c1714de28793c3771dd456be. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:09.625458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Getting quotas for user ae9bb35019914295aaca2034121e3dcd and project 4fd2d5f8c1714de28793c3771dd456be. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:09.645131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:09.648798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:09.759479 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5f98c9d4-862d-4530-9276-d8d63aaa9d7a tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025948 Sep 19 14:38:09.762852 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 154/293] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:38:09.767986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:09.768599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:09.775489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:09.776246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:09.776953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:09.777861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:09.778481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:09.779110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:10.010397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:10.025574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-85d97fb6-b03a-421f-a3cc-3eae1018dcab tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1390 microversion: 2.1 time: 0.261092 Sep 19 14:38:10.027743 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 155/294] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:09 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:10.035086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:10.035959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:10.050455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:10.051434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:10.051951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:10.052993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:10.053752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:10.054918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:10.255763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:10.269460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-63cd02b6-134e-44ae-8a12-a23d88fc4353 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1320 microversion: 2.1 time: 0.240292 Sep 19 14:38:10.271590 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 156/295] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:10 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:10.277525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d53de0b5-fc17-4e05-9f36-0adc8f84e639 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:10.278502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d53de0b5-fc17-4e05-9f36-0adc8f84e639 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:10.382213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d53de0b5-fc17-4e05-9f36-0adc8f84e639 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:10.398471 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d53de0b5-fc17-4e05-9f36-0adc8f84e639 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1219 microversion: 2.1 time: 0.125496 Sep 19 14:38:10.402908 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 157/296] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:10 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:10.734926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0144a464-ec20-4899-865a-9e46e11036da req-9f058430-fe23-467d-999e-45784eee545d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2236703-317f-4c8f-95c0-5cf482587fd7", "name": "network-vif-plugged", "status": "completed", "tag": "f7fbf092-ba33-4794-890e-184b77c5dc6f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:10.753947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0144a464-ec20-4899-865a-9e46e11036da req-9f058430-fe23-467d-999e-45784eee545d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:10.755644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0144a464-ec20-4899-865a-9e46e11036da req-9f058430-fe23-467d-999e-45784eee545d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:10.757895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0144a464-ec20-4899-865a-9e46e11036da req-9f058430-fe23-467d-999e-45784eee545d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:10.790979 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0144a464-ec20-4899-865a-9e46e11036da req-9f058430-fe23-467d-999e-45784eee545d service nova] Creating event network-vif-plugged:f7fbf092-ba33-4794-890e-184b77c5dc6f for instance f2236703-317f-4c8f-95c0-5cf482587fd7 on n-h1-858384-1 Sep 19 14:38:10.801911 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0144a464-ec20-4899-865a-9e46e11036da req-9f058430-fe23-467d-999e-45784eee545d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073760 Sep 19 14:38:10.802533 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 158/297] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:10.992814 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-16443dae-2617-4ae3-8b46-e9bf801ba5c3 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641/action" status: 202 len: 0 microversion: 2.1 time: 5.120820 Sep 19 14:38:10.993327 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 140/298] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:38:05 2022] POST /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641/action => generated 0 bytes in 5123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:11.003864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:11.004597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:11.020239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.020749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.021195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.022281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.022942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.024652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.054526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:11.056664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:11.112532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.114120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.114580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.123746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.127785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.128294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.238774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=22 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:11.347553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:11.360210 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f737d122-7e1e-41e3-97ac-e50756d67c82 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.361134 Sep 19 14:38:11.361908 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 159/299] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:10 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:11.368344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:11.369314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:11.378777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.379278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.379722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.380425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.381067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.381530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.387454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:11.398547 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-43bfe128-4508-43ec-a585-b59b3d451e09 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1390 microversion: 2.1 time: 0.348659 Sep 19 14:38:11.399807 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 141/300] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:11 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:11.423462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:11.424565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:11.436103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.436978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.437489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.438303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.438864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.439382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.521880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:11.535561 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8d34ac8e-4575-4e12-ad0f-82325f8abad6 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1271 microversion: 2.1 time: 0.117783 Sep 19 14:38:11.538989 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 142/301] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:11 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:11.673585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:11.690198 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ce1d91f9-ac36-423a-9e6f-935c40ce8aa9 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1320 microversion: 2.1 time: 0.326315 Sep 19 14:38:11.692407 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 160/302] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:11 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:11.927650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:11.929442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.930094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.930794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.931602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.932119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:11.932644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:11.977818 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-96059659-dfa5-4805-bb15-e0678c476b3a tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] 10.222.0.81 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.365239 Sep 19 14:38:11.982915 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 143/303] 10.222.0.81 () {58 vars in 1164 bytes} [Mon Sep 19 14:38:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 14:38:11.996310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:11.999113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:11.999819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.000744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.001689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.002557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.003715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.038691 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-10d8d343-58d1-4575-a45e-011be270698e tempest-AZAdminV2TestJSON-610359818 tempest-AZAdminV2TestJSON-610359818-project-admin] 10.222.0.81 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.047253 Sep 19 14:38:12.051900 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 161/304] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 14:38:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:12.385208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:12.385812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:12.394696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.395214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.395649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.396341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.396784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.407239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.423417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:12.424357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:12.436045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.436900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.437583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.439021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.439717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.440488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.717622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:12.727986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3b988ab-9a96-44e3-8f41-8056c6b98492 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.346403 Sep 19 14:38:12.728799 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 144/305] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:12 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:12.748420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:12.749042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:12.758149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.760038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.763774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.764692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.765416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.766075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.769950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:12.781975 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b0e95e0-8f9d-4823-a4e2-4df68c8067cc tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1589 microversion: 2.1 time: 0.362698 Sep 19 14:38:12.783055 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 162/306] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:12 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1589 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:12.788429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:12.789324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:12.797765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.798638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.799325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.800275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.800921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.801871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.925796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:12.937272 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97544d04-9412-405c-88d0-cbf06e0b3d57 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1277 microversion: 2.1 time: 0.206656 Sep 19 14:38:12.939044 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 145/307] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:12 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:12.964868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:12.966194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:12.974142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.974926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.975601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:12.976517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:12.977199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:12.977831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:13.008885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:13.009948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:13.039991 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94074476-e34a-43eb-a8ae-da0f01e03ef5 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1320 microversion: 2.1 time: 0.254265 Sep 19 14:38:13.041816 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 163/308] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:12 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:13.050301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c67153c-5556-4895-a2e8-b37f7c0823a2", "name": "network-vif-plugged", "status": "completed", "tag": "ac81d484-fc82-4101-a1b6-72778e9093be"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:13.065041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:13.065740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:13.066293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:13.072861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:13.107714 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] Creating event network-vif-plugged:ac81d484-fc82-4101-a1b6-72778e9093be for instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 on n-h1-858384-1 Sep 19 14:38:13.113321 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069176 Sep 19 14:38:13.115695 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 164/309] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:13.117424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:13.118407 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3edc6b0e-abb1-4288-82f6-6280a650bcef req-d50d4c22-c636-480a-a7d8-fb74f38d505a service nova] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001833 Sep 19 14:38:13.127294 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 165/310] 10.222.0.81 () {56 vars in 886 bytes} [Mon Sep 19 14:38:13 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 19 14:38:13.196811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8001c145-b649-4233-81cc-5f1fe8bbd874 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.241758 Sep 19 14:38:13.206203 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 146/311] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:38:12 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7/os-interface => generated 285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:13.769046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:13.772535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:13.804520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:13.806453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:13.813713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:13.816017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:13.824885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:13.856666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:14.008152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-027264a9-55c2-4587-98ed-a6085c5bdb86 tempest-InstanceUsageAuditLogTestJSON-1330408626 tempest-InstanceUsageAuditLogTestJSON-1330408626-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:14.057212 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-027264a9-55c2-4587-98ed-a6085c5bdb86 tempest-InstanceUsageAuditLogTestJSON-1330408626 tempest-InstanceUsageAuditLogTestJSON-1330408626-project-admin] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-19 14:38:13" status: 200 len: 318 microversion: 2.1 time: 0.616606 Sep 19 14:38:14.059226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 166/312] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 14:38:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-19%2014%3A38%3A13 => generated 318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:14.069283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-400b88d4-532c-4d81-a381-697feb801d51 req-c92357dc-f11f-4f43-8aee-f4c16e28e94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36015b1d-9daa-4b76-bb72-48bb7a834641", "name": "network-vif-unplugged", "status": "completed", "tag": "b7b08c8e-f338-40b2-9a9f-5815386907da"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:14.089185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-400b88d4-532c-4d81-a381-697feb801d51 req-c92357dc-f11f-4f43-8aee-f4c16e28e94a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:14.091321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-400b88d4-532c-4d81-a381-697feb801d51 req-c92357dc-f11f-4f43-8aee-f4c16e28e94a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:14.092165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-400b88d4-532c-4d81-a381-697feb801d51 req-c92357dc-f11f-4f43-8aee-f4c16e28e94a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:14.154923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-400b88d4-532c-4d81-a381-697feb801d51 req-c92357dc-f11f-4f43-8aee-f4c16e28e94a service nova] Creating event network-vif-unplugged:b7b08c8e-f338-40b2-9a9f-5815386907da for instance 36015b1d-9daa-4b76-bb72-48bb7a834641 on n-h2-858384-1 Sep 19 14:38:14.169145 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-400b88d4-532c-4d81-a381-697feb801d51 req-c92357dc-f11f-4f43-8aee-f4c16e28e94a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107202 Sep 19 14:38:14.173266 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 167/313] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:14.182303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:14.183593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:14.202101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:14.202603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:14.203079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:14.203789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:14.204246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:14.204665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:14.723686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:14.738272 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91d7e724-bcf4-4c12-844b-ee6ef777f295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.987946 Sep 19 14:38:14.739507 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 147/314] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:13 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:14.745178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:14.747243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:14.775008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:14.775616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:14.776054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:14.779948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:14.780829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:14.781507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:14.898863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:14.908536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3af5f1a9-7b96-48d5-9188-917c930481f0 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.733657 Sep 19 14:38:14.909907 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 168/315] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:14 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:14.915180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-058c1f79-7445-451b-8a6e-5866e6491f6a tempest-InstanceUsageAuditLogTestJSON-1330408626 tempest-InstanceUsageAuditLogTestJSON-1330408626-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:14.932853 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-058c1f79-7445-451b-8a6e-5866e6491f6a tempest-InstanceUsageAuditLogTestJSON-1330408626 tempest-InstanceUsageAuditLogTestJSON-1330408626-project-admin] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021011 Sep 19 14:38:14.942065 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 169/316] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 14:38:14 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:15.093035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:15.110915 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1f2f753-4561-48ca-a8a3-5b9d2fdaae46 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1469 microversion: 2.1 time: 0.369869 Sep 19 14:38:15.111847 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 148/317] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:14 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1469 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:15.139627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:15.142803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:15.157578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.157907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.158524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.159461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.160075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.162992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.345108 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d2d58015-73e6-4169-a1cc-56a3243c95b9 tempest-DeleteServersAdminTestJSON-1750840332 tempest-DeleteServersAdminTestJSON-1750840332-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2/action" status: 202 len: 0 microversion: 2.1 time: 0.209730 Sep 19 14:38:15.347021 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 149/318] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:38:15 2022] POST /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:38:15.364127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:15.372929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:15.392431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.394457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.396180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.397937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.411947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.412398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.459539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Calling method '.version_select at 0x7fde2a68b8b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:15.466651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.468173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.468838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.469915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.471294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.474330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.498844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.499509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.499957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.500386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lazy-loading 'fault' on Instance uuid 3c67153c-5556-4895-a2e8-b37f7c0823a2 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:15.574399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-29ba7b38-faaf-40ff-b4e8-33b7d43c91f0 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.630317 Sep 19 14:38:15.582636 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 170/319] 10.222.0.81 () {58 vars in 1128 bytes} [Mon Sep 19 14:38:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:15.782217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:15.795490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8121cfa-c037-42fc-a445-440e0e907d2d tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1452 microversion: 2.1 time: 0.439282 Sep 19 14:38:15.796134 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 150/320] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:15 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1452 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:15.822786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:15.823589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:15.833708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.834861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.835538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.836474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:15.837120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:15.837701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:15.985631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b132f7c2-8248-47ec-b84a-9f91c0901e98 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Calling method '.version_select at 0x7fde2a6301f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:15.992678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b132f7c2-8248-47ec-b84a-9f91c0901e98 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'abe3ab92f1964589941551f3d0c3ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243eef1ac70841df9b1b540ec42a7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b132f7c2-8248-47ec-b84a-9f91c0901e98 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Request method failure captured: Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7UG2jTXyE9c5wOKt4JNCqnejaz8v7ZVuWlSYdYPMyZmRgMol6E6iTlXIt-yiSATzNffuaMcRWnEW_FlxQ3tJo-c4eRL4CO3pUG6OyjQy5fEgLaHEcfRQYibumkiG5UF2ZZY8c8G3LFKASw1wuZlMXpVz8e6XaAsDXH4ei0nz5iB4Q Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:15.999223 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243eef1ac70841df9b1b540ec42a7319"}]}] Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abe3ab92f1964589941551f3d0c3ac07 Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: action_args: {} Sep 19 14:38:16.000718 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:16.001618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 19 14:38:16.003000 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.005130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b132f7c2-8248-47ec-b84a-9f91c0901e98 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:16.012645 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b132f7c2-8248-47ec-b84a-9f91c0901e98 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.425921 Sep 19 14:38:16.017730 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 171/321] 10.222.0.81 () {58 vars in 1128 bytes} [Mon Sep 19 14:38:15 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:16.025604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.026400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:16.041753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.043898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.044523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.045785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.047125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.048234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.077463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:16.088748 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a78907c7-c8dd-429e-831a-339505c9ae7a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.270089 Sep 19 14:38:16.110439 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 151/322] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:15 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:16.119877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.120378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:16.138638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.139181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.139615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.140329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.140785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.141205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.203473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:38:16.358822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:16.361750 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24ec4ed2-4465-490f-b6d0-cf84f68f31f3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 204 len: 0 microversion: 2.1 time: 0.248057 Sep 19 14:38:16.362423 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 152/323] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:16 2022] DELETE /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:38:16.372710 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b97919f7-ab7e-49e8-ae8e-9df718a9c963 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 200 len: 1589 microversion: 2.1 time: 0.357926 Sep 19 14:38:16.373814 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 172/324] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 1589 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:16.379010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fc4f2aeb-9a66-48c8-a6a5-94f0131899d0 req-8ac66ff7-5c41-4514-a18f-ecbd4075daf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2236703-317f-4c8f-95c0-5cf482587fd7", "tag": "f7fbf092-ba33-4794-890e-184b77c5dc6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:16.379174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.379833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:16.387919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.388633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.389253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.390288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.391334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.392172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.395459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc4f2aeb-9a66-48c8-a6a5-94f0131899d0 req-8ac66ff7-5c41-4514-a18f-ecbd4075daf8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.396005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc4f2aeb-9a66-48c8-a6a5-94f0131899d0 req-8ac66ff7-5c41-4514-a18f-ecbd4075daf8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.396438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc4f2aeb-9a66-48c8-a6a5-94f0131899d0 req-8ac66ff7-5c41-4514-a18f-ecbd4075daf8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.423148 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fc4f2aeb-9a66-48c8-a6a5-94f0131899d0 req-8ac66ff7-5c41-4514-a18f-ecbd4075daf8 service nova] Creating event network-changed:f7fbf092-ba33-4794-890e-184b77c5dc6f for instance f2236703-317f-4c8f-95c0-5cf482587fd7 on n-h1-858384-1 Sep 19 14:38:16.438178 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fc4f2aeb-9a66-48c8-a6a5-94f0131899d0 req-8ac66ff7-5c41-4514-a18f-ecbd4075daf8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074311 Sep 19 14:38:16.438808 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 153/325] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:16.448365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34900a6b-0a64-4228-9b9f-d014ef334fac tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Calling method '.version_select at 0x7fde2a89b3a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.450832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34900a6b-0a64-4228-9b9f-d014ef334fac tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'abe3ab92f1964589941551f3d0c3ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243eef1ac70841df9b1b540ec42a7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34900a6b-0a64-4228-9b9f-d014ef334fac tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Request method failure captured: Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hosts/n-d-858384-1/reboot HTTP/1.1 Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7UG2jTXyE9c5wOKt4JNCqnejaz8v7ZVuWlSYdYPMyZmRgMol6E6iTlXIt-yiSATzNffuaMcRWnEW_FlxQ3tJo-c4eRL4CO3pUG6OyjQy5fEgLaHEcfRQYibumkiG5UF2ZZY8c8G3LFKASw1wuZlMXpVz8e6XaAsDXH4ei0nz5iB4Q Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:16.452834 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243eef1ac70841df9b1b540ec42a7319"}]}] Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abe3ab92f1964589941551f3d0c3ac07 Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-d-858384-1'} Sep 19 14:38:16.454004 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:16.454821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 19 14:38:16.455965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.457093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34900a6b-0a64-4228-9b9f-d014ef334fac tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:16.457093 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-34900a6b-0a64-4228-9b9f-d014ef334fac tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-858384-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014325 Sep 19 14:38:16.457093 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 154/326] 10.222.0.81 () {58 vars in 1188 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/os-hosts/n-d-858384-1/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:16.461750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36015b1d-9daa-4b76-bb72-48bb7a834641", "tag": "b7b08c8e-f338-40b2-9a9f-5815386907da"}, {"name": "network-changed", "server_uuid": "e7f5390a-25dc-4d94-8f3e-b9b3babfa69d", "tag": "fe9aac60-e9b4-44df-820c-0c26324bd0f7"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:16.476084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.476861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.477378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.492992 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] Creating event network-changed:b7b08c8e-f338-40b2-9a9f-5815386907da for instance 36015b1d-9daa-4b76-bb72-48bb7a834641 on n-h2-858384-1 Sep 19 14:38:16.493843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] Creating event network-changed:fe9aac60-e9b4-44df-820c-0c26324bd0f7 for instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d on n-h1-858384-1 Sep 19 14:38:16.503620 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7eff8d01-c5d9-4741-b34a-fe61a0d4940b req-e25788e5-2b2a-4be9-ac50-c917cd4772b2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045448 Sep 19 14:38:16.504796 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 155/327] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:16.512194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.513241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:16.520618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.521515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.522167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.523079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.524054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.524667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.579863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:16.579863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:16.579863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:16.580112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lazy-loading 'fault' on Instance uuid 3c67153c-5556-4895-a2e8-b37f7c0823a2 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:16.864614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:16.877636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5400498d-d98e-4cb6-83bf-78b49d5e7dbd tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.502645 Sep 19 14:38:16.888480 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 173/328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:16.898832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab95e301-8728-4957-955d-26d19c378a20 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Calling method '.version_select at 0x7fde2a88aaf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.919993 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ab95e301-8728-4957-955d-26d19c378a20 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab95e301-8728-4957-955d-26d19c378a20 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:16.921974 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'nonexistent_hostname'} Sep 19 14:38:16.923491 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:16.924392 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 19 14:38:16.925755 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab95e301-8728-4957-955d-26d19c378a20 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:16.927458 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab95e301-8728-4957-955d-26d19c378a20 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.033429 Sep 19 14:38:16.934912 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 174/329] 10.222.0.81 () {58 vars in 1212 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:16.942208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0c5b556-4741-4998-a183-555fdd8e9f62 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Calling method '.version_select at 0x7fde2a5d51f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.944488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0c5b556-4741-4998-a183-555fdd8e9f62 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'abe3ab92f1964589941551f3d0c3ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243eef1ac70841df9b1b540ec42a7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0c5b556-4741-4998-a183-555fdd8e9f62 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Request method failure captured: Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hosts/n-d-858384-1 HTTP/1.1 Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7UG2jTXyE9c5wOKt4JNCqnejaz8v7ZVuWlSYdYPMyZmRgMol6E6iTlXIt-yiSATzNffuaMcRWnEW_FlxQ3tJo-c4eRL4CO3pUG6OyjQy5fEgLaHEcfRQYibumkiG5UF2ZZY8c8G3LFKASw1wuZlMXpVz8e6XaAsDXH4ei0nz5iB4Q Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:16.946575 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243eef1ac70841df9b1b540ec42a7319"}]}] Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abe3ab92f1964589941551f3d0c3ac07 Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'n-d-858384-1'} Sep 19 14:38:16.948168 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:16.949101 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 19 14:38:16.950372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.953897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0c5b556-4741-4998-a183-555fdd8e9f62 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:16.956789 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0c5b556-4741-4998-a183-555fdd8e9f62 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-858384-1" status: 403 len: 109 microversion: 2.1 time: 0.018871 Sep 19 14:38:16.957539 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 175/330] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/os-hosts/n-d-858384-1 => generated 109 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:16.969331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6495e4d-95cd-4bfe-917e-a3caa7d77c59 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Calling method '.version_select at 0x7fde2a68b0d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:16.977680 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d6495e4d-95cd-4bfe-917e-a3caa7d77c59 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6495e4d-95cd-4bfe-917e-a3caa7d77c59 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:16.981832 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'nonexistent_hostname'} Sep 19 14:38:16.983727 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.984648 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:16.985896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:16.988009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6495e4d-95cd-4bfe-917e-a3caa7d77c59 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:16.991994 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6495e4d-95cd-4bfe-917e-a3caa7d77c59 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025345 Sep 19 14:38:16.991994 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 176/331] 10.222.0.81 () {58 vars in 1191 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 19 14:38:16.997854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:17.009367 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12d3b427-0a43-4df2-a1b0-db05fd8677d7 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1458 microversion: 2.1 time: 0.503203 Sep 19 14:38:17.019289 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 156/332] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:16 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1458 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:17.022737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-594073d9-d4f2-44c1-a8c0-6da3bc1ae41a tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Calling method '.version_select at 0x7fde2a5d5e50>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:17.024904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-594073d9-d4f2-44c1-a8c0-6da3bc1ae41a tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'abe3ab92f1964589941551f3d0c3ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243eef1ac70841df9b1b540ec42a7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-594073d9-d4f2-44c1-a8c0-6da3bc1ae41a tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Request method failure captured: Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hosts/n-d-858384-1/shutdown HTTP/1.1 Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7UG2jTXyE9c5wOKt4JNCqnejaz8v7ZVuWlSYdYPMyZmRgMol6E6iTlXIt-yiSATzNffuaMcRWnEW_FlxQ3tJo-c4eRL4CO3pUG6OyjQy5fEgLaHEcfRQYibumkiG5UF2ZZY8c8G3LFKASw1wuZlMXpVz8e6XaAsDXH4ei0nz5iB4Q Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:17.031615 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243eef1ac70841df9b1b540ec42a7319"}]}] Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abe3ab92f1964589941551f3d0c3ac07 Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'n-d-858384-1'} Sep 19 14:38:17.032773 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:17.033534 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 19 14:38:17.034529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.037476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-594073d9-d4f2-44c1-a8c0-6da3bc1ae41a tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.039821 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-594073d9-d4f2-44c1-a8c0-6da3bc1ae41a tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-858384-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.028839 Sep 19 14:38:17.040867 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 177/333] 10.222.0.81 () {58 vars in 1194 bytes} [Mon Sep 19 14:38:17 2022] GET /compute/v2.1/os-hosts/n-d-858384-1/shutdown => generated 113 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:17.056202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8094c5a-4936-4708-b5ce-b58014b84f15 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Calling method '.version_select at 0x7fde2a9e3040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:17.092922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d8094c5a-4936-4708-b5ce-b58014b84f15 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8094c5a-4936-4708-b5ce-b58014b84f15 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:17.095679 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'nonexistent_hostname'} Sep 19 14:38:17.096847 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:17.097619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 19 14:38:17.098685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.100274 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.103826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8094c5a-4936-4708-b5ce-b58014b84f15 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.106100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8094c5a-4936-4708-b5ce-b58014b84f15 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.058655 Sep 19 14:38:17.113869 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 157/334] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 14:38:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:17.119442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:17.120071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:17.139045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c472396-20b0-4d90-8db1-73dbf60dd031 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Calling method '.version_select at 0x7fde2a98a670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:17.142465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c472396-20b0-4d90-8db1-73dbf60dd031 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'abe3ab92f1964589941551f3d0c3ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243eef1ac70841df9b1b540ec42a7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:17.145199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c472396-20b0-4d90-8db1-73dbf60dd031 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Request method failure captured: Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hosts/n-d-858384-1/startup HTTP/1.1 Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7UG2jTXyE9c5wOKt4JNCqnejaz8v7ZVuWlSYdYPMyZmRgMol6E6iTlXIt-yiSATzNffuaMcRWnEW_FlxQ3tJo-c4eRL4CO3pUG6OyjQy5fEgLaHEcfRQYibumkiG5UF2ZZY8c8G3LFKASw1wuZlMXpVz8e6XaAsDXH4ei0nz5iB4Q Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:17.146110 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243eef1ac70841df9b1b540ec42a7319"}]}] Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abe3ab92f1964589941551f3d0c3ac07 Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-d-858384-1'} Sep 19 14:38:17.147429 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:17.148381 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 19 14:38:17.149364 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.150235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:17.150235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:17.151024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:17.151496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:17.152624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:17.152860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c472396-20b0-4d90-8db1-73dbf60dd031 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.154015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c472396-20b0-4d90-8db1-73dbf60dd031 tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-858384-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.023910 Sep 19 14:38:17.161047 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 158/335] 10.222.0.81 () {58 vars in 1191 bytes} [Mon Sep 19 14:38:17 2022] GET /compute/v2.1/os-hosts/n-d-858384-1/startup => generated 110 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:17.167172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8a07d8b-85ea-487d-ae63-fadc3068bcee tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Calling method '.version_select at 0x7fde2a98a3a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:17.192336 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f8a07d8b-85ea-487d-ae63-fadc3068bcee tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8a07d8b-85ea-487d-ae63-fadc3068bcee tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:17.194006 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'nonexistent_hostname'} Sep 19 14:38:17.195986 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:17.196676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 19 14:38:17.197701 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8a07d8b-85ea-487d-ae63-fadc3068bcee tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f8a07d8b-85ea-487d-ae63-fadc3068bcee tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033086 Sep 19 14:38:17.200721 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 159/336] 10.222.0.81 () {58 vars in 1215 bytes} [Mon Sep 19 14:38:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:17.209850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9e963a8-19f7-4197-a286-3b9bb1f9edcf tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a9e38b0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9e963a8-19f7-4197-a286-3b9bb1f9edcf tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-hosts/n-d-858384-1 HTTP/1.1 Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 51 Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:17.213561 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: {"status": "enable", "maintenance_mode": "invalid"} Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.215379 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-d-858384-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'disable', Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'Enable', Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'Disable', Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance: Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'invalid' Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.216081 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.217439 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9e963a8-19f7-4197-a286-3b9bb1f9edcf tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9e963a8-19f7-4197-a286-3b9bb1f9edcf tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-858384-1" status: 400 len: 199 microversion: 2.1 time: 0.011643 Sep 19 14:38:17.218464 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 160/337] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:17 2022] PUT /compute/v2.1/os-hosts/n-d-858384-1 => generated 199 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:38:17.233076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-efa6c71b-6089-4465-aad8-5bb30d437f44 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Action: 'update', calling method: .version_select at 0x7fde2b8099d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-efa6c71b-6089-4465-aad8-5bb30d437f44 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-hosts/n-d-858384-1 HTTP/1.1 Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 51 Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:17.242571 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: {"status": "invalid", "maintenance_mode": "enable"} Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.245312 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-d-858384-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'disable', Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'Enable', Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'Disable', Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance: Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'invalid' Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.246942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.249932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.254864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.254864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:38:17.254864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:38:17.254864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 19 14:38:17.254864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.256493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-efa6c71b-6089-4465-aad8-5bb30d437f44 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.257517 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-efa6c71b-6089-4465-aad8-5bb30d437f44 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-858384-1" status: 400 len: 189 microversion: 2.1 time: 0.032117 Sep 19 14:38:17.264181 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 161/338] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:17 2022] PUT /compute/v2.1/os-hosts/n-d-858384-1 => generated 189 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:38:17.269287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-022a4964-9a38-4479-a2cd-35f9ea7783fa tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Action: 'update', calling method: .version_select at 0x7fde2a9e3af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:17.273316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-022a4964-9a38-4479-a2cd-35f9ea7783fa tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'abe3ab92f1964589941551f3d0c3ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243eef1ac70841df9b1b540ec42a7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-022a4964-9a38-4479-a2cd-35f9ea7783fa tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Request method failure captured: Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-hosts/n-d-858384-1 HTTP/1.1 Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 50 Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7UG2jTXyE9c5wOKt4JNCqnejaz8v7ZVuWlSYdYPMyZmRgMol6E6iTlXIt-yiSATzNffuaMcRWnEW_FlxQ3tJo-c4eRL4CO3pUG6OyjQy5fEgLaHEcfRQYibumkiG5UF2ZZY8c8G3LFKASw1wuZlMXpVz8e6XaAsDXH4ei0nz5iB4Q Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:17.275327 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243eef1ac70841df9b1b540ec42a7319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243eef1ac70841df9b1b540ec42a7319"}]}] Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 243eef1ac70841df9b1b540ec42a7319 Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1160019721 Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abe3ab92f1964589941551f3d0c3ac07 Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1160019721-project Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: {"status": "enable", "maintenance_mode": "enable"} Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 19 14:38:17.276513 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-d-858384-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:17.277906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 19 14:38:17.279111 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.281166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-022a4964-9a38-4479-a2cd-35f9ea7783fa tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.282130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-022a4964-9a38-4479-a2cd-35f9ea7783fa tempest-HostsAdminNegativeTestJSON-1160019721 tempest-HostsAdminNegativeTestJSON-1160019721-project] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-858384-1" status: 403 len: 111 microversion: 2.1 time: 0.016690 Sep 19 14:38:17.282946 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 162/339] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:17 2022] PUT /compute/v2.1/os-hosts/n-d-858384-1 => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:17.292151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c8626fe-dc4a-4485-a000-d53913682706 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a83d5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c8626fe-dc4a-4485-a000-d53913682706 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-hosts/n-d-858384-1 HTTP/1.1 Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 42 Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:17.299297 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: {"status": null, "maintenance_mode": null} Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 19 14:38:17.300570 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-d-858384-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'disable', Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'Enable', Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'Disable', Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance: Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi None Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.301333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.303276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.305910 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:38:17.305910 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:38:17.305910 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 19 14:38:17.305910 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.305910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c8626fe-dc4a-4485-a000-d53913682706 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.305910 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c8626fe-dc4a-4485-a000-d53913682706 tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-858384-1" status: 400 len: 127 microversion: 2.1 time: 0.012530 Sep 19 14:38:17.306779 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 163/340] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:17 2022] PUT /compute/v2.1/os-hosts/n-d-858384-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:38:17.311145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-65f2bc3c-8b8d-4d39-8dd2-c9caa01a8f0d tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a832e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:17.314256 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.hosts [None req-65f2bc3c-8b8d-4d39-8dd2-c9caa01a8f0d tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Enabling host nonexistent_hostname. Sep 19 14:38:17.319291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:17.322814 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-65f2bc3c-8b8d-4d39-8dd2-c9caa01a8f0d tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-65f2bc3c-8b8d-4d39-8dd2-c9caa01a8f0d tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Request method failure captured: Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 50 Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7WfBsEeLO2IQ7JDJiIsWqqT6QCiKB5DMuH19PnCWRVXa05THBW8Oi-Ub1logRrXJRBPynEC_hsJciWucKolEXZet331m0xwH8DJmSlq23SKfFTHaJ_lzeUVFuJlMtnHyGvlT4IM8XIyV_xc83p8YQ1Nwu87pREIK-etJvF9cf-KvQ Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:38:17.325648 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5f232368e77c4eb9a21d23eca0270f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5f232368e77c4eb9a21d23eca0270f35"}]}] Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5f232368e77c4eb9a21d23eca0270f35 Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430657633 Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 721394b6b63b48b29f5341cdbf07f5fb Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430657633-project-admin Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: {"status": "enable", "maintenance_mode": "enable"} Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.326880 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 19 14:38:17.327653 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:17.328833 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:17.330140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-65f2bc3c-8b8d-4d39-8dd2-c9caa01a8f0d tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:17.331186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-65f2bc3c-8b8d-4d39-8dd2-c9caa01a8f0d tempest-HostsAdminNegativeTestJSON-1430657633 tempest-HostsAdminNegativeTestJSON-1430657633-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020164 Sep 19 14:38:17.331186 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 164/341] 10.222.0.81 () {60 vars in 1211 bytes} [Mon Sep 19 14:38:17 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:17.572939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:17.599826 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffca2135-6db1-49e4-b461-0933a1eee0b8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.485941 Sep 19 14:38:17.607548 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 178/342] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:17 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:17.905812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:17.906441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:17.920352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:17.921134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:17.921945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:17.923530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:17.926188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:17.928092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.047078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:18.047831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:18.059015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:18.062141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:18.063765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.067048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:18.069058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:18.069574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.164182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:18.166225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:18.166521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.171804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lazy-loading 'fault' on Instance uuid 3c67153c-5556-4895-a2e8-b37f7c0823a2 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:18.326247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:18.343367 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61fff833-e620-4a30-bb8e-657202cbee5e tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.442174 Sep 19 14:38:18.345691 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 165/343] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:17 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:18.555568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:18.568040 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39f38c31-7ddd-4963-9494-4ae79056862c tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1458 microversion: 2.1 time: 0.527621 Sep 19 14:38:18.569897 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 179/344] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:18 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1458 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:18.637727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:18.638452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:18.645925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:18.646417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:18.646882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.647586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:18.649321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:18.649761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.887706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6c707ffc-1102-4fab-b9d9-08402cc8c55a req-03226349-728c-4963-aabe-821bce8095f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c67153c-5556-4895-a2e8-b37f7c0823a2", "name": "network-vif-deleted", "tag": "ac81d484-fc82-4101-a1b6-72778e9093be"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:18.912778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6c707ffc-1102-4fab-b9d9-08402cc8c55a req-03226349-728c-4963-aabe-821bce8095f8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:18.913351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6c707ffc-1102-4fab-b9d9-08402cc8c55a req-03226349-728c-4963-aabe-821bce8095f8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:18.913682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6c707ffc-1102-4fab-b9d9-08402cc8c55a req-03226349-728c-4963-aabe-821bce8095f8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:18.944608 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6c707ffc-1102-4fab-b9d9-08402cc8c55a req-03226349-728c-4963-aabe-821bce8095f8 service nova] Creating event network-vif-deleted:ac81d484-fc82-4101-a1b6-72778e9093be for instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 on n-h1-858384-1 Sep 19 14:38:18.956904 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6c707ffc-1102-4fab-b9d9-08402cc8c55a req-03226349-728c-4963-aabe-821bce8095f8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073905 Sep 19 14:38:18.957816 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 180/345] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:19.035890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:19.049089 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3730df44-0a71-4d0f-96df-a7d00bd6551a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.419661 Sep 19 14:38:19.049978 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 166/346] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:18 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:19.369784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:19.371546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:19.384837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:19.385453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:19.387287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:19.388070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:19.391442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:19.395188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:19.595320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:19.595936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:19.604855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:19.606984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:19.607968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:19.609037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:19.613097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:19.614304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:19.668389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:19.669140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:19.671026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:19.671705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lazy-loading 'fault' on Instance uuid 3c67153c-5556-4895-a2e8-b37f7c0823a2 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:19.773238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:19.787958 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d1c4c94-6433-4f8b-898b-6e91344a43ab tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.420403 Sep 19 14:38:19.788714 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 181/347] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:19 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:19.823341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd897005fef7483089f784339187e08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3e4615693f4560a776dc976ad302c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:19.833785 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb56fd22-b912-479e-a103-6f284f304957 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 200 len: 1310 microversion: 2.1 time: 0.242915 Sep 19 14:38:19.835198 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 167/348] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:19 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 1310 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:20.079549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:20.080370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:20.089169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:20.089951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:20.090588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:20.091582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:20.092357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:20.092971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:20.334781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3950d528-dc89-43b8-bc54-954edc5c2578 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1332672072", "id": 2034287048, "os-flavor-access:is_public": "False"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:20.347783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:20.358193 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8fd99ae7-d2fb-4afd-9ed5-ee8405a3d964 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.283953 Sep 19 14:38:20.359550 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 168/349] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:20 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:20.385485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3950d528-dc89-43b8-bc54-954edc5c2578 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.521550 Sep 19 14:38:20.390982 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 182/350] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:38:19 2022] POST /compute/v2.1/flavors => generated 431 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:20.399163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-877c8087-0026-488a-a8ed-f63b72c62a6a tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7dd788ffe017403dbda3d5bb71ca614a"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:20.813174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:20.813800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:20.825131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:20.825974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:20.827398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:20.828985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:20.829602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:20.830169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:20.866176 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-877c8087-0026-488a-a8ed-f63b72c62a6a tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/2034287048/action" status: 200 len: 97 microversion: 2.1 time: 0.470637 Sep 19 14:38:20.867594 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 169/351] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:38:20 2022] POST /compute/v2.1/flavors/2034287048/action => generated 97 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:38:20.884035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:20.887325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:20.901658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:20.902366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:20.903032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:20.903751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:20.904206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:20.904626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:20.932343 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] HTTP exception thrown: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Request method failure captured: Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 HTTP/1.1 Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6TKHd9I1Fp1E6SMOSI5e7Lbvf8DolUYdJwqsPMtjUOYRmjnDwHjxHEv8GKpm6JUOQOlgYTQIL3Wkid1yyIZahQmG3sD_sfjkwLkGpa8jvZiTOQZQLYb00jJYOCAg2g4okPC1uiFtTzBdjdz42HSKMGhWTq9l93ipGG5nPICACVnpI Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:20.935113 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e3e4615693f4560a776dc976ad302c1"}]}] Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: cd897005fef7483089f784339187e08f Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:20.936778 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '3c67153c-5556-4895-a2e8-b37f7c0823a2'} Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:20.937553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:20.938768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:20.939885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Returning 404 to user: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:20.939885 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4be1f286-b9c3-423d-bd82-1d3dfa492b1e tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 404 len: 111 microversion: 2.1 time: 0.067977 Sep 19 14:38:20.939885 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 170/352] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:20 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:21.120338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:21.135103 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b899cfd-b97d-4794-8589-ab62e6d2c886 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.327390 Sep 19 14:38:21.146783 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 183/353] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:20 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:21.146783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:21.147698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:21.160145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.161421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.161903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.163586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.164070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.164638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.187003 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] HTTP exception thrown: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Request method failure captured: Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 HTTP/1.1 Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TKHd9I1Fp1E6SMOSI5e7Lbvf8DolUYdJwqsPMtjUOYRmjnDwHjxHEv8GKpm6JUOQOlgYTQIL3Wkid1yyIZahQmG3sD_sfjkwLkGpa8jvZiTOQZQLYb00jJYOCAg2g4okPC1uiFtTzBdjdz42HSKMGhWTq9l93ipGG5nPICACVnpI Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:21.189169 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e3e4615693f4560a776dc976ad302c1"}]}] Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: cd897005fef7483089f784339187e08f Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.190711 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '3c67153c-5556-4895-a2e8-b37f7c0823a2'} Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:21.191584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.193552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.195126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Returning 404 to user: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:21.195126 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5764f0e7-8c90-40c2-b43d-1d3ce0e6ba75 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 404 len: 111 microversion: 2.1 time: 0.052436 Sep 19 14:38:21.195126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 184/354] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:21 2022] DELETE /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:21.204888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:21.205797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: 3c67153c-5556-4895-a2e8-b37f7c0823a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:21.216887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.217465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.218041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.218871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.219349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.219885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.251480 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] HTTP exception thrown: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Request method failure captured: Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 HTTP/1.1 Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TKHd9I1Fp1E6SMOSI5e7Lbvf8DolUYdJwqsPMtjUOYRmjnDwHjxHEv8GKpm6JUOQOlgYTQIL3Wkid1yyIZahQmG3sD_sfjkwLkGpa8jvZiTOQZQLYb00jJYOCAg2g4okPC1uiFtTzBdjdz42HSKMGhWTq9l93ipGG5nPICACVnpI Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:21.253783 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e3e4615693f4560a776dc976ad302c1"}]}] Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: cd897005fef7483089f784339187e08f Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.255278 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '3c67153c-5556-4895-a2e8-b37f7c0823a2'} Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:21.256213 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. Sep 19 14:38:21.257476 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.260063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Returning 404 to user: Instance 3c67153c-5556-4895-a2e8-b37f7c0823a2 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:21.263233 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea14bd47-3ddc-43d8-8618-fb9872e7c032 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2" status: 404 len: 111 microversion: 2.1 time: 0.064511 Sep 19 14:38:21.265895 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 185/355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:21 2022] GET /compute/v2.1/servers/3c67153c-5556-4895-a2e8-b37f7c0823a2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:21.280887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:21.281472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:21.287881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.288385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.288902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.290004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.290680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.291816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.310036 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] HTTP exception thrown: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Request method failure captured: Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a HTTP/1.1 Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TKHd9I1Fp1E6SMOSI5e7Lbvf8DolUYdJwqsPMtjUOYRmjnDwHjxHEv8GKpm6JUOQOlgYTQIL3Wkid1yyIZahQmG3sD_sfjkwLkGpa8jvZiTOQZQLYb00jJYOCAg2g4okPC1uiFtTzBdjdz42HSKMGhWTq9l93ipGG5nPICACVnpI Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:21.311766 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e3e4615693f4560a776dc976ad302c1"}]}] Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: cd897005fef7483089f784339187e08f Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.312947 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c31f7d67-a73a-4543-98ce-9edbf0fd020a'} Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:21.313612 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.314656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.315803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Returning 404 to user: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:21.317857 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c482b5f0-e205-4d14-b8c8-e488ae24bf26 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 404 len: 111 microversion: 2.1 time: 0.048730 Sep 19 14:38:21.318494 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 186/356] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:21 2022] DELETE /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:38:21.327835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:21.328456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] [instance: c31f7d67-a73a-4543-98ce-9edbf0fd020a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:21.332998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:21.337858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.338348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.338810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.340337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.341062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.341507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.360494 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] HTTP exception thrown: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Request method failure captured: Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a HTTP/1.1 Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6TKHd9I1Fp1E6SMOSI5e7Lbvf8DolUYdJwqsPMtjUOYRmjnDwHjxHEv8GKpm6JUOQOlgYTQIL3Wkid1yyIZahQmG3sD_sfjkwLkGpa8jvZiTOQZQLYb00jJYOCAg2g4okPC1uiFtTzBdjdz42HSKMGhWTq9l93ipGG5nPICACVnpI Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:21.362030 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e3e4615693f4560a776dc976ad302c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e3e4615693f4560a776dc976ad302c1"}]}] Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1e3e4615693f4560a776dc976ad302c1 Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-156043573 Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: cd897005fef7483089f784339187e08f Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersAdminTestJSON-156043573-project Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.363306 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c31f7d67-a73a-4543-98ce-9edbf0fd020a'} Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:21.368188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. Sep 19 14:38:21.369594 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:21.371663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] Returning 404 to user: Instance c31f7d67-a73a-4543-98ce-9edbf0fd020a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:21.371663 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7ddda92a-5e43-4ddd-b00b-66de8eda38d3 tempest-DeleteServersAdminTestJSON-156043573 tempest-DeleteServersAdminTestJSON-156043573-project] 10.222.0.81 "GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a" status: 404 len: 111 microversion: 2.1 time: 0.040870 Sep 19 14:38:21.371663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 187/357] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:21 2022] GET /compute/v2.1/servers/c31f7d67-a73a-4543-98ce-9edbf0fd020a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:38:21.383602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9c90299-7fb7-4634-9cd5-22246d25367c tempest-FlavorsAccessTestJSON-2048308518 tempest-FlavorsAccessTestJSON-2048308518-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:21.391184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:21.392158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:21.399170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.399747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.400551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.401332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:21.402363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:21.403137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:21.455107 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9c90299-7fb7-4634-9cd5-22246d25367c tempest-FlavorsAccessTestJSON-2048308518 tempest-FlavorsAccessTestJSON-2048308518-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.513497 Sep 19 14:38:21.455999 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 171/358] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:38:20 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:21.477039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b3af58c-6a96-481a-8867-fec2be3f7de0 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7dd788ffe017403dbda3d5bb71ca614a"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:21.701409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:21.710535 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21d9f64d-96d1-4da3-b9a4-9d840d46bacf tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.324711 Sep 19 14:38:21.712618 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 188/359] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:21 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:21.938595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:22.166742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.168059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:22.176641 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b3af58c-6a96-481a-8867-fec2be3f7de0 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/2034287048/action" status: 200 len: 21 microversion: 2.1 time: 0.703948 Sep 19 14:38:22.184457 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 172/360] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:38:21 2022] POST /compute/v2.1/flavors/2034287048/action => generated 21 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 14:38:22.188098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:22.188599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:22.189059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:22.190405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:22.190405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:22.190692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:22.197932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b629c64-8599-4b53-9847-ed479c8fdbf5 tempest-FlavorsAccessTestJSON-2048308518 tempest-FlavorsAccessTestJSON-2048308518-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.251308 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b629c64-8599-4b53-9847-ed479c8fdbf5 tempest-FlavorsAccessTestJSON-2048308518 tempest-FlavorsAccessTestJSON-2048308518-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.064501 Sep 19 14:38:22.266817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 173/361] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:22.272478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9e8dcaef-f213-4a21-b86a-3d9d437fc542 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.298069 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9e8dcaef-f213-4a21-b86a-3d9d437fc542 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/2034287048" status: 202 len: 0 microversion: 2.1 time: 0.029674 Sep 19 14:38:22.303199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 174/362] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:38:22 2022] DELETE /compute/v2.1/flavors/2034287048 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:22.312919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-256cc204-cad4-4986-95a8-3e5c4429b6d5 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.344241 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-256cc204-cad4-4986-95a8-3e5c4429b6d5 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.039524 Sep 19 14:38:22.345430 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 175/363] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:22.557476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:22.571068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4f82a900-894b-4286-800b-cf2068c9a01c tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.407886 Sep 19 14:38:22.572697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 189/364] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:22.582147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-072596c7-59e5-4411-ace0-e9b6a549d2c8 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1698700272", "id": 28972000, "os-flavor-access:is_public": "False"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:22.617668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-072596c7-59e5-4411-ace0-e9b6a549d2c8 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.042434 Sep 19 14:38:22.619621 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 190/365] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:38:22 2022] POST /compute/v2.1/flavors => generated 425 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:22.636168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2b37677-6eae-470a-b981-b008a9aad879 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.656859 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2b37677-6eae-470a-b981-b008a9aad879 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/28972000/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.027642 Sep 19 14:38:22.658078 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 191/366] 10.222.0.81 () {58 vars in 1203 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/flavors/28972000/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:38:22.672268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8233bd89-35d5-4df1-91bd-12695d438b53 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.704172 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8233bd89-35d5-4df1-91bd-12695d438b53 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/28972000" status: 202 len: 0 microversion: 2.1 time: 0.039447 Sep 19 14:38:22.705689 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 192/367] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 14:38:22 2022] DELETE /compute/v2.1/flavors/28972000 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:22.708999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-39ec9bea-7507-406c-8938-e8211391dbda tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '.version_select at 0x7fde2a97d8b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.718096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0067cdad-edd9-4fda-88c3-e0d7ac8acf49 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.780809 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0067cdad-edd9-4fda-88c3-e0d7ac8acf49 tempest-FlavorsAccessTestJSON-469673972 tempest-FlavorsAccessTestJSON-469673972-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.062733 Sep 19 14:38:22.801974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 193/368] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:22.816347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:22.820668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:22.837328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:22.838670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:22.844603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:22.844603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:22.844603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:22.844957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:22.898072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-39ec9bea-7507-406c-8938-e8211391dbda tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4" status: 200 len: 371 microversion: 2.1 time: 0.551056 Sep 19 14:38:22.908307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 176/369] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4 => generated 371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:22.920548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a8fa8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:23.316894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:23.327884 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4fa8c99-66d0-4c14-9592-bf8798c8e77b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1504 microversion: 2.1 time: 0.523189 Sep 19 14:38:23.328806 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 194/370] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:22 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:23.607628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:23.608600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:23.631889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:23.634031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:23.637002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:23.638699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:23.640385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:23.641525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:23.834615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:23.838059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:23.838818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:23.842226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:23.843086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:23.845874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:23.867748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:23.932571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:23.951672 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-18ae5370-93b7-49f1-a7bf-416256e899ae tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.347360 Sep 19 14:38:23.953991 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 195/371] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:23 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:24.030998 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c750c10-a28d-4a48-9444-95319f2d0dde tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4" status: 200 len: 328 microversion: 2.1 time: 1.121198 Sep 19 14:38:24.032332 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 177/372] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:38:22 2022] PUT /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4 => generated 328 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:24.046262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5905107c-a534-4c5c-8278-5550a55b6cdd tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:24.064044 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5905107c-a534-4c5c-8278-5550a55b6cdd tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4" status: 202 len: 0 microversion: 2.1 time: 0.023764 Sep 19 14:38:24.071981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 196/373] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 14:38:24 2022] DELETE /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:24.079346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03bf0560-99f1-43b9-b670-6e1372e8f3e7 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '.version_select at 0x7fde2a8b3ca0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:24.372420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:24.372420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:24.386836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:24.391408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:24.395014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:24.396161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:24.401248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:24.403631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:24.755338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:24.773824 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e99e056e-19f6-4aaf-a3d6-75bc7defec20 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1494 microversion: 2.1 time: 0.406817 Sep 19 14:38:24.774605 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 197/374] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:24 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1494 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:24.799939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5ef0402-2cc6-4bfd-9d82-25f31c610529 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '.version_select at 0x7fde2a6308b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:24.804409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ef0402-2cc6-4bfd-9d82-25f31c610529 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:24.805117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ef0402-2cc6-4bfd-9d82-25f31c610529 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:24.805791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ef0402-2cc6-4bfd-9d82-25f31c610529 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:24.823006 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d5ef0402-2cc6-4bfd-9d82-25f31c610529 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.027124 Sep 19 14:38:24.824426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 198/375] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:38:24 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:24.831493 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03bf0560-99f1-43b9-b670-6e1372e8f3e7 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4" status: 200 len: 371 microversion: 2.1 time: 0.760968 Sep 19 14:38:24.833335 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 178/376] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:38:24 2022] GET /compute/v2.1/os-quota-sets/d4674a172ff244ca898022b70d4195c4 => generated 371 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:24.837994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:24.840496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:24.853480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:24.856740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:24.858044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:24.860848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:24.861697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:24.862387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:24.935424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=30 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:24.983090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:24.983742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:24.994175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:24.994674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:24.995365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:24.999727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:25.000441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:25.001219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:25.101432 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f319a26-b91f-4f01-b120-30451fc4b31d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1645 microversion: 2.1 time: 0.268001 Sep 19 14:38:25.134348 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 199/377] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:24 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1645 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:25.489514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:25.504949 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-50a26f44-4496-49b6-bf64-75297e09f6b7 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.529433 Sep 19 14:38:25.513591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:25.518027 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 179/378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:24 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:25.529359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-836095da-9189-4534-a65b-9fd8ff451677 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '.version_select at 0x7fde2a88c5e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:25.924890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Calling method '.version_select at 0x7fde2a5f63a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:25.930957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:25.931503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:25.931951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:25.981924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:25.982442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:25.986361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.019436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:26.029802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.030868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.031527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.047612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.048182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.048839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.086139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.086976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.087576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.103948 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a2b5426-a45c-4673-a947-1f29b301dcba tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.967364 Sep 19 14:38:26.104943 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 200/379] 10.222.0.81 () {60 vars in 1243 bytes} [Mon Sep 19 14:38:25 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:26.140722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-01455256-1d66-4bdd-b6d3-aaab438bc9d0 req-9308a720-0f77-4fd1-9c0d-df42d79964ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f5390a-25dc-4d94-8f3e-b9b3babfa69d", "name": "network-vif-plugged", "status": "completed", "tag": "fe9aac60-e9b4-44df-820c-0c26324bd0f7"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:26.181037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-01455256-1d66-4bdd-b6d3-aaab438bc9d0 req-9308a720-0f77-4fd1-9c0d-df42d79964ff service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.181522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-01455256-1d66-4bdd-b6d3-aaab438bc9d0 req-9308a720-0f77-4fd1-9c0d-df42d79964ff service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.182375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-01455256-1d66-4bdd-b6d3-aaab438bc9d0 req-9308a720-0f77-4fd1-9c0d-df42d79964ff service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.205135 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-01455256-1d66-4bdd-b6d3-aaab438bc9d0 req-9308a720-0f77-4fd1-9c0d-df42d79964ff service nova] Creating event network-vif-plugged:fe9aac60-e9b4-44df-820c-0c26324bd0f7 for instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d on n-h1-858384-1 Sep 19 14:38:26.218270 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-01455256-1d66-4bdd-b6d3-aaab438bc9d0 req-9308a720-0f77-4fd1-9c0d-df42d79964ff service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111789 Sep 19 14:38:26.219493 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 201/380] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:26.229186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1235980313", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "eb86d89b-8fd6-474f-a09d-aade8cfee6cf"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:26.326613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] validate_networks() for [('eb86d89b-8fd6-474f-a09d-aade8cfee6cf', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:38:26.675078 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-836095da-9189-4534-a65b-9fd8ff451677 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec/defaults" status: 200 len: 371 microversion: 2.1 time: 1.148518 Sep 19 14:38:26.678022 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 180/381] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:38:25 2022] GET /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec/defaults => generated 371 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:26.701971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Calling method '.version_select at 0x7fde2a98a9d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:26.715567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.716663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.720561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.758070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.758586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.759059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.817084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.817506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.817962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.849014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.849531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.852027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.903305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.904051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.910049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.920085 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc41599f-de0c-442c-8ca1-2aa693e0a3ad tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.229645 Sep 19 14:38:26.921335 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 181/382] 10.222.0.81 () {60 vars in 1222 bytes} [Mon Sep 19 14:38:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:26.927285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:26.928510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:26.941395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.942187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.942981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:26.944277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:26.945053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:26.945704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:27.475147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:27.489216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf1701d2-9eba-457c-b22a-663ac7a20578 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1319 microversion: 2.1 time: 0.565995 Sep 19 14:38:27.490017 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 182/383] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:26 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1319 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:27.495974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Calling method '.version_select at 0x7fde2a88cdc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:27.500886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:27.502055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:27.502719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:27.524213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:27.525334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:27.525979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:27.534888 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca954b8d-d58a-46da-99d4-31eaf910daa0 tempest-HypervisorAdminV253TestBase-979425111 tempest-HypervisorAdminV253TestBase-979425111-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/5eccfc91-3fda-4874-8968-02b87bce4d60" status: 200 len: 792 microversion: 2.53 time: 0.043272 Sep 19 14:38:27.536235 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 183/384] 10.222.0.81 () {60 vars in 1298 bytes} [Mon Sep 19 14:38:27 2022] GET /compute/v2.1/os-hypervisors/5eccfc91-3fda-4874-8968-02b87bce4d60 => generated 792 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:27.541333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a8b34c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:28.054289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.054912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.055345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.056141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.061442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.062107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.166741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:28.167271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:28.167834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:28.168537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:28.169323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:28.172659 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b264824-69c2-4ca3-8251-11f8ca171208 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee" status: 200 len: 328 microversion: 2.1 time: 0.635122 Sep 19 14:38:28.182738 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 184/385] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:38:27 2022] PUT /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee => generated 328 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:28.191375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.191879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.193600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '.version_select at 0x7fde2a98a670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:28.196108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.197192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.197792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.198229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.268735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:28.283265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for user a989536b40ed41ddaa1554bf40378758 and project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:28.308899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:28.315398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:28.453572 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dee11857-500d-462d-9e45-9e93b560b3d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232801 Sep 19 14:38:28.461848 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 202/386] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:38:28.476810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06a1025c-f7eb-4e9c-ac7c-29fb937ddc26 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:28.483806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06a1025c-f7eb-4e9c-ac7c-29fb937ddc26 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:28.685738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06a1025c-f7eb-4e9c-ac7c-29fb937ddc26 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:28.713416 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06a1025c-f7eb-4e9c-ac7c-29fb937ddc26 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1211 microversion: 2.1 time: 0.243911 Sep 19 14:38:28.718498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 203/387] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:28 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1211 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:28.737988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:28.738498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:28.772620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.773130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.782541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.783297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.787188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.787556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.865358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.869315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.869795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.872278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:28.873101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:28.880145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:28.957092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:28.969297 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa0a1d49-f431-418c-b2b7-e215c9cad44d tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee/detail" status: 200 len: 916 microversion: 2.1 time: 0.784239 Sep 19 14:38:28.972644 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 185/388] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:38:28 2022] GET /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee/detail => generated 916 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:29.207553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:29.226645 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-db33e4ef-696b-4722-bbee-0915900aaa65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1468 microversion: 2.1 time: 0.498305 Sep 19 14:38:29.228750 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 204/389] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:28 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:29.262610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:29.263189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:29.295346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:29.295901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:29.296345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:29.302269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:29.303452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:29.303737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:29.512674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lazy-loading 'flavor' on Instance uuid e7f5390a-25dc-4d94-8f3e-b9b3babfa69d {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:29.636949 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-53f58747-1ced-45ed-8588-05ec539dfc13 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d/action" status: 202 len: 0 microversion: 2.1 time: 0.380663 Sep 19 14:38:29.644898 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 205/390] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:38:29 2022] POST /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:29.663764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:29.666951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:29.686317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:29.687105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:29.687707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:29.691011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:29.692783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:29.695814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:30.065866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08eaf859-d0fa-4b8e-b3c7-e9afcad30120 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Action: 'create', calling method: .version_select at 0x7fde2a843550>, body: {"keypair": {"name": "tempest-keypair-1963850088", "type": "ssh", "user_id": "b06acd56d21a41a4b4520caef47e466f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+Cpl4/x0K66oZtYHrgf0ySyzA+0CgtmNCnm2tOECXw6L/eN51C2QXt9lXJdsRgWG5alhFEoXCHo3GkvgXjbi/U/k/lA6112xVbz6SGH7DB5/2HTs3r9/yq2eVlfNl1hw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:30.092680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-08eaf859-d0fa-4b8e-b3c7-e9afcad30120 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Getting quotas for project 04a2b0f8cdac4283b1d7c7006a39caaf. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:30.100612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-08eaf859-d0fa-4b8e-b3c7-e9afcad30120 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Getting quotas for user 7a5396d2544a44a28a2e7bf479c4c09d and project 04a2b0f8cdac4283b1d7c7006a39caaf. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:30.144035 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08eaf859-d0fa-4b8e-b3c7-e9afcad30120 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.893870 Sep 19 14:38:30.146193 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 186/391] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:38:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 897 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:38:30.153562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:30.156457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:30.158948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:30.176972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1bc91662-4570-4b5b-a6b7-d6684c4da9ff tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1476 microversion: 2.1 time: 0.528941 Sep 19 14:38:30.201710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:30.203016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 206/392] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:29 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1476 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:30.203486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:30.205543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:30.208398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:30.210200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:30.211366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:30.216827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8fe282a8-f135-499c-b5c3-bc264fbecc1a tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Action: 'create', calling method: .version_select at 0x7fde2a599940>, body: {"keypair": {"name": "tempest-keypair-132177573", "type": "ssh", "user_id": "b06acd56d21a41a4b4520caef47e466f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNVBX0GK1DNEWLkygVSbYF2RBPLEiRskVIrcyxuebo1ulQq5qLvVga2iI7DP9pEq/zOHAfIxMNd7i44uli2wR9FHkqBcecQeOexKl9RVt5KdeO//LS1Qp172Z0hS+0HsQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:30.303371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8fe282a8-f135-499c-b5c3-bc264fbecc1a tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Getting quotas for project 04a2b0f8cdac4283b1d7c7006a39caaf. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:30.318731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8fe282a8-f135-499c-b5c3-bc264fbecc1a tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Getting quotas for user 7a5396d2544a44a28a2e7bf479c4c09d and project 04a2b0f8cdac4283b1d7c7006a39caaf. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:30.383929 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8fe282a8-f135-499c-b5c3-bc264fbecc1a tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.179307 Sep 19 14:38:30.385092 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 207/393] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:38:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:38:30.396495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8b90ff8-0482-4b01-a034-ca1922482e45 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Calling method '.version_select at 0x7fde2a58f430>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:30.427584 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8b90ff8-0482-4b01-a034-ca1922482e45 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-1963850088?user_id=b06acd56d21a41a4b4520caef47e466f" status: 200 len: 512 microversion: 2.10 time: 0.034810 Sep 19 14:38:30.429746 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 208/394] 10.222.0.81 () {60 vars in 1340 bytes} [Mon Sep 19 14:38:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1963850088?user_id=b06acd56d21a41a4b4520caef47e466f => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:38:30.454768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9f53ffd-6665-4471-980c-043efd343351 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Action: 'create', calling method: .version_select at 0x7fde2a58f940>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1693730422", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq0/8tJ25zEGHrVZyUUkyXYlXyxyWZkt/YfC4tMs80joelCnyyi3lJb9GC28oqCOruEzFTA7f4z0+/Eo8u0+R/klOHXwtXhdA2+3WtNG1Az66PmGuqPUDqZmZWOLM4eiw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:30.494285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:30.506602 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6daefced-10e8-4c94-88b5-4c9c61cec050 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1263 microversion: 2.1 time: 0.358869 Sep 19 14:38:30.509179 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 187/395] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:30 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1263 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:30.520605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-f9f53ffd-6665-4471-980c-043efd343351 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Getting quotas for project 04a2b0f8cdac4283b1d7c7006a39caaf. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:30.520605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-f9f53ffd-6665-4471-980c-043efd343351 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Getting quotas for user 7a5396d2544a44a28a2e7bf479c4c09d and project 04a2b0f8cdac4283b1d7c7006a39caaf. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:30.520832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a7e4ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:30.562238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9f53ffd-6665-4471-980c-043efd343351 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.117590 Sep 19 14:38:30.573070 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 209/396] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:38:30 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:38:30.579240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-85971a06-6a29-4a36-baac-803ef04e0ec7 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Calling method '.version_select at 0x7fde2a68ef70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:30.584244 n-d-858384-1 devstack@n-api.service[128730]: WARNING oslo_db.sqlalchemy.utils [None req-85971a06-6a29-4a36-baac-803ef04e0ec7 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 19 14:38:30.591034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:30.597767 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-85971a06-6a29-4a36-baac-803ef04e0ec7 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "GET /compute/v2.1/os-keypairs?user_id=b06acd56d21a41a4b4520caef47e466f" status: 200 len: 725 microversion: 2.10 time: 0.024738 Sep 19 14:38:30.606486 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 210/397] 10.222.0.81 () {60 vars in 1259 bytes} [Mon Sep 19 14:38:30 2022] GET /compute/v2.1/os-keypairs?user_id=b06acd56d21a41a4b4520caef47e466f => generated 725 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:30.612206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d698e6a2-c00b-48fa-a9e7-7df2521feff8 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Calling method '.version_select at 0x7fde2a54edc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:30.645012 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d698e6a2-c00b-48fa-a9e7-7df2521feff8 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1693730422" status: 204 len: 0 microversion: 2.10 time: 0.036392 Sep 19 14:38:30.645737 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 211/398] 10.222.0.81 () {60 vars in 1325 bytes} [Mon Sep 19 14:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1693730422 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:38:30.656700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e2ad8a2f-a282-4413-a801-a0c946f37dc0 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Calling method '.version_select at 0x7fde2a68e4c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:30.695163 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e2ad8a2f-a282-4413-a801-a0c946f37dc0 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132177573?user_id=b06acd56d21a41a4b4520caef47e466f" status: 204 len: 0 microversion: 2.10 time: 0.043806 Sep 19 14:38:30.701685 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 212/399] 10.222.0.81 () {60 vars in 1340 bytes} [Mon Sep 19 14:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132177573?user_id=b06acd56d21a41a4b4520caef47e466f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:38:30.708386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3bc1049-28aa-44da-86e4-f6399124bef4 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] Calling method '.version_select at 0x7fde2a81b940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:30.781808 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3bc1049-28aa-44da-86e4-f6399124bef4 tempest-KeyPairsV210TestJSON-1173323112 tempest-KeyPairsV210TestJSON-1173323112-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963850088?user_id=b06acd56d21a41a4b4520caef47e466f" status: 204 len: 0 microversion: 2.10 time: 0.076361 Sep 19 14:38:30.784991 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 213/400] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963850088?user_id=b06acd56d21a41a4b4520caef47e466f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:38:31.141044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.141593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.141963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.142696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.143176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.143598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.202465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.205163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.205872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.207999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.209440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.210005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:31.210148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.211804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:31.220447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.221716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.222307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.223530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.224168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.224763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.311706 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e2b7741-5323-4145-bfb8-c6cfcc9ec37e tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee?user_id=a8d9b4660e084e44adc114dae74b58f6" status: 200 len: 328 microversion: 2.1 time: 0.801301 Sep 19 14:38:31.334707 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 188/401] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:38:30 2022] PUT /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee?user_id=a8d9b4660e084e44adc114dae74b58f6 => generated 328 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:31.341618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd82544b-14f2-427d-8c0d-0af250211a32 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '.version_select at 0x7fde2a98a940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:31.573628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:31.588914 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9613b02-a6ba-4141-a948-e7188b6b2034 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1459 microversion: 2.1 time: 0.385866 Sep 19 14:38:31.592130 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 214/402] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:31 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1459 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:31.600164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:31.603453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:31.618985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.623538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.626690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.627767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.628853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.629616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.737914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:31.748632 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3848c534-f2a7-4085-901e-1e8221468464 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1269 microversion: 2.1 time: 0.154988 Sep 19 14:38:31.750392 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 215/403] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:31 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:31.759829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:31.760544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:31.777659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.779790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.781249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:31.782097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:31.787159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:31.787709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.137753 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd82544b-14f2-427d-8c0d-0af250211a32 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee?user_id=a8d9b4660e084e44adc114dae74b58f6" status: 200 len: 370 microversion: 2.1 time: 0.801357 Sep 19 14:38:32.140028 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 189/404] 10.222.0.81 () {58 vars in 1323 bytes} [Mon Sep 19 14:38:31 2022] GET /compute/v2.1/os-quota-sets/02f8cf17f1fd4236b43e2ba7c49097ee?user_id=a8d9b4660e084e44adc114dae74b58f6 => generated 370 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:32.476746 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48d7847d-72f0-4ec0-a427-43db45929608 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1610 microversion: 2.1 time: 0.723905 Sep 19 14:38:32.482088 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 216/405] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:31 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1610 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:32.507613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:32.513703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.515395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.517898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.518918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.519536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.523416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.555199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-885f0f09-342e-4008-8e9c-026c7b80461a tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051768 Sep 19 14:38:32.560664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 190/406] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:38:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:32.575350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:32.581844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:32.604111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.606547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.607693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.610379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.610988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.614494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.664789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Lazy-loading 'flavor' on Instance uuid e7f5390a-25dc-4d94-8f3e-b9b3babfa69d {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:32.689256 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d while it is in vm_state suspended Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Request method failure captured: Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d/action HTTP/1.1 Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 97 Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6-OVQBSo1Yl7q5cuo5RJ9YZc6v_lQnyQ626VgPBABgEwgZi4fMhTnpQcfovEGBO7H3EG2h4SUKgpakOcfZuS6cEVdhecBGqFd0YXv35y6TomPD8EVUfQ86XiJwM5VuBcaJK6-aGquPQ9qosjLIG3TI45RuIgaQdnILcgfoSOEug_A Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 998758a221b846a2a493d281c0bfe186 Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveMigrationNegativeTest-748570144 Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:32.703684 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_998758a221b846a2a493d281c0bfe186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/998758a221b846a2a493d281c0bfe186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/998758a221b846a2a493d281c0bfe186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/998758a221b846a2a493d281c0bfe186"}]}] Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveMigrationNegativeTest-748570144 Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 998758a221b846a2a493d281c0bfe186 Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-748570144 Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveMigrationNegativeTest-748570144-project-admin Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 52a5200010304dfdb2ed2129bec96779 Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveMigrationNegativeTest-748570144-project-admin Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": true, "disk_over_commit": false}} Sep 19 14:38:32.704878 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'os-migrateLive' instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d while it is in vm_state suspended Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e7f5390a-25dc-4d94-8f3e-b9b3babfa69d', 'body': {'os-migrateLive': {'host': 'n-h2-858384-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 19 14:38:32.705602 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:32.706567 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d while it is in vm_state suspended Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d while it is in vm_state suspended Sep 19 14:38:32.707658 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:32.709712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d while it is in vm_state suspended {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:32.713093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-77e44caf-bd1d-4387-b332-4ed37ac68600 tempest-LiveMigrationNegativeTest-748570144 tempest-LiveMigrationNegativeTest-748570144-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d/action" status: 409 len: 155 microversion: 2.1 time: 0.141910 Sep 19 14:38:32.713714 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 217/407] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:38:32 2022] POST /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d/action => generated 155 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:38:32.725396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:32.726244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:32.735124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.735996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.737854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.739865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.740596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.741246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.771163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:38:32.780070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:32.780712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:32.787647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.788143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.788579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.789283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.810433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.812658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.895773 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7416162d-dd06-4d87-93cc-c79e54009210 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 204 len: 0 microversion: 2.1 time: 0.173475 Sep 19 14:38:32.900885 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 191/408] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:32 2022] DELETE /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:38:32.908306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:32.909451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:32.918797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.919616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.921504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:32.922550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:32.923617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:32.924311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:33.264769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:33.284677 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-112a9a43-e23c-4dd4-83d9-701e7cec4dac tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.505822 Sep 19 14:38:33.287016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 218/409] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:32 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:33.296789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f244d871-962f-442b-b212-29f556596265 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Calling method '.version_select at 0x7fde2a5399d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:33.302584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:33.315053 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32cc4572-ff09-403d-b11f-ce3b26da6676 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1465 microversion: 2.1 time: 0.411493 Sep 19 14:38:33.315654 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 192/410] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:32 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1465 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:33.453580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e75770b7-7bc7-4d9c-8756-b08479b630d9 req-61f39153-8c73-4b86-b6b2-253d6d557941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2679ae8-f24f-4bb1-a771-0994a55bd65a", "tag": "0abb9a01-3482-473b-ac11-2d6a4f22ab12"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:33.489716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e75770b7-7bc7-4d9c-8756-b08479b630d9 req-61f39153-8c73-4b86-b6b2-253d6d557941 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:33.490363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e75770b7-7bc7-4d9c-8756-b08479b630d9 req-61f39153-8c73-4b86-b6b2-253d6d557941 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:33.493054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e75770b7-7bc7-4d9c-8756-b08479b630d9 req-61f39153-8c73-4b86-b6b2-253d6d557941 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:33.521805 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e75770b7-7bc7-4d9c-8756-b08479b630d9 req-61f39153-8c73-4b86-b6b2-253d6d557941 service nova] Creating event network-changed:0abb9a01-3482-473b-ac11-2d6a4f22ab12 for instance d2679ae8-f24f-4bb1-a771-0994a55bd65a on n-h2-858384-1 Sep 19 14:38:33.538909 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e75770b7-7bc7-4d9c-8756-b08479b630d9 req-61f39153-8c73-4b86-b6b2-253d6d557941 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090276 Sep 19 14:38:33.541573 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 193/411] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:34.051917 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f244d871-962f-442b-b212-29f556596265 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec/defaults" status: 200 len: 371 microversion: 2.1 time: 0.762035 Sep 19 14:38:34.054272 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 219/412] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:38:33 2022] GET /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec/defaults => generated 371 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:34.072958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a539040>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:34.300673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f6d5695-c15e-486d-b90d-c454f7d10c77 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1027113359", "id": 685310663, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:34.366795 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1f6d5695-c15e-486d-b90d-c454f7d10c77 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.782263 Sep 19 14:38:34.372274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 194/413] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:38:33 2022] POST /compute/v2.1/flavors => generated 468 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:34.381242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:34.385101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:34.406418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:34.409665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:34.411731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:34.413125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:34.415638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:34.419760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:34.948604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:34.961044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f66aedb6-ebc5-47ef-a3fd-8cc896717c1a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.587300 Sep 19 14:38:34.979194 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 195/414] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:34 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:34.988166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:34.989144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:34.995923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:34.996797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:34.997781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:34.999399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:35.000300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:35.000956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:35.027397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:35.032017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:35.032580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:35.033403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:35.034116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:35.035573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:35.345334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:35.359449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d765b41d-e1a8-4e9a-8b6f-7c87756a60e1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1465 microversion: 2.1 time: 0.377359 Sep 19 14:38:35.379508 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 196/415] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:34 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1465 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:35.395723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6969841-14bf-4345-ba1f-6108b5355fe0 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:35.652353 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1e038c6-f5fa-4a7b-b286-963af91f3561 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec" status: 200 len: 329 microversion: 2.1 time: 1.589013 Sep 19 14:38:35.661776 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 220/416] 10.222.0.81 () {60 vars in 1263 bytes} [Mon Sep 19 14:38:34 2022] PUT /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec => generated 329 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:35.668356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a5390d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:35.980661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c6969841-14bf-4345-ba1f-6108b5355fe0 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/685310663/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.599274 Sep 19 14:38:35.988419 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 197/417] 10.222.0.81 () {62 vars in 1262 bytes} [Mon Sep 19 14:38:35 2022] POST /compute/v2.1/flavors/685310663/os-extra_specs => generated 62 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:35.994929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-57a59720-fde8-4aa1-9469-e8a7c4db5bed req-4bda8b25-9c31-4d08-bfef-f9fe3ba9aaac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f5390a-25dc-4d94-8f3e-b9b3babfa69d", "name": "network-vif-deleted", "tag": "fe9aac60-e9b4-44df-820c-0c26324bd0f7"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:36.019992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-57a59720-fde8-4aa1-9469-e8a7c4db5bed req-4bda8b25-9c31-4d08-bfef-f9fe3ba9aaac service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.020766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-57a59720-fde8-4aa1-9469-e8a7c4db5bed req-4bda8b25-9c31-4d08-bfef-f9fe3ba9aaac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.021610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-57a59720-fde8-4aa1-9469-e8a7c4db5bed req-4bda8b25-9c31-4d08-bfef-f9fe3ba9aaac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.038031 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-57a59720-fde8-4aa1-9469-e8a7c4db5bed req-4bda8b25-9c31-4d08-bfef-f9fe3ba9aaac service nova] Creating event network-vif-deleted:fe9aac60-e9b4-44df-820c-0c26324bd0f7 for instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d on n-h1-858384-1 Sep 19 14:38:36.054317 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-57a59720-fde8-4aa1-9469-e8a7c4db5bed req-4bda8b25-9c31-4d08-bfef-f9fe3ba9aaac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063670 Sep 19 14:38:36.055612 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 198/418] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:36.062589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:36.063678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:36.071661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.072471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.073151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.075554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.076569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.077465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.433915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:36.457991 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-805f69a4-60d6-4bc9-8fdc-7bbc5c30fca2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.400903 Sep 19 14:38:36.479331 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 199/419] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:36 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:36.484480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.484707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a34dda38-a9be-42f9-9efb-d589255b4719 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:36.484981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.485416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.489506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.490056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.494152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.557033 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a34dda38-a9be-42f9-9efb-d589255b4719 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/685310663" status: 202 len: 0 microversion: 2.86 time: 0.090403 Sep 19 14:38:36.562377 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 200/420] 10.222.0.81 () {60 vars in 1199 bytes} [Mon Sep 19 14:38:36 2022] DELETE /compute/v2.1/flavors/685310663 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:38:36.582385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:36.588701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:36.616368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.617293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.624456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.625840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.627315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.628730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.751613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:36.752110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:36.752543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:36.752993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lazy-loading 'fault' on Instance uuid e7f5390a-25dc-4d94-8f3e-b9b3babfa69d {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:36.908718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:36.922057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:36.925428 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-485d69cf-6486-4875-839b-5b64fe0cbde9 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 200 len: 1309 microversion: 2.1 time: 0.360433 Sep 19 14:38:36.928464 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 201/421] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:36 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:36.934536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-736aa46e-eacb-4566-9c01-624ef10da8d3 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:36.944389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=3,nova_api:INSERT=21,nova_api:UPDATE=7 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:37.001948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-736aa46e-eacb-4566-9c01-624ef10da8d3 tempest-FlavorMetadataValidation-183245150 tempest-FlavorMetadataValidation-183245150-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.071327 Sep 19 14:38:37.003752 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 202/422] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:36 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:37.300006 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55821090-938e-4d10-a7f5-4f5bf6cb67d0 tempest-QuotasAdminTestJSON-860520270 tempest-QuotasAdminTestJSON-860520270-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec" status: 200 len: 329 microversion: 2.1 time: 1.636822 Sep 19 14:38:37.300983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 221/423] 10.222.0.81 () {60 vars in 1263 bytes} [Mon Sep 19 14:38:35 2022] PUT /compute/v2.1/os-quota-sets/9edcc353473b40d8a1c4df227bc783ec => generated 329 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:37.498262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:37.499057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:37.518254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:37.518811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:37.519432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:37.520194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:37.520787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:37.521321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:37.798901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:37.812516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-725f9794-88ca-477b-86c0-c2058c3d3071 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.320148 Sep 19 14:38:37.813126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 222/424] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:37 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:37.951337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:37.952804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: e7f5390a-25dc-4d94-8f3e-b9b3babfa69d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:37.960638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:37.962139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:37.962947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:37.965016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:37.986117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:37.990384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.015075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Calling method '.version_select at 0x7fde2a88cee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:38.017690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.018381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.019256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.054080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.054770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.055538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.057779 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] HTTP exception thrown: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d could not be found. Sep 19 14:38:38.065384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Request method failure captured: Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d HTTP/1.1 Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH68zi3oF_PaDkMyLS1rB-w5J9qteYNQ1FPkiNvb_hJIikS7-rJl4JR4P1A-2wYkBoyigGFGns6h3vAI2PgWgk5gb-x5ADFDCDS2ifDsdq_hg-J-9qE7C8Sxv-_ywOsL0tEicltxYObzY2XYuwzy47V28APzf571YHuPSGhiK1c9d4s Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 4fd2d5f8c1714de28793c3771dd456be Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveMigrationNegativeTest-925021971 Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:38.066584 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4fd2d5f8c1714de28793c3771dd456be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4fd2d5f8c1714de28793c3771dd456be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4fd2d5f8c1714de28793c3771dd456be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4fd2d5f8c1714de28793c3771dd456be"}]}] Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveMigrationNegativeTest-925021971 Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 4fd2d5f8c1714de28793c3771dd456be Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-925021971 Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveMigrationNegativeTest-925021971-project Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ae9bb35019914295aaca2034121e3dcd Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveMigrationNegativeTest-925021971-project Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d could not be found. Sep 19 14:38:38.068184 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e7f5390a-25dc-4d94-8f3e-b9b3babfa69d'} Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d could not be found. Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:38.069243 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d could not be found. Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d could not be found. Sep 19 14:38:38.070605 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.073322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Returning 404 to user: Instance e7f5390a-25dc-4d94-8f3e-b9b3babfa69d could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:38.073322 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20f69be8-3a6e-413e-9559-544b2352661d tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d" status: 404 len: 111 microversion: 2.1 time: 0.126007 Sep 19 14:38:38.073322 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 223/425] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:37 2022] GET /compute/v2.1/servers/e7f5390a-25dc-4d94-8f3e-b9b3babfa69d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:38.082962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.083752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.087210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.091263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:38.091904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:38.108157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.111262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.112788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.113910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.114584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.114971 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f857d6e-f0bc-4589-9b07-c91a6647ef98 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.797587 Sep 19 14:38:38.115387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.122899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 203/426] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:38:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:38.166850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:38:38.329427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:38.399561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-741b62d4-6a40-4230-9c93-5548a9e97085 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 204 len: 0 microversion: 2.1 time: 0.317441 Sep 19 14:38:38.403510 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 224/427] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:38 2022] DELETE /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:38:38.688044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-19c1888f-a726-4470-8fe4-5ab11e837a9d tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] Calling method '.version_select at 0x7fde2a545af0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:38.735240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-19c1888f-a726-4470-8fe4-5ab11e837a9d tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.328052 Sep 19 14:38:38.735898 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 225/428] 10.222.0.81 () {60 vars in 1226 bytes} [Mon Sep 19 14:38:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:38.750466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:38.755976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:38.775449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.776316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.780460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.781511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:38.782217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:38.783272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:38.786138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-744f4375-7677-4490-a071-b8a2a835ed48 tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Calling method '.version_select at 0x7fde2a7ae0d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:38.788178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-744f4375-7677-4490-a071-b8a2a835ed48 tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'da4586ae34464336b8f6bc1009624337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b7268cf7774263bd13208dc499605c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-744f4375-7677-4490-a071-b8a2a835ed48 tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Request method failure captured: Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hypervisors/n-h2-858384-1/search HTTP/1.1 Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7rpu8MT8xc7QKaa_2Sj7ZwN_9V-sz5e9nPA-ZSGhqf5zyE-ZlwvhDuLZ-1NLVbM2w7pk3pp1npFgCCRhm4pSfVsZZ3qoAL5eoafupV5sJrJCcJwomPMAx2UzkCj896Fg2z6rA4LisgtlMewUdBw7MFScy0AL2TljlS8udP-v-4E4g Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 46b7268cf7774263bd13208dc499605c Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-315642691 Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:38.790409 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_46b7268cf7774263bd13208dc499605c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/46b7268cf7774263bd13208dc499605c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/46b7268cf7774263bd13208dc499605c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/46b7268cf7774263bd13208dc499605c"}]}] Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-315642691 Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 46b7268cf7774263bd13208dc499605c Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-315642691 Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-315642691-project Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da4586ae34464336b8f6bc1009624337 Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-315642691-project Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 19 14:38:38.791782 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'n-h2-858384-1'} Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:38.792822 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 19 14:38:38.795690 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:38.797775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-744f4375-7677-4490-a071-b8a2a835ed48 tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:38.797775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-744f4375-7677-4490-a071-b8a2a835ed48 tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/n-h2-858384-1/search" status: 403 len: 117 microversion: 2.1 time: 0.661831 Sep 19 14:38:38.797775 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 204/429] 10.222.0.81 () {58 vars in 1209 bytes} [Mon Sep 19 14:38:38 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-1/search => generated 117 bytes in 664 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:38:38.800038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5c52c3bc-5b83-4d88-9d35-3af878a3d86b tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a7f1430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:39.145549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:39.164236 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04448697-812e-4dd2-a72e-55a0ff704f65 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1472 microversion: 2.1 time: 0.421873 Sep 19 14:38:39.177185 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 226/430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:38 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:39.190107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Calling method '.version_select at 0x7fde2a4b01f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:39.193104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.194257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.195105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.220796 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Request method failure captured: Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7t46pOYuQFbgWnVypqubfm6J75hGDG0x05d9bmizKH1lxSeUQmcmZc-lfdGYV6lD9FM-4bdTHJM1iLlSxYKCaATecD7fgSGn297YenJcp95oAjYioWZ_Xog9qqkDJ1xd_1pVQMoBhtcYE8JgpSHCx5Mygtl8QnRtgxcGixaNMm3e8 Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 514fc07b89d84f85875cc7ed258e6ddf Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2084804054 Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:39.225505 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_514fc07b89d84f85875cc7ed258e6ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/514fc07b89d84f85875cc7ed258e6ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/514fc07b89d84f85875cc7ed258e6ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/514fc07b89d84f85875cc7ed258e6ddf"}]}] Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2084804054 Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 514fc07b89d84f85875cc7ed258e6ddf Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2084804054 Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 18435be74d574d5b8b4cfa0358bb3510 Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 19 14:38:39.227383 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:39.228126 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:39.229251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:39.229251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:39.229251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:39.229251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 19 14:38:39.229251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.232522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:39.233855 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b7b85a5-c201-4538-a2a0-f675cacfb530 tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.054705 Sep 19 14:38:39.238836 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 227/431] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 14:38:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:39.247642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:39.248686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:39.262162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.263269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.263791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.264829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.267440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.269929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.325687 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5c52c3bc-5b83-4d88-9d35-3af878a3d86b tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.530914 Sep 19 14:38:39.333809 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 205/432] 10.222.0.81 () {62 vars in 1247 bytes} [Mon Sep 19 14:38:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:39.338536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Calling method '.version_select at 0x7fde2a7e4700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:39.342425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.343220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.344114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.361195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.362192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.362814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.379332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.380091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.380676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.388389 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2246cf30-6a40-4ec3-ac9c-b6b117e59bce tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053415 Sep 19 14:38:39.389445 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 206/433] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:38:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:39.394503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46665c1a-7d81-478d-b468-764c69dcf6e6 tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] Calling method '.version_select at 0x7fde2a7d9310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:39.447675 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46665c1a-7d81-478d-b468-764c69dcf6e6 tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.056720 Sep 19 14:38:39.465288 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 207/434] 10.222.0.81 () {60 vars in 1226 bytes} [Mon Sep 19 14:38:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:39.478576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-938b14b5-8dfd-439a-bf2e-9732fe2cc5bf tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Calling method '.version_select at 0x7fde2a7f1af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:39.486035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-938b14b5-8dfd-439a-bf2e-9732fe2cc5bf tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'da4586ae34464336b8f6bc1009624337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b7268cf7774263bd13208dc499605c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-938b14b5-8dfd-439a-bf2e-9732fe2cc5bf tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Request method failure captured: Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7rpu8MT8xc7QKaa_2Sj7ZwN_9V-sz5e9nPA-ZSGhqf5zyE-ZlwvhDuLZ-1NLVbM2w7pk3pp1npFgCCRhm4pSfVsZZ3qoAL5eoafupV5sJrJCcJwomPMAx2UzkCj896Fg2z6rA4LisgtlMewUdBw7MFScy0AL2TljlS8udP-v-4E4g Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 46b7268cf7774263bd13208dc499605c Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-315642691 Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:38:39.494102 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_46b7268cf7774263bd13208dc499605c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/46b7268cf7774263bd13208dc499605c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/46b7268cf7774263bd13208dc499605c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/46b7268cf7774263bd13208dc499605c"}]}] Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-315642691 Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 46b7268cf7774263bd13208dc499605c Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-315642691 Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-315642691-project Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da4586ae34464336b8f6bc1009624337 Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-315642691-project Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 19 14:38:39.495511 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1'} Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:38:39.496706 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 19 14:38:39.498070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.501066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-938b14b5-8dfd-439a-bf2e-9732fe2cc5bf tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:39.503106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-938b14b5-8dfd-439a-bf2e-9732fe2cc5bf tempest-HypervisorAdminNegativeUnderV252Test-315642691 tempest-HypervisorAdminNegativeUnderV252Test-315642691-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.034818 Sep 19 14:38:39.506457 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 208/435] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:38:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:39.519258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-151737bb-c953-411f-b181-df9af168926f tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a7a60d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:39.660589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:39.674689 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90514628-7826-4a27-a472-755fa289f25a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.434241 Sep 19 14:38:39.675721 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 228/436] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:39 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:39.689712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Calling method '.version_select at 0x7fde2a4c6d30>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:39.694320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:39.696726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:39.697702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:39.703390 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-151737bb-c953-411f-b181-df9af168926f tempest-QuotaClassesAdmin257Test-1526594233 tempest-QuotaClassesAdmin257Test-1526594233-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.193676 Sep 19 14:38:39.712664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 209/437] 10.222.0.81 () {62 vars in 1247 bytes} [Mon Sep 19 14:38:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:39.716460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] HTTP exception thrown: No hypervisor matching 'e5f37071-0244-475a-a820-02fc89e8f723' could be found. Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Request method failure captured: Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hypervisors/e5f37071-0244-475a-a820-02fc89e8f723/servers HTTP/1.1 Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7t46pOYuQFbgWnVypqubfm6J75hGDG0x05d9bmizKH1lxSeUQmcmZc-lfdGYV6lD9FM-4bdTHJM1iLlSxYKCaATecD7fgSGn297YenJcp95oAjYioWZ_Xog9qqkDJ1xd_1pVQMoBhtcYE8JgpSHCx5Mygtl8QnRtgxcGixaNMm3e8 Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 514fc07b89d84f85875cc7ed258e6ddf Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2084804054 Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:38:39.720570 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_514fc07b89d84f85875cc7ed258e6ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/514fc07b89d84f85875cc7ed258e6ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/514fc07b89d84f85875cc7ed258e6ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/514fc07b89d84f85875cc7ed258e6ddf"}]}] Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2084804054 Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 514fc07b89d84f85875cc7ed258e6ddf Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2084804054 Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 18435be74d574d5b8b4cfa0358bb3510 Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: exception: No hypervisor matching 'e5f37071-0244-475a-a820-02fc89e8f723' could be found. Sep 19 14:38:39.721810 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e5f37071-0244-475a-a820-02fc89e8f723'} Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e5f37071-0244-475a-a820-02fc89e8f723' could be found. Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.722486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e5f37071-0244-475a-a820-02fc89e8f723' could be found. Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:39.723552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] Returning 404 to user: No hypervisor matching 'e5f37071-0244-475a-a820-02fc89e8f723' could be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:39.727056 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8aad5be6-a7c9-4dec-8874-35a9c4595b5f tempest-HypervisorAdminNegativeUnderV252Test-2084804054 tempest-HypervisorAdminNegativeUnderV252Test-2084804054-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/e5f37071-0244-475a-a820-02fc89e8f723/servers" status: 404 len: 123 microversion: 2.1 time: 0.044471 Sep 19 14:38:39.727651 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 229/438] 10.222.0.81 () {58 vars in 1281 bytes} [Mon Sep 19 14:38:39 2022] GET /compute/v2.1/os-hypervisors/e5f37071-0244-475a-a820-02fc89e8f723/servers => generated 123 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:40.191897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:40.192511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:40.215354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:40.216001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:40.216450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:40.226277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:40.232299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:40.236067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:40.638915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-12441495-bf5d-4b7c-a331-8da82684fdd3 req-4bf57780-6986-4e04-ae66-90cec2e98750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2679ae8-f24f-4bb1-a771-0994a55bd65a", "name": "network-vif-plugged", "status": "completed", "tag": "0abb9a01-3482-473b-ac11-2d6a4f22ab12"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:40.661202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-12441495-bf5d-4b7c-a331-8da82684fdd3 req-4bf57780-6986-4e04-ae66-90cec2e98750 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:40.662349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-12441495-bf5d-4b7c-a331-8da82684fdd3 req-4bf57780-6986-4e04-ae66-90cec2e98750 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:40.663257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-12441495-bf5d-4b7c-a331-8da82684fdd3 req-4bf57780-6986-4e04-ae66-90cec2e98750 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:40.680973 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-12441495-bf5d-4b7c-a331-8da82684fdd3 req-4bf57780-6986-4e04-ae66-90cec2e98750 service nova] Creating event network-vif-plugged:0abb9a01-3482-473b-ac11-2d6a4f22ab12 for instance d2679ae8-f24f-4bb1-a771-0994a55bd65a on n-h2-858384-1 Sep 19 14:38:40.688348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-12441495-bf5d-4b7c-a331-8da82684fdd3 req-4bf57780-6986-4e04-ae66-90cec2e98750 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054127 Sep 19 14:38:40.690283 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 230/439] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:40.707029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:40.709749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:40.725372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:40.726560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:40.728542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:40.729568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:40.731186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:40.743399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:41.182700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:41.201553 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-511fd8d0-ea55-4b73-9e1f-6d5acb8314f3 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1472 microversion: 2.1 time: 1.013924 Sep 19 14:38:41.216199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 210/440] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:40 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1472 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:41.310514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:41.325879 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3c4089e-88e5-41ea-bbde-01efc7a792a0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.627260 Sep 19 14:38:41.327139 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 231/441] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:40 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:38:42.064587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ef07f8c1-5007-42b4-97f4-082661b72fc2 req-634e9692-4b91-449f-9058-eed2a1713e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952ef11-b28e-44c5-8fe2-490862dbaf42", "name": "network-vif-deleted", "tag": "21277d18-1b4b-4f3b-a543-777b8edd7fed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:42.124488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ef07f8c1-5007-42b4-97f4-082661b72fc2 req-634e9692-4b91-449f-9058-eed2a1713e4b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:42.125259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ef07f8c1-5007-42b4-97f4-082661b72fc2 req-634e9692-4b91-449f-9058-eed2a1713e4b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:42.125955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ef07f8c1-5007-42b4-97f4-082661b72fc2 req-634e9692-4b91-449f-9058-eed2a1713e4b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:42.191415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ef07f8c1-5007-42b4-97f4-082661b72fc2 req-634e9692-4b91-449f-9058-eed2a1713e4b service nova] Creating event network-vif-deleted:21277d18-1b4b-4f3b-a543-777b8edd7fed for instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 on n-h2-858384-1 Sep 19 14:38:42.226480 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ef07f8c1-5007-42b4-97f4-082661b72fc2 req-634e9692-4b91-449f-9058-eed2a1713e4b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168815 Sep 19 14:38:42.234808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:42.235584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:42.238812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 211/442] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:42.270740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:42.272093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:42.273280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:42.282983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:42.289622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:42.291475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:42.356683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:42.357763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:42.382315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:42.383377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:42.383975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:42.384960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:42.387704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:42.389390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:42.562544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=13 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:42.565813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9bb35019914295aaca2034121e3dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2d5f8c1714de28793c3771dd456be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:42.576744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04b93973-b24d-462a-8ff6-cd123971f3d1 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 200 len: 1302 microversion: 2.1 time: 0.349267 Sep 19 14:38:42.577551 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 232/443] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:42 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 1302 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:43.021882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:43.034248 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3cf40b8-1ed9-4d6a-9d5e-37f26f06b176 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1311 microversion: 2.1 time: 0.683687 Sep 19 14:38:43.036583 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 212/444] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:42 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1311 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:43.601503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:43.602778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] [instance: 6952ef11-b28e-44c5-8fe2-490862dbaf42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:43.623109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:43.624735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:43.625548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:43.630519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:43.631515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:43.633475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:43.681558 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] HTTP exception thrown: Instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 could not be found. Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Request method failure captured: Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 HTTP/1.1 Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH68zi3oF_PaDkMyLS1rB-w5J9qteYNQ1FPkiNvb_hJIikS7-rJl4JR4P1A-2wYkBoyigGFGns6h3vAI2PgWgk5gb-x5ADFDCDS2ifDsdq_hg-J-9qE7C8Sxv-_ywOsL0tEicltxYObzY2XYuwzy47V28APzf571YHuPSGhiK1c9d4s Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 4fd2d5f8c1714de28793c3771dd456be Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveMigrationNegativeTest-925021971 Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:38:43.685405 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4fd2d5f8c1714de28793c3771dd456be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4fd2d5f8c1714de28793c3771dd456be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4fd2d5f8c1714de28793c3771dd456be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4fd2d5f8c1714de28793c3771dd456be"}]}] Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveMigrationNegativeTest-925021971 Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 4fd2d5f8c1714de28793c3771dd456be Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-925021971 Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveMigrationNegativeTest-925021971-project Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ae9bb35019914295aaca2034121e3dcd Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveMigrationNegativeTest-925021971-project Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 could not be found. Sep 19 14:38:43.687061 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6952ef11-b28e-44c5-8fe2-490862dbaf42'} Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 could not be found. Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:38:43.687964 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 could not be found. Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 could not be found. Sep 19 14:38:43.689512 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:38:43.691889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] Returning 404 to user: Instance 6952ef11-b28e-44c5-8fe2-490862dbaf42 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:38:43.692944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-34944b4e-12e8-48db-97dc-384423fa0060 tempest-LiveMigrationNegativeTest-925021971 tempest-LiveMigrationNegativeTest-925021971-project] 10.222.0.81 "GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42" status: 404 len: 111 microversion: 2.1 time: 0.095989 Sep 19 14:38:43.699013 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 233/445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:43 2022] GET /compute/v2.1/servers/6952ef11-b28e-44c5-8fe2-490862dbaf42 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:38:44.065471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:44.066196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:44.076836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:44.077362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:44.077809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:44.079954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:44.080802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:44.082801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:44.425366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:44.434954 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d51507a-07f2-4135-aa60-4d72dc0fc6eb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1494 microversion: 2.1 time: 0.373313 Sep 19 14:38:44.436109 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 213/446] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:44 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1494 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:44.478853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:44.480304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:44.488902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:44.490019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:44.490837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:44.495620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:44.496455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:44.497057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:44.839619 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76d8a56b-8e12-4e82-a71c-ea1513e0d5c4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1645 microversion: 2.1 time: 0.374594 Sep 19 14:38:44.842905 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 234/447] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:44 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1645 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:44.875388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:44.876649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:44.897308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:44.898285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:44.898977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:44.902462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:44.903280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:44.904222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.119334 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70bb3729-d5d1-48b3-8d67-5fae6f654793 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1645 microversion: 2.1 time: 0.251885 Sep 19 14:38:45.120336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 214/448] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:44 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1645 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:45.148344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:45.156560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:45.157468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:45.162457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.164431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:45.166068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:45.166982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.209484 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-435ded63-3f1e-4b67-9df6-f45179188c40 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065476 Sep 19 14:38:45.210150 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 215/449] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:38:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:38:45.225186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:45.226309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:45.234986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:45.235927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:45.236601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.237692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:45.238375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:45.239091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.368114 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68eddcc3-b99a-493f-8df1-6ad1fb164ab2 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a/action" status: 202 len: 0 microversion: 2.1 time: 0.148249 Sep 19 14:38:45.372823 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 216/450] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:38:45 2022] POST /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:45.379936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:45.385187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:45.400860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:45.402023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:45.402696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.403733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:45.406357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:45.407593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:45.607029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dd477cb3-83ac-47d3-974e-acab51a7edaf tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1650 microversion: 2.1 time: 0.230926 Sep 19 14:38:45.608033 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 217/451] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:45 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1650 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:45.733147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1596375599", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e31e1958-afee-4116-8310-ef2e73536125"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:45.803749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] validate_networks() for [('e31e1958-afee-4116-8310-ef2e73536125', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:38:46.415373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:46.415970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:46.416252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:46.416655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:46.417503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:46.430905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:46.431404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:46.431916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:46.442926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:46.443292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:46.443666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:46.463210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:46.469320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for user 79d78edfe25746049a02a43130f1df11 and project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:46.482854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:46.485362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:46.548553 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87b0d403-67a2-464e-9fa2-7003cd162891 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.661160 Sep 19 14:38:46.550113 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 235/452] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 14:38:46.562800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-da18d026-4611-4272-b2fd-bb0dc252cf17 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:46.563410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-da18d026-4611-4272-b2fd-bb0dc252cf17 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:46.633662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:46.634559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:46.653423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:46.658585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:46.663035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da18d026-4611-4272-b2fd-bb0dc252cf17 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:46.663231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:46.664273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:46.666099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:46.667301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:46.671018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da18d026-4611-4272-b2fd-bb0dc252cf17 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:46.672482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da18d026-4611-4272-b2fd-bb0dc252cf17 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:46.673599 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-da18d026-4611-4272-b2fd-bb0dc252cf17 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1262 microversion: 2.25 time: 0.115853 Sep 19 14:38:46.674154 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 218/453] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:46 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1262 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:46.943977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e0aa552-5ecc-4030-baf4-bd91fae3a279 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1630 microversion: 2.1 time: 0.312822 Sep 19 14:38:46.946537 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 236/454] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:46 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1630 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:46.976921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:46.981910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:46.992851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:46.994095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:46.995083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:46.997099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:46.998802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:46.999909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:47.047766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lazy-loading 'flavor' on Instance uuid d2679ae8-f24f-4bb1-a771-0994a55bd65a {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:47.080888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Going to try to live migrate instance to n-h1-858384-1 {{(pid=128731) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:38:47.983609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22065514-990d-4970-8abf-d56c86dade6f tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1621772408", "id": 1926240146, "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:48.021027 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-22065514-990d-4970-8abf-d56c86dade6f tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.612573 Sep 19 14:38:48.022377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 237/455] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:38:47 2022] POST /compute/v2.1/flavors => generated 449 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:48.027639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:48.028498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:48.037238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:48.038181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:48.038696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:48.040530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:48.041180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:48.041683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:48.135341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:48.164794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:48.169854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:48.172480 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a087645f-c45e-4bad-b1fc-cc24bb6b50c8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1314 microversion: 2.25 time: 0.147402 Sep 19 14:38:48.173124 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 238/456] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:48 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:49.024998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d3fcfd0-1bbd-45d7-8f06-5bd4eee1ba28 tempest-FlavorsV255TestJSON-2057239824 tempest-FlavorsV255TestJSON-2057239824-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:49.077199 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d3fcfd0-1bbd-45d7-8f06-5bd4eee1ba28 tempest-FlavorsV255TestJSON-2057239824 tempest-FlavorsV255TestJSON-2057239824-project] 10.222.0.81 "GET /compute/v2.1/flavors/1926240146" status: 200 len: 449 microversion: 2.55 time: 0.897587 Sep 19 14:38:49.083705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 239/457] 10.222.0.81 () {60 vars in 1199 bytes} [Mon Sep 19 14:38:48 2022] GET /compute/v2.1/flavors/1926240146 => generated 449 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:49.430064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eaad6ba5-c278-4f2e-9660-8bdb7a2f11c5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a/action" status: 202 len: 0 microversion: 2.1 time: 2.458020 Sep 19 14:38:49.437735 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 219/458] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:38:46 2022] POST /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a/action => generated 0 bytes in 2467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:38:49.443239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5c3e56a7-8d7b-4b69-bf19-e6e0005407ff tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] Action: 'update', calling method: .version_select at 0x7fde2bda7dc0>, body: {"flavor": {"description": "new"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:49.529711 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5c3e56a7-8d7b-4b69-bf19-e6e0005407ff tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/1926240146" status: 200 len: 450 microversion: 2.55 time: 0.090168 Sep 19 14:38:49.530645 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 220/459] 10.222.0.81 () {62 vars in 1219 bytes} [Mon Sep 19 14:38:49 2022] PUT /compute/v2.1/flavors/1926240146 => generated 450 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:49.554120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:49.557156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:49.600673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:49.601816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:49.602540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:49.604887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:49.605989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:49.610803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:49.743587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-462453181", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:49.967386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:49.968179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:49.968991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:49.969697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:49.970449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:50.007292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:50.012910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:50.013901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:50.015350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:50.021876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:50.023192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:50.090903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:50.106450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Getting quotas for project c561898f9ac344d4bc9c06a04cff776d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:50.129066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:50.131085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Getting quotas for user af68e3d765f14854b4823ee57f5f9d5c and project c561898f9ac344d4bc9c06a04cff776d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:50.132912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:50.140340 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d408a1a4-3dc1-4688-a30d-4ecc4b2c4d2a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.595249 Sep 19 14:38:50.145525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:UPDATE=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:50.148241 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 221/460] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:49 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:50.157812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:50.162876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:50.180517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:50.184172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:50.187401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:50.188480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:50.190573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:50.191012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:50.228376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:50.231530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:50.337117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00f6ffa3-462f-4f51-8f10-8c4bb3d2c0b4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.251120 Sep 19 14:38:50.350471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 240/461] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:38:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:38:50.360883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d3b4ffc-8fe6-4d14-8335-4681bb67eb32 tempest-FlavorsV255TestJSON-2057239824 tempest-FlavorsV255TestJSON-2057239824-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:50.403074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d3b4ffc-8fe6-4d14-8335-4681bb67eb32 tempest-FlavorsV255TestJSON-2057239824 tempest-FlavorsV255TestJSON-2057239824-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6596 microversion: 2.55 time: 0.046468 Sep 19 14:38:50.420923 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 241/462] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:50 2022] GET /compute/v2.1/flavors/detail => generated 6596 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:50.429450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-947c5783-1365-4bfb-bd97-a2f842fda33e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:50.435665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-947c5783-1365-4bfb-bd97-a2f842fda33e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:51.092265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-947c5783-1365-4bfb-bd97-a2f842fda33e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:51.098814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:51.101345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-947c5783-1365-4bfb-bd97-a2f842fda33e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:51.102912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-947c5783-1365-4bfb-bd97-a2f842fda33e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:51.130903 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-947c5783-1365-4bfb-bd97-a2f842fda33e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1452 microversion: 2.91 time: 0.708485 Sep 19 14:38:51.132244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 242/463] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:50 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1452 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:51.138431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-105f7b9d-8430-470f-a93b-71f52e651df2 tempest-FlavorsV255TestJSON-2057239824 tempest-FlavorsV255TestJSON-2057239824-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:51.254141 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-105f7b9d-8430-470f-a93b-71f52e651df2 tempest-FlavorsV255TestJSON-2057239824 tempest-FlavorsV255TestJSON-2057239824-project] 10.222.0.81 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.55 time: 0.120471 Sep 19 14:38:51.255336 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 243/464] 10.222.0.81 () {60 vars in 1166 bytes} [Mon Sep 19 14:38:51 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:51.315667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:51.359435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1899236d-3950-4394-a4b6-b4bf994bcf10 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 1.208572 Sep 19 14:38:51.365310 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 222/465] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:50 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:51.385893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:51.387097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:51.391182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:51.396261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:51.397030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:51.397720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:51.398710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:51.399384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:51.399979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:51.988397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-393025078", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:52.123849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.150587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:52.152059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.154808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.156631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:52.158988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:52.159181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a4c077a-94d1-4c00-a262-d925b2487aa9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.791993 Sep 19 14:38:52.163792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:52.164874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:52.171198 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 223/466] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:51 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:52.183637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62995341-9a8d-47f6-a523-6fec17b15eae tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:52.222011 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62995341-9a8d-47f6-a523-6fec17b15eae tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1926240146" status: 202 len: 0 microversion: 2.55 time: 0.049595 Sep 19 14:38:52.223564 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 224/467] 10.222.0.81 () {60 vars in 1202 bytes} [Mon Sep 19 14:38:52 2022] DELETE /compute/v2.1/flavors/1926240146 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:38:52.228196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:52.235028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:52.236653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:52.238973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:52.239489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:52.241059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:52.242078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:52.242337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:52.263510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:52.264341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:52.265331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:52.266554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:52.267222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:52.267836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:52.322042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Getting quotas for project 3b105727a7264ac48d63d3b99bee751b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:52.345252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Getting quotas for user c4366f009b944ca08d4ce0ddc4aac7c4 and project 3b105727a7264ac48d63d3b99bee751b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:52.402728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:52.409684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:52.536655 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90288684-4f87-4ff1-bc24-c185627372e8 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.279773 Sep 19 14:38:52.538541 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 244/468] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:38:52.539450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.543903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:52.552517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.553210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9437eaad-556c-4b78-866e-7e96762b7879 tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:52.554128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.582293 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fcda630d-70cd-4153-a5c2-35f3f2f7d5af tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1448 microversion: 2.91 time: 0.351062 Sep 19 14:38:52.597285 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 225/469] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:52 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1448 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:52.607434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9437eaad-556c-4b78-866e-7e96762b7879 tempest-FlavorsV255TestJSON-1362801682 tempest-FlavorsV255TestJSON-1362801682-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.065242 Sep 19 14:38:52.609351 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 245/470] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:38:52 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:52.613301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:52.613924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:52.619575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e2601d6-0e4f-4e76-8259-b827057c12a2 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:52.624697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6e2601d6-0e4f-4e76-8259-b827057c12a2 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:52.653753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:52.669925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:52.670389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:52.671225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:52.671718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:52.672149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:52.860724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e2601d6-0e4f-4e76-8259-b827057c12a2 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.890396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e2601d6-0e4f-4e76-8259-b827057c12a2 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.897436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e2601d6-0e4f-4e76-8259-b827057c12a2 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:52.922978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e2601d6-0e4f-4e76-8259-b827057c12a2 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "PUT /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1358 microversion: 2.75 time: 0.311275 Sep 19 14:38:52.924018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 246/471] 10.222.0.81 () {62 vars in 1297 bytes} [Mon Sep 19 14:38:52 2022] PUT /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:53.063961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:53.081683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1f3d5eec-9ec0-422d-b56e-da97ddbb0680 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 0.482777 Sep 19 14:38:53.082330 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 226/472] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:52 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:53.102009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:53.103939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:53.140250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:53.141057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:53.142819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:53.144790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:53.146714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:53.147436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:53.279070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:38:53.626072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-637c8cc6-ae77-4d62-bfff-50a3d0f7eb93 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 204 len: 0 microversion: 2.1 time: 0.539818 Sep 19 14:38:53.628201 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 227/473] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:38:53 2022] DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:38:53.655145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74f3f791-cbc1-4e84-9840-c363ec813018 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:53.657868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74f3f791-cbc1-4e84-9840-c363ec813018 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:53.707414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a5b7280>, body: {"quota_set": {"ram": "5120"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:53.869693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:53.871900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:53.872633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:53.873980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:53.875086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:53.875807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:53.893288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74f3f791-cbc1-4e84-9840-c363ec813018 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:53.926518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:53.935358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74f3f791-cbc1-4e84-9840-c363ec813018 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:53.937658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74f3f791-cbc1-4e84-9840-c363ec813018 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:53.947298 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74f3f791-cbc1-4e84-9840-c363ec813018 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1358 microversion: 2.75 time: 0.313662 Sep 19 14:38:53.949786 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 228/474] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:53 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:53.956237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d6b56c01-8e72-4a7d-94b5-31f2d678bd96 req-52615483-ed3f-493c-ad57-8905c79f25b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f71947-2bb8-4578-85f9-29c818e8d88a", "tag": "f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:53.973650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6b56c01-8e72-4a7d-94b5-31f2d678bd96 req-52615483-ed3f-493c-ad57-8905c79f25b6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:53.974473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6b56c01-8e72-4a7d-94b5-31f2d678bd96 req-52615483-ed3f-493c-ad57-8905c79f25b6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:53.975162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6b56c01-8e72-4a7d-94b5-31f2d678bd96 req-52615483-ed3f-493c-ad57-8905c79f25b6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:53.990139 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-985b158e-7ec0-4757-8b84-f2842ce415f6 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508" status: 200 len: 148 microversion: 2.57 time: 1.064908 Sep 19 14:38:53.997633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 247/475] 10.222.0.81 () {62 vars in 1303 bytes} [Mon Sep 19 14:38:52 2022] PUT /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508 => generated 148 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:53.998286 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d6b56c01-8e72-4a7d-94b5-31f2d678bd96 req-52615483-ed3f-493c-ad57-8905c79f25b6 service nova] Creating event network-changed:f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74 for instance 09f71947-2bb8-4578-85f9-29c818e8d88a on n-h1-858384-1 Sep 19 14:38:54.005408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d6b56c01-8e72-4a7d-94b5-31f2d678bd96 req-52615483-ed3f-493c-ad57-8905c79f25b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053818 Sep 19 14:38:54.006713 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 229/476] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:54.009438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:54.011942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:54.014048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:54.015067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:54.022265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.024016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.024751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.024869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.026002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.026157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.027913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.028413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.028878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.029395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.029616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.033484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.149985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:54.161135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:54.167663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:54.180356 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5eed62c4-bf15-4a95-b5a9-4cb2d15972e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1510 microversion: 2.91 time: 0.171744 Sep 19 14:38:54.181489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 230/477] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:54 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:54.188651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-eb7e470b-1840-456d-b8a6-6b942ecc96ff req-8096a214-967e-42de-ba40-d7665ef9f6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2679ae8-f24f-4bb1-a771-0994a55bd65a", "name": "network-vif-unplugged", "status": "completed", "tag": "0abb9a01-3482-473b-ac11-2d6a4f22ab12"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:54.200887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-eb7e470b-1840-456d-b8a6-6b942ecc96ff req-8096a214-967e-42de-ba40-d7665ef9f6c7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.201516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-eb7e470b-1840-456d-b8a6-6b942ecc96ff req-8096a214-967e-42de-ba40-d7665ef9f6c7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.202179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-eb7e470b-1840-456d-b8a6-6b942ecc96ff req-8096a214-967e-42de-ba40-d7665ef9f6c7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.218077 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-eb7e470b-1840-456d-b8a6-6b942ecc96ff req-8096a214-967e-42de-ba40-d7665ef9f6c7 service nova] Creating event network-vif-unplugged:0abb9a01-3482-473b-ac11-2d6a4f22ab12 for instance d2679ae8-f24f-4bb1-a771-0994a55bd65a on n-h2-858384-1 Sep 19 14:38:54.223643 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-eb7e470b-1840-456d-b8a6-6b942ecc96ff req-8096a214-967e-42de-ba40-d7665ef9f6c7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040329 Sep 19 14:38:54.224759 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 231/478] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:54.233665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1595940379", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "1927601974", "adminPass": "***", "networks": [{"uuid": "43492a9f-0461-4247-9e52-67b0bf35451a"}], "security_groups": [{"name": "tempest-securitygroup--2056380407"}], "key_name": "tempest-keypair-1907518306", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:54.282642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:54.308681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:54.312842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:54.316822 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b631a3cb-d074-4240-b1e2-a914e5af8f0d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.316925 Sep 19 14:38:54.335630 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 248/479] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:53 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:54.343222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Calling method '.version_select at 0x7fde2a545c10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:54.444182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] validate_networks() for [('43492a9f-0461-4247-9e52-67b0bf35451a', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:38:54.446278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.446937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.447619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.450043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.450872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.451591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.490913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8563e41-e12b-4673-9ba8-6f07310c09b7 tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508/detail" status: 200 len: 463 microversion: 2.57 time: 0.154022 Sep 19 14:38:54.512966 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 249/480] 10.222.0.81 () {60 vars in 1304 bytes} [Mon Sep 19 14:38:54 2022] GET /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508/detail => generated 463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:54.529816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:54.530437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:54.551646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.554865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.555823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:54.557324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:54.561191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:54.562412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:55.183985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:55.469770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:55.478950 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd3087a5-3cc9-4166-9cec-935ec57ebc8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 0.963955 Sep 19 14:38:55.491344 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 250/481] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:54 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:55.502595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a4b00d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:55.607778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:55.611108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:55.611650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:55.612561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:55.613209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:55.613780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:55.624156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=17 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:55.673323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:55.673939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:55.674437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:55.675304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:55.675821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:55.676308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:55.794276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d1b2d0f-fa5b-4df7-a60f-a6cd228b4d8c tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508?user_id=c3106d23620449189091e128716cadb7" status: 200 len: 148 microversion: 2.57 time: 0.301013 Sep 19 14:38:55.795330 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 251/482] 10.222.0.81 () {62 vars in 1384 bytes} [Mon Sep 19 14:38:55 2022] PUT /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508?user_id=c3106d23620449189091e128716cadb7 => generated 148 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:55.801626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:55.802247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:55.810837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:55.811348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:55.811789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:55.812513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:55.813130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:55.813573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.073252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:56.095307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:56.097249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:56.110447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ca8b86e-8862-4f5f-bdd7-c6e9f899737e tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1410 microversion: 2.75 time: 0.313913 Sep 19 14:38:56.122775 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 252/483] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:55 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1410 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:56.137744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:56.138375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:56.169242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:56.169789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:56.170239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.171061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:56.174968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:56.176085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.397111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:56.408243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:56.419136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:56.442964 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-235d11a9-fcb0-4fea-9dbf-bab77c4aa587 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1531 microversion: 2.91 time: 0.318136 Sep 19 14:38:56.442964 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 253/484] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:56 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1531 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:56.444868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:56.444868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:56.446825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:56.461160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:56.466582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:38:56.467188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:56.467553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.468430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:38:56.468973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:56.469097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:38:56.469660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:38:56.469932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:56.470341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:38:56.471037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.493866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:56.499267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:56.500130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.501286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:56.502917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:56.503709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:56.557979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Getting quotas for project 2ea30ac65a7f47cb8c41480e5b4a1e3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:38:56.570319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Getting quotas for user c20e5e13d7af46ad87d0c7bb66ec5a19 and project 2ea30ac65a7f47cb8c41480e5b4a1e3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:38:56.617230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:38:56.625347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:38:56.791188 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f6b16d4-d223-419a-9f84-cc798fb1baa1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.564420 Sep 19 14:38:56.807670 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 232/485] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:38:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:38:56.827138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b5bc1b2-ac0e-47eb-8f1b-29b74ad2addb tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] Calling method '.version_select at 0x7fde2a73a3a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:57.113608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:57.129652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:57.131324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:57.135093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00ab3dcd-3daa-422e-8ed7-5d5467249d03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.700578 Sep 19 14:38:57.139193 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 254/486] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:56 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:57.464412 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b5bc1b2-ac0e-47eb-8f1b-29b74ad2addb tempest-QuotasAdminTestV257-767347607 tempest-QuotasAdminTestV257-767347607-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508?user_id=c3106d23620449189091e128716cadb7" status: 200 len: 190 microversion: 2.57 time: 0.653282 Sep 19 14:38:57.467347 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 233/487] 10.222.0.81 () {60 vars in 1364 bytes} [Mon Sep 19 14:38:56 2022] GET /compute/v2.1/os-quota-sets/8eaf0cccf03b44a08e9a245fd2c9c508?user_id=c3106d23620449189091e128716cadb7 => generated 190 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:57.482536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:57.484149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:57.509638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:57.511705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:57.513390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:57.515217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:57.518411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:57.520914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:57.555007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:57.556573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:57.570834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:57.571989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:57.574105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:57.576815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:57.590008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:57.593198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.061286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:38:58.078029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lazy-loading 'services' on Instance uuid 18e172dc-fe01-426d-bcaf-51f504be487b {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:58.247078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17f9ed73-1e45-4475-bcf9-a3847a439a01 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1936 microversion: 2.91 time: 1.106518 Sep 19 14:38:58.251407 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 255/488] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:57 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1936 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:58.259546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7040ea45-e0c5-40d6-a04d-ca3bc33828ab req-9ba4e046-21ec-44ee-afda-709a456828f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2679ae8-f24f-4bb1-a771-0994a55bd65a", "tag": "0abb9a01-3482-473b-ac11-2d6a4f22ab12"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:58.274970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7040ea45-e0c5-40d6-a04d-ca3bc33828ab req-9ba4e046-21ec-44ee-afda-709a456828f3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.275712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7040ea45-e0c5-40d6-a04d-ca3bc33828ab req-9ba4e046-21ec-44ee-afda-709a456828f3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.277596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7040ea45-e0c5-40d6-a04d-ca3bc33828ab req-9ba4e046-21ec-44ee-afda-709a456828f3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.294830 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7040ea45-e0c5-40d6-a04d-ca3bc33828ab req-9ba4e046-21ec-44ee-afda-709a456828f3 service nova] Creating event network-changed:0abb9a01-3482-473b-ac11-2d6a4f22ab12 for instance d2679ae8-f24f-4bb1-a771-0994a55bd65a on n-h2-858384-1 Sep 19 14:38:58.303720 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7040ea45-e0c5-40d6-a04d-ca3bc33828ab req-9ba4e046-21ec-44ee-afda-709a456828f3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050517 Sep 19 14:38:58.305009 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 256/489] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:38:58.311619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:58.313242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:58.333842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.334353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.348214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.348991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.349493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.349930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.520029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:58.537284 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff012d25-8571-44d6-b212-600a2c0ee9c1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1261 microversion: 2.1 time: 0.230820 Sep 19 14:38:58.538205 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 257/490] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:58 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:58.543622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:58.544559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:58.564308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.565269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.565913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.567050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.567517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.567946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.605646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:58.633082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c65fd40-eba7-4081-90b9-13c4a7dc33ec tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 1.163503 Sep 19 14:38:58.634321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 234/491] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:57 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:38:58.654661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:58.657727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:58.678401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.681124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.683795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.684943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.686494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.688901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.793129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:58.828391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:58.833290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:58.857800 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b20be3f2-c7db-40b9-99a4-1ea373541442 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1416 microversion: 2.75 time: 0.318328 Sep 19 14:38:58.872849 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 258/492] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:58 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1416 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:58.886473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:58.888060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:58.895840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.896687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.897349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:58.898235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:58.898952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:58.899596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:59.072254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lazy-loading 'services' on Instance uuid 18e172dc-fe01-426d-bcaf-51f504be487b {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:59.148120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a35e6bab-6205-431b-928a-f98ec62f8778 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1936 microversion: 2.91 time: 0.272280 Sep 19 14:38:59.167743 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 259/493] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:58 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1936 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:59.188074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:59.194296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:59.196050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:59.197137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:59.200961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:59.202122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:59.202813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:59.332459 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-45012ec2-e745-48c8-b74a-421d694bfa86 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.148658 Sep 19 14:38:59.345968 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 260/494] 10.222.0.81 () {60 vars in 1217 bytes} [Mon Sep 19 14:38:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:38:59.359869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:38:59.360836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:59.376943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:59.377818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:59.381807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:59.382857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:59.386688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:59.387457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:59.472172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lazy-loading 'flavor' on Instance uuid 18e172dc-fe01-426d-bcaf-51f504be487b {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:38:59.805473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:59.823866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:59.842639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:38:59.846083 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb098504-c18e-4633-b612-603e1105e181 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 1.207313 Sep 19 14:38:59.849948 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 235/495] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:38:58 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:38:59.862143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:38:59.866470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:38:59.897015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:59.897817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:59.898323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:38:59.899219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:38:59.900094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:38:59.900766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.051004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.076656 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f30a033b-2632-4a15-abe7-7c2f115d1841 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1323 microversion: 2.1 time: 0.225137 Sep 19 14:39:00.078881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 236/496] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:38:59 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:00.094631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:00.095482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:00.116058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.116662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.117177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.117965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.118504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.119091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.124241 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae717f3b-fcd5-4c3c-bf11-bade21f64fbd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action" status: 202 len: 0 microversion: 2.91 time: 0.771814 Sep 19 14:39:00.124859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 261/497] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:38:59 2022] POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:39:00.186106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-efb32ede-1166-4b53-a7a5-65a2e2c6df0c req-3032146c-b49a-4057-a248-9a06d31eda00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2236703-317f-4c8f-95c0-5cf482587fd7", "name": "network-vif-deleted", "tag": "f7fbf092-ba33-4794-890e-184b77c5dc6f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:00.212165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-efb32ede-1166-4b53-a7a5-65a2e2c6df0c req-3032146c-b49a-4057-a248-9a06d31eda00 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.222027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-efb32ede-1166-4b53-a7a5-65a2e2c6df0c req-3032146c-b49a-4057-a248-9a06d31eda00 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.222525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-efb32ede-1166-4b53-a7a5-65a2e2c6df0c req-3032146c-b49a-4057-a248-9a06d31eda00 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.266324 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-efb32ede-1166-4b53-a7a5-65a2e2c6df0c req-3032146c-b49a-4057-a248-9a06d31eda00 service nova] Creating event network-vif-deleted:f7fbf092-ba33-4794-890e-184b77c5dc6f for instance f2236703-317f-4c8f-95c0-5cf482587fd7 on n-h1-858384-1 Sep 19 14:39:00.278275 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-efb32ede-1166-4b53-a7a5-65a2e2c6df0c req-3032146c-b49a-4057-a248-9a06d31eda00 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136385 Sep 19 14:39:00.281679 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 262/498] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:00.293726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:00.294994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:00.304639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.308680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.313647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.316252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.316767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.317208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.534124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.550733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.552742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.564894 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-89f9b9b4-800b-42e1-bd9b-3473b5c6e9df tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1437 microversion: 2.75 time: 0.280939 Sep 19 14:39:00.566840 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 263/499] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:00 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1437 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:00.581332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:00.582574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:00.627384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.628528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.631935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.634852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.638654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.639408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.883621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.903522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.908875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:00.923365 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b7d9b55f-911f-4dd5-84aa-7f6ab4f16378 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.355061 Sep 19 14:39:00.926426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 264/500] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:00 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:00.932471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:00.936364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:00.950226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.953159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.954995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:00.958633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:00.982356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:00.983351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:01.143084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:01.152761 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-556dc2d1-02fb-4183-8e33-051a36a6b7d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 1.071249 Sep 19 14:39:01.157825 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 237/501] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:00 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:01.169920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:01.170552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:01.175036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:01.175520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:01.175837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:01.176241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:01.176646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:01.184050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:01.190570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:01.191475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:01.193071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:01.195185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:01.195842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:01.290084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:01.309042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:01.312274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:01.312847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:01.315070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:01.317234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:01.317794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:01.837688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:01.846993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:01.848380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:01.868198 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b418a77-58cc-4ce5-9dfb-633b76485757 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "POST /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322/action" status: 202 len: 1494 microversion: 2.75 time: 0.940342 Sep 19 14:39:01.869368 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 265/502] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:39:00 2022] POST /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322/action => generated 1494 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 19 14:39:01.887544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:01.888440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:01.896554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:01.897313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:01.897942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:01.898885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:01.899294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:01.899754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.079484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.091710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.099508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.101376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.102716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d983556-4d1b-4d9e-9fdb-983a549a1dd5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.943864 Sep 19 14:39:02.104562 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 238/503] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:01 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:02.123725 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-33ecb943-a0e6-45a2-ba5b-c2bd79a2ff42 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1323 microversion: 2.1 time: 0.233314 Sep 19 14:39:02.124393 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 266/504] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:01 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:02.145629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.146503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:02.154221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.154718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.155186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.155893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.156712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.157295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.341386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.357399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.360901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.367944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8c32469e-923a-4042-82b6-7ecb42411f42 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.227402 Sep 19 14:39:02.369426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 267/505] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:02.379360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.381524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:02.397220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.399265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.401322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.404584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.405144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.407721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.493152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fecb7b62-0ba4-43d1-9948-44d3f47fb541 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Calling method '.version_select at 0x7fde2a6bc670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.496202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fecb7b62-0ba4-43d1-9948-44d3f47fb541 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '31f57663bbd1440494d860673342870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efa19db9651459ba652f67e2d43ac7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fecb7b62-0ba4-43d1-9948-44d3f47fb541 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Request method failure captured: Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8EaQPrL_9R4_mMgevnkEx6j9PhGKtTcQ2UfTn0MjktzlkAVaogXAf2Z4xI32b_dakj40KPS7iuJRl9_koKQQw4hskJoFKborNVIlKJtu6A-wt3yYazObBCj7jp_yuar4SUPCyYXRUQKsDHQWC1uqpTwT_g-8M8sCfd-ggG_Q_pp_s Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:39:02.498053 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7efa19db9651459ba652f67e2d43ac7e"}]}] Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 31f57663bbd1440494d860673342870d Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:39:02.499649 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:02.500616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 19 14:39:02.501967 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.504037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fecb7b62-0ba4-43d1-9948-44d3f47fb541 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:02.505034 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fecb7b62-0ba4-43d1-9948-44d3f47fb541 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.399288 Sep 19 14:39:02.506032 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 239/506] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:02.513097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.513931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:02.523876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.524597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.525222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.526205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.527502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.528095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.625858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.641164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.644448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.655023 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e41a4136-1ade-411f-9854-3a818056264a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.283000 Sep 19 14:39:02.656377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 268/507] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:02.676730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a42123cd-218d-4d66-9c75-c52a139c7cd2 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Calling method '.version_select at 0x7fde2a2b9430>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.681440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a42123cd-218d-4d66-9c75-c52a139c7cd2 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '31f57663bbd1440494d860673342870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efa19db9651459ba652f67e2d43ac7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a42123cd-218d-4d66-9c75-c52a139c7cd2 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Request method failure captured: Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8EaQPrL_9R4_mMgevnkEx6j9PhGKtTcQ2UfTn0MjktzlkAVaogXAf2Z4xI32b_dakj40KPS7iuJRl9_koKQQw4hskJoFKborNVIlKJtu6A-wt3yYazObBCj7jp_yuar4SUPCyYXRUQKsDHQWC1uqpTwT_g-8M8sCfd-ggG_Q_pp_s Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:39:02.685053 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7efa19db9651459ba652f67e2d43ac7e"}]}] Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 31f57663bbd1440494d860673342870d Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: action_args: {} Sep 19 14:39:02.687849 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:02.689691 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 19 14:39:02.692029 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.694173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a42123cd-218d-4d66-9c75-c52a139c7cd2 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:02.694173 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a42123cd-218d-4d66-9c75-c52a139c7cd2 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.029602 Sep 19 14:39:02.694173 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 269/508] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:02.702278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2582623f-2267-4bae-a512-d047735ee3f1 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Calling method '.version_select at 0x7fde2a3c1ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.704385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2582623f-2267-4bae-a512-d047735ee3f1 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '31f57663bbd1440494d860673342870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efa19db9651459ba652f67e2d43ac7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2582623f-2267-4bae-a512-d047735ee3f1 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Request method failure captured: Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8EaQPrL_9R4_mMgevnkEx6j9PhGKtTcQ2UfTn0MjktzlkAVaogXAf2Z4xI32b_dakj40KPS7iuJRl9_koKQQw4hskJoFKborNVIlKJtu6A-wt3yYazObBCj7jp_yuar4SUPCyYXRUQKsDHQWC1uqpTwT_g-8M8sCfd-ggG_Q_pp_s Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:39:02.706972 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7efa19db9651459ba652f67e2d43ac7e"}]}] Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 31f57663bbd1440494d860673342870d Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: action_args: {} Sep 19 14:39:02.708712 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:02.709665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 19 14:39:02.711111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.713348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2582623f-2267-4bae-a512-d047735ee3f1 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:02.715421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2582623f-2267-4bae-a512-d047735ee3f1 tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018168 Sep 19 14:39:02.722628 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 270/509] 10.222.0.81 () {58 vars in 1179 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:02.857159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Calling method '.version_select at 0x7fde2a4c6af0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.868141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.868891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.869544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.894453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.895416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.896050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.900104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:02.924346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:02.925208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:02.926406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:02.944160 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-de93e4b5-e8d5-4b21-a8fb-a998c507cdd9 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.219322 Sep 19 14:39:02.954593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 271/510] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:02.963811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-79f236ca-655a-42e1-b652-98a17dbae86f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Calling method '.version_select at 0x7fde2a3c13a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:02.968420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-79f236ca-655a-42e1-b652-98a17dbae86f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '31f57663bbd1440494d860673342870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efa19db9651459ba652f67e2d43ac7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-79f236ca-655a-42e1-b652-98a17dbae86f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Request method failure captured: Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8EaQPrL_9R4_mMgevnkEx6j9PhGKtTcQ2UfTn0MjktzlkAVaogXAf2Z4xI32b_dakj40KPS7iuJRl9_koKQQw4hskJoFKborNVIlKJtu6A-wt3yYazObBCj7jp_yuar4SUPCyYXRUQKsDHQWC1uqpTwT_g-8M8sCfd-ggG_Q_pp_s Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:39:02.970804 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7efa19db9651459ba652f67e2d43ac7e"}]}] Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 31f57663bbd1440494d860673342870d Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1'} Sep 19 14:39:02.973681 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:02.974651 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 19 14:39:02.976486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:02.980159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-79f236ca-655a-42e1-b652-98a17dbae86f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:02.981542 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-79f236ca-655a-42e1-b652-98a17dbae86f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025157 Sep 19 14:39:02.982454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 272/511] 10.222.0.81 () {58 vars in 1173 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:02.996496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b5049e4f-9467-4012-ab00-5b9b71d518f1 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Calling method '.version_select at 0x7fde2a314ca0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.003478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b5049e4f-9467-4012-ab00-5b9b71d518f1 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] HTTP exception thrown: Hypervisor with ID 'd3d8fec7-540a-4e13-b150-ee2d4c213667' could not be found. Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b5049e4f-9467-4012-ab00-5b9b71d518f1 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Request method failure captured: Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-hypervisors/d3d8fec7-540a-4e13-b150-ee2d4c213667/uptime HTTP/1.1 Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8F6uFN2qAYRsIW95OBKo9muA824Fh3j4IvWmbveVkShvQQj3hlqy4HbIS3RMHfelfNAFjE40JBcYRO1h8hT9M7YG7Ku-kOrA0S5R1R5krDFZ6Mw_wsVzWZsjWS2-Cme9ThULEx6kcfWhUIjSwCLgKKgGZs-U_1EtXTgizfMs3vxpM Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: bd31696db1e9468a915b7328ad9704d1 Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-908199772 Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:39:03.013518 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bd31696db1e9468a915b7328ad9704d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd31696db1e9468a915b7328ad9704d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd31696db1e9468a915b7328ad9704d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bd31696db1e9468a915b7328ad9704d1"}]}] Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-908199772 Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: bd31696db1e9468a915b7328ad9704d1 Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-908199772 Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f26b0315f087452e8e1c7ced2b961fa0 Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: exception: Hypervisor with ID 'd3d8fec7-540a-4e13-b150-ee2d4c213667' could not be found. Sep 19 14:39:03.015122 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd3d8fec7-540a-4e13-b150-ee2d4c213667'} Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd3d8fec7-540a-4e13-b150-ee2d4c213667' Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 19 14:39:03.015982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd3d8fec7-540a-4e13-b150-ee2d4c213667' could not be found. Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.023628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd3d8fec7-540a-4e13-b150-ee2d4c213667' could not be found. Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b5049e4f-9467-4012-ab00-5b9b71d518f1 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Returning 404 to user: Hypervisor with ID 'd3d8fec7-540a-4e13-b150-ee2d4c213667' could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b5049e4f-9467-4012-ab00-5b9b71d518f1 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/d3d8fec7-540a-4e13-b150-ee2d4c213667/uptime" status: 404 len: 123 microversion: 2.1 time: 0.024683 Sep 19 14:39:03.025604 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 273/512] 10.222.0.81 () {58 vars in 1278 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/os-hypervisors/d3d8fec7-540a-4e13-b150-ee2d4c213667/uptime => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:03.036073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Calling method '.version_select at 0x7fde2a473790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.041864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.043097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.043717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.084201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.086508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.088670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.113934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.114443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.114931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.136867 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b5ca907c-84cd-4a5e-9625-dd45cc0b764e tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109656 Sep 19 14:39:03.140548 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 274/513] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:03.149749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.153140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:03.165974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.168698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.172622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.174855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.178955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.179731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.211331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.226019 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-60ddf997-0c34-43f1-92e5-a7c42eeab180 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 0.717402 Sep 19 14:39:03.226667 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 240/514] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:02 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:03.251373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2c31c2e-64ea-422f-83bd-854496ff875f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Calling method '.version_select at 0x7fde2a6d6310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.253158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2c31c2e-64ea-422f-83bd-854496ff875f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '31f57663bbd1440494d860673342870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efa19db9651459ba652f67e2d43ac7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2c31c2e-64ea-422f-83bd-854496ff875f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Request method failure captured: Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8EaQPrL_9R4_mMgevnkEx6j9PhGKtTcQ2UfTn0MjktzlkAVaogXAf2Z4xI32b_dakj40KPS7iuJRl9_koKQQw4hskJoFKborNVIlKJtu6A-wt3yYazObBCj7jp_yuar4SUPCyYXRUQKsDHQWC1uqpTwT_g-8M8sCfd-ggG_Q_pp_s Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:39:03.255250 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7efa19db9651459ba652f67e2d43ac7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7efa19db9651459ba652f67e2d43ac7e"}]}] Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7efa19db9651459ba652f67e2d43ac7e Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809 Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 31f57663bbd1440494d860673342870d Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1092148809-project Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1'} Sep 19 14:39:03.256501 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:03.263985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 19 14:39:03.265113 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.266197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2c31c2e-64ea-422f-83bd-854496ff875f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:03.266197 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2c31c2e-64ea-422f-83bd-854496ff875f tempest-HypervisorAdminNegativeTestJSON-1092148809 tempest-HypervisorAdminNegativeTestJSON-1092148809-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.028294 Sep 19 14:39:03.266197 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 241/515] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:03.271669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.272293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:03.282840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.283616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.284235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.285430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.286070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.286668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.481256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.525804 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c4ec9bac-a365-468b-981e-44ab9f288b7e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1323 microversion: 2.1 time: 0.261637 Sep 19 14:39:03.537599 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 242/516] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:03.545232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf18a821-766b-4692-b97f-3d2cc856db35 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Calling method '.version_select at 0x7fde2a68e5e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.566387 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-cf18a821-766b-4692-b97f-3d2cc856db35 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] HTTP exception thrown: Hypervisor with ID '702819e6-cda7-4056-855a-d035fa0b4f3f' could not be found. Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf18a821-766b-4692-b97f-3d2cc856db35 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Request method failure captured: Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-hypervisors/702819e6-cda7-4056-855a-d035fa0b4f3f HTTP/1.1 Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8F6uFN2qAYRsIW95OBKo9muA824Fh3j4IvWmbveVkShvQQj3hlqy4HbIS3RMHfelfNAFjE40JBcYRO1h8hT9M7YG7Ku-kOrA0S5R1R5krDFZ6Mw_wsVzWZsjWS2-Cme9ThULEx6kcfWhUIjSwCLgKKgGZs-U_1EtXTgizfMs3vxpM Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: bd31696db1e9468a915b7328ad9704d1 Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-908199772 Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:39:03.574664 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bd31696db1e9468a915b7328ad9704d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd31696db1e9468a915b7328ad9704d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd31696db1e9468a915b7328ad9704d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bd31696db1e9468a915b7328ad9704d1"}]}] Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-908199772 Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: bd31696db1e9468a915b7328ad9704d1 Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-908199772 Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f26b0315f087452e8e1c7ced2b961fa0 Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: exception: Hypervisor with ID '702819e6-cda7-4056-855a-d035fa0b4f3f' could not be found. Sep 19 14:39:03.576635 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '702819e6-cda7-4056-855a-d035fa0b4f3f'} Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '702819e6-cda7-4056-855a-d035fa0b4f3f' Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 19 14:39:03.577733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:39:03.579492 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '702819e6-cda7-4056-855a-d035fa0b4f3f' could not be found. Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '702819e6-cda7-4056-855a-d035fa0b4f3f' could not be found. Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:03.581155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf18a821-766b-4692-b97f-3d2cc856db35 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] Returning 404 to user: Hypervisor with ID '702819e6-cda7-4056-855a-d035fa0b4f3f' could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:03.582490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf18a821-766b-4692-b97f-3d2cc856db35 tempest-HypervisorAdminNegativeTestJSON-908199772 tempest-HypervisorAdminNegativeTestJSON-908199772-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/702819e6-cda7-4056-855a-d035fa0b4f3f" status: 404 len: 123 microversion: 2.1 time: 0.043581 Sep 19 14:39:03.583618 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 243/517] 10.222.0.81 () {58 vars in 1257 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/os-hypervisors/702819e6-cda7-4056-855a-d035fa0b4f3f => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:03.598608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.601122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:03.611323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.613115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.613866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.614714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.615304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:03.616096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:03.816303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.819485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.862435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.893779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.900319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.919125 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab2efe71-cdb7-4eaf-a233-c39bfd548a1c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.330462 Sep 19 14:39:03.921441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:03.922924 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 244/518] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:03.945729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:03.959314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:03.968673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aedc4c54-4dec-4b41-a04b-e49df8add32b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.826454 Sep 19 14:39:03.969565 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 275/519] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:03.990541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:03.999519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:04.003393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:04.020366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:04.021562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:04.024604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:04.255989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:04.257077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:04.320517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:04.321675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:04.322815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:04.331700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:04.332742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:04.333795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:04.397181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:04.450532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:04.460420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:04.481368 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0d945d86-49ca-4900-9152-af11582ef0c7 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.555607 Sep 19 14:39:04.482396 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 245/520] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:03 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:04.557558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:04.559175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:04.569614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:04.572275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:04.572822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:04.575153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:04.577539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:04.584457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.045017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.060347 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3043b25-f697-4105-8a4c-57c6627cca4e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1504 microversion: 2.1 time: 0.812592 Sep 19 14:39:05.061106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 276/521] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:04 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:05.069512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:05.070238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:05.078350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.079520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.080135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.081134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.081904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.082563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.289633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.317452 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d553e2f5-365f-42f3-ab86-29d2f3ae6047 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 0.763621 Sep 19 14:39:05.324542 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 246/522] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:04 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:05.337099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:05.341598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:05.356834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.358151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.358953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.361196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.362026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.362789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.378048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.393826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.395694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.408818 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ca2532f-b03c-498b-9b21-c51a6cc8d88b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.346549 Sep 19 14:39:05.440510 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 277/523] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:05 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:05.452665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-05bb2b1f-5d59-4176-83e5-83547a536b46 req-bbde813a-f14f-4997-b98d-1c7c77acc891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f71947-2bb8-4578-85f9-29c818e8d88a", "name": "network-vif-plugged", "status": "completed", "tag": "f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:05.477261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-05bb2b1f-5d59-4176-83e5-83547a536b46 req-bbde813a-f14f-4997-b98d-1c7c77acc891 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.477768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-05bb2b1f-5d59-4176-83e5-83547a536b46 req-bbde813a-f14f-4997-b98d-1c7c77acc891 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.478212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-05bb2b1f-5d59-4176-83e5-83547a536b46 req-bbde813a-f14f-4997-b98d-1c7c77acc891 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.498128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-05bb2b1f-5d59-4176-83e5-83547a536b46 req-bbde813a-f14f-4997-b98d-1c7c77acc891 service nova] Creating event network-vif-plugged:f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74 for instance 09f71947-2bb8-4578-85f9-29c818e8d88a on n-h1-858384-1 Sep 19 14:39:05.503497 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-05bb2b1f-5d59-4176-83e5-83547a536b46 req-bbde813a-f14f-4997-b98d-1c7c77acc891 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061060 Sep 19 14:39:05.504662 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 278/524] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:05.513828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:05.514799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:05.523202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.523984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.524589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.525552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:05.526169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:05.527591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:05.715824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.732980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.735950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.743026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8455320-b2d8-4979-8bda-b29a30988603 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.234805 Sep 19 14:39:05.762859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 279/525] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:05 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:05.883453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.888080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:05.899969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.902780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:05.905121 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-927527e7-191c-4e86-b03b-5ff313d40d1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1362 microversion: 2.25 time: 0.577189 Sep 19 14:39:05.906396 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 247/526] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:05 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:06.088726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:06.089359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:06.100693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=30 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:06.109042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.109970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.111469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.113510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.114696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.115166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.358737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:06.359500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:06.371441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.375561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.378405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.379296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.379711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.380149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.525856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:06.592217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:06.601512 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae9aa689-4292-4549-b4d7-c789b01df8ba tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1479 microversion: 2.1 time: 0.517818 Sep 19 14:39:06.602414 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 280/527] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:06 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1479 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:06.619116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:06.619776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:06.642070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.642070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.642070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.642070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.642389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.642818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.779830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:06.798353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:06.800074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:06.807020 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-959c0c96-3329-4551-ad7c-1bf8fcbd4e3d tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.203695 Sep 19 14:39:06.831400 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 281/528] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:06 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:06.845603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ddb36a8-2aa1-40a0-a605-cd47022d23f5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '.version_select at 0x7fde2a28cca0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:06.849280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddb36a8-2aa1-40a0-a605-cd47022d23f5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.849974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddb36a8-2aa1-40a0-a605-cd47022d23f5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.850603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddb36a8-2aa1-40a0-a605-cd47022d23f5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.874336 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ddb36a8-2aa1-40a0-a605-cd47022d23f5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.040783 Sep 19 14:39:06.875509 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 282/529] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:39:06 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:06.889180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:06.890084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:06.900967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.902434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.903173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.906575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.907285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.911675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.944085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:06.958975 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-918f22db-1748-4d9d-a015-b9c4ff6481de tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 0.611612 Sep 19 14:39:06.959930 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 248/530] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:06 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:06.965610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:06.968448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:06.990692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.991424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.992052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:06.992966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:06.993658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:06.994062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:07.204351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:07.234089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:07.239520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:07.272871 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-64f2d08f-4506-4a2a-99bc-a01e73da251a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.380973 Sep 19 14:39:07.299111 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 283/531] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:06 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:07.312506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:07.313128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:07.335814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:07.336203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:07.336644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:07.337369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:07.337831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:07.349702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:07.436674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=11 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:07.913531 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a6262323-8b92-4070-938c-9af8843bbe5d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1630 microversion: 2.1 time: 0.951506 Sep 19 14:39:07.916731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 249/532] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:06 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1630 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:07.938115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-da8902e5-ed0f-437b-99a0-47c676a1b00b req-fac5417b-7bd2-4046-91c8-20f5e99d986f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910cecb9-63f3-4ab8-9ef4-92d4af15b996", "tag": "0ff9d586-7183-4c29-ad3b-d8f08b31311a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:07.970413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-da8902e5-ed0f-437b-99a0-47c676a1b00b req-fac5417b-7bd2-4046-91c8-20f5e99d986f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:07.971859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-da8902e5-ed0f-437b-99a0-47c676a1b00b req-fac5417b-7bd2-4046-91c8-20f5e99d986f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:07.975166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-da8902e5-ed0f-437b-99a0-47c676a1b00b req-fac5417b-7bd2-4046-91c8-20f5e99d986f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:07.990798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.000076 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-da8902e5-ed0f-437b-99a0-47c676a1b00b req-fac5417b-7bd2-4046-91c8-20f5e99d986f service nova] Creating event network-changed:0ff9d586-7183-4c29-ad3b-d8f08b31311a for instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 on n-h1-858384-1 Sep 19 14:39:08.012117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.014786 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-da8902e5-ed0f-437b-99a0-47c676a1b00b req-fac5417b-7bd2-4046-91c8-20f5e99d986f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095005 Sep 19 14:39:08.015255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.015751 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 250/533] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:08.018640 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-36602d37-8276-467c-805d-73e4602c47d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1558 microversion: 2.25 time: 0.719198 Sep 19 14:39:08.023169 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 284/534] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:07 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1558 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:08.034069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:08.035221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:08.037289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bec0161f-1b45-45cb-9335-7226db4abee8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Action: 'create', calling method: .version_select at 0x7fde2a358790>, body: {"keypair": {"name": "tempest-keypair-1235644104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLzW6bonkAAnStzpa7iAG/DcOkcBoXz5ldkFPuZP9T/Ob9mIbhs2IQRkUO4HPPSKD28dXSXGhJxkHtKkqO0hUQ0sZN6vmV1L7bVPY6eQaPf77YT7bjrV84s4vixZzAKpQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:08.055638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.056553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.060012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.061231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.062593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.065188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.067797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-bec0161f-1b45-45cb-9335-7226db4abee8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for project 512934300eb6480bab9b4394114bbc30. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:08.074336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-bec0161f-1b45-45cb-9335-7226db4abee8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for user a989536b40ed41ddaa1554bf40378758 and project 512934300eb6480bab9b4394114bbc30. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:08.126825 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bec0161f-1b45-45cb-9335-7226db4abee8 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100983 Sep 19 14:39:08.127933 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 285/535] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:39:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:08.138659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:08.143693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:08.164773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.166774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.170604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.172562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.173315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.174641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.360808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.380130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.387213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.406252 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0eb3d700-7930-4621-a26a-7a28b32dca4a tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.389163 Sep 19 14:39:08.408229 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 251/536] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:08 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:08.739680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:08.754726 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cdbd33c8-f670-4170-8008-c818cb735c02 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 0.625336 Sep 19 14:39:08.760467 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 286/537] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:08 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:08.766179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:08.777126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:08.781870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:08.795564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.803789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.804613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.805744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.806475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.807330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.886398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:08.887307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:08.907511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.911582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.912041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:08.917799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:08.921109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:08.922766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:09.074804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:09.086059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:09.104124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:09.119157 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5877a84a-877b-4177-8cc8-b7e0dfec0192 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.356809 Sep 19 14:39:09.119707 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 287/538] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:08 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:09.219828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:09.315053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 09f71947-2bb8-4578-85f9-29c818e8d88a {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:09.444130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8626c856-b3af-409c-9994-2686ad24f49e tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 2051 microversion: 2.25 time: 1.032974 Sep 19 14:39:09.445016 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 252/539] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:08 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 2051 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:09.454906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:09.455780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:09.471269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:09.471713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:09.472417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:09.484641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:09.485896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:09.487109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:09.640928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1015964897", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:09.665450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:09.676503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:09.678000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:09.698468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:09.700185 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0fb79538-dc95-4c34-a7ad-19e8269f8d02 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.250147 Sep 19 14:39:09.704433 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 253/540] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:09 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:09.711026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:09.723696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:09.747198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:09.747722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:09.750312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:09.755600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:09.759284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:09.759829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:09.763218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:10.214817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 09f71947-2bb8-4578-85f9-29c818e8d88a {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:10.238291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ffe081d-e829-41bf-8ee6-2ffe8f803877 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 2051 microversion: 2.25 time: 0.532481 Sep 19 14:39:10.244890 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 254/541] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:09 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 2051 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:10.263785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:10.264555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:10.277416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:10.278207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:10.278968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:10.279838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:10.280423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:10.283338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:10.452013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:10.452595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:10.453188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:10.453712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:10.454235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:10.483279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:10.490529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:10.495711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:10.496910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:10.497655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:10.498352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:10.531114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Getting quotas for project b861518542eb4523bfa081e634ad1419. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:10.538190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Getting quotas for user d31d7d194a2742e78c7fb85b8a31d5a5 and project b861518542eb4523bfa081e634ad1419. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:10.564160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:10.566864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:10.730881 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6c47881-fb1f-4f26-836f-b6902dbe4f71 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607186 Sep 19 14:39:10.740930 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 288/542] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:39:10.757716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:10.763632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:10.788210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:10.789409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:10.791782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:10.793729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:10.795769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:10.796471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.007713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.032835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.033768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.039225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.059534 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b72fbd34-c9de-4755-b28e-bf05c13386ec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 0.799620 Sep 19 14:39:11.060785 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 255/543] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:10 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:11.072966 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4917eff7-5aa1-4984-be39-176ff046f2ae tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.316247 Sep 19 14:39:11.078305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:11.081319 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 289/544] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:10 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:11.097646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:11.098813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:11.103201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:11.108305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:11.108441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.111574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:11.112057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:11.112490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.142270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:11.143423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:11.144612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.146713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:11.147864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:11.148803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.194072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64b0e439-7cae-44d8-9ea4-ba883ba0019a tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.120222 Sep 19 14:39:11.197391 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 256/545] 10.222.0.81 () {60 vars in 1217 bytes} [Mon Sep 19 14:39:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:39:11.219571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bbb3dc8-7346-44e7-a47a-36c30a9b4f5e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:11.220817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bbb3dc8-7346-44e7-a47a-36c30a9b4f5e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:11.299219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.329213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.331717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.339530 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75027ce5-a8d4-4651-8f29-780bb4b69de5 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.255616 Sep 19 14:39:11.340820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 290/546] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:11 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:11.359578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": "auto"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:11.363213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:11.376181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:11.376959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:11.377829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.381111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:11.381524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:11.382124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:11.383436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3bbb3dc8-7346-44e7-a47a-36c30a9b4f5e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:11.399150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bbb3dc8-7346-44e7-a47a-36c30a9b4f5e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1223 microversion: 2.1 time: 0.199132 Sep 19 14:39:11.400004 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 257/547] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:11 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:11.465442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'flavor' on Instance uuid 09f71947-2bb8-4578-85f9-29c818e8d88a {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:11.515843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Going to try to live migrate instance to n-h2-858384-1 {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:39:11.688313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:12.090981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:12.100880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:12.132857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:12.138221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:12.146390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:12.147927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:12.148782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:12.149594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:12.605723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:12.623958 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1a01b71-986e-4631-be28-30170eb4b276 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 0.541156 Sep 19 14:39:12.648768 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 258/548] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:12 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:12.665559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:12.666372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:12.675155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:12.676171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:12.676822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:12.688968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:12.694672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:12.695293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:12.874319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:12.897307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:12.901146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:12.914258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c901205f-99ed-4187-8e83-713bf1b1bb3e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.263405 Sep 19 14:39:12.917926 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 259/549] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:12 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:13.210324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1987597321", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:13.381386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:13.960343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:13.961774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:13.962955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:13.966785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:13.970134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:14.010185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.013028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.015096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.016921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.017657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.018351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.049470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:14.057122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:14.082820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:14.085064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:14.200745 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d6a6a4ff-68d1-410f-9874-beafea2d6511 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279163 Sep 19 14:39:14.201943 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 260/550] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:39:14.207133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:14.209141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:14.222276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.223026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.223544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.224561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.225263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.225969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.381419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:14.398928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:14.400446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:14.410506 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c49953f9-cfa8-4825-83e7-4b5d311f7128 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.207337 Sep 19 14:39:14.414329 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 261/551] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:14 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:14.429514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:14.430593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:14.445595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.446103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.446551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.447318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.447780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.448247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.567989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:14.583178 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-505b7d8a-4b2a-4ed0-9035-340c8c178422 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1281 microversion: 2.1 time: 0.167448 Sep 19 14:39:14.584153 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 262/552] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:14 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:14.592039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:14.592877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:14.610934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.611802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.612537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:14.613470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:14.614490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:14.615787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:15.033942 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54c9d0e3-6913-44de-a057-5054e499ec6d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a/action" status: 202 len: 0 microversion: 2.25 time: 3.691809 Sep 19 14:39:15.042077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 291/553] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:39:11 2022] POST /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a/action => generated 0 bytes in 3699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:39:15.057049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1621573338", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "eb86d89b-8fd6-474f-a09d-aade8cfee6cf"}], "security_groups": [{"name": "tempest-securitygroup--1980525095"}], "key_name": "tempest-keypair-1235644104", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:15.603900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:15.627177 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-22147045-16bb-43d2-8c89-82efd08a7b19 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 1.033626 Sep 19 14:39:15.634892 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 263/554] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:14 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:15.635498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:15.640601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:15.651666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:15.652319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:15.652787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:15.653794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:15.654314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:15.655210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:15.699209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] validate_networks() for [('eb86d89b-8fd6-474f-a09d-aade8cfee6cf', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:15.866102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:15.883034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:15.887725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:15.899247 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-399527da-6129-4bb2-8f37-11140e6b87f6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.267462 Sep 19 14:39:15.900519 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 264/555] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:15 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:15.906486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:15.907363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:15.934882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:15.935755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:15.936410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:15.937347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:15.940778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:15.941533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:16.173907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:16.187482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8cdaedb7-1815-48c6-8706-ced9bc22e4c6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1269 microversion: 2.1 time: 0.285663 Sep 19 14:39:16.188092 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 265/556] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:15 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1269 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:16.193141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:16.194093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:16.201598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:16.202317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:16.203020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:16.204030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:16.204575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:16.205099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.044559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.057019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:17.063371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.066189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.069152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d495b6ba-7921-4cc1-866d-2037f3824dd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.880077 Sep 19 14:39:17.070502 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 266/557] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:16 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:17.075818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4fca3320-c710-4ea0-81fa-92919ab00595 req-7ccd09a6-6d01-4f3b-9cff-6e5a37f1b75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910cecb9-63f3-4ab8-9ef4-92d4af15b996", "name": "network-vif-plugged", "status": "completed", "tag": "0ff9d586-7183-4c29-ad3b-d8f08b31311a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:17.098953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4fca3320-c710-4ea0-81fa-92919ab00595 req-7ccd09a6-6d01-4f3b-9cff-6e5a37f1b75a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.099381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4fca3320-c710-4ea0-81fa-92919ab00595 req-7ccd09a6-6d01-4f3b-9cff-6e5a37f1b75a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.099861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4fca3320-c710-4ea0-81fa-92919ab00595 req-7ccd09a6-6d01-4f3b-9cff-6e5a37f1b75a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.113633 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4fca3320-c710-4ea0-81fa-92919ab00595 req-7ccd09a6-6d01-4f3b-9cff-6e5a37f1b75a service nova] Creating event network-vif-plugged:0ff9d586-7183-4c29-ad3b-d8f08b31311a for instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 on n-h1-858384-1 Sep 19 14:39:17.120586 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4fca3320-c710-4ea0-81fa-92919ab00595 req-7ccd09a6-6d01-4f3b-9cff-6e5a37f1b75a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047972 Sep 19 14:39:17.122925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 267/558] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:17.134384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:17.135817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:17.144967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.146945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.147830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.149766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.151192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.152555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.405257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.422654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.424740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.437015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b34bf712-5d3c-45d7-99a2-b4cce0f82fc4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.312148 Sep 19 14:39:17.454277 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 268/559] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:17 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:17.474424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:17.475471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:17.483427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.484770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.485469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.489301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.490279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.491041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.655911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:17.656997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:17.657539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:17.658197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:17.659216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:17.681683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.683713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.684497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.684847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.685518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.686180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.711982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:17.720959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for user a989536b40ed41ddaa1554bf40378758 and project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:17.747696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:17.750100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:17.847297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:17.849745 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-47312134-91e0-4546-ae7a-4d28016ede9e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.804375 Sep 19 14:39:17.850400 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 292/560] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:39:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:39:17.866544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:17.867194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:17.869094 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f82cca9-e5c4-45bc-beeb-4cac6fd9a7be tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 0.412038 Sep 19 14:39:17.872571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 269/561] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:17 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:17.893896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:17.894608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:17.895787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.896298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.903822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.904391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.904885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.905332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.913870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.914427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.914902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:17.916027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:17.916545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:17.917065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:18.079752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:18.096823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:18.099676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:18.119295 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-33525b82-ed5a-49a0-80a1-255d32d84298 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.241960 Sep 19 14:39:18.121919 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 270/562] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:17 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:18.130177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:18.138997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:18.165451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:18.166680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:18.168131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:18.171134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:18.174953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:18.176903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:18.334103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:18.352923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9dbeb633-7a8a-4be6-875e-db0735d565ff tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1391 microversion: 2.1 time: 0.496340 Sep 19 14:39:18.365196 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 293/563] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:17 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:18.383508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b76cbcf-499d-4766-ab4c-ff82b03b26cd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:18.384224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b76cbcf-499d-4766-ab4c-ff82b03b26cd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:18.409913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:18.423709 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4b0f8e8-1cc8-460e-a610-211aae7bfb09 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1275 microversion: 2.1 time: 0.295831 Sep 19 14:39:18.424759 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 271/564] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:18 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:18.439543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:18.440502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:18.447926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:18.453022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:18.455295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:18.467979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:18.471953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:18.473089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:18.784886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7b76cbcf-499d-4766-ab4c-ff82b03b26cd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:18.796173 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b76cbcf-499d-4766-ab4c-ff82b03b26cd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1235 microversion: 2.1 time: 0.428596 Sep 19 14:39:18.797009 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 294/565] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:18 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1235 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:18.822904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:18.825505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:18.846788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:18.847286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:18.847721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:18.848435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:18.848901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:18.849315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.129377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.153358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.160413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.193318 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-52f2938e-5779-4afa-8e50-a0d9480d310c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.384945 Sep 19 14:39:19.195713 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 295/566] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:18 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:19.210880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.213346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f40160ef-a616-45dd-bc41-06e62927baa4 req-2d0cc477-1d15-42a4-a5c1-3bad7c8e98f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8b40db-13c3-4747-b112-a5fbd27d33ee", "tag": "88d4918c-e11b-44f5-8385-9b9b3f655ba8"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:19.223619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.226447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.231071 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-34fb1cd5-3873-4c88-b0c5-454353012b21 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.804345 Sep 19 14:39:19.233853 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 272/567] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:18 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:19.242404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:19.243052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:19.256606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.257108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.260163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.260997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.261476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.261907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.268495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f40160ef-a616-45dd-bc41-06e62927baa4 req-2d0cc477-1d15-42a4-a5c1-3bad7c8e98f9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.269396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f40160ef-a616-45dd-bc41-06e62927baa4 req-2d0cc477-1d15-42a4-a5c1-3bad7c8e98f9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.272819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f40160ef-a616-45dd-bc41-06e62927baa4 req-2d0cc477-1d15-42a4-a5c1-3bad7c8e98f9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.311289 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f40160ef-a616-45dd-bc41-06e62927baa4 req-2d0cc477-1d15-42a4-a5c1-3bad7c8e98f9 service nova] Creating event network-changed:88d4918c-e11b-44f5-8385-9b9b3f655ba8 for instance af8b40db-13c3-4747-b112-a5fbd27d33ee on n-h2-858384-1 Sep 19 14:39:19.325364 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f40160ef-a616-45dd-bc41-06e62927baa4 req-2d0cc477-1d15-42a4-a5c1-3bad7c8e98f9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125363 Sep 19 14:39:19.328916 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 296/568] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:19.347113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:19.350197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:19.367127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.368726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.369754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.372308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.373431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.374487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.540114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.565814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.567376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.582641 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a5e3337-e414-4268-bca4-4d6bb025bd4c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.251477 Sep 19 14:39:19.584049 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 297/569] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:19 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:19.590282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:19.600990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:19.607973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.608474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.608956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.610000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.610463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.611113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.817128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:19.842008 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6bbe871f-33a5-4d09-a87c-a919e2db23e7 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 0.606685 Sep 19 14:39:19.842402 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 273/570] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:19 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:19.848863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:19.849695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:19.859991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.861223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.861826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:19.863017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:19.863650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:19.864285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:20.626101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:20.641893 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2fdd06f5-abd5-4b24-8829-7edc80c2eaec tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1589 microversion: 2.1 time: 1.056212 Sep 19 14:39:20.643686 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 298/571] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:19 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1589 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:20.650356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:20.652205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:20.661230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:20.662315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:20.663070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:20.664009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:20.665345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:20.665905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:20.784210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:20.794976 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28f32187-41ee-498f-b6a1-089775de297c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.950742 Sep 19 14:39:20.798807 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 274/572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:19 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:20.814336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:20.818240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:20.819152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:20.829824 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4ec1cca1-3042-40c2-b1fa-f68a19bd71c7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1293 microversion: 2.1 time: 0.184677 Sep 19 14:39:20.846359 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 299/573] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:20 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1293 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:20.846359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:20.846359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:20.850373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:20.852660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:20.855118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:20.858626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:20.859303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:20.861160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:20.861951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:20.862556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:20.863678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:20.864482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:20.864958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:20.865390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.118255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.132035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.133507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.140525 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1fdb8904-782b-4e35-a1d0-d7ed61a62073 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.340342 Sep 19 14:39:21.142248 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 275/574] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:20 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:21.147267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5b6b64ed-4b43-4436-967b-2507f78a3e1a req-1e65b3b7-dc20-4bd2-a047-657985b4f833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9085e40-1d2e-49e2-b258-cf1528c9877b", "tag": "ecb476e9-c2c4-486c-a74a-06020674886d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:21.159668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5b6b64ed-4b43-4436-967b-2507f78a3e1a req-1e65b3b7-dc20-4bd2-a047-657985b4f833 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.160920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5b6b64ed-4b43-4436-967b-2507f78a3e1a req-1e65b3b7-dc20-4bd2-a047-657985b4f833 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.161549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5b6b64ed-4b43-4436-967b-2507f78a3e1a req-1e65b3b7-dc20-4bd2-a047-657985b4f833 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.197650 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5b6b64ed-4b43-4436-967b-2507f78a3e1a req-1e65b3b7-dc20-4bd2-a047-657985b4f833 service nova] Creating event network-changed:ecb476e9-c2c4-486c-a74a-06020674886d for instance c9085e40-1d2e-49e2-b258-cf1528c9877b on n-h2-858384-1 Sep 19 14:39:21.204158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5b6b64ed-4b43-4436-967b-2507f78a3e1a req-1e65b3b7-dc20-4bd2-a047-657985b4f833 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060222 Sep 19 14:39:21.205424 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 276/575] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:21.221823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:21.222917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:21.232590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.233391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.234028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.234948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.235570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.236227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.443494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.460216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.461688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.471412 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c396e1d-4050-4e34-8924-52fe2555978f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.264533 Sep 19 14:39:21.472017 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 277/576] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:21 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:21.481762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:21.482272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:21.505207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.505742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.506173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.507123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.507757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.508781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.568754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.582694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.585343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:21.586795 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0cae9872-c5ec-4790-a7cf-0782e0552f69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.754935 Sep 19 14:39:21.590995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 300/577] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:20 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:21.603057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:21.632849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:21.644294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.645070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.646344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.650081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.653149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.654508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.795934 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-16dcd684-4a92-4a84-b7ef-4ca250d3677c tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.322782 Sep 19 14:39:21.796619 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 278/578] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:39:21 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:21.803010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-70690ff0-521f-4669-b845-93b23139843b req-daa57c73-36c9-4092-9fea-865fcd6c3a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f71947-2bb8-4578-85f9-29c818e8d88a", "name": "network-vif-unplugged", "status": "completed", "tag": "f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:21.831847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-70690ff0-521f-4669-b845-93b23139843b req-daa57c73-36c9-4092-9fea-865fcd6c3a19 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.832346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-70690ff0-521f-4669-b845-93b23139843b req-daa57c73-36c9-4092-9fea-865fcd6c3a19 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.832782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-70690ff0-521f-4669-b845-93b23139843b req-daa57c73-36c9-4092-9fea-865fcd6c3a19 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.869363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-70690ff0-521f-4669-b845-93b23139843b req-daa57c73-36c9-4092-9fea-865fcd6c3a19 service nova] Creating event network-vif-unplugged:f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74 for instance 09f71947-2bb8-4578-85f9-29c818e8d88a on n-h1-858384-1 Sep 19 14:39:21.876842 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-70690ff0-521f-4669-b845-93b23139843b req-daa57c73-36c9-4092-9fea-865fcd6c3a19 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079023 Sep 19 14:39:21.877471 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 279/579] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:21.895571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:21.897733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:21.917464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.917975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.918603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:21.919804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:21.920454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:21.923790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.593302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:22.607084 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4dbb20b2-1c41-4709-a6f2-460eafb8cef5 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 1.014625 Sep 19 14:39:22.614913 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 301/580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:21 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:22.627532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:22.628407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:22.646771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.649183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.651981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.652793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.653275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.653709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.684005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:22.695982 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c094d08-a786-4a3e-8d78-ee133632801e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.817243 Sep 19 14:39:22.696994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 280/581] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:21 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:22.709297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:22.712156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:22.733974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.736503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.736971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.737687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.740415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.741006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.832041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:22.842805 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ba47b50-d896-4af0-9307-be4cb5909f0b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1293 microversion: 2.1 time: 0.233805 Sep 19 14:39:22.860402 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 302/582] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:22 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:22.867835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:22.868747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:22.882257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.884086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.885158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.888064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.889462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.890479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.895629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:22.910931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:22.912574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:22.929923 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d4fdcb3-303c-4db8-9276-1d6b1422adf9 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.231624 Sep 19 14:39:22.944268 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 281/583] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:22 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:22.959195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:22.960017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:22.967343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.968099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.968734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:22.969707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:22.970517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:22.971134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:23.279048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:23.291636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:23.295615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:23.308817 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a03e2275-17d9-4045-a161-d08ad52f374c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.445933 Sep 19 14:39:23.310228 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 303/584] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:22 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:23.648130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:23.648807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:23.664359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:23.664876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:23.665325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:23.666053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:23.666516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:23.667114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:23.956269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:23.971150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:23.975455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:23.976784 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0141dd30-c0a2-48fd-9c2a-7e7e8e56fdc5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 1.031159 Sep 19 14:39:23.977684 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 282/585] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:22 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:23.984151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:23.985048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:23.993221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:23.994140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:23.994865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:23.995808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:23.996425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:23.997056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.042540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:24.069202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:24.184182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:24.199036 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-417ea214-e7c6-41a9-9703-061e11a8ed1e tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 0.554817 Sep 19 14:39:24.200018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 304/586] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:23 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:24.209778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:24.211791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:24.223928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.225240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.226262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.227789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.229192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.230930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.667919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:24.685472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f91e10f8-e1d7-4cc3-81ef-203aabfeec5b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.704572 Sep 19 14:39:24.700648 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 283/587] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:23 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:24.700648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-50abc7b1-fe12-42f2-9c41-dbdb1ac16de8 req-6bad4c1c-b991-4ea8-a1f5-b550329fe322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f71947-2bb8-4578-85f9-29c818e8d88a", "tag": "f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:24.718473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-50abc7b1-fe12-42f2-9c41-dbdb1ac16de8 req-6bad4c1c-b991-4ea8-a1f5-b550329fe322 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.719070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-50abc7b1-fe12-42f2-9c41-dbdb1ac16de8 req-6bad4c1c-b991-4ea8-a1f5-b550329fe322 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.719633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-50abc7b1-fe12-42f2-9c41-dbdb1ac16de8 req-6bad4c1c-b991-4ea8-a1f5-b550329fe322 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.753063 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-50abc7b1-fe12-42f2-9c41-dbdb1ac16de8 req-6bad4c1c-b991-4ea8-a1f5-b550329fe322 service nova] Creating event network-changed:f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74 for instance 09f71947-2bb8-4578-85f9-29c818e8d88a on n-h1-858384-1 Sep 19 14:39:24.766371 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-50abc7b1-fe12-42f2-9c41-dbdb1ac16de8 req-6bad4c1c-b991-4ea8-a1f5-b550329fe322 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077779 Sep 19 14:39:24.768167 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 284/588] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:24.774125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:24.775265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:24.784676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.785564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.786232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.787259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.788516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.789532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.810072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:24.825264 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38fdcf51-8e4e-4324-b701-7b998f98fa31 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.623405 Sep 19 14:39:24.826380 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 305/589] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:24 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:24.849351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:24.852278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:24.861245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.867885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.868826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.869786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:24.870479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:24.871996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:24.998894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.010268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.013207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.020804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:25.023457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-22f4b7ad-ca14-4b50-9e2a-6d647cf95f2c tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.253779 Sep 19 14:39:25.029148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 285/590] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:24 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:25.032375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.037216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:25.038291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:25.044705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.051663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.056573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.058152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.060450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.061544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.062209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.063388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.066526 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb19e3f1-031f-44a4-bb82-31eeae40e57b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.227554 Sep 19 14:39:25.069889 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 306/591] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:24 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:25.103291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:25.248943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:25.250015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:25.257654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.258445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.259109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.260007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.261214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.262013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.601270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.621972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.625679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.628342 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-adb8ab56-080b-44cc-bb22-2f48be8f6f90 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.597505 Sep 19 14:39:25.630028 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 286/592] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:25 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:25.649977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:25.660231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-458796de-cb3e-4e06-a7cc-225e5aa801d8 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 0.416234 Sep 19 14:39:25.660806 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 307/593] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:25 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:25.708765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:25.709526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:25.716818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.717698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.718359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.722172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.725072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.725791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.764865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:25.765843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:25.779505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.787934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.788856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:25.790540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:25.793766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:25.795683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.145270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.161478 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0f5823a-0c85-4c7a-b279-bd648e419ec8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.453057 Sep 19 14:39:26.178576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 287/594] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:25 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:26.194637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:26.195722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:26.212552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.213490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.217351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.219396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.220767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.226957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.240091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2e8e3b8-1b47-468a-80d7-a185f0f5a88d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1589 microversion: 2.1 time: 0.480297 Sep 19 14:39:26.240486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.251158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 308/595] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:25 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1589 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:26.273271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:26.274326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:26.282856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.283724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.284471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.285557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.286427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.287279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.410642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.425175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.429917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.439507 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-994ad195-4bd8-44d4-8537-fdd0735abc03 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.171186 Sep 19 14:39:26.440565 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 309/596] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:26 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:26.454817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:26.461940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:26.475536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.476432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.477110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.478002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.478633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.479890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.502733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:26.874532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.891853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.894321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.902834 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b55b373-a010-45f9-ad8f-605c06a5dfdf tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.455357 Sep 19 14:39:26.905516 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 310/597] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:26 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:26.913428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:26.914265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:26.922590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:26.924297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.924955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.926217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.927137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.927756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.928370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.941895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:26.952545 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bac86360-2545-4d41-aefe-01c63c1d80dc tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.772511 Sep 19 14:39:26.955027 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 288/598] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:26 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:26.966179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:26.967791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:26.980746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.982489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.983223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:26.984221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:26.993539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:26.995385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.442914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.458564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.465860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.473443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.476271 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-65eeca9c-fc0b-4d0a-93d2-ca8f6c172fdf tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 0.518963 Sep 19 14:39:27.478115 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-851c3247-6f80-4dcb-a7ad-c11a9747a38f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.571056 Sep 19 14:39:27.480289 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 311/599] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:26 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:27.499139 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 289/600] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:26 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:27.503748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-51f16027-eeaf-4ceb-9163-e96b01d822c9 req-0d2c5a68-50d3-4849-8379-878b8f93cc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8b40db-13c3-4747-b112-a5fbd27d33ee", "name": "network-vif-plugged", "status": "completed", "tag": "88d4918c-e11b-44f5-8385-9b9b3f655ba8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:27.505070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-932a9b5d-92d4-4c28-90c4-fee82a6494ae req-8548d037-67cd-4de6-8727-eb47251f5f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910cecb9-63f3-4ab8-9ef4-92d4af15b996", "tag": "0ff9d586-7183-4c29-ad3b-d8f08b31311a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:27.519825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-932a9b5d-92d4-4c28-90c4-fee82a6494ae req-8548d037-67cd-4de6-8727-eb47251f5f07 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.520636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-932a9b5d-92d4-4c28-90c4-fee82a6494ae req-8548d037-67cd-4de6-8727-eb47251f5f07 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.522133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-932a9b5d-92d4-4c28-90c4-fee82a6494ae req-8548d037-67cd-4de6-8727-eb47251f5f07 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.530544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-51f16027-eeaf-4ceb-9163-e96b01d822c9 req-0d2c5a68-50d3-4849-8379-878b8f93cc10 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.531637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-51f16027-eeaf-4ceb-9163-e96b01d822c9 req-0d2c5a68-50d3-4849-8379-878b8f93cc10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.532270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-51f16027-eeaf-4ceb-9163-e96b01d822c9 req-0d2c5a68-50d3-4849-8379-878b8f93cc10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.545017 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-932a9b5d-92d4-4c28-90c4-fee82a6494ae req-8548d037-67cd-4de6-8727-eb47251f5f07 service nova] Creating event network-changed:0ff9d586-7183-4c29-ad3b-d8f08b31311a for instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 on n-h1-858384-1 Sep 19 14:39:27.552739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-932a9b5d-92d4-4c28-90c4-fee82a6494ae req-8548d037-67cd-4de6-8727-eb47251f5f07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070430 Sep 19 14:39:27.558011 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 312/601] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:27.566167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:27.567293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:27.575718 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-51f16027-eeaf-4ceb-9163-e96b01d822c9 req-0d2c5a68-50d3-4849-8379-878b8f93cc10 service nova] Creating event network-vif-plugged:88d4918c-e11b-44f5-8385-9b9b3f655ba8 for instance af8b40db-13c3-4747-b112-a5fbd27d33ee on n-h2-858384-1 Sep 19 14:39:27.579851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.579851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.580209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.580852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.581320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.581758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.588777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-51f16027-eeaf-4ceb-9163-e96b01d822c9 req-0d2c5a68-50d3-4849-8379-878b8f93cc10 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093114 Sep 19 14:39:27.589812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 290/602] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:27.595595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:27.604861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:27.624558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.625310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.625931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.626887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.627520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.628134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.704098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:27.808670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.825492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.829928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:27.845163 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7797895e-13d2-4bd4-b6f0-c9bb746924a4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.253663 Sep 19 14:39:27.869540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 291/603] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:27 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:27.936259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:27.936887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:27.954083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.954595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.955109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.955838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:27.956489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:27.957087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:27.995704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.008078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0242e350-040e-4184-a114-213c8d1db0cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.447700 Sep 19 14:39:28.009096 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 313/604] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:27 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:28.017255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:28.018038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:28.037913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.039430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.041176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.043153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.043638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.044073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.077828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.091937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.093491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.112873 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-abe8bf31-25b9-4116-a8ad-8409fc06ad22 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.181050 Sep 19 14:39:28.113832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 292/605] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:27 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:28.402259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.417529 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3059e6ea-0754-4eb6-9817-eba9700a4653 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.406512 Sep 19 14:39:28.420852 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 314/606] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:28 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:28.515153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:28.516087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:28.516547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:28.517775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:28.526784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.527274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.529706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.530077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.530445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.531054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.531857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.532663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.533111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.534531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.536334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.537052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.789645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=18 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:28.832662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.841875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.843756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.844820 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b73fce51-b2a5-49ff-bb1a-a667c9b6eafa tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.342556 Sep 19 14:39:28.845709 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 293/607] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:28 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:28.879580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:28.882913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:28.883859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:28.891620 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-15e26530-fab9-4cde-9218-9260225fdb72 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1323 microversion: 2.1 time: 0.387648 Sep 19 14:39:28.908585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 315/608] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:28 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:28.908821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.908821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.908821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:28.908821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:28.909122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:28.909122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.005771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.039599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:29.040428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:29.056524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.059267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.059826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.061741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.062638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.063272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.063809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.066365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.078118 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-382049cd-4756-48e6-acd0-710a7be26161 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.205175 Sep 19 14:39:29.084533 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 294/609] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:28 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:29.147864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:29.148697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:29.160941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.164418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.165212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.167267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.169134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.170244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.317840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.333484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.337681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.344619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-287e3a9d-f55a-46ce-a335-3ea740ff99a0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.203016 Sep 19 14:39:29.357063 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 295/610] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:29 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:29.445922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:29.446531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:29.462314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.463038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.466427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.468915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.469953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.470365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.481187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.490879 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4fffff1e-f100-4b0e-916b-09e6e2e72848 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.458534 Sep 19 14:39:29.492454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 316/611] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:29 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:29.591193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-364cada3-f29c-4465-a327-3524fe24d076 req-fe3beb8b-5518-46c0-a1ec-4fad91127ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e03d5dc-b937-4876-a4ca-43dc55f3dc77", "tag": "b2d523b2-6a3a-47a4-a07f-f8bb721d78de"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:29.601291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-364cada3-f29c-4465-a327-3524fe24d076 req-fe3beb8b-5518-46c0-a1ec-4fad91127ef2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.602057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-364cada3-f29c-4465-a327-3524fe24d076 req-fe3beb8b-5518-46c0-a1ec-4fad91127ef2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.602667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-364cada3-f29c-4465-a327-3524fe24d076 req-fe3beb8b-5518-46c0-a1ec-4fad91127ef2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.616304 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-364cada3-f29c-4465-a327-3524fe24d076 req-fe3beb8b-5518-46c0-a1ec-4fad91127ef2 service nova] Creating event network-changed:b2d523b2-6a3a-47a4-a07f-f8bb721d78de for instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 on n-h1-858384-1 Sep 19 14:39:29.622783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-364cada3-f29c-4465-a327-3524fe24d076 req-fe3beb8b-5518-46c0-a1ec-4fad91127ef2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035453 Sep 19 14:39:29.623864 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 317/612] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:39:29.638368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ef56cebe-b828-42cc-97da-9fd43dfbb048 req-cb7be18d-0060-4f0f-8b92-457cf3b20066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9085e40-1d2e-49e2-b258-cf1528c9877b", "name": "network-vif-plugged", "status": "completed", "tag": "ecb476e9-c2c4-486c-a74a-06020674886d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:29.649661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ef56cebe-b828-42cc-97da-9fd43dfbb048 req-cb7be18d-0060-4f0f-8b92-457cf3b20066 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.650062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ef56cebe-b828-42cc-97da-9fd43dfbb048 req-cb7be18d-0060-4f0f-8b92-457cf3b20066 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.650499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ef56cebe-b828-42cc-97da-9fd43dfbb048 req-cb7be18d-0060-4f0f-8b92-457cf3b20066 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.663097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ef56cebe-b828-42cc-97da-9fd43dfbb048 req-cb7be18d-0060-4f0f-8b92-457cf3b20066 service nova] Creating event network-vif-plugged:ecb476e9-c2c4-486c-a74a-06020674886d for instance c9085e40-1d2e-49e2-b258-cf1528c9877b on n-h2-858384-1 Sep 19 14:39:29.670627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ef56cebe-b828-42cc-97da-9fd43dfbb048 req-cb7be18d-0060-4f0f-8b92-457cf3b20066 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041851 Sep 19 14:39:29.671276 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 318/613] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:39:29.802774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:29.811649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7902d719-5f6f-4f1b-ae59-240fcbd0023c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.369511 Sep 19 14:39:29.812748 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 296/614] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:29 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:29.871157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:29.871965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:29.881686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.882597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.883171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.884143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.884923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.885413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.927547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:29.929024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:29.936016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.937296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.937842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:29.938955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:29.939799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:29.940355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.181729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.193461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.195895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.199651 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f5d5a1d-f117-49c7-9427-1fad547e25a0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.333189 Sep 19 14:39:30.217364 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 319/615] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:29 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:30.223406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.226597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.227484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.232544 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b41d2293-5cab-4f8e-bda1-12bcb12e4a2d tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1472 microversion: 2.1 time: 0.313315 Sep 19 14:39:30.235125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.235746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.236316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.237135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.237696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.238224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.247083 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 297/616] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:29 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:30.256551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.257649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.265211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.266003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.266694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.267691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.268382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.268962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.296005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Request method failure captured: Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee/diagnostics HTTP/1.1 Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8KYGvkhJvWsm4fDbDS_dCxkC36tyv5CIf2_Uo-Wc75UHTxSNQnKFYwmK2t0j6UctvPV97w6kKCGz74Tzm3JIaaeCAgaAE5-19gj9g8F3Eo_Ikmdmuy0CnGI6YLo8v58f82YSYd6SWl99s-R9_Q8PCX8Ay2FP_S2WYHiGLBm4PXECs Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b861518542eb4523bfa081e634ad1419 Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1500045413 Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:39:30.298273 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b861518542eb4523bfa081e634ad1419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b861518542eb4523bfa081e634ad1419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b861518542eb4523bfa081e634ad1419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b861518542eb4523bfa081e634ad1419"}]}] Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1500045413 Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b861518542eb4523bfa081e634ad1419 Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1500045413 Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiagnosticsNegativeTest-1500045413-project Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: d31d7d194a2742e78c7fb85b8a31d5a5 Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1500045413-project Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:39:30.299969 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': 'af8b40db-13c3-4747-b112-a5fbd27d33ee'} Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:30.300893 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 19 14:39:30.302444 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:30.304642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:30.305692 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df505dc4-135d-4593-ac32-ee1ed2fb4669 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.053793 Sep 19 14:39:30.306436 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 298/617] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:39:30 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee/diagnostics => generated 117 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:39:30.318064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.318979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.328095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.328850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.329560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.330507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.331206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.331835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.335109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.344120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.345537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.352171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d08a3bb8-387a-45cb-801a-537e40a20ebc tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.133278 Sep 19 14:39:30.353170 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 320/618] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:30 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:30.376951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:39:30.386491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.387451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.399648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.400541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.401765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.420112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.420650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.421095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.518975 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14e30e4e-73b6-4aa0-8638-5bbacdad0377 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "DELETE /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 204 len: 0 microversion: 2.1 time: 0.202049 Sep 19 14:39:30.525960 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 299/619] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:39:30 2022] DELETE /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:39:30.535318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.536294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.547170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.559847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.560922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.561373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.562201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.562727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.563194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.570667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.573809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.584038 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9aa30a0-505e-4898-831e-42680b9b499b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.200803 Sep 19 14:39:30.601792 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 321/620] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:30 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:30.612305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.613213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.623926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.624791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.625598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.628468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.630871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.631774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.792669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.804758 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-788c00a8-8d3f-426a-87ad-94130dd7a733 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.274517 Sep 19 14:39:30.819963 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 300/621] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:30 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:30.846507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:30.847463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:30.857382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.858148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.858779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.860462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:30.861560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:30.862515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:30.950167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:30.965608 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3683b43e-11b4-419a-843c-382fe3a02fba tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1478 microversion: 2.1 time: 0.359006 Sep 19 14:39:30.968158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 322/622] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:30 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1478 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:31.102865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.113636 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad87a1a9-fbe4-4097-a28a-841e3c2b58d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.276692 Sep 19 14:39:31.127717 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 301/623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:30 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:31.232160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:31.233043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:31.251900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.252498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.253035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.254170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.255935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.256440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.390450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:31.391513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:31.398812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.399609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.400411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.402080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.402765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.403212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.428695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:31.744935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.749134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.754212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.755736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.756928 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ec5d051-6eea-4284-9522-f7dd77651c84 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.529896 Sep 19 14:39:31.757348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.757812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 323/624] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:31 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:31.758783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.763019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:31.763635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:31.765075 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfb06e85-5386-4150-9ce1-e390573e9b53 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.383118 Sep 19 14:39:31.765712 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 302/625] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:31 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:31.779272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.779272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.779272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.779272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.779653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.779653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.844145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:31.844741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:31.851418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.852034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.852673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.853778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:31.855221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:31.855683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:31.855797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.864389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.865844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:31.871783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-735b73c1-056c-4e50-827a-d6f64bb5667d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.112901 Sep 19 14:39:31.872363 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 324/626] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:31 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:31.991706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:31.992551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:32.001549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.002119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.002739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.003805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.003946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:32.004296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.004736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.015572 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b97bf8d-c6d7-424f-9620-9122496c3f5d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1317 microversion: 2.1 time: 0.175204 Sep 19 14:39:32.016217 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 303/627] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:31 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:32.141766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:32.142716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:32.149909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.150788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.152116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.153320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.154212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.154923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.157536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:32.165777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-18434e8c-1470-4571-83d6-23df5d9e81a2 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1478 microversion: 2.1 time: 0.179366 Sep 19 14:39:32.166356 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 325/628] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:31 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1478 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:32.294454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:32.302436 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-759de1b7-9256-4690-9c62-253735a09e6c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.164675 Sep 19 14:39:32.303267 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 304/629] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:32 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:32.784407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:32.785391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:32.794513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.795410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.795976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.796618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.797068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.797520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.803526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:32.805162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:32.820642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.821770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.822556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.824685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.825313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.825906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.929553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:32.943329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:32.946023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:32.955189 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1ad2b6d-31af-449e-8ec2-a0df8a540bff tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1446 microversion: 2.75 time: 0.159867 Sep 19 14:39:32.956009 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 305/630] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:32 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:32.967046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:32.967991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:32.978833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.980626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.981662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:32.982591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:32.983516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:32.984319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.008645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.023529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.025363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.027399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a813dab-11a9-43cc-baf3-db45f3b5cccc tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1568 microversion: 2.25 time: 0.247244 Sep 19 14:39:33.047555 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 326/631] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:32 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:33.052847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b6ede702-e5b1-4571-930e-a680644dd4dd req-649900e8-15d3-425b-b472-c3cd09f48984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e03d5dc-b937-4876-a4ca-43dc55f3dc77", "name": "network-vif-plugged", "status": "completed", "tag": "b2d523b2-6a3a-47a4-a07f-f8bb721d78de"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:33.071414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b6ede702-e5b1-4571-930e-a680644dd4dd req-649900e8-15d3-425b-b472-c3cd09f48984 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.072787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b6ede702-e5b1-4571-930e-a680644dd4dd req-649900e8-15d3-425b-b472-c3cd09f48984 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.074008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b6ede702-e5b1-4571-930e-a680644dd4dd req-649900e8-15d3-425b-b472-c3cd09f48984 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.083258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.092626 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b6ede702-e5b1-4571-930e-a680644dd4dd req-649900e8-15d3-425b-b472-c3cd09f48984 service nova] Creating event network-vif-plugged:b2d523b2-6a3a-47a4-a07f-f8bb721d78de for instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 on n-h1-858384-1 Sep 19 14:39:33.101797 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b6ede702-e5b1-4571-930e-a680644dd4dd req-649900e8-15d3-425b-b472-c3cd09f48984 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051171 Sep 19 14:39:33.103168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 327/632] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:33.103868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.106821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.118586 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17b52159-86e4-4a5a-b4eb-518551f3d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1558 microversion: 2.91 time: 0.161199 Sep 19 14:39:33.120677 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 306/633] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:32 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:33.131462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:33.132516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:33.144684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.145404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.146095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.147438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.148222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.148660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.190223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:33.191247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:33.198882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.199390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.199974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.200685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.201209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.201669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.389859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.403201 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f987f2f-b830-488b-ad60-420be68c59c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1467 microversion: 2.1 time: 0.296424 Sep 19 14:39:33.419056 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 328/634] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:33 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:33.419172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.420131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:33.421154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:33.426977 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed78069f-8154-45b7-a581-078f90a11eee tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1478 microversion: 2.1 time: 0.241021 Sep 19 14:39:33.428023 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 307/635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:33 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1478 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:33.429243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.429759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.430304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.431332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.432173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.432929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.465072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:33.862096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:33.883297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8ed50c1-00bf-4c17-b27f-ab7754962a66 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1361 microversion: 2.1 time: 0.467344 Sep 19 14:39:33.886334 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 329/636] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:33 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:33.918464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:33.919574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:33.931037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.931962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.933138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.934776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:33.936836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:33.937856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:33.987079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:33.988326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:34.006082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.006977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.007853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.009097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.009921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.022935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.165425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.179871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.183637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.191890 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e60ac505-bbf7-4589-bb50-9acc8978da9b tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1452 microversion: 2.75 time: 0.210740 Sep 19 14:39:34.192906 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 330/637] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:33 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:34.199067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:34.200343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:34.207331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.208163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.208992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.210055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.210798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.211773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.481718 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-39f92dcc-59a6-48f4-836f-8a1c5700cc26 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1618 microversion: 2.1 time: 1.052321 Sep 19 14:39:34.482463 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 308/638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:33 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1618 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:34.497427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:34.498100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:34.521547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.522408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.523043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.524133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.525073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.525791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.528069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.539932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.542728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.544989 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5668aee6-955a-4cb2-b46f-41f32ecedadf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1558 microversion: 2.25 time: 0.350518 Sep 19 14:39:34.545870 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 331/639] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:34 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1558 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:34.641815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.656187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.657829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.664681 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-068818e3-e841-438f-8bbb-7ca48a5fd655 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1558 microversion: 2.91 time: 0.175345 Sep 19 14:39:34.665247 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 309/640] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:34 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:34.672593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:34.673712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:34.681573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.682345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.683449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.684291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.684922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.687510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.700288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1005118645", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:34.753927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:34.763530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a03a420a-7eec-4110-9d90-31c5930947c0 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1436 microversion: 2.1 time: 0.096899 Sep 19 14:39:34.763717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:34.764226 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 310/641] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:34 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1436 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:34.769261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23416063-54a7-458b-a5e8-c2d9e286420d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: .version_select at 0x7fde2a7a6b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-94342117", "policies": ["affinity"]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:34.788503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-23416063-54a7-458b-a5e8-c2d9e286420d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:34.793941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-23416063-54a7-458b-a5e8-c2d9e286420d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:34.850606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-23416063-54a7-458b-a5e8-c2d9e286420d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:34.857548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-23416063-54a7-458b-a5e8-c2d9e286420d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:34.871252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:34.876117 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23416063-54a7-458b-a5e8-c2d9e286420d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.110738 Sep 19 14:39:34.877137 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 311/642] 10.222.0.81 () {60 vars in 1174 bytes} [Mon Sep 19 14:39:34 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:34.883494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2d8b33fa-83f5-46cc-8fc8-352d1d871b31 req-b8101af1-39ae-4e6c-acd8-bd38ac69093e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8b40db-13c3-4747-b112-a5fbd27d33ee", "name": "network-vif-deleted", "tag": "88d4918c-e11b-44f5-8385-9b9b3f655ba8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:34.894521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2d8b33fa-83f5-46cc-8fc8-352d1d871b31 req-b8101af1-39ae-4e6c-acd8-bd38ac69093e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.895060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2d8b33fa-83f5-46cc-8fc8-352d1d871b31 req-b8101af1-39ae-4e6c-acd8-bd38ac69093e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.895485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2d8b33fa-83f5-46cc-8fc8-352d1d871b31 req-b8101af1-39ae-4e6c-acd8-bd38ac69093e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.908649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2d8b33fa-83f5-46cc-8fc8-352d1d871b31 req-b8101af1-39ae-4e6c-acd8-bd38ac69093e service nova] Creating event network-vif-deleted:88d4918c-e11b-44f5-8385-9b9b3f655ba8 for instance af8b40db-13c3-4747-b112-a5fbd27d33ee on n-h2-858384-1 Sep 19 14:39:34.913887 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2d8b33fa-83f5-46cc-8fc8-352d1d871b31 req-b8101af1-39ae-4e6c-acd8-bd38ac69093e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035524 Sep 19 14:39:34.914827 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 312/643] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:34.921177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc832042-150e-486e-9803-e75d7a2b9078 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '.version_select at 0x7fde2a7d91f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:34.925743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc832042-150e-486e-9803-e75d7a2b9078 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.926927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc832042-150e-486e-9803-e75d7a2b9078 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.927462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc832042-150e-486e-9803-e75d7a2b9078 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:34.958101 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc832042-150e-486e-9803-e75d7a2b9078 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.041205 Sep 19 14:39:34.958987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 313/644] 10.222.0.81 () {60 vars in 1184 bytes} [Mon Sep 19 14:39:34 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:34.965198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:34.966266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:34.989620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:34.996458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:34.997379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.001209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.002257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.003953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.007123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:35.007680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:35.008087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:35.008489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:35.009078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:35.023057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.024344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.025057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.028163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.028680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.029156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.066206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Getting quotas for project d6f0ada3b2a1446db012bcbdd2334e94. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:35.074190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Getting quotas for user 12de6f76b4c3407ead7ece5ff764c913 and project d6f0ada3b2a1446db012bcbdd2334e94. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:35.090460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:35.093955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:35.157276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4276e113-d69f-40a0-9761-62bdca5b6f5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609939 Sep 19 14:39:35.158383 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 332/645] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:39:35.163552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:35.164290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:35.172320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.172901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.173438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.174229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.174783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.175297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.257778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:35.266334 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e21937a-fd7e-44c6-ace2-3e45b7146685 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1544 microversion: 2.1 time: 0.306293 Sep 19 14:39:35.267323 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 314/646] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:34 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1544 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:35.287816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1746732305", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "295b47a1-efb2-424b-84d9-e8e135348118"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:35.350156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:35.365081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 09f71947-2bb8-4578-85f9-29c818e8d88a {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:35.380097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-536b3592-20e0-4e22-9ad5-32d06ef4316c tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 2051 microversion: 2.25 time: 0.220448 Sep 19 14:39:35.390866 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 333/647] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:35 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 2051 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:35.390866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:35.390866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:35.392728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.393240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.393691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.394391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.394928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.395356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.533939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:35.544168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:35.546625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:35.553726 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b04a5619-3486-4424-b938-e5e4c63f2311 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1452 microversion: 2.75 time: 0.171663 Sep 19 14:39:35.567505 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 334/648] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:35 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:35.584738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1954487175", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:35.653073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:35.682588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:35.683362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:35.684095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:35.684404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:35.684829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:35.712824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.713397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.714810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.715574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.716058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.716516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.738041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:35.744145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:35.758261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Going to run 2 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:35.761653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:35.805691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128731) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 19 14:39:35.828458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:35.834355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:35.878313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:35.878736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:35.879237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:35.879664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:35.880081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:35.888946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:35.889721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.890212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.890645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.891420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.891930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.892302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:35.893574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:35.907165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=5a1394eb-90c8-4b69-9f2c-a9d5834cf633,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:35.909037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Getting quotas for project d6f0ada3b2a1446db012bcbdd2334e94. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:35.913580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Getting quotas for user 12de6f76b4c3407ead7ece5ff764c913 and project d6f0ada3b2a1446db012bcbdd2334e94. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:35.926257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:35.928473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:35.964917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:35.971066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:35.981722 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-53c44641-0b8a-4b65-92a6-73c79c52af8e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.412375 Sep 19 14:39:35.982575 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 335/649] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:39:35.987932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:35.988431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:35.997023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:35.998181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:35.998644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.009897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:36.011062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:36.011648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.030472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:36.039734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:36.090194 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f9d28b2-fa48-4ffd-a559-5c2690e34467 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.822087 Sep 19 14:39:36.090889 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 315/650] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:39:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:39:36.097145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-861076812", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e31e1958-afee-4116-8310-ef2e73536125"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:36.195451 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-02d2e78f-e99e-4800-9841-52be6361d5aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211883 Sep 19 14:39:36.196147 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 336/651] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:39:35 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:36.201879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:36.202931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] validate_networks() for [('e31e1958-afee-4116-8310-ef2e73536125', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:39:36.203058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:36.231844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:36.233230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:36.234469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.235998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:36.237324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:36.239102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.408635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:36.436862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:36.454406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:36.483791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fdc354cf-4c4f-46a1-addf-604627abe93d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.286068 Sep 19 14:39:36.486022 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 337/652] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:36 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:36.500100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:36.500855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:36.515432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:36.516526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:36.517959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.519024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:36.519841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:36.520434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.594415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:36.595984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:36.596595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:36.597232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lazy-loading 'fault' on Instance uuid af8b40db-13c3-4747-b112-a5fbd27d33ee {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:36.766016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31d7d194a2742e78c7fb85b8a31d5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b861518542eb4523bfa081e634ad1419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:36.776161 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-574e5263-8176-4f3d-bad4-33ce384c1e74 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 200 len: 1313 microversion: 2.1 time: 0.288264 Sep 19 14:39:36.784407 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 338/653] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:36 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:36.790314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf668265-ee1f-4bae-91ad-5ba6f420a683 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:36.798219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf668265-ee1f-4bae-91ad-5ba6f420a683 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:36.839023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:36.955260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf668265-ee1f-4bae-91ad-5ba6f420a683 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:36.984517 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf668265-ee1f-4bae-91ad-5ba6f420a683 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1214 microversion: 2.1 time: 0.198388 Sep 19 14:39:36.999892 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 339/654] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:36 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:37.011532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:37.023362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.025789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Searching by: {'deleted': False, 'project_id': '32c474c76d064369addb54e031ce368b'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:39:37.052671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:37.053368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:37.054731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:37.056411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:37.057045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:37.059274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:37.081118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:37.082213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:37.082704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:37.083150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:37.083573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:37.111346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:37.111908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:37.112555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:37.113429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:37.116165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:37.118356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:37.181145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:39:37.195600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for user 79d78edfe25746049a02a43130f1df11 and project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:39:37.230324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:39:37.232569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:39:37.325769 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f55d5fba-dabc-4a34-8ab4-5680279c9bf7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.232068 Sep 19 14:39:37.327329 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 316/655] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:39:37.344693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:37.347511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:37.382721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:37.383733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:37.384837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:37.387636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:37.388501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:37.389865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:37.544050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.560588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.561812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.572383 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46b1c86e-fd6c-4fc3-b34c-eccc9671d300 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1437 microversion: 2.75 time: 0.243313 Sep 19 14:39:37.573860 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 317/656] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:37 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1437 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:37.642028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf32813f-2114-486a-a04b-0783a9cdec77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:37.649017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf32813f-2114-486a-a04b-0783a9cdec77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:37.686946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:37.836717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:39:37.955016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf32813f-2114-486a-a04b-0783a9cdec77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.967944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf32813f-2114-486a-a04b-0783a9cdec77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.975311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf32813f-2114-486a-a04b-0783a9cdec77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:37.976896 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf32813f-2114-486a-a04b-0783a9cdec77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1261 microversion: 2.25 time: 0.360422 Sep 19 14:39:37.982202 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 318/657] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:37 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1261 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:37.993539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:37.996255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:38.014218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.015600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.020230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.022112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.023143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.023575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.125306 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-402a88ac-0413-4fc8-9ae2-340246bf47a6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 1.123403 Sep 19 14:39:38.143154 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 340/658] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:39:36 2022] GET /compute/v2.1/servers => generated 1004 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:38.403297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:38.447188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:38.449295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:38.450705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:38.452401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:38.460212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-25ec4e0b-e34b-4e28-9b8c-54cfae1bc10f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.475935 Sep 19 14:39:38.461415 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 319/659] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:37 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:38.485147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:38.486537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] [instance: af8b40db-13c3-4747-b112-a5fbd27d33ee] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:38.491719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.492222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.492744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.493457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.493914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.494354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.506985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.508643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.509897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.511563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.512203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.512831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.548115 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] HTTP exception thrown: Instance af8b40db-13c3-4747-b112-a5fbd27d33ee could not be found. Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Request method failure captured: Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee HTTP/1.1 Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8KYGvkhJvWsm4fDbDS_dCxkC36tyv5CIf2_Uo-Wc75UHTxSNQnKFYwmK2t0j6UctvPV97w6kKCGz74Tzm3JIaaeCAgaAE5-19gj9g8F3Eo_Ikmdmuy0CnGI6YLo8v58f82YSYd6SWl99s-R9_Q8PCX8Ay2FP_S2WYHiGLBm4PXECs Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b861518542eb4523bfa081e634ad1419 Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1500045413 Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:39:38.550504 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b861518542eb4523bfa081e634ad1419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b861518542eb4523bfa081e634ad1419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b861518542eb4523bfa081e634ad1419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b861518542eb4523bfa081e634ad1419"}]}] Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1500045413 Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b861518542eb4523bfa081e634ad1419 Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1500045413 Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiagnosticsNegativeTest-1500045413-project Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: d31d7d194a2742e78c7fb85b8a31d5a5 Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1500045413-project Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance af8b40db-13c3-4747-b112-a5fbd27d33ee could not be found. Sep 19 14:39:38.551867 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'af8b40db-13c3-4747-b112-a5fbd27d33ee'} Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af8b40db-13c3-4747-b112-a5fbd27d33ee could not be found. Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:38.552685 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af8b40db-13c3-4747-b112-a5fbd27d33ee could not be found. Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af8b40db-13c3-4747-b112-a5fbd27d33ee could not be found. Sep 19 14:39:38.553848 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:38.567166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] Returning 404 to user: Instance af8b40db-13c3-4747-b112-a5fbd27d33ee could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:38.573718 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9b357caa-e34a-4a2f-a3e7-c27b6491eb19 tempest-ServerDiagnosticsNegativeTest-1500045413 tempest-ServerDiagnosticsNegativeTest-1500045413-project] 10.222.0.81 "GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee" status: 404 len: 111 microversion: 2.1 time: 0.108937 Sep 19 14:39:38.575308 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 320/660] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:38 2022] GET /compute/v2.1/servers/af8b40db-13c3-4747-b112-a5fbd27d33ee => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:39:38.584975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:38.603422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:38.624076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.625144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.625973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.628173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.629106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.629774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.724127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:39:38.724127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:39:38.724446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:39:38.735258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:39:38.737070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:39:38.820355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:38.835792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-93ed295b-23f3-42af-89f0-65cc4f272e5e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1284 microversion: 2.1 time: 0.258366 Sep 19 14:39:38.856400 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 321/661] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:38 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:38.875416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:38.879199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:38.895255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.896568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.905212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.908648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.909448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:38.910946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:38.955114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:38.965398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:38.996669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.000584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.004200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.007290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.009527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.151894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:39.170773 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a96fe22b-12d3-481e-946f-56f93cdc99e4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1215 microversion: 2.1 time: 0.308554 Sep 19 14:39:39.172862 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 322/662] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:38 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:39.194588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:39.199908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:39.256766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.261810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.263504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.267283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.268982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.269676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.428345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:39.484918 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91a783e9-1feb-44e2-a4d2-41c5ed037443 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322/action" status: 202 len: 1940 microversion: 2.75 time: 1.339890 Sep 19 14:39:39.502630 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 341/663] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:39:38 2022] POST /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322/action => generated 1940 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 19 14:39:39.517132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:39.521424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-17b73d42-d58d-4e79-bae9-d2981b0f3402 req-d277a2b0-b327-4a4c-b9fc-d19303c314d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e03d5dc-b937-4876-a4ca-43dc55f3dc77", "tag": "b2d523b2-6a3a-47a4-a07f-f8bb721d78de"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:39.530349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:39.535576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-17b73d42-d58d-4e79-bae9-d2981b0f3402 req-d277a2b0-b327-4a4c-b9fc-d19303c314d5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.536522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-17b73d42-d58d-4e79-bae9-d2981b0f3402 req-d277a2b0-b327-4a4c-b9fc-d19303c314d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.537238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:39.538527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-17b73d42-d58d-4e79-bae9-d2981b0f3402 req-d277a2b0-b327-4a4c-b9fc-d19303c314d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.542048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-36dbff8e-4204-4ed4-aeca-84d75c62a350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1257 microversion: 2.25 time: 0.359318 Sep 19 14:39:39.544185 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 323/664] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:39 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1257 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:39.553888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:39.554393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:39.561091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-17b73d42-d58d-4e79-bae9-d2981b0f3402 req-d277a2b0-b327-4a4c-b9fc-d19303c314d5 service nova] Creating event network-changed:b2d523b2-6a3a-47a4-a07f-f8bb721d78de for instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 on n-h1-858384-1 Sep 19 14:39:39.567951 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-17b73d42-d58d-4e79-bae9-d2981b0f3402 req-d277a2b0-b327-4a4c-b9fc-d19303c314d5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063358 Sep 19 14:39:39.570111 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 342/665] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:39.574742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.575269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.575704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.580481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.580692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:39.581269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:39.582420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.586266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.590552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.590552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.590965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.591967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:39.592613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:39.593218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:39.655721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:39.965222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:39.986772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.012367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed34581f-75df-49cd-a253-9164a719fb47 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.438557 Sep 19 14:39:40.019369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.020898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.029347 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 343/666] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:39 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:40.049847 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c20008f7-7e5c-45d4-94fc-bff0a7a758b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.501383 Sep 19 14:39:40.050851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:40.051499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:40.074864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:40.075120 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 324/667] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:39 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:40.075255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:40.075255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:40.075255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:40.075255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:40.075646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:40.203939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:40.204809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:40.221350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:40.223257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:40.225467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:40.227022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:40.229223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:40.229831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:40.356987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.386907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9179966a-3da5-433b-b196-2c6fabaeb468 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1272 microversion: 2.1 time: 0.334569 Sep 19 14:39:40.386907 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 344/668] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:40 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:40.422260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.431448 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e66369a2-f35f-4e29-8152-c16f8dece904 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1271 microversion: 2.1 time: 0.231424 Sep 19 14:39:40.444006 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 325/669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:40 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:40.572428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:40.574882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:40.585833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:40.586599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:40.588542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:40.591125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:40.596307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:40.597077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:40.656494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:40.815588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.831406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.848105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:40.853016 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1168e35-e943-4a91-98ee-b28f1430e919 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1257 microversion: 2.25 time: 0.281320 Sep 19 14:39:40.866844 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 345/670] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:40 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1257 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:41.049398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:41.050015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:41.059969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:41.070645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:41.072581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:41.074938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:41.078286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:41.079461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:41.099745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:41.101748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:41.119296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:41.121027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:41.121816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:41.125034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:41.125926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:41.127307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:41.931816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:41.942708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:41.944674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:41.955642 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-490d1212-5ea4-4f2a-8923-7f27850d7b2f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.858327 Sep 19 14:39:41.980166 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 346/671] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:41 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:41.987726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:41.999386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:42.038177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:42.038906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:42.039556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:42.045503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:42.046226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:42.046845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:42.180650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:42.203481 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c456b4d-23d7-4c05-a679-cb2b31c81b25 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 1.161734 Sep 19 14:39:42.204672 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 326/672] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:41 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:42.209723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:42.210601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:42.218498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:42.219385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:42.220079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:42.220987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:42.222468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:42.223171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:42.246072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:42.260598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b16eac9-6d42-4732-8a7b-a70fedffdcd4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1272 microversion: 2.1 time: 0.274695 Sep 19 14:39:42.276614 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 347/673] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:41 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:42.294257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:42.296163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:42.311776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:42.314833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:42.315313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:42.316732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:42.317584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:42.319098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:42.473804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:42.492725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:42.494553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:42.496307 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-501994ba-18aa-4886-812e-4945c3fa2bc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1319 microversion: 2.25 time: 0.217206 Sep 19 14:39:42.496871 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 348/674] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:42 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:42.610400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:42.618358 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cca8dc9-8795-4eac-99c8-486c7ea4b550 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1277 microversion: 2.1 time: 0.412277 Sep 19 14:39:42.618964 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 327/675] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:42 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1277 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:42.987580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:42.988217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:43.004472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.004982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.005433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.006177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.006644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.007115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.162727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:43.177349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:43.179403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:43.186682 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a9b8f5cd-7b1d-4dd9-b44f-af7c554b28fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.203953 Sep 19 14:39:43.199748 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 349/676] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:42 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:43.236656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:43.237253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:43.250940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.251744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.252342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.253235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.253852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.254433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.291233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:43.292409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:43.301518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.309065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.311730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.314157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.317150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.317787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.532035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:43.579080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fe2abd28-56ba-40b6-a71d-41b09ddd837a tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.346092 Sep 19 14:39:43.580514 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 328/677] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:43 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:43.606975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:43.607522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:43.615493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.615991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.616432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.617149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.629902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.630658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.841886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:43.858559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:43.875019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:43.876929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-35b51e12-327d-4098-a856-512f74749466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1319 microversion: 2.25 time: 0.286474 Sep 19 14:39:43.878660 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 329/678] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:43 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:43.883951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:43.884976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:43.892592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.893663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.894388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:43.895363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:43.896050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:43.896687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.190539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:44.203428 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-52413d6e-7765-4406-9cb5-681f270e792e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.916021 Sep 19 14:39:44.220392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:44.222505 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 350/679] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:43 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:44.227116 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3cec3f3-372c-4cfe-887c-0d29c28eb348 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1277 microversion: 2.1 time: 0.346747 Sep 19 14:39:44.228083 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 330/680] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:43 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:44.230028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:44.231003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:44.238654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:44.239546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:44.240282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.241844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:44.242892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:44.243553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.404023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:44.418149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:44.422703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:44.436488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5eb58be-10c1-485d-abfe-c79333955705 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.212379 Sep 19 14:39:44.437085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 351/681] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:44 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:44.614621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:44.615947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:44.628652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:44.630661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:44.635369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.636766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:44.637931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:44.638584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.879552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:44.911666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:44.914467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:44.936284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:44.937684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:44.938296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.940534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:44.942360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:44.944095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:44.944758 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-230ff83c-00cf-4efa-994e-50b3ae3423ed tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.332896 Sep 19 14:39:44.972241 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 331/682] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:44 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:45.231685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:45.232259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:45.246102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:45.246102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:45.247528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:45.251241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:45.254212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:45.254866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:45.518591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.532743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.537888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.546973 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6ade7add-bb46-4139-a2a9-bffb96cc3466 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.635878 Sep 19 14:39:45.547788 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 352/683] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:44 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:45.554661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:45.558132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:45.571685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:45.577514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:45.578409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:45.580597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:45.581298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:45.585521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:45.673123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.686184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-984de1ca-c175-417f-9c18-6fcf4d61d704 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.457636 Sep 19 14:39:45.690363 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 332/684] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:45 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:45.706533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:45.707872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:45.723672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:45.724172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:45.724608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:45.728131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:45.728131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:45.728131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:45.879927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.908978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.919901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:45.945607 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06159e73-f5f2-4bb6-be85-63ef74d431ac tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.252467 Sep 19 14:39:45.947607 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 333/685] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:45 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:45.966123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7e1c873c-6f64-4623-b9f3-d2877ca6e185 req-75bddc4f-ae6b-4b86-9574-8e20d6251b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee743740-af6b-4413-85fc-0b23e4e3bb36", "tag": "bedfe11b-122c-4ed5-93b4-13b7e2892b3a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:46.006934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7e1c873c-6f64-4623-b9f3-d2877ca6e185 req-75bddc4f-ae6b-4b86-9574-8e20d6251b10 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.007564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7e1c873c-6f64-4623-b9f3-d2877ca6e185 req-75bddc4f-ae6b-4b86-9574-8e20d6251b10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.008125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7e1c873c-6f64-4623-b9f3-d2877ca6e185 req-75bddc4f-ae6b-4b86-9574-8e20d6251b10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.021767 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7e1c873c-6f64-4623-b9f3-d2877ca6e185 req-75bddc4f-ae6b-4b86-9574-8e20d6251b10 service nova] Creating event network-changed:bedfe11b-122c-4ed5-93b4-13b7e2892b3a for instance ee743740-af6b-4413-85fc-0b23e4e3bb36 on n-h1-858384-1 Sep 19 14:39:46.028305 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7e1c873c-6f64-4623-b9f3-d2877ca6e185 req-75bddc4f-ae6b-4b86-9574-8e20d6251b10 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071729 Sep 19 14:39:46.029490 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 334/686] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:46.041270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:46.043276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:46.053927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.054820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.055425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.056328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.056963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.058213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.237865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:46.258039 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be11bfd8-bba9-4487-88ac-6f6ec78bc54f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.227106 Sep 19 14:39:46.259847 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 335/687] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:46 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:46.266105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:46.284106 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3648c15-50c0-4923-86f3-86fb9779b24a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.734544 Sep 19 14:39:46.285396 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 353/688] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:45 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:46.490648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-9568a2d8-c475-4722-8ea6-0a09b4d4ad08 req-a6e6946b-f981-412f-83ef-5d9f8d04259b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:46.509282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9568a2d8-c475-4722-8ea6-0a09b4d4ad08 req-a6e6946b-f981-412f-83ef-5d9f8d04259b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.512597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9568a2d8-c475-4722-8ea6-0a09b4d4ad08 req-a6e6946b-f981-412f-83ef-5d9f8d04259b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.513371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9568a2d8-c475-4722-8ea6-0a09b4d4ad08 req-a6e6946b-f981-412f-83ef-5d9f8d04259b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.529651 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-9568a2d8-c475-4722-8ea6-0a09b4d4ad08 req-a6e6946b-f981-412f-83ef-5d9f8d04259b service nova] Creating event network-changed:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:39:46.549177 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-9568a2d8-c475-4722-8ea6-0a09b4d4ad08 req-a6e6946b-f981-412f-83ef-5d9f8d04259b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066082 Sep 19 14:39:46.551005 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 336/689] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:46.582388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:46.583930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:46.599619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.600882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.603036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.604128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.607043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.610425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.716594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:46.718309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:46.745350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.746769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.747473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.754596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:46.754596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:46.754596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:46.959993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:47.157366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:47.170822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.180895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.184032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.185152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4e9d45b8-6422-4128-8e00-70c81b67a6d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.612644 Sep 19 14:39:47.185698 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 354/690] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:46 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:47.373145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:47.378311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.379049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.379715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.380728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.381594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.382206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.421779 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c7d1288-900e-4276-86c8-95d449d21a79 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.234772 Sep 19 14:39:47.423035 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 355/691] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:39:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:47.433940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:47.434955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:47.441996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.442684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.443477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.444370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.445215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.447131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.617673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.630685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.632803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.642520 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba616ada-8b7b-49df-b072-0c56ad96131f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.218175 Sep 19 14:39:47.653235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:47.659987 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 356/692] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:47 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:47.663000 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5bfa20e8-9e98-4baa-a025-7c94d9d4fe9e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.952971 Sep 19 14:39:47.668393 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 337/693] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:46 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:47.673905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:47.682873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:47.693056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:47.693672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:47.694955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.695656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.700210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.701256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.701905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.702520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.704728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.705559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.706860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.707865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.708492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.709615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.903474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:47.936048 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec71a7e2-b94c-4d81-81c6-9899e907be2f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.274636 Sep 19 14:39:47.937269 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 357/694] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:47 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:47.942424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:47.946697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.947434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.949490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.950554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:47.951515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:47.952149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:47.960097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=38 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:47.995421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d197f2c9-bbce-4665-b85d-b45e8f4280b6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.056207 Sep 19 14:39:47.997556 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 358/695] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 14:39:47 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:48.027413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.035683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.036543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.037603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.038539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.039519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.041095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.082079 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c3dbb9c-8f30-4b36-8b1c-e9a0609d80af tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.062383 Sep 19 14:39:48.083746 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 359/696] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/os-services => generated 944 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:48.096568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1bcc113c-3060-4b0a-8cdc-f24aa31e101d req-8b33f4b9-2c30-4818-bd51-5d8a3b9254c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef523061-9b8f-4105-8bbd-8a439e6a847c", "tag": "3824cb1b-7519-470c-8f9f-4bb74e33833b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:48.117837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1bcc113c-3060-4b0a-8cdc-f24aa31e101d req-8b33f4b9-2c30-4818-bd51-5d8a3b9254c0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.119075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1bcc113c-3060-4b0a-8cdc-f24aa31e101d req-8b33f4b9-2c30-4818-bd51-5d8a3b9254c0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.120446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1bcc113c-3060-4b0a-8cdc-f24aa31e101d req-8b33f4b9-2c30-4818-bd51-5d8a3b9254c0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.138272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1bcc113c-3060-4b0a-8cdc-f24aa31e101d req-8b33f4b9-2c30-4818-bd51-5d8a3b9254c0 service nova] Creating event network-changed:3824cb1b-7519-470c-8f9f-4bb74e33833b for instance ef523061-9b8f-4105-8bbd-8a439e6a847c on n-h1-858384-1 Sep 19 14:39:48.153984 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1bcc113c-3060-4b0a-8cdc-f24aa31e101d req-8b33f4b9-2c30-4818-bd51-5d8a3b9254c0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067401 Sep 19 14:39:48.155631 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 360/697] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:48.163429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.170430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.171215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.171871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.172861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.173461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.174117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.217437 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b71e6761-3754-470d-a88c-532c5bb81286 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=n-d-858384-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.059849 Sep 19 14:39:48.218806 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 361/698] 10.222.0.81 () {58 vars in 1194 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/os-services?host=n-d-858384-1&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:39:48.233725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.236473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:48.251826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.252904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.253518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.254489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.255277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.256331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.355951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:48.371003 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e034e457-a92d-464c-923c-b179d8d2880b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.701164 Sep 19 14:39:48.380557 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 338/699] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:47 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:48.399743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.405440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.406419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.407264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.408378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.409099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.409763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.459442 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-089a43a6-60df-482d-a071-2971f2a4f7c6 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.077459 Sep 19 14:39:48.461474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 339/700] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/os-services => generated 944 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:48.475138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.480285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.481081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.481752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.482800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.483504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.484178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.521592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-469b8a26-e04a-43ab-8cf7-3d4ff89bb135 tempest-ServicesAdminNegativeTestJSON-1622817022 tempest-ServicesAdminNegativeTestJSON-1622817022-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.049682 Sep 19 14:39:48.523188 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 340/701] 10.222.0.81 () {58 vars in 1198 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:39:48.766021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00ce6b92-d4e0-4ae1-97c0-36debfa0a72c tempest-ServicesAdminNegativeTestJSON-969558776 tempest-ServicesAdminNegativeTestJSON-969558776-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.770726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00ce6b92-d4e0-4ae1-97c0-36debfa0a72c tempest-ServicesAdminNegativeTestJSON-969558776 tempest-ServicesAdminNegativeTestJSON-969558776-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '13cc20d49ea745e6bfbfaf2f13228923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bb0e4933d234fe3a1771711c8d97be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00ce6b92-d4e0-4ae1-97c0-36debfa0a72c tempest-ServicesAdminNegativeTestJSON-969558776 tempest-ServicesAdminNegativeTestJSON-969558776-project] Request method failure captured: Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8x-8DqQezE77KCRsMyIuUiO0F_lz_OCiaDZoiiGgzGAZE2IpP4mpud4YWEomUyulHMa0ImPU52NMUgIwKWIgRMFtIz2tIxI5jOKFXsFxnR3e4OAMkj4Ky7q8GcQbr8LhXibNRDqie3DyU67fZwerVJe2Wrv9IykAbttPPct9q2ZI4 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 3bb0e4933d234fe3a1771711c8d97be4 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-969558776 Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:39:48.773058 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3bb0e4933d234fe3a1771711c8d97be4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3bb0e4933d234fe3a1771711c8d97be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3bb0e4933d234fe3a1771711c8d97be4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3bb0e4933d234fe3a1771711c8d97be4"}]}] Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-969558776 Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 3bb0e4933d234fe3a1771711c8d97be4 Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-969558776 Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServicesAdminNegativeTestJSON-969558776-project Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 13cc20d49ea745e6bfbfaf2f13228923 Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-969558776-project Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 19 14:39:48.774680 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:39:48.775605 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 19 14:39:48.777899 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:39:48.783518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00ce6b92-d4e0-4ae1-97c0-36debfa0a72c tempest-ServicesAdminNegativeTestJSON-969558776 tempest-ServicesAdminNegativeTestJSON-969558776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:39:48.785233 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00ce6b92-d4e0-4ae1-97c0-36debfa0a72c tempest-ServicesAdminNegativeTestJSON-969558776 tempest-ServicesAdminNegativeTestJSON-969558776-project] 10.222.0.81 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.251857 Sep 19 14:39:48.790539 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 341/702] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:39:48.797122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d8c6241b-bd42-4bdb-bccb-d9adc60eb377 req-a46023ed-4212-4d62-86cd-a1b5a58d1114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1394eb-90c8-4b69-9f2c-a9d5834cf633", "tag": "a58ef42b-4694-4396-b183-28ed5e188474"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:48.808710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d8c6241b-bd42-4bdb-bccb-d9adc60eb377 req-a46023ed-4212-4d62-86cd-a1b5a58d1114 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.809718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d8c6241b-bd42-4bdb-bccb-d9adc60eb377 req-a46023ed-4212-4d62-86cd-a1b5a58d1114 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.810379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d8c6241b-bd42-4bdb-bccb-d9adc60eb377 req-a46023ed-4212-4d62-86cd-a1b5a58d1114 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.822401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d8c6241b-bd42-4bdb-bccb-d9adc60eb377 req-a46023ed-4212-4d62-86cd-a1b5a58d1114 service nova] Creating event network-changed:a58ef42b-4694-4396-b183-28ed5e188474 for instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 on n-h1-858384-1 Sep 19 14:39:48.829023 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d8c6241b-bd42-4bdb-bccb-d9adc60eb377 req-a46023ed-4212-4d62-86cd-a1b5a58d1114 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036967 Sep 19 14:39:48.830501 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 342/703] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:48.837851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:48.839250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:48.846711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.847605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.848287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.849221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:48.849897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:48.850542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:48.966688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:48.984997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:48.986396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:48.987594 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3630fa53-5ca1-431d-8738-42c234d6d69f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.762563 Sep 19 14:39:49.008484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 362/704] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:49.008484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:49.008484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:49.014092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:49.014788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:49.015278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:49.015775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:49.016252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:49.016682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:49.101611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:49.124967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:49.132087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:49.148501 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d2191e6-2b0c-4568-9cdc-371cc5dae476 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.312996 Sep 19 14:39:49.149525 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 343/705] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:49.166261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:49.172602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:49.217696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:49.240469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:49.250410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:49.255772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:49.264614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:49.265322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:49.284488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:49.352450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:49.373136 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97705632-e42e-4398-85c7-38f4d993f2ee tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.383456 Sep 19 14:39:49.397562 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 363/706] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:48 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:49.403992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:49.405924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:49.412872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:49.413513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:49.414064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:49.416036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:49.417217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:49.418040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:49.466303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:49.488776 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df2b5f37-0f38-49cc-a39e-91e48a8cbb04 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.334215 Sep 19 14:39:49.489604 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 344/707] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:49 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:49.636487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:49.649762 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61244342-8d54-431e-890d-9454063eb070 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.250659 Sep 19 14:39:49.667540 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 364/708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:49 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:50.014422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:50.015663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:50.030706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.031715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.033152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.034427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.035213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.036165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.190124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:50.194797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:50.235869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.237622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.239241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.245844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.248569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.250353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.268856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:50.676333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:50.691504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:50.710394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:50.715681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:50.717179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:50.724761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:50.725933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cc1b2db-94a5-4b0b-b4ce-06aaba947acf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.717198 Sep 19 14:39:50.733528 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 345/709] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:50 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:50.742254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:50.750534 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54ee56de-028f-4695-a81b-9b8fa5dff2b1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.568172 Sep 19 14:39:50.755532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:50.770103 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 365/710] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:50 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:50.779050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.786086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.786860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.790166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:50.792537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.794958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:50.795115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.799475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.804385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.805248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.805857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:50.806964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:50.809078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:50.810029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.121952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:51.159956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb452c9e-c3cb-4a5e-9453-e0b3b653abc2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.388514 Sep 19 14:39:51.160821 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 366/711] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:50 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:51.175388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:51.176813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:51.189234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.192289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.193765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.194674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.199002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.199920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.596990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:51.613704 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0232cb4f-1412-410e-99c3-955f7dd41b9b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.874527 Sep 19 14:39:51.625558 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 346/712] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:50 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:51.630854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-726ac203-eb0e-4644-93cc-c50193fda90b req-87956162-9327-43b4-a030-6eb2ef8411fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f", "tag": "64f45d91-a8b5-407b-8a52-7529acd6c48f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:51.665862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-726ac203-eb0e-4644-93cc-c50193fda90b req-87956162-9327-43b4-a030-6eb2ef8411fb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.666345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-726ac203-eb0e-4644-93cc-c50193fda90b req-87956162-9327-43b4-a030-6eb2ef8411fb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.667422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-726ac203-eb0e-4644-93cc-c50193fda90b req-87956162-9327-43b4-a030-6eb2ef8411fb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.699360 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-726ac203-eb0e-4644-93cc-c50193fda90b req-87956162-9327-43b4-a030-6eb2ef8411fb service nova] Creating event network-changed:64f45d91-a8b5-407b-8a52-7529acd6c48f for instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f on n-h1-858384-1 Sep 19 14:39:51.754587 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-726ac203-eb0e-4644-93cc-c50193fda90b req-87956162-9327-43b4-a030-6eb2ef8411fb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127650 Sep 19 14:39:51.755762 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 347/713] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:51.764090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:51.765331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:51.814044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.814950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.815700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.816681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.817354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.818009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.848213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:51.862295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b79729b-b1d5-4d12-9436-2a9b2ac146df tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.697939 Sep 19 14:39:51.863712 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 367/714] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:51 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:51.870634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:51.871827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:51.887073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.895994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.896461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:51.897241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:51.897677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:51.898109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:52.064572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:52.081362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:52.088189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:52.111321 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d4b2f58-2a18-491a-af65-c37882029dd4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.244297 Sep 19 14:39:52.114590 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 368/715] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:51 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:52.201497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:52.204209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:52.216561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:52.218299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:52.219191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:52.220114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:52.220734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:52.221340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:52.683788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:52.723500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-10517c42-41ed-4722-aa17-14da53cef9c9 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.527319 Sep 19 14:39:52.737213 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 369/716] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:52 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:52.737213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:52.737213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:52.743193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:52.749219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:52.750143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:52.750771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:52.755891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:52.756643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:52.757255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:52.775652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:52.782137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:52.784159 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f7549077-feb6-4dee-b73b-030fefc502e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 1.026379 Sep 19 14:39:52.788312 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 348/717] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:51 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:52.889288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:52.890137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:52.903407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:52.905484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:52.907302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:52.908330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:52.911950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:52.930894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:53.509333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:53.529937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd1fc672-cdc4-40b4-9953-2f503bb5c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.804635 Sep 19 14:39:53.551697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 370/718] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:52 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:53.560140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-02219a2a-227e-4576-b636-442dd4def954 req-f4d8a9a7-3cde-4d62-b12a-cc2ca53d0e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "name": "network-vif-plugged", "status": "completed", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:53.582837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-02219a2a-227e-4576-b636-442dd4def954 req-f4d8a9a7-3cde-4d62-b12a-cc2ca53d0e38 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:53.583582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-02219a2a-227e-4576-b636-442dd4def954 req-f4d8a9a7-3cde-4d62-b12a-cc2ca53d0e38 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:53.584179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-02219a2a-227e-4576-b636-442dd4def954 req-f4d8a9a7-3cde-4d62-b12a-cc2ca53d0e38 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:53.602497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:53.613479 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ade73719-697d-4ee0-8e2d-bb69f9c1c1fd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.728340 Sep 19 14:39:53.614556 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-02219a2a-227e-4576-b636-442dd4def954 req-f4d8a9a7-3cde-4d62-b12a-cc2ca53d0e38 service nova] Creating event network-vif-plugged:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:39:53.618133 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 349/719] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:52 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:53.625631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:53.627710 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-02219a2a-227e-4576-b636-442dd4def954 req-f4d8a9a7-3cde-4d62-b12a-cc2ca53d0e38 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074120 Sep 19 14:39:53.628464 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 371/720] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:53.629437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:53.639086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:53.639765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:53.640389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:53.641333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:53.641959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:53.642840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:53.763177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:53.764126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:53.773296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:53.775756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:53.777960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:53.779714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:53.780811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:53.781548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:53.782488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.009621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.037298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.040535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.049526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb97a50c-c27f-4d95-bf37-6b0da27c1ae2 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.430048 Sep 19 14:39:54.050795 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 350/721] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:53 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:54.058238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:54.059270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:54.074889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:54.083182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:54.083932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.084852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:54.087672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:54.088978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.194203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:54.239481 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6911b598-9e01-480a-81f7-711d34b7d352 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.483810 Sep 19 14:39:54.240789 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 372/722] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:53 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:54.458738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.470808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.473283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.474496 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6dde486c-ebd2-4d7c-8d60-2bcffffd82d5 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.421532 Sep 19 14:39:54.475259 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 351/723] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:54 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:54.565305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:54.567357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:54.575844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:54.576592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:54.577075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.577997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:54.579103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:54.579714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.646437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:54.647330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:54.657258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:54.661448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:54.662217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.663157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:54.663797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:54.664409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:54.861435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.879364 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73a87e4d-6eeb-41d6-89f1-dfacf2f398cf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.317812 Sep 19 14:39:54.882678 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 373/724] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:54 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:54.987021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:54.997822 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c6af748-0c80-4936-958d-b6012652a673 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.355804 Sep 19 14:39:55.015470 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 352/725] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:54 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:55.085084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:55.085960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:55.101970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.102779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.103153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.108107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.108633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.110439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.230139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:55.249491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:55.256704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:55.268060 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ccfc8d1-9769-454b-98bb-bf86bb3911b9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.186937 Sep 19 14:39:55.268904 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 374/726] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:55 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:55.305059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:55.305817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:55.343811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.344322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.346038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.350823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.351325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.352032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.501268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:55.502131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:55.518363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.519242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.519871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.520789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.521418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.522013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.624011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:55.681004 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ce9e5ba1-9a2a-42b5-a135-acb4521386f7 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.396056 Sep 19 14:39:55.682428 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 353/727] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:55 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:55.688122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee743740-af6b-4413-85fc-0b23e4e3bb36", "name": "network-vif-plugged", "status": "completed", "tag": "bedfe11b-122c-4ed5-93b4-13b7e2892b3a"}, {"server_uuid": "ef523061-9b8f-4105-8bbd-8a439e6a847c", "name": "network-vif-plugged", "status": "completed", "tag": "3824cb1b-7519-470c-8f9f-4bb74e33833b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:55.721193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.724333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.725150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.748079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] Creating event network-vif-plugged:bedfe11b-122c-4ed5-93b4-13b7e2892b3a for instance ee743740-af6b-4413-85fc-0b23e4e3bb36 on n-h1-858384-1 Sep 19 14:39:55.754062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] Creating event network-vif-plugged:3824cb1b-7519-470c-8f9f-4bb74e33833b for instance ef523061-9b8f-4105-8bbd-8a439e6a847c on n-h1-858384-1 Sep 19 14:39:55.774030 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a976a99d-364e-4da7-9f8c-2c6637d14519 req-d88b81c5-6682-49af-abcd-957a22311b24 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089618 Sep 19 14:39:55.775731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 354/728] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:55.910693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:55.912547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:55.936360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.941026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.943612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:55.943612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:55.943612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:55.946916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:56.025648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.037890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.047122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.057721 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd7b2244-6ced-49b2-b2de-fe465f798581 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.557411 Sep 19 14:39:56.061277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 375/729] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:55 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:56.076505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:56.086324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:56.108483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:56.114229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:56.117873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:56.122459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:56.128350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:56.131552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:56.561166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.591523 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba004595-3610-41eb-adc0-08f31c25fe20 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 0.684821 Sep 19 14:39:56.616941 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 355/730] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:55 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:39:56.646726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:56.647642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:56.680027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:56.683089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:56.683975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:56.684750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:56.691981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:56.693005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:56.693653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:56.956047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.965580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.967085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:56.978005 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3d4c73e-0bf3-4b97-9132-11a2c4b5388e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.358659 Sep 19 14:39:56.980822 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 356/731] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:56 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:56.989194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:56.990174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:56.997814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:56.999171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:56.999825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:57.001869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:57.002514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:57.003186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:57.109503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:57.131676 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba21a16a-fee0-4a2c-98a9-04fac4ec5f5f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 1.066078 Sep 19 14:39:57.132842 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 376/732] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:56 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:57.139382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:57.140203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:57.147850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:57.149239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:57.149925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:57.151949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:57.152598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:57.153212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:57.265896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:57.319491 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7b2f5b3-f3ab-46b5-8599-c39fa5890d24 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.335760 Sep 19 14:39:57.320308 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 357/733] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:56 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:57.582202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:57.602723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:57.609598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:57.610857 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d15e802-a4ef-4f79-8070-c47137bc44da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1361 microversion: 2.25 time: 0.476304 Sep 19 14:39:57.615489 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 377/734] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:57 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:57.646561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:57.647378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:57.673580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:57.676682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:57.678187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:57.682598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:57.684217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:57.686250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:58.013975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:58.014956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:58.044532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:58.045046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:58.045772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:58.046473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:58.046962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:58.047386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:58.210033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:58.468515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:58.493515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:39:58.495372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:58.500703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:58.532048 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8bb3a9e0-17eb-4b8a-91a1-4140d473b28e tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.513227 Sep 19 14:39:58.533616 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 378/735] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:58 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:39:58.563195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:58.566242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:58.591717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:58.593639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:58.596606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:58.597719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:58.601148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:58.602093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.483367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:59.491325 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13713b1d-8249-4b1f-adc8-ffbb7cc2874e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1314 microversion: 2.1 time: 1.854578 Sep 19 14:39:59.496365 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 358/736] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:57 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1314 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:59.504894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:59.505512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:59.526358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.527129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.528880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.536757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.537883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.538930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.616168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:39:59.641569 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8231dd8c-96d9-4451-b3c8-52d436bd657c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 1.100532 Sep 19 14:39:59.643155 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 379/737] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:39:58 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:39:59.649060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d971ba12-8a09-4e2c-9e01-246ec6abe37b req-741287fd-c24b-4504-93f4-f1e37eb6b2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1394eb-90c8-4b69-9f2c-a9d5834cf633", "name": "network-vif-plugged", "status": "completed", "tag": "a58ef42b-4694-4396-b183-28ed5e188474"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:39:59.666265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d971ba12-8a09-4e2c-9e01-246ec6abe37b req-741287fd-c24b-4504-93f4-f1e37eb6b2a1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.674826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d971ba12-8a09-4e2c-9e01-246ec6abe37b req-741287fd-c24b-4504-93f4-f1e37eb6b2a1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.675554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d971ba12-8a09-4e2c-9e01-246ec6abe37b req-741287fd-c24b-4504-93f4-f1e37eb6b2a1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.687947 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d971ba12-8a09-4e2c-9e01-246ec6abe37b req-741287fd-c24b-4504-93f4-f1e37eb6b2a1 service nova] Creating event network-vif-plugged:a58ef42b-4694-4396-b183-28ed5e188474 for instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 on n-h1-858384-1 Sep 19 14:39:59.693980 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d971ba12-8a09-4e2c-9e01-246ec6abe37b req-741287fd-c24b-4504-93f4-f1e37eb6b2a1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049238 Sep 19 14:39:59.694881 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 380/738] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:39:59.710210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:59.711141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:59.719379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.720081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.721752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.723026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.723809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.724239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.851274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:39:59.889690 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f94e260d-e7f8-41fb-afbb-b7cd2b779c81 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.392128 Sep 19 14:39:59.895516 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 359/739] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:59 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:39:59.900519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:39:59.906690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:39:59.915995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.933945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.934994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.936021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:39:59.936912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:39:59.937560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:39:59.993352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:40:00.018066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:00.146588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.154098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-978fabdf-4ac2-4517-811c-0bbf863ae7f8 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "DELETE /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 204 len: 0 microversion: 2.1 time: 0.256641 Sep 19 14:40:00.158921 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 360/740] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:39:59 2022] DELETE /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:00.165481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:00.169333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:00.172157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.173767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.177652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.178323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.178977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.181669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.182402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.183449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.186475 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff8b4a68-36a6-4dbe-97c8-c1e553163e03 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1557 microversion: 2.25 time: 0.485252 Sep 19 14:40:00.206468 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 381/741] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:39:59 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1557 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:00.217862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:00.218594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:00.236086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.236733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.237286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.238160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.239066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.239904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.250327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:00.327005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.336767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.338468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.346616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48e49a73-c7f9-4201-b5e8-939248b89650 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.185876 Sep 19 14:40:00.347264 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 361/742] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:00 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:00.352101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:00.352719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:00.365124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.365885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.366483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.367433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.368194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.368586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.590064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.602220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41462952-f373-4e05-ab6d-0d842a22a80e tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1714 microversion: 2.1 time: 0.394412 Sep 19 14:40:00.603210 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 382/743] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:00 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1714 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:00.610577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:00.611623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:00.622217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.624057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.625198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.626527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.627224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.627966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.706925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid ee743740-af6b-4413-85fc-0b23e4e3bb36 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:00.722593 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-acfb9f81-50e6-4abd-9e0f-41761fdc0a90 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 2049 microversion: 2.25 time: 0.374055 Sep 19 14:40:00.723683 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 362/744] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:00 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 2049 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:00.728534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:00.730081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:00.743788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.744656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.745566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.748212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.748641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.749293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.919357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:00.941576 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1bc1d8f-1541-47ac-947c-064b387b5caa tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1464 microversion: 2.1 time: 0.336342 Sep 19 14:40:00.942169 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 383/745] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:00 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:00.947118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:00.947842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:00.959168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.960285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.961259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:00.962694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:00.964554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:00.964661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.169740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:01.180007 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8716a534-f06e-4b18-aea5-ffc7f13b9121 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.454946 Sep 19 14:40:01.180381 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 363/746] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:00 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:01.185839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:01.191976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:01.201899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.202397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.202857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.203562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.204021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.204440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.369083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:01.387191 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c068191-4160-4b91-9b33-88168857e9fa tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.205617 Sep 19 14:40:01.399173 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 364/747] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:01 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:01.412893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:01.413211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:01.417925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid ee743740-af6b-4413-85fc-0b23e4e3bb36 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:01.419733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.420234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.420936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.421638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.422108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.422530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.440465 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d717b23-a90d-494b-ad0f-291e50d66b16 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 2049 microversion: 2.25 time: 0.491346 Sep 19 14:40:01.440902 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 384/748] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:00 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 2049 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:01.446141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:01.447021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:01.455498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.456854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.457489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.458410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.459100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.459690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.548571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:01.559652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:01.562006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:01.568123 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b4e3819-57cc-4074-9f05-1b3b5e7431cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1535 microversion: 2.91 time: 0.126005 Sep 19 14:40:01.569476 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 385/749] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:01 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1535 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:01.582603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:01.599627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.600222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.600662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.601490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.601942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.602370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.636166 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6fa3aa19-1c92-402e-862b-23ce79c1d555 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064723 Sep 19 14:40:01.637001 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 386/750] 10.222.0.81 () {60 vars in 1217 bytes} [Mon Sep 19 14:40:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:40:01.641402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:01.642016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:01.648735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.649400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.649875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.650427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.651507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.651956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.884392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:01.892701 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a524b4f3-d304-4d71-9b44-6524e5e10bc6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1464 microversion: 2.1 time: 0.492285 Sep 19 14:40:01.893285 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 365/751] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:01 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:01.898015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:01.898623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:01.905356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.906172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.906675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.907801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.908323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.909057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:01.952481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:01.962107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f1e6edfe-5a4a-4d74-8759-833a03c97d99 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1714 microversion: 2.1 time: 0.324418 Sep 19 14:40:01.962952 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 387/752] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:01 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1714 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:01.976973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d08f55d6-b6e8-4b53-8536-4007bb825218 req-229dd133-eded-4656-80af-a2a31335727d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f", "name": "network-vif-plugged", "status": "completed", "tag": "64f45d91-a8b5-407b-8a52-7529acd6c48f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:01.989221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d08f55d6-b6e8-4b53-8536-4007bb825218 req-229dd133-eded-4656-80af-a2a31335727d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:01.990075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d08f55d6-b6e8-4b53-8536-4007bb825218 req-229dd133-eded-4656-80af-a2a31335727d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:01.990723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d08f55d6-b6e8-4b53-8536-4007bb825218 req-229dd133-eded-4656-80af-a2a31335727d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:02.003762 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d08f55d6-b6e8-4b53-8536-4007bb825218 req-229dd133-eded-4656-80af-a2a31335727d service nova] Creating event network-vif-plugged:64f45d91-a8b5-407b-8a52-7529acd6c48f for instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f on n-h1-858384-1 Sep 19 14:40:02.011128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d08f55d6-b6e8-4b53-8536-4007bb825218 req-229dd133-eded-4656-80af-a2a31335727d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044053 Sep 19 14:40:02.012338 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 388/753] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:02.053422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2077140184", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cb0edfc6-3572-4040-881b-4a1785ac4895"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:02.066394 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc9048b1-67a4-4a17-af70-6097ebc860fb tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36/action" status: 202 len: 0 microversion: 2.25 time: 0.171368 Sep 19 14:40:02.067872 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 366/754] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:40:01 2022] POST /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:02.077346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:02.078972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:02.091558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:02.094961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:02.099505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:02.102464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:02.104935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:02.105842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:02.145040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:40:02.747106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid ee743740-af6b-4413-85fc-0b23e4e3bb36 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:02.762714 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1c1dc109-cbc1-4e9f-8c3a-0c73d2be9071 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 2054 microversion: 2.25 time: 0.690571 Sep 19 14:40:02.779336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 367/755] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:02 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 2054 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:02.788150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:02.789357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:02.797470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:02.798351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:02.799052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:02.800224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:02.800927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:02.801595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.046445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:03.059206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ef9f1ec-505d-41a0-b0da-400c47b60bce tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1319 microversion: 2.1 time: 0.278209 Sep 19 14:40:03.059827 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 368/756] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:02 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:03.073702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:03.078491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:03.085851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.086837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.087513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.088885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.090031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.090737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.100884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:40:03.101949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:40:03.102672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:40:03.103341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:40:03.104658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:40:03.117163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.118309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.119946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.122796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.124312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.124988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.151645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Getting quotas for project d6f0ada3b2a1446db012bcbdd2334e94. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:03.159185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Getting quotas for user 12de6f76b4c3407ead7ece5ff764c913 and project d6f0ada3b2a1446db012bcbdd2334e94. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:03.181397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:40:03.186191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:40:03.213329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:03.254450 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4ccf95f1-8320-46c8-8e82-302dcd148d83 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.192303 Sep 19 14:40:03.256427 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 369/757] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:03 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:03.258144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-370c53b8-9148-4415-9f74-ecbf480bb432 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208785 Sep 19 14:40:03.259156 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 389/758] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:40:03.265312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:03.266455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:03.271579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:03.272980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:03.275504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.277193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.278106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.279484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.280394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.281095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.282634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.283375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.283889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.284715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.285255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.285988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.377750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:03.389329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:03.391693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:03.399718 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70f44bdf-6604-4f96-82ab-71196c6e9e37 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1538 microversion: 2.91 time: 0.141514 Sep 19 14:40:03.400596 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 370/759] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:03 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1538 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:03.554410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20e5e13d7af46ad87d0c7bb66ec5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea30ac65a7f47cb8c41480e5b4a1e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:03.563519 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-550a210b-147b-49da-ad3c-031d21f8f363 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 200 len: 1714 microversion: 2.1 time: 0.303107 Sep 19 14:40:03.578789 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 390/760] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:03 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 1714 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:03.580513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-099a6a6e-9779-4b94-90cb-5f590f563cef tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:03.581345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-099a6a6e-9779-4b94-90cb-5f590f563cef tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:03.665419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f1ac49f-7bdd-48c2-a5c8-4ca5219c314a tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Action: 'create', calling method: .version_select at 0x7fde2a609ca0>, body: {"pool": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:03.670265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-099a6a6e-9779-4b94-90cb-5f590f563cef tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:03.678053 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-099a6a6e-9779-4b94-90cb-5f590f563cef tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1214 microversion: 2.1 time: 0.112912 Sep 19 14:40:03.679872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 391/761] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:03 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:03.687326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:03.701535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:03.725226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.726148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.726683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.727541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:03.728100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:03.728626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:03.845843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858384-1". {{(pid=128730) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 14:40:03.991722 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa879a38-481e-4891-b9e6-6b58e2c2198a tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action" status: 202 len: 0 microversion: 2.91 time: 0.308728 Sep 19 14:40:03.996273 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 392/762] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:40:03 2022] POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:04.001436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:04.008889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:04.023012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:04.023635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:04.024294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:04.025130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:04.027764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:04.028737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:04.599325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid ee743740-af6b-4413-85fc-0b23e4e3bb36 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:04.633964 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f56ddf8-ddff-47d9-bd96-f7d764d90b02 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 2034 microversion: 2.25 time: 0.636409 Sep 19 14:40:04.648749 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 393/763] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:03 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 2034 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:04.674965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:04.675779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:04.690213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:04.690963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:04.691560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:04.692430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:04.693044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:04.693654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:04.878277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:04.892717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:04.895489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:04.920798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba95efd5-d210-41dd-b579-bddbce3a4704 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1486 microversion: 2.91 time: 0.259102 Sep 19 14:40:04.921696 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 394/764] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:04 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1486 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:04.932758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:04.933660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:04.981085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:04.982120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:04.983672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:04.992195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:04.994168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:04.995407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:05.365005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:05.396368 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5285c4ee-f63c-4d26-99ef-32a7fd5070d1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1468 microversion: 2.1 time: 0.471299 Sep 19 14:40:05.399301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 395/765] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:04 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1468 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:05.426009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:05.429478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:05.448667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:05.450010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:05.450644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:05.452457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:05.457802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:05.459548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:06.006394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:06.049359 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2fd08715-fd3a-4c73-8eef-c99cdf0cc4b0 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.645347 Sep 19 14:40:06.050633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 396/766] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:05 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:06.055680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c1d0a438-7dc8-4916-8d75-73f4c1239a2e req-a351f65f-aa18-4000-a275-4662aa17eb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910cecb9-63f3-4ab8-9ef4-92d4af15b996", "name": "network-vif-deleted", "tag": "0ff9d586-7183-4c29-ad3b-d8f08b31311a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:06.068945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c1d0a438-7dc8-4916-8d75-73f4c1239a2e req-a351f65f-aa18-4000-a275-4662aa17eb35 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:06.071033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c1d0a438-7dc8-4916-8d75-73f4c1239a2e req-a351f65f-aa18-4000-a275-4662aa17eb35 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:06.071751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c1d0a438-7dc8-4916-8d75-73f4c1239a2e req-a351f65f-aa18-4000-a275-4662aa17eb35 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:06.113108 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c1d0a438-7dc8-4916-8d75-73f4c1239a2e req-a351f65f-aa18-4000-a275-4662aa17eb35 service nova] Creating event network-vif-deleted:0ff9d586-7183-4c29-ad3b-d8f08b31311a for instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 on n-h1-858384-1 Sep 19 14:40:06.125439 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c1d0a438-7dc8-4916-8d75-73f4c1239a2e req-a351f65f-aa18-4000-a275-4662aa17eb35 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072560 Sep 19 14:40:06.126531 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 397/767] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:06.144734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:06.154048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:06.170489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:06.171308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:06.171768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:06.172524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:06.172988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:06.173423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:06.193278 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 HTTP/1.1 Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:40:06.195080 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:06.196363 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '910cecb9-63f3-4ab8-9ef4-92d4af15b996'} Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:06.197102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:06.203796 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:06.205303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:06.205303 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6478d297-3d19-41de-9351-e390e34dc9b1 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 404 len: 111 microversion: 2.1 time: 0.068099 Sep 19 14:40:06.205303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 398/768] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:06 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:06.216564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": "auto"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:06.219352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:06.227872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:06.228519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:06.229221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:06.230129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:06.230664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:06.231183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:06.284372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'flavor' on Instance uuid ee743740-af6b-4413-85fc-0b23e4e3bb36 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:06.306151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Going to try to live migrate instance to n-h2-858384-1 {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:40:06.361948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:07.085903 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f1ac49f-7bdd-48c2-a5c8-4ca5219c314a tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.668246 Sep 19 14:40:07.087164 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 371/769] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:40:03 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:07.093933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:07.095137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:07.109773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:07.109773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:07.110458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:07.126474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:07.128766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:07.129594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:07.592188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:07.629428 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62c7cda5-a610-4bb7-91f1-bb063846e443 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.540378 Sep 19 14:40:07.631281 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 372/770] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:07 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:07.642774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:07.644368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:07.668725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:07.669893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:07.671765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:07.674088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:07.675482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:07.676518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.097033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:08.128735 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b39847b-eac6-444f-abf9-c924c22cf8aa tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633" status: 200 len: 1469 microversion: 2.1 time: 0.495277 Sep 19 14:40:08.136276 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 373/771] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:07 2022] GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:08.162649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:08.164567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:08.189304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:08.193858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:08.195832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.198584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:08.200992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:08.203420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.256915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:08.355496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:08.379574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:08.381866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:08.389058 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fbcc0445-29b9-4e85-b95b-b19955982289 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.250734 Sep 19 14:40:08.390616 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 374/772] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:08 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:08.395795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:08.397153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:08.405173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:08.406145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:08.407203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.408166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:08.408962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:08.409576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.435588 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 HTTP/1.1 Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:40:08.438516 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:08.439986 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'f2236703-317f-4c8f-95c0-5cf482587fd7'} Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:08.440921 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:08.442229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:08.444968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:08.446594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b59af7b6-042f-4c8d-ac9e-2d23480b869f tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 404 len: 111 microversion: 2.1 time: 0.054894 Sep 19 14:40:08.453154 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 375/773] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:40:08 2022] DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:08.492170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:08.497459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:08.516588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:08.517737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:08.519762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.520756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:08.523855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:08.524991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:08.533337 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d122057-b40b-41e4-9342-b7f0cf407528 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36/action" status: 202 len: 0 microversion: 2.25 time: 2.326820 Sep 19 14:40:08.536362 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 399/774] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:40:06 2022] POST /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36/action => generated 0 bytes in 2338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:08.549462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7cdfe56-12ad-4687-a9f5-ec1ea6e32676 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Action: 'create', calling method: .version_select at 0x7fde2a88a3a0>, body: {"pool": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:09.319852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:09.370134 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4ccd6b8d-1db4-4995-acf1-376848cc2de8 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.916945 Sep 19 14:40:09.372068 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 376/775] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:08 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:09.395322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:09.402047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:09.403457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Searching by: {'reservation_id': 'r-vcyigwdi', 'deleted': False, 'project_id': '32c474c76d064369addb54e031ce368b'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:09.424132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:09.424622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:09.425065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:09.425799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:09.426254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:09.426678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:09.709306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:09.918699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:09.928200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:09.928711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:09.929761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:10.326685 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41558dac-9ec9-4c2e-99e8-eb25a01fb9cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?reservation_id=r-vcyigwdi" status: 200 len: 2930 microversion: 2.1 time: 0.952659 Sep 19 14:40:10.327913 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 377/776] 10.222.0.81 () {58 vars in 1197 bytes} [Mon Sep 19 14:40:09 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vcyigwdi => generated 2930 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:10.340816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:10.347999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:10.366465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:10.368452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:10.369288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:10.371623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:10.372504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:10.373269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:10.404248 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 HTTP/1.1 Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:40:10.410538 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:10.412530 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'f2236703-317f-4c8f-95c0-5cf482587fd7'} Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:10.413456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:10.415023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:10.417071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:10.417071 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40755c47-0266-4382-9734-b3e6fc2549b5 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 404 len: 111 microversion: 2.1 time: 0.080626 Sep 19 14:40:10.417071 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 378/777] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:10 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:10.426788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:10.439702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:10.450439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:10.451130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:10.451681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:10.452516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:10.453082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:10.453616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:10.830020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:10.840800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:10.842415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:10.843754 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a615b84-0771-4c13-9961-4be3999b6f4d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.425393 Sep 19 14:40:10.844515 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 379/778] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:10 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:10.849267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:10.849922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:10.856921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:10.857429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:10.857875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:10.859016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:10.859306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:10.859751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.126925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:11.147567 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3f85e6ac-8a66-4e23-8201-8b393201f3ff tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.301995 Sep 19 14:40:11.148174 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 380/779] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:10 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:11.171250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:11.171250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:11.176010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.176521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.177034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.177772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.178707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.181042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.343206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:11.363338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:11.366173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:11.376579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46b122a3-b13b-420c-9410-a598b337a96f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.226758 Sep 19 14:40:11.378015 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 381/780] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:11 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:11.387098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0dc39a6f-5693-4b27-9f07-e54dbc686bf4 req-8858fb9f-d0f1-404e-a037-2ca93ff62add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75170b67-f117-49e1-a9ce-a972a6205a9e", "tag": "d844333e-bee5-4ff6-933f-9cf66a9234ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:11.405634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0dc39a6f-5693-4b27-9f07-e54dbc686bf4 req-8858fb9f-d0f1-404e-a037-2ca93ff62add service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.406548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0dc39a6f-5693-4b27-9f07-e54dbc686bf4 req-8858fb9f-d0f1-404e-a037-2ca93ff62add service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.407401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0dc39a6f-5693-4b27-9f07-e54dbc686bf4 req-8858fb9f-d0f1-404e-a037-2ca93ff62add service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.430796 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0dc39a6f-5693-4b27-9f07-e54dbc686bf4 req-8858fb9f-d0f1-404e-a037-2ca93ff62add service nova] Creating event network-changed:d844333e-bee5-4ff6-933f-9cf66a9234ed for instance 75170b67-f117-49e1-a9ce-a972a6205a9e on n-h2-858384-1 Sep 19 14:40:11.441731 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0dc39a6f-5693-4b27-9f07-e54dbc686bf4 req-8858fb9f-d0f1-404e-a037-2ca93ff62add service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060977 Sep 19 14:40:11.443213 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 382/781] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:11.452482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d36af5c-5982-4aa2-a793-bed0c06c791a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:11.483614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.compute.server_groups [None req-6d36af5c-5982-4aa2-a793-bed0c06c791a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Querying cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) for 2 instances {{(pid=128731) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 19 14:40:11.484971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d36af5c-5982-4aa2-a793-bed0c06c791a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.485897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d36af5c-5982-4aa2-a793-bed0c06c791a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.486674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d36af5c-5982-4aa2-a793-bed0c06c791a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.504096 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7cdfe56-12ad-4687-a9f5-ec1ea6e32676 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.965257 Sep 19 14:40:11.505648 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 400/782] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:40:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:11.519258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:11.520180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:11.534772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.535749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.537012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.538358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.539047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.539640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.577324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d36af5c-5982-4aa2-a793-bed0c06c791a tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/295b47a1-efb2-424b-84d9-e8e135348118" status: 200 len: 264 microversion: 2.1 time: 0.132562 Sep 19 14:40:11.578287 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 383/783] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:40:11 2022] GET /compute/v2.1/os-server-groups/295b47a1-efb2-424b-84d9-e8e135348118 => generated 264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:11.596104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28483fa9-4bdc-45a7-96b8-60378aa23cd4 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '.version_select at 0x7fde2a59ee50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:11.644846 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28483fa9-4bdc-45a7-96b8-60378aa23cd4 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907518306" status: 202 len: 0 microversion: 2.1 time: 0.064207 Sep 19 14:40:11.650474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 384/784] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:40:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907518306 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:11.663623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8aa24a28-8416-4be7-94ae-178519d9c275 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Action: 'create', calling method: .version_select at 0x7fde2a68eb80>, body: {"pool": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:11.672788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:11.723633 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c6ceee80-bd2e-436a-a5ce-f810576096c2 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.208039 Sep 19 14:40:11.725383 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 401/785] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:11 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:11.737903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:11.739646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:11.766665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.777027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.783693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:11.785178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:11.786073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:11.786914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:12.205231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3513bbf-4884-4aac-884d-f6c7137216b6 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633" status: 200 len: 1620 microversion: 2.1 time: 0.477466 Sep 19 14:40:12.206315 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 402/786] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:11 2022] GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 => generated 1620 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:12.230486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:12.235340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:12.260618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:12.263078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:12.263798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:12.264848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:12.267523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:12.268109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:12.269669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:12.749582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:12.759915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:12.762071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:12.764234 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97fd1b06-e40f-4952-8deb-ce20bad7f683 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.545846 Sep 19 14:40:12.784629 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 403/787] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:12 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:12.790160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:12.791121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:12.798831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:12.799649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:12.800270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:12.801172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:12.801800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:12.802397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.094500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:13.113231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3b43270-5001-4e4a-a634-dc6038e0ce69 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.327067 Sep 19 14:40:13.113832 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 404/788] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:12 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:13.118687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:13.119338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:13.127102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:13.127915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:13.128538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.129471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:13.130155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:13.130566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.137072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:13.375561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20c9f2ad-0503-4b08-aa74-c7b869c8fd91 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 200 len: 1619 microversion: 2.1 time: 0.259844 Sep 19 14:40:13.391480 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 405/789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:13 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 1619 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:13.419127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:13.420220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:13.429588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:13.430254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:13.430711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.431839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:13.433771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:13.434393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.597406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:13.615634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:13.619179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:13.630351 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d03b58e0-6915-4ca4-a994-10f34948766d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.220031 Sep 19 14:40:13.631488 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 406/790] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:13 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:13.640550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:13.641628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:13.653514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:13.654380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:13.655195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.656640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:13.657491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:13.658254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:13.708234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:13.814849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:13.844837 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38af660c-c9c4-403d-a46c-ac259c66cc80 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.210764 Sep 19 14:40:13.845725 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 407/791] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:13 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:13.876110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-27352a87-bc5a-450f-b2cb-c58c28cc5106 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:13.909117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-27352a87-bc5a-450f-b2cb-c58c28cc5106 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1122109653" status: 202 len: 0 microversion: 2.1 time: 0.040486 Sep 19 14:40:13.914705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 408/792] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:40:13 2022] DELETE /compute/v2.1/flavors/1122109653 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:13.923957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c165d274-c970-4a7a-bb95-b45a2be99cd9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: .version_select at 0x7fde2c6363a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1201621159", "policies": ["anti-affinity"]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:13.961817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c165d274-c970-4a7a-bb95-b45a2be99cd9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:13.972944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c165d274-c970-4a7a-bb95-b45a2be99cd9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:14.084572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c165d274-c970-4a7a-bb95-b45a2be99cd9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:14.094827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c165d274-c970-4a7a-bb95-b45a2be99cd9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:14.125429 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c165d274-c970-4a7a-bb95-b45a2be99cd9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.208634 Sep 19 14:40:14.126635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 409/793] 10.222.0.81 () {60 vars in 1174 bytes} [Mon Sep 19 14:40:13 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:14.139109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:14.140175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:14.155157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:14.155157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:14.155157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:14.155157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:14.155867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:14.155867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:14.499023 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8aa24a28-8416-4be7-94ae-178519d9c275 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.848158 Sep 19 14:40:14.501406 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 385/794] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:40:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:14.511666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0520bbae-7ff7-4dd1-be35-816f8de4f00d tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:14.565164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:14.569988 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0520bbae-7ff7-4dd1-be35-816f8de4f00d tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.066079 Sep 19 14:40:14.571396 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 386/795] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:40:14 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:14.581092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:14.582952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:14.595883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:14.597293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:14.598347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:14.600136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:14.601231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:14.602248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:14.605299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:14.606878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:14.610379 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-64fec5d7-4bc0-4afa-bd41-1f49b320b79a tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.482137 Sep 19 14:40:14.610903 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 410/796] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:14 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:14.628810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:14.629931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:14.643430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:14.644536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:14.645351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:14.646361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:14.647150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:14.647867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:14.874188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:14.879338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-89ac874a-1271-440e-ac58-7b1c999c250e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1814 microversion: 2.1 time: 0.267216 Sep 19 14:40:14.879980 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 411/797] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:14 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1814 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:14.884998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1671801339", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f400c482-d1b8-4170-ac92-582c6c5bc0c8"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:14.887805 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d6c1c81c-633e-459e-b5bb-0e9067160db6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.313993 Sep 19 14:40:14.888485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 387/798] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:14 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:14.893900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31ce0fb1-fa72-4555-aeb7-63d7ad7dbb26 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Action: 'create', calling method: .version_select at 0x7fde2a636550>, body: {"pool": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:14.956834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:40:15.315767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:40:15.316477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:40:15.317320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:40:15.318039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:40:15.318736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:40:15.358124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:15.359048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:15.359831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:15.361110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:15.362100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:15.363145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:15.398683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:15.410640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:15.426346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Going to run 2 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:40:15.429426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:40:15.486018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128730) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 19 14:40:15.514561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:15.522064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:15.597757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:15.602932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:15.619099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=acae3af4-40cc-4a06-8e7d-0603e92dcfa7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:40:15.672632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:INSERT=9 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:15.687936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:15.694350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:15.769418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:15.775787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'server_group_members'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:15.866307 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-79dec459-1861-4146-bfe3-2b23c1a43a6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.985034 Sep 19 14:40:15.867148 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 412/799] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:40:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:40:15.873363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51c9309e-71a2-4d30-9b88-419cba9188b6 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:15.896247 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51c9309e-71a2-4d30-9b88-419cba9188b6 tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1927601974" status: 202 len: 0 microversion: 2.1 time: 0.027596 Sep 19 14:40:15.898951 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 413/800] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:40:15 2022] DELETE /compute/v2.1/flavors/1927601974 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:15.906285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:15.907380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:15.948752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:15.950027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:15.951214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:15.953524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:15.954597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:15.955529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.382872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:16.394397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:16.405008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:16.412165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dddd80df-fe0e-4bc8-9a83-5406d21a90fd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.510199 Sep 19 14:40:16.438864 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 414/801] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:15 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:16.438864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:16.438864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:16.450418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.450418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.450418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.450418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.450838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.450838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.612258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:16.636595 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12297281-c63d-4aa0-a8ff-a7d2108f3f5f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.209379 Sep 19 14:40:16.637595 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 415/802] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:16 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:16.660622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:16.671462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.672759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.674717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.677236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.677964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.678711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.718808 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab0f0fbb-a0ab-4568-9c56-6ac6c570974d tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079724 Sep 19 14:40:16.719910 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 416/803] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:40:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:16.741813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:16.742662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:16.752858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.753611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.754296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.755365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.756040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.756679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.930420 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31ce0fb1-fa72-4555-aeb7-63d7ad7dbb26 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.040524 Sep 19 14:40:16.931496 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 388/804] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:40:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:16.946992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:16.961746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:16.966851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Searching by: {'deleted': False, 'project_id': '32c474c76d064369addb54e031ce368b'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:16.992681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:16.996566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:16.997446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:16.998814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.000594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.001734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.054138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.072277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.077585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.081850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2cf5f019-8fb9-41c7-aa46-bac952eb2dd0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.345640 Sep 19 14:40:17.085264 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 417/805] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:16 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:17.094223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a248989-104e-46c6-9613-1be4d6b303bb tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.160570 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3a248989-104e-46c6-9613-1be4d6b303bb tempest-ServersWithSpecificFlavorTestJSON-2072257790 tempest-ServersWithSpecificFlavorTestJSON-2072257790-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064246 Sep 19 14:40:17.162346 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 418/806] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:17.168820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.169803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:17.187679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.188582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.190015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.190725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.193581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.194968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.215099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:17.346526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dd5a2b3f-97ae-470c-9d0e-b9afc42245d7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.413302 Sep 19 14:40:17.355012 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 389/807] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:40:16 2022] GET /compute/v2.1/servers => generated 1666 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:17.355012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c48ad08-de17-4855-acc0-438934bae17c tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde2a6bc550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.553362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.564898 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d05c6de1-07eb-47af-b1eb-747fd68f3273 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.400826 Sep 19 14:40:17.579747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 419/808] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:17.579747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.579747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:17.579747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.580531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.580531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.580531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.580929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.581313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.599915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 HTTP/1.1 Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:40:17.601725 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.603613 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '910cecb9-63f3-4ab8-9ef4-92d4af15b996'} Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:17.605396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.607885 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.610024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:17.610024 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9e5fd7e-697b-472a-896d-69cfb5a471f0 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "DELETE /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 404 len: 111 microversion: 2.1 time: 0.035689 Sep 19 14:40:17.610024 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 420/809] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:40:17 2022] DELETE /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:17.613944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.614575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:17.624438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.624438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.624438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.624438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.624964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.624964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.663641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:17.679129 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c48ad08-de17-4855-acc0-438934bae17c tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/5e79d6d2-cbb5-4544-9e85-302747cbe100" status: 200 len: 142 microversion: 2.1 time: 0.330388 Sep 19 14:40:17.680386 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 390/810] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/os-floating-ips/5e79d6d2-cbb5-4544-9e85-302747cbe100 => generated 142 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:17.688106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.688817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:17.697140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.698558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.699125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.699957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.700485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.701030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.756257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.775025 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-146e3c8c-8501-4b9c-a839-590e41f6e231 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1271 microversion: 2.1 time: 0.164765 Sep 19 14:40:17.778054 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 421/811] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:17.794177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.795703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: 910cecb9-63f3-4ab8-9ef4-92d4af15b996] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:17.811496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.812037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.812475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.813764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.813854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.814295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.849491 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 HTTP/1.1 Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:40:17.857440 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.858831 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '910cecb9-63f3-4ab8-9ef4-92d4af15b996'} Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:17.859896 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. Sep 19 14:40:17.862857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:17.863997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance 910cecb9-63f3-4ab8-9ef4-92d4af15b996 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:17.863997 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-238c3eac-86e6-43eb-9bc5-8c55118dd02d tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996" status: 404 len: 111 microversion: 2.1 time: 0.080959 Sep 19 14:40:17.871201 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 422/812] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/servers/910cecb9-63f3-4ab8-9ef4-92d4af15b996 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:17.897441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:17.898902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:17.914944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.915447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.919491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.931445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.931445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:17.931445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:17.931445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:17.939065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.940621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:17.956496 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4d06375-5ff1-4373-bffb-8b8feb2e90bd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.272639 Sep 19 14:40:17.957426 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 391/813] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:17.964173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-891f3803-6af3-4c21-8a56-3034d1acda02 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde2a73ac10>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:18.082335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:18.102804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-556b3476-cc82-49f3-bced-ec4f8dceb18b tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1927 microversion: 2.75 time: 0.230017 Sep 19 14:40:18.104775 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 423/814] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:17 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1927 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:18.110865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:18.111735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:18.118475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.119145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.120718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.121859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.122553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.123224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.142441 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 HTTP/1.1 Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:40:18.144551 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.146413 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'f2236703-317f-4c8f-95c0-5cf482587fd7'} Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:18.147752 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.149655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.154642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:18.155902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b10d6f12-5ecd-44ae-8948-1dfcffeb4ad3 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 404 len: 111 microversion: 2.1 time: 0.049659 Sep 19 14:40:18.156659 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 424/815] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:40:18 2022] DELETE /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:18.162006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:18.162863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:18.170811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.171707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.173304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.182013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.183237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.183875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.521698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:18.533384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:18.535419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:18.536775 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a320e2c-0329-45f6-aa4e-1f570d77a1d1 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.378997 Sep 19 14:40:18.538012 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 425/816] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:18 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:18.543771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:18.544704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] [instance: f2236703-317f-4c8f-95c0-5cf482587fd7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:18.555334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.556217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.558307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.559763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.561053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.563607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.585826 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] HTTP exception thrown: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Request method failure captured: Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 HTTP/1.1 Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH60L8up2ORu3C5spECQai2UfgFtoD8dAn_QpJCppw2aG9pBx7DFBYrMvaIhqsGMbObjZIAnF8r_aO6-mMbXoKO1AN7Q66RKWPLXEzoHOlm-N6u6eVNbXwZoGEBfxuO7a3V2lKJexVKM0kp5gaIsbD4mNkpIo0gz20zzXZrSTL8Z-WA Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:40:18.592463 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ea30ac65a7f47cb8c41480e5b4a1e3f"}]}] Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2ea30ac65a7f47cb8c41480e5b4a1e3f Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796 Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c20e5e13d7af46ad87d0c7bb66ec5a19 Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-618687796-project Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.594212 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'f2236703-317f-4c8f-95c0-5cf482587fd7'} Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:18.594975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. Sep 19 14:40:18.596181 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:18.597203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] Returning 404 to user: Instance f2236703-317f-4c8f-95c0-5cf482587fd7 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:18.597203 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c89b0a2b-8d36-4ae7-aafd-45a399e788a9 tempest-ServersWithSpecificFlavorTestJSON-618687796 tempest-ServersWithSpecificFlavorTestJSON-618687796-project] 10.222.0.81 "GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7" status: 404 len: 111 microversion: 2.1 time: 0.054565 Sep 19 14:40:18.603289 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 426/817] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:18 2022] GET /compute/v2.1/servers/f2236703-317f-4c8f-95c0-5cf482587fd7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:18.608624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:18.609236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:18.624732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.625239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.625678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:18.626740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:18.626996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:18.627274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.009179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:19.036648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-208993a0-72e7-403b-b71c-6adb3257f3bf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.432125 Sep 19 14:40:19.054244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 427/818] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:18 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:19.062430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:19.067989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:19.082053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.082878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.083964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.085955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.087695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.089519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.239950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:19.257969 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-283c0752-71f7-4380-9354-4222c04e679f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1277 microversion: 2.1 time: 0.201482 Sep 19 14:40:19.274383 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 428/819] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:19 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:19.292241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:19.293211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:19.301307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.302093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.302795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.303743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.304358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.304949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.413094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:19.430347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:19.432794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:19.461044 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ceaa0344-8234-495d-a999-f4c0b5e48e40 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.185394 Sep 19 14:40:19.463588 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 429/820] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:19 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:19.469740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:19.470659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:19.492698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.493627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.494277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.496094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.496744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.497304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.708001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:19.748373 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e270921-5347-4b0c-b36a-836550437217 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1945 microversion: 2.75 time: 0.282892 Sep 19 14:40:19.753586 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 430/821] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:19 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1945 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:19.765011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:19.769077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:19.781775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-891f3803-6af3-4c21-8a56-3034d1acda02 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/5e79d6d2-cbb5-4544-9e85-302747cbe100" status: 202 len: 0 microversion: 2.1 time: 1.823107 Sep 19 14:40:19.783203 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 392/822] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:40:17 2022] DELETE /compute/v2.1/os-floating-ips/5e79d6d2-cbb5-4544-9e85-302747cbe100 => generated 0 bytes in 1825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:19.784406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.785018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.787154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.788190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:19.790565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:19.791158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:19.794109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba34a60d-b951-4547-8bff-6c7cd0e68751 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde2a719790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:19.919345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:20.766393 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba34a60d-b951-4547-8bff-6c7cd0e68751 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.977363 Sep 19 14:40:20.775656 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 393/823] 10.222.0.81 () {58 vars in 1164 bytes} [Mon Sep 19 14:40:19 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:20.784082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:20.787283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:20.803287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:20.804266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:20.804870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:20.805770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:20.806228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:20.807343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:20.808695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:20.819827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:20.821564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:20.823589 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e4eef91e-1762-46db-a183-56e909789dcd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 1.067928 Sep 19 14:40:20.839336 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 431/824] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:19 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:20.848735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6201d369-0b7b-4d88-87bf-266491387356", "device": "/dev/xvdb"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:20.852086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:20.860089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:20.861159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:20.861159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:20.861730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:20.862195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:20.862622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.071612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:21.082592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d34eaba3-f405-4b17-a918-3053ac610cc3 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.305139 Sep 19 14:40:21.083581 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 394/825] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:20 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:21.090497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:21.091506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:21.098215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:21.100178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.100571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.101070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.101900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.102378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.102874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.288106 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-58970b9d-10ef-437e-a6f9-d0ce3a924257 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "POST /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447068 Sep 19 14:40:21.288755 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 432/826] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 14:40:20 2022] POST /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:21.313628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:21.319648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:21.329758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.330447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.330930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.332591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.333547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.334696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.335604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:21.346672 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7150b5e2-32cc-4614-a590-1e2674e6dfeb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1319 microversion: 2.1 time: 0.261651 Sep 19 14:40:21.370379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 395/827] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:21 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:21.370379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0ed70ac0-a1b5-40a7-8c23-33e35718b05d req-5b26f17b-e3fd-4658-978f-9483e29e3e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af008c9b-060d-4b4b-9fbf-5d98074b4ebf", "tag": "b5129d39-a81b-4b33-bdf4-60e47b2765de"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:21.391530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ed70ac0-a1b5-40a7-8c23-33e35718b05d req-5b26f17b-e3fd-4658-978f-9483e29e3e8c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.392037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ed70ac0-a1b5-40a7-8c23-33e35718b05d req-5b26f17b-e3fd-4658-978f-9483e29e3e8c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.392467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ed70ac0-a1b5-40a7-8c23-33e35718b05d req-5b26f17b-e3fd-4658-978f-9483e29e3e8c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.427745 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0ed70ac0-a1b5-40a7-8c23-33e35718b05d req-5b26f17b-e3fd-4658-978f-9483e29e3e8c service nova] Creating event network-changed:b5129d39-a81b-4b33-bdf4-60e47b2765de for instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf on n-h1-858384-1 Sep 19 14:40:21.442158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0ed70ac0-a1b5-40a7-8c23-33e35718b05d req-5b26f17b-e3fd-4658-978f-9483e29e3e8c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084533 Sep 19 14:40:21.442716 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 396/828] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:21.448554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a8eb9e0-fc14-4857-95fb-7b26a04c1640 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde2a428af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:21.592665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:21.602109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:21.603572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:21.609854 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-34303bb5-a0de-4996-b768-92339002e4d0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.319759 Sep 19 14:40:21.610644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 433/829] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:21 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:21.614854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:21.615460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:21.624024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.624521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.624955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.625659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.626107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.626561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.763612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:21.785176 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc38dfbd-0c63-4665-bea8-9700c794f8b5 tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1933 microversion: 2.75 time: 0.173623 Sep 19 14:40:21.794118 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 434/830] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:21 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1933 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:21.852575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:21.853586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:21.861734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.862209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.863505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.871857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:21.872371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:21.872833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:21.992757 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a8eb9e0-fc14-4857-95fb-7b26a04c1640 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips" status: 200 len: 395 microversion: 2.1 time: 0.548422 Sep 19 14:40:22.004499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 397/831] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:40:21 2022] GET /compute/v2.1/os-floating-ips => generated 395 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:22.011349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e6475d97-cec4-47b8-9025-9edadd5a505b tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde2a609040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:22.304772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:22.314729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:22.316390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:22.317688 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83c353b8-003c-4577-8532-fe7916201a3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.469099 Sep 19 14:40:22.318343 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 435/832] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:21 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:40:22.323826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:22.324620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:22.331497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:22.332796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:22.333337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:22.334181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:22.334737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:22.335288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:22.930391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:22.962603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b26d2a8-57a2-4193-beee-6834e2f4706d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.642391 Sep 19 14:40:22.966145 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 436/833] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:22 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:22.980044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:22.981536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:22.993122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:22.994410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:22.995479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:22.997035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:22.998320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:22.999390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:24.455748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:24.460798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:24.499144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b5fd59e-db2e-4d33-9b35-38129f997ef6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1319 microversion: 2.1 time: 1.530281 Sep 19 14:40:24.511211 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 437/834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:22 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1319 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:24.528375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:24.529864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:24.553015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:24.554206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:24.559655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:24.561660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:24.562919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:24.563893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:24.793545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:24.844461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:24.851342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:24.882714 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f225196-9961-4a15-b788-db77251317c9 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1531 microversion: 2.91 time: 0.369262 Sep 19 14:40:24.892997 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 438/835] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:24 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1531 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:24.955178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:24.956804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:24.985511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:24.986427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:24.987248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:24.988558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:24.989393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:25.000980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:25.422654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] Lazy-loading 'services' on Instance uuid f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:25.461872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:25.468171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ddea6c1-cda4-4799-a327-1a45c637bf3f tempest-ServersAdmin275Test-1138404574 tempest-ServersAdmin275Test-1138404574-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1918 microversion: 2.75 time: 0.573503 Sep 19 14:40:25.469259 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 439/836] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:24 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1918 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:25.474394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:25.487564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:25.497222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:25.497851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:25.498313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:25.500474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:25.503225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:25.503794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:25.798928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=30 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:25.973055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:25.984113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:25.986169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:25.987479 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7d91751-10cf-4aed-ba06-1eae8c1fb5cb tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.516979 Sep 19 14:40:25.988120 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 440/837] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:25 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:25.992991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:25.993668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:26.001514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.002086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.002594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.003514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.004227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.004853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.343528 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e6475d97-cec4-47b8-9025-9edadd5a505b tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/0f8316f0-9b41-4d80-b775-34ae898c7780" status: 202 len: 0 microversion: 2.1 time: 4.336673 Sep 19 14:40:26.347635 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 398/838] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:40:22 2022] DELETE /compute/v2.1/os-floating-ips/0f8316f0-9b41-4d80-b775-34ae898c7780 => generated 0 bytes in 4338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:26.354377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-24ac6d02-3100-4724-ba7f-5ea62882bf40 req-b69f33ed-3041-494f-8eee-2e56eaed107c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee743740-af6b-4413-85fc-0b23e4e3bb36", "name": "network-vif-unplugged", "status": "completed", "tag": "bedfe11b-122c-4ed5-93b4-13b7e2892b3a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:26.374481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-24ac6d02-3100-4724-ba7f-5ea62882bf40 req-b69f33ed-3041-494f-8eee-2e56eaed107c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.374893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-24ac6d02-3100-4724-ba7f-5ea62882bf40 req-b69f33ed-3041-494f-8eee-2e56eaed107c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.375743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-24ac6d02-3100-4724-ba7f-5ea62882bf40 req-b69f33ed-3041-494f-8eee-2e56eaed107c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.397150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-24ac6d02-3100-4724-ba7f-5ea62882bf40 req-b69f33ed-3041-494f-8eee-2e56eaed107c service nova] Creating event network-vif-unplugged:bedfe11b-122c-4ed5-93b4-13b7e2892b3a for instance ee743740-af6b-4413-85fc-0b23e4e3bb36 on n-h1-858384-1 Sep 19 14:40:26.431570 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-24ac6d02-3100-4724-ba7f-5ea62882bf40 req-b69f33ed-3041-494f-8eee-2e56eaed107c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057585 Sep 19 14:40:26.431570 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 399/839] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:26.440931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:26.446372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:26.465129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.469982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.470604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.472035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.474335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.474739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.489319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:26.498952 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bddeb7a5-aad4-4973-b771-32962e04d2a8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.509406 Sep 19 14:40:26.535377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 441/840] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:25 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:26.540963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:26.543882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:26.575597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.576302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.576921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.581135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.586343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.588772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.632102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:40:26.673958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lazy-loading 'services' on Instance uuid 18e172dc-fe01-426d-bcaf-51f504be487b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:26.697444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:26.705380 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9b7d9b2b-3547-4cb9-b75d-43de6f5452ad tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1936 microversion: 2.91 time: 0.272141 Sep 19 14:40:26.706902 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 400/841] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:26 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1936 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:26.719485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:26.722009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:26.742458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.743927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.745197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.747160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:26.748596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:26.750021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:26.897684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e8347ae-2dcb-4e6f-8349-226fbda8e7da tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 204 len: 0 microversion: 2.75 time: 0.360780 Sep 19 14:40:26.898605 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 442/842] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:40:26 2022] DELETE /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:40:26.907507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-818c163c-99fb-4b9b-95f5-5fd24b816abf tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde29fe5700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:27.104695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:27.402595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:27.427994 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d8d2031-e949-45f5-9b91-63f18cb113cb tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1319 microversion: 2.1 time: 0.719170 Sep 19 14:40:27.442800 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 401/843] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:26 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1319 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:27.456757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:27.456757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:27.472638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:27.473579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:27.474357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:27.475710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:27.476554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:27.477377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:27.486959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:27.536604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lazy-loading 'flavor' on Instance uuid 18e172dc-fe01-426d-bcaf-51f504be487b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:28.334355 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d7240f1b-a3fb-4220-92ae-0c9aba9002fb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action" status: 202 len: 0 microversion: 2.91 time: 0.903155 Sep 19 14:40:28.337872 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 402/844] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:40:27 2022] POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:28.373982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:28.380389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:28.394249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:28.394775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:28.395233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:28.395972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:28.400480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:28.404187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:28.626606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:28.669990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:28.674352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4366f009b944ca08d4ce0ddc4aac7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b105727a7264ac48d63d3b99bee751b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:28.689044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-43358ad6-1590-40fd-b167-37a220eeb4c4 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 200 len: 1443 microversion: 2.75 time: 0.347262 Sep 19 14:40:28.690507 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 403/845] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:28 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 1443 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:28.704244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:28.708196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:28.737194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:28.738441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:28.739505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:28.741082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:28.742529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:28.743639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:29.279088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:29.331875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:29.339881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:29.349493 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d59d937b-6bcd-4bf9-9570-df7e9477a043 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 0.649962 Sep 19 14:40:29.354224 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 404/846] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:28 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:29.381223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:29.382995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:29.408104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:29.419248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:29.422832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:29.426574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:29.428234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:29.430915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:30.768719 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-818c163c-99fb-4b9b-95f5-5fd24b816abf tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/1504689f-b26a-4866-bd03-59988ed4ae60" status: 202 len: 0 microversion: 2.1 time: 3.869107 Sep 19 14:40:30.770052 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 443/847] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:40:26 2022] DELETE /compute/v2.1/os-floating-ips/1504689f-b26a-4866-bd03-59988ed4ae60 => generated 0 bytes in 3871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:30.780028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:30.781586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:30.789225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:30.792630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:30.793807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:30.797491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:30.798387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:30.799170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:30.806591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:30.839611 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7983dd51-8f22-4f65-866c-b371882a5930 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 1.481424 Sep 19 14:40:30.849696 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 405/848] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:29 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:30.864087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:30.865129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:30.890023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:30.890938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:30.896002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:30.897716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:30.898785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:30.899750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:31.184944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:31.209596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:31.217212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:31.242823 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5472a13a-e29c-4048-b9fa-5f5521bfd0c6 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.467287 Sep 19 14:40:31.246374 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 444/849] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:30 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:31.262333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a64eab36-c213-44e5-a24e-aa1b276c88b3 req-2b2288aa-76dd-4233-8931-4aa71626268c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee743740-af6b-4413-85fc-0b23e4e3bb36", "tag": "bedfe11b-122c-4ed5-93b4-13b7e2892b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:31.293969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a64eab36-c213-44e5-a24e-aa1b276c88b3 req-2b2288aa-76dd-4233-8931-4aa71626268c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:31.294474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a64eab36-c213-44e5-a24e-aa1b276c88b3 req-2b2288aa-76dd-4233-8931-4aa71626268c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:31.294948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a64eab36-c213-44e5-a24e-aa1b276c88b3 req-2b2288aa-76dd-4233-8931-4aa71626268c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:31.319487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a64eab36-c213-44e5-a24e-aa1b276c88b3 req-2b2288aa-76dd-4233-8931-4aa71626268c service nova] Creating event network-changed:bedfe11b-122c-4ed5-93b4-13b7e2892b3a for instance ee743740-af6b-4413-85fc-0b23e4e3bb36 on n-h1-858384-1 Sep 19 14:40:31.336783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a64eab36-c213-44e5-a24e-aa1b276c88b3 req-2b2288aa-76dd-4233-8931-4aa71626268c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087257 Sep 19 14:40:31.338553 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 445/850] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:31.344582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:31.355841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] [instance: f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:31.363571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:31.364383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:31.365012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:31.366012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:31.374581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:31.375389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:31.411098 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] HTTP exception thrown: Instance f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 could not be found. Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Request method failure captured: Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 HTTP/1.1 Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH74Uk7VU7sJ25i86K8rlvbMQpCWyyvKriUzDytnIJ64naDpi24756sg4IrGqTM9gpqDQEKP3Up1ju0MA4xmGyUnUJ_LiADy-yhc0lDsTZc43ZxILRUyI6hPx2LcovEvbgdDaX7VHfmmLUB0wcpj9KUJoaApJn_NS5LKIwvnfTtnCYA Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.75 Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 3b105727a7264ac48d63d3b99bee751b Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdmin275Test-463770965 Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:40:31.413112 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b105727a7264ac48d63d3b99bee751b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b105727a7264ac48d63d3b99bee751b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b105727a7264ac48d63d3b99bee751b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b105727a7264ac48d63d3b99bee751b"}]}] Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdmin275Test-463770965 Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 3b105727a7264ac48d63d3b99bee751b Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdmin275Test-463770965 Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdmin275Test-463770965-project Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c4366f009b944ca08d4ce0ddc4aac7c4 Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdmin275Test-463770965-project Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 could not be found. Sep 19 14:40:31.414883 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322'} Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 could not be found. Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:31.415801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 could not be found. Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 could not be found. Sep 19 14:40:31.417420 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:40:31.419792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] Returning 404 to user: Instance f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:31.425850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04b3008e-a269-4cbe-819d-0921a2edcda6 tempest-ServersAdmin275Test-463770965 tempest-ServersAdmin275Test-463770965-project] 10.222.0.81 "GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322" status: 404 len: 111 microversion: 2.75 time: 0.085548 Sep 19 14:40:31.429454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 446/851] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:31 2022] GET /compute/v2.1/servers/f61ebe35-8b10-4e8e-82b4-8cfa1e1c4322 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:40:31.432670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a00ddbc0-cc8f-46ac-b346-2528ccb73e26 req-36d92a5c-44c8-46a2-9e2d-47010a09098a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af008c9b-060d-4b4b-9fbf-5d98074b4ebf", "name": "network-vif-plugged", "status": "completed", "tag": "b5129d39-a81b-4b33-bdf4-60e47b2765de"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:31.456753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a00ddbc0-cc8f-46ac-b346-2528ccb73e26 req-36d92a5c-44c8-46a2-9e2d-47010a09098a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:31.457311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a00ddbc0-cc8f-46ac-b346-2528ccb73e26 req-36d92a5c-44c8-46a2-9e2d-47010a09098a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:31.457759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a00ddbc0-cc8f-46ac-b346-2528ccb73e26 req-36d92a5c-44c8-46a2-9e2d-47010a09098a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:31.498380 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a00ddbc0-cc8f-46ac-b346-2528ccb73e26 req-36d92a5c-44c8-46a2-9e2d-47010a09098a service nova] Creating event network-vif-plugged:b5129d39-a81b-4b33-bdf4-60e47b2765de for instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf on n-h1-858384-1 Sep 19 14:40:31.529832 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a00ddbc0-cc8f-46ac-b346-2528ccb73e26 req-36d92a5c-44c8-46a2-9e2d-47010a09098a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101224 Sep 19 14:40:31.531360 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 447/852] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:31.541373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:31.551696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:31.587236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:31.588981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:31.590095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:31.591818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:31.595130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:31.596215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:32.189134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:32.198614 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-102fbf3e-cb13-4f65-9c4c-1b5d80850ad6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1319 microversion: 2.1 time: 1.346740 Sep 19 14:40:32.211305 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 406/853] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:30 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1319 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:32.217148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a56df64a-2717-4398-bc01-88ea18f76163 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] Calling method '.version_select at 0x7fde2a8b3f70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:32.742424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:32.787091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:32.795995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:32.800213 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e33da11d-b37d-42ba-86ac-2394d394ef14 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1567 microversion: 2.25 time: 1.266669 Sep 19 14:40:32.801763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 448/854] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:31 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1567 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:32.808707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:32.810871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:32.821430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:32.823225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:32.824828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:32.832152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:32.833880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:32.850696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:33.674727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:33.693409 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a95e9027-27d2-42e4-a8e4-010acd7e7ab4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.889753 Sep 19 14:40:33.695480 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 449/855] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:32 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:33.718146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:33.721269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:33.733558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:33.734600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:33.735559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:33.737033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:33.739363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:33.740224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:33.952730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:33.989440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:33.993628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:34.004577 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14fd4753-c3d1-4210-a7a3-fb78cee0137c tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.306874 Sep 19 14:40:34.006308 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 450/856] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:33 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:34.018412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0804b40f-2043-46a6-89d3-63b0a74709ea req-b9fbe754-1ff2-46b6-9f46-e387c60935f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acae3af4-40cc-4a06-8e7d-0603e92dcfa7", "tag": "f32e0873-60a6-42b3-b820-3f4ac1305909"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:34.059477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0804b40f-2043-46a6-89d3-63b0a74709ea req-b9fbe754-1ff2-46b6-9f46-e387c60935f7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:34.060849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0804b40f-2043-46a6-89d3-63b0a74709ea req-b9fbe754-1ff2-46b6-9f46-e387c60935f7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:34.062116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0804b40f-2043-46a6-89d3-63b0a74709ea req-b9fbe754-1ff2-46b6-9f46-e387c60935f7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:34.121686 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0804b40f-2043-46a6-89d3-63b0a74709ea req-b9fbe754-1ff2-46b6-9f46-e387c60935f7 service nova] Creating event network-changed:f32e0873-60a6-42b3-b820-3f4ac1305909 for instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 on n-h2-858384-1 Sep 19 14:40:34.156782 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0804b40f-2043-46a6-89d3-63b0a74709ea req-b9fbe754-1ff2-46b6-9f46-e387c60935f7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148041 Sep 19 14:40:34.165497 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 451/857] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:34.190655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:34.194489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:34.217327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:34.218608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:34.219696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:34.221315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:34.222480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:34.223542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:34.972495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:34.991590 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b6194d7-2f70-46d3-8a4c-b222a35dfd14 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1319 microversion: 2.1 time: 0.820454 Sep 19 14:40:34.993227 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 452/858] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:34 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:35.007640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6d4f2dd1-b2ca-4831-aea1-a9fb4683c74e req-d7fd76ab-76b5-4db4-ace9-db93c9b02ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75170b67-f117-49e1-a9ce-a972a6205a9e", "name": "network-vif-plugged", "status": "completed", "tag": "d844333e-bee5-4ff6-933f-9cf66a9234ed"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:35.030085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6d4f2dd1-b2ca-4831-aea1-a9fb4683c74e req-d7fd76ab-76b5-4db4-ace9-db93c9b02ad7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.030948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6d4f2dd1-b2ca-4831-aea1-a9fb4683c74e req-d7fd76ab-76b5-4db4-ace9-db93c9b02ad7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.031618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6d4f2dd1-b2ca-4831-aea1-a9fb4683c74e req-d7fd76ab-76b5-4db4-ace9-db93c9b02ad7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.058413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6d4f2dd1-b2ca-4831-aea1-a9fb4683c74e req-d7fd76ab-76b5-4db4-ace9-db93c9b02ad7 service nova] Creating event network-vif-plugged:d844333e-bee5-4ff6-933f-9cf66a9234ed for instance 75170b67-f117-49e1-a9ce-a972a6205a9e on n-h2-858384-1 Sep 19 14:40:35.069551 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6d4f2dd1-b2ca-4831-aea1-a9fb4683c74e req-d7fd76ab-76b5-4db4-ace9-db93c9b02ad7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072384 Sep 19 14:40:35.070894 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 453/859] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:35.084721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:35.086975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:35.101640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.106222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.107732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.109454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.110816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.111907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.215661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a56df64a-2717-4398-bc01-88ea18f76163 tempest-FloatingIPDetailsTestJSON-1227319345 tempest-FloatingIPDetailsTestJSON-1227319345-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/e621e01d-3862-46cb-93ad-e915dbb68eff" status: 202 len: 0 microversion: 2.1 time: 3.002816 Sep 19 14:40:35.223104 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 407/860] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:40:32 2022] DELETE /compute/v2.1/os-floating-ips/e621e01d-3862-46cb-93ad-e915dbb68eff => generated 0 bytes in 3006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:35.226473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:35.227238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:35.238903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.239759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.240356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.241274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.241742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.242165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.557541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.574707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.577400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.579024 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7cc029d1-e6f3-42e1-bc50-9e28cd3734f2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1542 microversion: 2.25 time: 0.504115 Sep 19 14:40:35.580085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 454/861] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:35 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1542 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:35.589573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:35.591111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:35.606333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.607268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.608074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.609374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.610239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.611123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.626888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.643459 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24c714fc-87ce-437b-b5f5-9a3582c20c45 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.423501 Sep 19 14:40:35.660270 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 408/862] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:35 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:35.686820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de6521de-c417-46c9-9a32-99cf15ca2cac tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '.version_select at 0x7fde2abd7430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:35.692914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de6521de-c417-46c9-9a32-99cf15ca2cac tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.694367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de6521de-c417-46c9-9a32-99cf15ca2cac tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.695967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de6521de-c417-46c9-9a32-99cf15ca2cac tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.715830 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de6521de-c417-46c9-9a32-99cf15ca2cac tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.051677 Sep 19 14:40:35.717439 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 409/863] 10.222.0.81 () {60 vars in 1184 bytes} [Mon Sep 19 14:40:35 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:35.740308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:35.741393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:35.754140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.755900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.757598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.759381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:35.760436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:35.760653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.761553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:35.774310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.776772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:35.783923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6534c6d7-585a-4f07-a9cf-e1659dca63dd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.202022 Sep 19 14:40:35.784967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 455/864] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:35 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:36.029390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:36.030396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:36.067647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid ee743740-af6b-4413-85fc-0b23e4e3bb36 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:36.075147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:36.076006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:36.082627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:36.084053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:36.092283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:36.095307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:36.104606 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b5c1545b-3f80-48bf-b4e3-56b802dc9835 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 2034 microversion: 2.25 time: 0.372828 Sep 19 14:40:36.107093 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 410/865] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:35 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 2034 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:36.172078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff423a57-0cef-48c4-9880-fa1f761e22ff tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Action: 'create', calling method: .version_select at 0x7fde2a832c10>, body: {"keypair": {"name": "tempest-keypair-1182171430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcJXipGjwuXqqpOmHnXOJ4N9uCvO2jPdlP2SgjgPIvUx9TuvyldxtmCdcNQjCvtfcIHPO7mtT6uLsrbdrY4G/IaTjxa5QfhPA1xvDRsDlqXbFTi0QG4OeiomzBvDeMWEg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:36.207904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ff423a57-0cef-48c4-9880-fa1f761e22ff tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for project 6a64d6b46c4541198f372d1f74417498. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:36.227899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ff423a57-0cef-48c4-9880-fa1f761e22ff tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for user 79d78edfe25746049a02a43130f1df11 and project 6a64d6b46c4541198f372d1f74417498. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:36.311485 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff423a57-0cef-48c4-9880-fa1f761e22ff tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.144607 Sep 19 14:40:36.312804 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 411/866] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:40:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:40:36.688404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:36.689041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:36.703496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:36.708181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:36.708743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:36.709525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:36.710166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:36.710619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:36.836325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:36.840653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:36.860331 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-199f3e6b-1a54-4ad2-bff5-b7baa4fc17d9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1469 microversion: 2.1 time: 0.836951 Sep 19 14:40:36.869007 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 456/867] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:36 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1469 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:36.905988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:36.908823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:36.931744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:36.933424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:36.933866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:36.935869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:36.936821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:36.937807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:37.074015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:37.087704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:37.090664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:37.099440 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91a9dde7-4ae3-447c-8c86-7c8340beed5f tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.228000 Sep 19 14:40:37.100732 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 457/868] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:36 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:37.108521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:37.109498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:37.118448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:37.120042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:37.121239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:37.122350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:37.123135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:37.123936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:37.298561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:37.311357 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0093b16a-61f4-476d-af54-ea786aec81f2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1314 microversion: 2.1 time: 0.626744 Sep 19 14:40:37.313922 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 412/869] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:36 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:40:37.543601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:37.564962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-956d0422-4003-41eb-a32b-d14008392f23 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1319 microversion: 2.1 time: 0.454459 Sep 19 14:40:37.566398 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 458/870] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:37 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:38.134694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:38.136287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:38.149096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:38.150453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:38.154506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:38.155721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:38.156226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:38.163601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:38.351545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:38.352163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:38.360122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:38.370939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:38.371446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:38.371896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:38.380118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:38.382551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:38.390212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:38.407470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:38.409045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:38.453574 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c1e4fd5-94ea-4c42-a3b6-2bac8e8073e4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.322967 Sep 19 14:40:38.461540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 413/871] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:38 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:40:38.594030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:38.595323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:38.613210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:38.614035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:38.615531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:38.616537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:38.617215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:38.617947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:38.843448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:38.873683 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d977f079-cd69-4048-b283-2df8a8f36618 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1464 microversion: 2.1 time: 0.526779 Sep 19 14:40:38.875051 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 459/872] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:38 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1464 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:40:38.925418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:38.935403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87b68a37-a88d-4ca8-a8ff-af803360fde7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1319 microversion: 2.1 time: 0.350827 Sep 19 14:40:38.937363 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 414/873] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:38 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:40:39.299512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:39.345198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'deleted': False, 'project_id': '7361948db9d549aeaa5262c477608c72'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:39.378253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:39.388593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:39.389828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:39.391053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:39.391719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:39.392456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:39.493677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:39.497889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:39.519267 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8025fc9-80fc-416e-a806-c5d37d43d0da tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.592965 Sep 19 14:40:39.520411 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 460/874] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:40:38 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:39.522541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:39.533486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:39.534687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:39.540494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:39.542030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:39.543475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:39.637035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1701427863", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:39.719147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:40:39.798635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:39.827390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:39.838905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:39.854500 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c46cce7-3089-4b8f-97be-96699e068b8a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.363841 Sep 19 14:40:39.855969 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 415/875] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:39 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:40:39.874799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:39.896447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'deleted': False} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:39.913058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:39.914660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:39.916008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:39.918517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:39.919827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:39.921062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:40.175838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:40.196508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:40:40.197174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:40:40.198497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:40:40.199905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:40:40.200446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:40:40.223641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:40.225767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:40.227619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:40.232518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:40.235093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:40.236543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:40.272068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Getting quotas for project 7a9404a412184ccfbacbdbf438e4b496. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:40.280616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Getting quotas for user a130f01dc587496296ac76c50fb62388 and project 7a9404a412184ccfbacbdbf438e4b496. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:40.300329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:40:40.304912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:40:40.408694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:40.410114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:40.411213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:40.486112 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8e2c7b7-e5c9-403a-a285-b2d6c2215ae0 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963983 Sep 19 14:40:40.487457 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 461/876] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:40:40.504855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:40.505989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:40.521554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:40.521989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:40.522671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:40.568193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:40.569939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:40.571666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:41.591795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:41.631130 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3038216-6cb2-446f-8fb9-bd0b9b783eba tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1319 microversion: 2.1 time: 1.141626 Sep 19 14:40:41.632800 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 462/877] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:40 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1319 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:41.643315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61f01ec4-2902-42e7-9be3-b38c9c8b8571 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:41.645142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-61f01ec4-2902-42e7-9be3-b38c9c8b8571 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:42.213847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-61f01ec4-2902-42e7-9be3-b38c9c8b8571 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:42.223506 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61f01ec4-2902-42e7-9be3-b38c9c8b8571 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1222 microversion: 2.1 time: 0.587915 Sep 19 14:40:42.225139 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 463/878] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:41 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1222 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:42.235996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:42.236661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:42.245056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:42.245620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:42.246134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:42.248073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:42.248829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:42.249599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:42.514098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:42.523358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:42.526015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:42.532524 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b16efb9-dde8-47e4-ad15-cb603e100ddd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.305764 Sep 19 14:40:42.533225 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 464/879] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:42 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:42.538796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:42.539898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:42.548130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:42.549001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:42.549688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:42.550793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:42.551551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:42.552408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:43.004819 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-778bd95c-ab2f-4759-9614-de15206a49e1 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22583 microversion: 2.1 time: 3.145088 Sep 19 14:40:43.006790 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 416/880] 10.222.0.81 () {58 vars in 1171 bytes} [Mon Sep 19 14:40:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22583 bytes in 3150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:40:43.022896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-544e267f-affb-4a60-a2dd-f7b3b08a8414 req-62bf4488-49fd-4dfb-8ef5-607998583b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acae3af4-40cc-4a06-8e7d-0603e92dcfa7", "name": "network-vif-plugged", "status": "completed", "tag": "f32e0873-60a6-42b3-b820-3f4ac1305909"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:43.050153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-544e267f-affb-4a60-a2dd-f7b3b08a8414 req-62bf4488-49fd-4dfb-8ef5-607998583b84 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:43.050950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-544e267f-affb-4a60-a2dd-f7b3b08a8414 req-62bf4488-49fd-4dfb-8ef5-607998583b84 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:43.051556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-544e267f-affb-4a60-a2dd-f7b3b08a8414 req-62bf4488-49fd-4dfb-8ef5-607998583b84 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:43.052205 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c7af020-91f0-44aa-847c-349731dae635 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1860 microversion: 2.1 time: 0.516884 Sep 19 14:40:43.062775 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 465/881] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:42 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1860 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:43.070416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2010723890", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e31e1958-afee-4116-8310-ef2e73536125"}], "security_groups": [{"name": "tempest-securitygroup--457780209"}], "key_name": "tempest-keypair-1182171430", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:43.090504 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-544e267f-affb-4a60-a2dd-f7b3b08a8414 req-62bf4488-49fd-4dfb-8ef5-607998583b84 service nova] Creating event network-vif-plugged:f32e0873-60a6-42b3-b820-3f4ac1305909 for instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 on n-h2-858384-1 Sep 19 14:40:43.096633 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-544e267f-affb-4a60-a2dd-f7b3b08a8414 req-62bf4488-49fd-4dfb-8ef5-607998583b84 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079865 Sep 19 14:40:43.098068 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 417/882] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:43.106258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:43.108238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:43.116954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:43.117378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:43.118090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:43.121867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:43.124984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:43.128309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:43.482518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] validate_networks() for [('e31e1958-afee-4116-8310-ef2e73536125', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:40:43.756851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:43.794986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-743f28b3-4220-4aa9-ac0d-6ebfc45f9908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1319 microversion: 2.1 time: 0.694286 Sep 19 14:40:43.796551 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 418/883] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:43 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1319 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:43.808856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:43.813766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:43.828420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:43.829685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:43.830507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:43.831890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:43.832763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:43.833744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:43.845746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:43.896977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lazy-loading 'flavor' on Instance uuid 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:40:43.930962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Going to try to live migrate instance to n-h2-858384-1 {{(pid=128731) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:40:45.063434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:40:45.064456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:40:45.065012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:40:45.065632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:40:45.066051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:40:45.080400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:45.081178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:45.081779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:45.082738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:45.083518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:45.084128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:45.174483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:45.191901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for user 79d78edfe25746049a02a43130f1df11 and project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:45.244551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:40:45.254782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:40:45.313366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.479798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3a0eb484-4580-418e-999f-db5b25ffb9b9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.421921 Sep 19 14:40:45.492314 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 466/884] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:40:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:40:45.506568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:45.519428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'deleted': False, 'project_id': '7361948db9d549aeaa5262c477608c72'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:45.540796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:45.541894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:45.543218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:45.544201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:45.544831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:45.545440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:45.589743 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8444e98b-20eb-460d-b480-19d547e861e2 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?tenant_id=d6f0ada3b2a1446db012bcbdd2334e94" status: 200 len: 15 microversion: 2.1 time: 0.094925 Sep 19 14:40:45.591060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 467/885] 10.222.0.81 () {58 vars in 1231 bytes} [Mon Sep 19 14:40:45 2022] GET /compute/v2.1/servers/detail?tenant_id=d6f0ada3b2a1446db012bcbdd2334e94 => generated 15 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:45.599070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:45.599972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:45.610576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:45.611500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:45.613149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:45.614698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:45.615392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:45.615991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:46.819067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:46.851576 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f045b7e6-c688-4cca-a12d-a30089012cf3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1322 microversion: 2.1 time: 1.257984 Sep 19 14:40:46.871520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 468/886] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:45 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1322 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:46.881362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:46.888412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:46.896567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:46.897439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:46.898255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:46.899442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:46.900261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:46.901134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:46.955582 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24e4ab23-d269-4f4a-8727-2d934a758904 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/action" status: 202 len: 0 microversion: 2.1 time: 3.154405 Sep 19 14:40:46.956199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 419/887] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:40:43 2022] POST /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/action => generated 0 bytes in 3157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:46.961573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:46.962191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:46.993507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:46.997573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.001456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.002397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.005756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.006562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.056210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.068098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.069542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.086873 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b08b5677-5122-49e5-89b6-5db3398598d4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.214002 Sep 19 14:40:47.088711 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 469/888] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:46 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:47.099371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:47.107995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:47.134404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.139324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.140344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.141456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.143626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.145554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.352188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.366667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.377809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.379402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82f4ec90-96c4-40d8-9164-c7536fa6de94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1338 microversion: 2.25 time: 0.289488 Sep 19 14:40:47.380572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 470/889] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:47 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:47.385833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:47.406049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'tenant_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'deleted': False} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:47.417085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.417813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.418429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.419465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.420118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.420712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.490898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:47.658790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.659324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.659771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.779357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:47.793054 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fca980de-815a-406a-8e41-1196c3effd59 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1468 microversion: 2.1 time: 0.833910 Sep 19 14:40:47.793791 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 420/890] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:46 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1468 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:47.804650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:47.805479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:47.819083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.820294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.821295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:47.822322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:47.823115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:47.823708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:48.435171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe73e995-bdc7-43a2-a248-100835f797ce tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d6f0ada3b2a1446db012bcbdd2334e94" status: 200 len: 4828 microversion: 2.1 time: 1.053096 Sep 19 14:40:48.436357 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 471/891] 10.222.0.81 () {58 vars in 1257 bytes} [Mon Sep 19 14:40:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d6f0ada3b2a1446db012bcbdd2334e94 => generated 4828 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:48.456984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d1fb74ad-7475-483a-be8f-aeb7837a655e req-8f7ca798-a60e-4cab-8db6-f6e001cca727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2cd608-9f79-4b8e-a65e-f2cf48304141", "tag": "0a7f5f4a-8fc1-4658-8690-b360d264cbaf"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:48.488221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1fb74ad-7475-483a-be8f-aeb7837a655e req-8f7ca798-a60e-4cab-8db6-f6e001cca727 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:48.499952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1fb74ad-7475-483a-be8f-aeb7837a655e req-8f7ca798-a60e-4cab-8db6-f6e001cca727 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:48.504396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1fb74ad-7475-483a-be8f-aeb7837a655e req-8f7ca798-a60e-4cab-8db6-f6e001cca727 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:48.552411 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d1fb74ad-7475-483a-be8f-aeb7837a655e req-8f7ca798-a60e-4cab-8db6-f6e001cca727 service nova] Creating event network-changed:0a7f5f4a-8fc1-4658-8690-b360d264cbaf for instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 on n-h1-858384-1 Sep 19 14:40:48.580029 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d1fb74ad-7475-483a-be8f-aeb7837a655e req-8f7ca798-a60e-4cab-8db6-f6e001cca727 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141681 Sep 19 14:40:48.581583 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 472/892] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:48.606674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:48.630684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:48.632431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Searching by: {'reservation_id': 'r-025k6uav', 'deleted': False, 'project_id': '32c474c76d064369addb54e031ce368b'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:48.655343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:48.656046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:48.656668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:48.657923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:48.658913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:48.669741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:48.992962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:49.145951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:49.160124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:49.161309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:49.162341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:49.167479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:49.193207 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bdfbb238-55c0-41d8-b458-bd1fc7dd545b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.392898 Sep 19 14:40:49.193864 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 421/893] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:47 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:49.204285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:49.206989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:49.232623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:49.235736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:49.237966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:49.240072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:49.242452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:49.243705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:49.903102 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfdd6482-f6d4-4676-956d-a7296889935b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?reservation_id=r-025k6uav" status: 200 len: 2930 microversion: 2.1 time: 1.319282 Sep 19 14:40:49.905231 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 473/894] 10.222.0.81 () {58 vars in 1197 bytes} [Mon Sep 19 14:40:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-025k6uav => generated 2930 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:49.915020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:49.917557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:49.929904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:49.949945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:49.951316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:49.952907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:49.954013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:49.955142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:49.983406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:50.054476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.062916 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd6c146c-d4a4-4624-b7ff-835da39d2308 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1322 microversion: 2.1 time: 0.867927 Sep 19 14:40:50.069213 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 422/895] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:49 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1322 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:50.077227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:50.079601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:50.094350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.099859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.100671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:50.101694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.102350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.102983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:50.360817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.372531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:50.391818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.401595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.421715 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1b5d889-0414-4ca9-b1d2-bfe52f76d243 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.512879 Sep 19 14:40:50.439713 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 474/896] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:49 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:50.444504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.461145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.466612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:50.470180 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3d6b2981-84e4-4168-be15-5a80d7509498 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1344 microversion: 2.25 time: 0.399541 Sep 19 14:40:50.472690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 423/897] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:50 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1344 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:50.497804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:50.534400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'tenant_id': '7361948db9d549aeaa5262c477608c72', 'deleted': False} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:50.555823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.557303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.560344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:50.561935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.567308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.570708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:50.677220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef033bf0-5907-4ff0-b3ca-7a85f6405803 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7361948db9d549aeaa5262c477608c72" status: 200 len: 15 microversion: 2.1 time: 0.235549 Sep 19 14:40:50.680554 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 475/898] 10.222.0.81 () {58 vars in 1257 bytes} [Mon Sep 19 14:40:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7361948db9d549aeaa5262c477608c72 => generated 15 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:50.690353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2bd234bc-d20b-4335-92bb-d8e69afab7d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:50.740082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.server_groups [None req-2bd234bc-d20b-4335-92bb-d8e69afab7d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Querying cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) for 2 instances {{(pid=128730) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 19 14:40:50.743816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd234bc-d20b-4335-92bb-d8e69afab7d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.764447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd234bc-d20b-4335-92bb-d8e69afab7d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.764999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd234bc-d20b-4335-92bb-d8e69afab7d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:50.908941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2bd234bc-d20b-4335-92bb-d8e69afab7d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/f400c482-d1b8-4170-ac92-582c6c5bc0c8" status: 200 len: 271 microversion: 2.1 time: 0.224386 Sep 19 14:40:50.913396 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 476/899] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:40:50 2022] GET /compute/v2.1/os-server-groups/f400c482-d1b8-4170-ac92-582c6c5bc0c8 => generated 271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:50.926848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:50.928625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:50.951773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.952837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.960778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:50.961907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:50.965321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:50.966116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:51.028150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:51.032411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1339113f-5f60-4989-8a15-9180db0ce032 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2009390708", "id": 1938787264, "os-flavor-access:is_public": "False"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:51.076386 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1339113f-5f60-4989-8a15-9180db0ce032 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.600819 Sep 19 14:40:51.077412 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 424/900] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:40:50 2022] POST /compute/v2.1/flavors => generated 439 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:51.094597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fce321df-c2b6-4e80-aaf4-17079970ed24 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:51.112857 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fce321df-c2b6-4e80-aaf4-17079970ed24 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.031973 Sep 19 14:40:51.116290 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 425/901] 10.222.0.81 () {58 vars in 1189 bytes} [Mon Sep 19 14:40:51 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:51.136823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:51.137886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:51.155093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:51.155757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:51.156360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:51.157595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:51.158216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:51.158862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:51.540330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:51.555291 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aed790e6-2bcd-40dd-9ccd-c0a74a61746f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.638092 Sep 19 14:40:51.555914 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 477/902] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:50 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:51.576499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-edfd9f7b-a912-411d-9b08-4719d436e2d3 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:51.715049 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4628099d-1a50-4ce8-a2d5-cbb3409d77ff tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1619 microversion: 2.1 time: 0.594945 Sep 19 14:40:51.717670 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 426/903] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:51 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1619 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:51.723906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:51.725310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:51.737818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:51.741791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:51.742624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:51.745959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:51.748051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:51.750155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:51.752241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.308338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-edfd9f7b-a912-411d-9b08-4719d436e2d3 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1938787264/action" status: 200 len: 97 microversion: 2.1 time: 0.747757 Sep 19 14:40:52.319264 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 478/904] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:40:51 2022] POST /compute/v2.1/flavors/1938787264/action => generated 97 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:52.330133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:52.340263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:52.365516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.366347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.367635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.368931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.376038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.376933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.379370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:52.391653 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f538e890-7b0c-48ad-a3d0-4a36c8fc5c34 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1322 microversion: 2.1 time: 0.672241 Sep 19 14:40:52.395838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 427/905] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:51 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:52.500264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa9f7703-8c46-424a-a93c-75dda6ad85e7 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Action: 'create', calling method: .version_select at 0x7fde2a7a68b0>, body: {"keypair": {"name": "tempest-keypair-477768999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9Hpmx9e+YM2LpjOxhMSdiXm/hfMzgFnRw488OdB+8W3lei9LUidL0nHWLQwXCWr1QnUWfXuit9F+uRxlA6ILW7MtGxrKCHHuSt31/GWknUJJhajCT5V4JWcveTLlatlg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:52.536163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-fa9f7703-8c46-424a-a93c-75dda6ad85e7 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:52.548832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-fa9f7703-8c46-424a-a93c-75dda6ad85e7 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for user d8a6c3f55b8845fbbb988a4b83093140 and project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:52.562588 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-247c0829-ea6c-4e11-9148-5a89b94abee0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 0 microversion: 2.1 time: 0.241534 Sep 19 14:40:52.565941 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 479/906] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:40:52 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:52.586262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:52.588186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:52.591386 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa9f7703-8c46-424a-a93c-75dda6ad85e7 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194508 Sep 19 14:40:52.592148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 428/907] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:40:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:52.610677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.612172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.613289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.619137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.621396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.622307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:52.624622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:52.625016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.656473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.657469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.664492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.667731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.668711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.669538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.914914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:52.943379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:52.945063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:52.958239 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf27c0b3-dbaf-4ad9-b793-68727248d1ed tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.390191 Sep 19 14:40:52.959139 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 480/908] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:52 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:52.966272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:52.967038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:52.979011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.979826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.980270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:52.981003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:52.981613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:52.982049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:53.050689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:53.061521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:53.074202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:53.075442 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fd6ead3-9e57-4618-bb74-4d9acc91a8d2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1411 microversion: 2.25 time: 0.481655 Sep 19 14:40:53.086790 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 429/909] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:52 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1411 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:53.102786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d39f97c8-5ac7-438a-ac46-33de710cfca8 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:53.271456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d39f97c8-5ac7-438a-ac46-33de710cfca8 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 5d1c99724c394f358dfa1350682d77b7 combination. Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d39f97c8-5ac7-438a-ac46-33de710cfca8 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Request method failure captured: Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/flavors/1938787264/action HTTP/1.1 Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 67 Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9vo60ZiI0SQ2xTDfEU1sOvBgMB1FV-EBgwpiAT2NT_yuLkRXKzpR5vePzo9tmM7xHQCKwvpFVVUygKTq1Gu4YOjkZzaA2BfmKQGODk9r8SQf-bZ6weaSm2VRH0LVg7H46alVeUFAqCPkw8q3TAxBjZfA6vdobdHpMUujDQpdYpYxE Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: be5f67ab39554c08ad736cf73fddd3c3 Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:40:53.309741 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be5f67ab39554c08ad736cf73fddd3c3"}]}] Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: be5f67ab39554c08ad736cf73fddd3c3 Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d65e8cb7ec14a27907bf107b1e27f36 Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: {"addTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} Sep 19 14:40:53.311245 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: exception: Flavor access already exists for flavor 34 and project 5d1c99724c394f358dfa1350682d77b7 combination. Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1938787264', 'body': {'addTenantAccess': {'tenant': '5d1c99724c394f358dfa1350682d77b7'}}} Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result.read() Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:40:53.312145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-5d1c99724c394f358dfa1350682d77b7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi session.flush() Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:40:53.313254 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:40:53.316776 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:40:53.319501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result.read() Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-5d1c99724c394f358dfa1350682d77b7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 19, 14, 40, 53, 260666), 'updated_at': None, 'flavor_id': 34, 'project_id': '5d1c99724c394f358dfa1350682d77b7'}] Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:53.325985 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 5d1c99724c394f358dfa1350682d77b7 combination. Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:53.328925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 5d1c99724c394f358dfa1350682d77b7 combination. Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:53.332266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:53.335255 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 5d1c99724c394f358dfa1350682d77b7 combination. Sep 19 14:40:53.335255 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:53.335255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d39f97c8-5ac7-438a-ac46-33de710cfca8 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 5d1c99724c394f358dfa1350682d77b7 combination. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:53.335255 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d39f97c8-5ac7-438a-ac46-33de710cfca8 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1938787264/action" status: 409 len: 152 microversion: 2.1 time: 0.234262 Sep 19 14:40:53.335255 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 430/910] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:40:53 2022] POST /compute/v2.1/flavors/1938787264/action => generated 152 bytes in 236 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:40:53.335255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:53.336115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:53.336115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:53.340426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:53.340980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:53.341552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:53.342423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:53.342912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:53.343391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:53.475553 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0991386a-44af-45cb-a211-f047f8159225 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 200 len: 1620 microversion: 2.1 time: 0.514673 Sep 19 14:40:53.486842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:53.491174 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 481/911] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:52 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 1620 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:53.497526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:53.507731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:53.537179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:53.538357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:53.543133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:53.544443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:53.545525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:53.547876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:53.697087 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79311035-5fb8-47d3-8f13-09712972db17 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.374572 Sep 19 14:40:53.704934 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 431/912] 10.222.0.81 () {58 vars in 1150 bytes} [Mon Sep 19 14:40:53 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:53.723200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ccfd480-1a15-4428-aa3b-b2b27f148033 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde2a9e3670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:53.769599 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ccfd480-1a15-4428-aa3b-b2b27f148033 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-477768999" status: 200 len: 496 microversion: 2.1 time: 0.061185 Sep 19 14:40:53.770191 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 432/913] 10.222.0.81 () {58 vars in 1215 bytes} [Mon Sep 19 14:40:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-477768999 => generated 496 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:53.779174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-263651b1-2c59-4261-b55e-c2fd21a4d12c tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:54.050283 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-263651b1-2c59-4261-b55e-c2fd21a4d12c tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1938787264/action" status: 200 len: 21 microversion: 2.1 time: 0.277379 Sep 19 14:40:54.063881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 433/914] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:40:53 2022] POST /compute/v2.1/flavors/1938787264/action => generated 21 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:54.084232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:54.090027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:54.122843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:54.153720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:54.154913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:54.156533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:54.157493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:54.158274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:54.378918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:54.389596 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c7edab18-cb75-441b-9487-4dc637435b93 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.896961 Sep 19 14:40:54.403390 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 482/915] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:53 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:54.412806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:54.415428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:54.429734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:54.430516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:54.431432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:54.434388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:54.436409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:54.437461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:54.582543 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa36b341-0cea-4c9e-ad8a-ff30c0cd28a0 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 0 microversion: 2.1 time: 0.177641 Sep 19 14:40:54.585665 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 483/916] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:40:54 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:54.601094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91b4aa17-80e6-4815-b48d-d22d04d65390 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde29de4280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:54.637846 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91b4aa17-80e6-4815-b48d-d22d04d65390 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-477768999" status: 202 len: 0 microversion: 2.1 time: 0.046849 Sep 19 14:40:54.638838 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 484/917] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 14:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-477768999 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:54.654813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-58018429", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c9085e40-1d2e-49e2-b258-cf1528c9877b"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:54.777121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:54.814095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:40:54.840093 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa41910e-55ac-4326-b5c4-c5c461e15c14 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1322 microversion: 2.1 time: 0.765691 Sep 19 14:40:54.841766 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 434/918] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:54 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1322 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:54.862646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:54.864069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:54.876997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:54.878272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:54.879360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:54.881137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:54.882150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:54.883237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.101641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:55.122331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:55.128177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:55.137955 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdaff1b0-764e-4a91-8b18-25eb4394f40a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.294158 Sep 19 14:40:55.138905 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 435/919] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:54 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:55.149483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c148ba02-a5fb-47c5-b3a9-2a958e9f5589 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:55.194624 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c148ba02-a5fb-47c5-b3a9-2a958e9f5589 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1938787264" status: 202 len: 0 microversion: 2.1 time: 0.054142 Sep 19 14:40:55.199739 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 436/920] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:40:55 2022] DELETE /compute/v2.1/flavors/1938787264 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:55.209504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:55.210605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:55.220062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.220998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.221667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.222615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.223529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.224299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.673825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:40:55.675074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:40:55.675719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:40:55.676307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:40:55.676886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:40:55.689465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.690288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.690956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.691995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.692668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.693297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.719789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:55.726379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:55.743376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:40:55.746514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:40:55.830691 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e69e9d09-e127-4fe0-ae1e-3988bcb99ee4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.190301 Sep 19 14:40:55.831848 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 485/921] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:40:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:40:55.844306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-46e7ec88-6c98-49b3-a1cb-ed4fa86967ae req-f60032c7-9e22-4fb9-816c-0dc33e5b3040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cd608-9f79-4b8e-a65e-f2cf48304141", "name": "network-vif-plugged", "status": "completed", "tag": "0a7f5f4a-8fc1-4658-8690-b360d264cbaf"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:55.875465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-46e7ec88-6c98-49b3-a1cb-ed4fa86967ae req-f60032c7-9e22-4fb9-816c-0dc33e5b3040 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.875975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-46e7ec88-6c98-49b3-a1cb-ed4fa86967ae req-f60032c7-9e22-4fb9-816c-0dc33e5b3040 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.876445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-46e7ec88-6c98-49b3-a1cb-ed4fa86967ae req-f60032c7-9e22-4fb9-816c-0dc33e5b3040 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.906601 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-46e7ec88-6c98-49b3-a1cb-ed4fa86967ae req-f60032c7-9e22-4fb9-816c-0dc33e5b3040 service nova] Creating event network-vif-plugged:0a7f5f4a-8fc1-4658-8690-b360d264cbaf for instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 on n-h1-858384-1 Sep 19 14:40:55.924458 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-46e7ec88-6c98-49b3-a1cb-ed4fa86967ae req-f60032c7-9e22-4fb9-816c-0dc33e5b3040 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090995 Sep 19 14:40:55.925664 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 486/922] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:55.933709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:55.934728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:55.953981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.954891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.955391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:55.956225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:55.967045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:55.967648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:56.372697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:56.385656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:56.396223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:56.398476 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b34e9478-9c08-43a2-8886-625d5a0d02e6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1411 microversion: 2.25 time: 1.197255 Sep 19 14:40:56.399724 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 437/923] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:55 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1411 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:56.405893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a501c90-be60-436f-b5cd-d3875dca675e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Action: 'create', calling method: .version_select at 0x7fde29fae3a0>, body: {"keypair": {"name": "tempest-keypair-1813851684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4q0LPEZBkQsMz2mhS5HlcOvDMawvJyZxNZhy8g/2B6bygwUADEdlWO+EIcKi2YCr0bVw2lbRIhjV0fE31zt1C9jdqe6q7UAWxaLTYm4uEEfV3buZDKr8K7YPnrCZbouw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:56.456723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9a501c90-be60-436f-b5cd-d3875dca675e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:56.478412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9a501c90-be60-436f-b5cd-d3875dca675e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for user d8a6c3f55b8845fbbb988a4b83093140 and project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:56.528346 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a501c90-be60-436f-b5cd-d3875dca675e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126253 Sep 19 14:40:56.529615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 438/924] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:40:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:56.534721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3e48814-98ea-4d40-bf0f-5eb2b55a1824 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:56.561699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3e48814-98ea-4d40-bf0f-5eb2b55a1824 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030509 Sep 19 14:40:56.563167 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 439/925] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:40:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:56.568376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-717f4d16-85dc-44b6-b29c-0fc69bf3180a req-5db2aa02-8094-4336-82e7-49e766814e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fba3b9-9528-42c7-a666-cbd5f158103d", "tag": "7c91d2c7-d1d4-4305-b4a1-488ce3e7e978"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:56.596246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-717f4d16-85dc-44b6-b29c-0fc69bf3180a req-5db2aa02-8094-4336-82e7-49e766814e88 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:56.597150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-717f4d16-85dc-44b6-b29c-0fc69bf3180a req-5db2aa02-8094-4336-82e7-49e766814e88 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:56.597848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-717f4d16-85dc-44b6-b29c-0fc69bf3180a req-5db2aa02-8094-4336-82e7-49e766814e88 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:56.615625 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-717f4d16-85dc-44b6-b29c-0fc69bf3180a req-5db2aa02-8094-4336-82e7-49e766814e88 service nova] Creating event network-changed:7c91d2c7-d1d4-4305-b4a1-488ce3e7e978 for instance 94fba3b9-9528-42c7-a666-cbd5f158103d on n-h1-858384-1 Sep 19 14:40:56.623018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-717f4d16-85dc-44b6-b29c-0fc69bf3180a req-5db2aa02-8094-4336-82e7-49e766814e88 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058100 Sep 19 14:40:56.624496 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 440/926] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:56.630063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:56.631054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:56.641041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:56.641621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:56.642173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:56.643065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:56.643854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:56.644394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:57.087846 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d66754f0-2eb4-4549-80f4-709569f28242 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1615 microversion: 2.1 time: 1.160297 Sep 19 14:40:57.090042 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 487/927] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:55 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1615 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:57.128198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:57.134298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:57.149413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:57.152058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:57.164256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:57.167794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:57.172867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:57.173696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:57.550416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:57.579410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-40182416-56cb-4233-a437-a7587e1d3b88 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1219 microversion: 2.1 time: 0.469769 Sep 19 14:40:57.583594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 488/928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:57 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1219 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:57.606930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:57.608696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:57.637801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:57.640398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:57.641247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:57.646567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:57.647535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:57.651423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:57.738279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:57.794460 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ecfb6378-7151-4817-93d4-cfeb3fe2a0a2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.165223 Sep 19 14:40:57.795938 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 441/929] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:56 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:57.824110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:57.840135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:57.872022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:57.872892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:57.873655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:57.874817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:57.875568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:57.876344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.106131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.132196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.137279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.149586 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-129c0beb-b8a3-445e-b6b7-e59b242badab tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.346686 Sep 19 14:40:58.167658 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 442/930] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:57 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:58.174605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27267999-3cc2-48c1-8084-f63972ac6bf7 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde2a88c820>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.209784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.230540 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76f7ab25-d24a-43d0-8d73-dc7d4960d87c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1322 microversion: 2.1 time: 0.642429 Sep 19 14:40:58.234524 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27267999-3cc2-48c1-8084-f63972ac6bf7 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813851684" status: 202 len: 0 microversion: 2.1 time: 0.065228 Sep 19 14:40:58.236033 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 443/931] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813851684 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:58.254891 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 489/932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:57 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:58.255096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-308ffb1c-00c5-4566-a671-be0ab0d7e625 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1191512503", "id": 547731771, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:58.261348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.270373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:58.294718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.297992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.298783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.304175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.308490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.309192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.313069 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-308ffb1c-00c5-4566-a671-be0ab0d7e625 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.070296 Sep 19 14:40:58.317011 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 444/933] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:40:58 2022] POST /compute/v2.1/flavors => generated 435 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:58.328761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.333406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:58.370206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.371238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.371858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.372844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.373456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.374116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.392541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:58.695504 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96b4d7d0-dce8-47e8-a7a9-ed0e22faa0ec tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1615 microversion: 2.1 time: 0.452856 Sep 19 14:40:58.696462 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 490/934] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:58 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1615 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:58.708481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-24ff2268-88ed-423d-ab47-2253efdf6961 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Action: 'create', calling method: .version_select at 0x7fde29e09ee0>, body: {"keypair": {"name": "tempest-keypair-1747907355", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:58.725498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.730857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-24ff2268-88ed-423d-ab47-2253efdf6961 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:58.736622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-24ff2268-88ed-423d-ab47-2253efdf6961 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for user d8a6c3f55b8845fbbb988a4b83093140 and project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:58.737812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.741615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.743522 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c993ab51-fdb9-49b7-abd5-072aa6ec1578 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1411 microversion: 2.25 time: 0.424952 Sep 19 14:40:58.755161 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 445/935] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:58 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1411 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:58.767810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17cc3f28-6f2d-4abe-abe3-bf76a8e2655e tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.777088 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-17cc3f28-6f2d-4abe-abe3-bf76a8e2655e tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 19 14:40:58.777320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-24ff2268-88ed-423d-ab47-2253efdf6961 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.079257 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17cc3f28-6f2d-4abe-abe3-bf76a8e2655e tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Request method failure captured: Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/flavors/547731771/os-flavor-access HTTP/1.1 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9vo60ZiI0SQ2xTDfEU1sOvBgMB1FV-EBgwpiAT2NT_yuLkRXKzpR5vePzo9tmM7xHQCKwvpFVVUygKTq1Gu4YOjkZzaA2BfmKQGODk9r8SQf-bZ6weaSm2VRH0LVg7H46alVeUFAqCPkw8q3TAxBjZfA6vdobdHpMUujDQpdYpYxE Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: be5f67ab39554c08ad736cf73fddd3c3 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:40:58.779239 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be5f67ab39554c08ad736cf73fddd3c3"}]}] Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: be5f67ab39554c08ad736cf73fddd3c3 Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d65e8cb7ec14a27907bf107b1e27f36 Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: exception: Access list not available for public flavors. Sep 19 14:40:58.780723 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'flavor_id': '547731771'} Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 19 14:40:58.781486 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:40:58.784305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 491/936] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:40:58 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:58.785747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17cc3f28-6f2d-4abe-abe3-bf76a8e2655e tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:40:58.786801 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17cc3f28-6f2d-4abe-abe3-bf76a8e2655e tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/547731771/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.030503 Sep 19 14:40:58.790332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.792846 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 446/937] 10.222.0.81 () {58 vars in 1206 bytes} [Mon Sep 19 14:40:58 2022] GET /compute/v2.1/flavors/547731771/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:40:58.793761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:58.797607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.800922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:58.802961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.804616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.804616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.805356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.806037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.806379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'host': 'n-h2-858384-1', 'deleted': False} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:58.807822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.827626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.828316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.830567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.831584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:58.832183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:58.832730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:58.926399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:58.939964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:40:58.943290 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca920031-8c63-45ff-be0e-20c1101eea8d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1267 microversion: 2.1 time: 0.157415 Sep 19 14:40:58.944249 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 492/938] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:58 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:58.950117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6766d6c-ea5e-4b16-bda5-a0dfc0ea98f1 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde29fad5e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:58.999191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6766d6c-ea5e-4b16-bda5-a0dfc0ea98f1 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747907355" status: 202 len: 0 microversion: 2.1 time: 0.052678 Sep 19 14:40:59.006820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 493/939] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747907355 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:59.008481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9f89522-5af3-4b2a-a805-843d3a2e989b tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:59.079527 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9f89522-5af3-4b2a-a805-843d3a2e989b tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/547731771" status: 202 len: 0 microversion: 2.1 time: 0.077101 Sep 19 14:40:59.080544 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 494/940] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:40:59 2022] DELETE /compute/v2.1/flavors/547731771 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:40:59.096175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:59.096884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:59.104951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.105743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.106335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.107343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.108600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.109218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.112812 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfe5d8d6-33d6-4608-a8c5-ec606935c7f7 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers?host=n-h2-858384-1&all_tenants=1" status: 200 len: 2329 microversion: 2.1 time: 0.318969 Sep 19 14:40:59.123493 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 447/941] 10.222.0.81 () {58 vars in 1190 bytes} [Mon Sep 19 14:40:58 2022] GET /compute/v2.1/servers?host=n-h2-858384-1&all_tenants=1 => generated 2329 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:59.134443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-988d5534-c685-47d7-8adf-c67eee4fa650 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Action: 'create', calling method: .version_select at 0x7fde2a88c700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2117480413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjJWPEnbmmkwep/5ExRjta35VebMEg+haZ7ikqornjzgfUnZrMTt1vr7eSQ2rxL4dHO+sH+oKRbpxq5hfodTbrkonshpR/uTtNyW098rnuEqrmJpAHfBmkPZay8TV29nw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:59.213951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-988d5534-c685-47d7-8adf-c67eee4fa650 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:59.238422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-988d5534-c685-47d7-8adf-c67eee4fa650 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for user d8a6c3f55b8845fbbb988a4b83093140 and project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:40:59.326176 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-988d5534-c685-47d7-8adf-c67eee4fa650 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.200742 Sep 19 14:40:59.327507 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 448/942] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:40:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:40:59.333428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87550d4a-1568-4d22-91d0-143dfe861f91 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:59.362965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87550d4a-1568-4d22-91d0-143dfe861f91 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033600 Sep 19 14:40:59.364282 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 449/943] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:40:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:59.369845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:59.377484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:40:59.389874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.392475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.393380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.395401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.396075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.396656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.406810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:59.426547 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed1d4aa9-db27-4711-87ea-37645cb69391 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.344329 Sep 19 14:40:59.438800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9d9e2a4d-aa8f-4cf5-b9a3-dadec5063c75 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.066069 Sep 19 14:40:59.440332 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 495/944] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:59 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:59.449967 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 450/945] 10.222.0.81 () {58 vars in 1196 bytes} [Mon Sep 19 14:40:59 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:40:59.452829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:59.453439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:59.464846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.465331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.465773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.466489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.466974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.467394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.469604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:40:59.471032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:40:59.483023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.485023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.486172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.487974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:40:59.489141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:40:59.490228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:40:59.665975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:59.710085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:59.725154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:40:59.754549 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17532b4c-ced5-48b0-892a-55e26494d24b tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.301103 Sep 19 14:40:59.767189 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 496/946] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:40:59 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:40:59.802672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8768a52-735d-4fa2-ac7a-13ee3fb0bc7e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Action: 'create', calling method: .version_select at 0x7fde29e27ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-91260470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArvryI8PD4jCqrOPanEtpgCYKzOCwvmkw+tRY0B+WJGtES/ws5laPOUsicjB8zNKjJuy4zkFcFhIWDSY0AiZhP8wRthVstsgSfy1Escm3hH13Kuuut0IW9NYu5uwbJXsQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:40:59.923145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a8768a52-735d-4fa2-ac7a-13ee3fb0bc7e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:40:59.937517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a8768a52-735d-4fa2-ac7a-13ee3fb0bc7e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for user d8a6c3f55b8845fbbb988a4b83093140 and project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:00.039666 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8768a52-735d-4fa2-ac7a-13ee3fb0bc7e tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.271017 Sep 19 14:41:00.041397 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 497/947] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:40:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:00.049958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e530587-ce7f-4857-8b4c-7eb776899fc4 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-777194297", "id": 1409167498, "os-flavor-access:is_public": "False"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:00.063881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:00.083670 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-703c90bb-51c7-43e7-b158-9aa4c2dcf0bf tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1472 microversion: 2.1 time: 0.633316 Sep 19 14:41:00.085066 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 451/948] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:40:59 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1472 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:00.101595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:00.110014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:00.125544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:00.129987 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4e530587-ce7f-4857-8b4c-7eb776899fc4 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.086767 Sep 19 14:41:00.133101 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 498/949] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:00.135607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:00.136503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:00.137275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:00.144426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:00.149379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:00.156087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:00.157145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:00.157938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:00.173265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:00.174038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:00.174657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:00.179389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:00.180178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:00.180776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:00.226381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:00.515745 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cccbd028-ae30-481e-9656-99021511e430 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 0 microversion: 2.1 time: 0.422514 Sep 19 14:41:00.520205 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 452/950] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:00 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:00.530667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:00.531260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:00.542422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:00.542971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:00.543440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:00.544182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:00.544662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:00.545098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:01.022366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:01.033834 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13a333d4-8dea-461c-80c4-b3e243468312 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1275 microversion: 2.1 time: 0.512274 Sep 19 14:41:01.041588 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 453/951] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:00 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1275 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:01.046530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10f25114-0e00-4fd4-8bc2-b251b8fa68ee tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Action: 'create', calling method: .version_select at 0x7fde29e3d670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1509029342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+w87/U42OYouhEpKQxb/2fUVq5lz4po8sBZvZ2Rl1kKG+SjMftH2kw2j4RaZ6xGs8HmKbsCTxnA53tfaGXnXw7Icel2Z/6WAJ0UyFHyvdWePH4VPTkQQKf8iaeHBlSgQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:01.090013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-10f25114-0e00-4fd4-8bc2-b251b8fa68ee tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:01.104014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-10f25114-0e00-4fd4-8bc2-b251b8fa68ee tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Getting quotas for user d8a6c3f55b8845fbbb988a4b83093140 and project 82dca371b52647c2b2c9f1aef067dbdb. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:01.171192 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-10f25114-0e00-4fd4-8bc2-b251b8fa68ee tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.128334 Sep 19 14:41:01.173116 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 454/952] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:41:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:01.362016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:01.397220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:01.408137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:01.422940 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98805759-3a8a-42f0-8e8d-10f9d394daae tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1411 microversion: 2.25 time: 1.284068 Sep 19 14:41:01.424949 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 499/953] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:00 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1411 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:01.555563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b910f64d-7dad-47f4-91a9-0bffd53efa60 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:01.560975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b910f64d-7dad-47f4-91a9-0bffd53efa60 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] [instance: e864cd9c-f8f4-4afb-ae32-bbf5dae47a06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:01.578409 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b910f64d-7dad-47f4-91a9-0bffd53efa60 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] HTTP exception thrown: Instance e864cd9c-f8f4-4afb-ae32-bbf5dae47a06 could not be found. Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b910f64d-7dad-47f4-91a9-0bffd53efa60 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Request method failure captured: Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/e864cd9c-f8f4-4afb-ae32-bbf5dae47a06/action HTTP/1.1 Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 15 Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9m3rLJK_klA6IFt77dd9yIjBwQwLAT8YVIZt-wNjJ8PSHrovZdfA-BhgYiJKMFRAyypa7_Xt9Nt6U3ivRtyMfClDYFugZyfW8VLggf9PzpgfviVlomjSCAmBJF1RtkBaMgKMnwycuUSdFYhqLCiPqw_3_4oJFd4iuoAagHMVXFD5I Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:41:01.585599 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8837ae3f574dc2a9bb507a2f2c416d"}]}] Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abd1eb70579f43f0be2d597ad0b1955e Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: {"migrate": {}} Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:01.588579 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance e864cd9c-f8f4-4afb-ae32-bbf5dae47a06 could not be found. Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'e864cd9c-f8f4-4afb-ae32-bbf5dae47a06', 'body': {'migrate': {}}} Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e864cd9c-f8f4-4afb-ae32-bbf5dae47a06 could not be found. Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:01.590298 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e864cd9c-f8f4-4afb-ae32-bbf5dae47a06 could not be found. Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e864cd9c-f8f4-4afb-ae32-bbf5dae47a06 could not be found. Sep 19 14:41:01.593520 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.602398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b910f64d-7dad-47f4-91a9-0bffd53efa60 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Returning 404 to user: Instance e864cd9c-f8f4-4afb-ae32-bbf5dae47a06 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:01.607223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b910f64d-7dad-47f4-91a9-0bffd53efa60 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/e864cd9c-f8f4-4afb-ae32-bbf5dae47a06/action" status: 404 len: 111 microversion: 2.1 time: 0.429541 Sep 19 14:41:01.620965 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 455/954] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:01 2022] POST /compute/v2.1/servers/e864cd9c-f8f4-4afb-ae32-bbf5dae47a06/action => generated 111 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:01.630035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:01.638445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:01.668488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:01.669853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:01.670055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-378f06e3-f57e-4904-bbfb-0a207caaaa2d tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:01.671185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:01.674930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:01.676163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:01.677225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:01.686244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-378f06e3-f57e-4904-bbfb-0a207caaaa2d tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fbc5b5840eac4ffc8768ffbe826f6e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c99724c394f358dfa1350682d77b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-378f06e3-f57e-4904-bbfb-0a207caaaa2d tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Request method failure captured: Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/flavors/1409167498/action HTTP/1.1 Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 67 Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH9uzUxhiMd_nC3LV3Hltoe7SY5E_aVFgQ7UxcM0_t0_B6fWmxMjVawTiSl8cEu4xOz_1WAZtmZDOyOT99_U4XwaTYqXWpSNMJvFipDAr6-6PCTVcgHkcWWLssuu3K-rp6pyQATbBVbtU8yOtRsFxtnUWI0R-E7Xp4Fv73I-BPxScbM Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5d1c99724c394f358dfa1350682d77b7 Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1048817226 Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:01.692121 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d1c99724c394f358dfa1350682d77b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d1c99724c394f358dfa1350682d77b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d1c99724c394f358dfa1350682d77b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d1c99724c394f358dfa1350682d77b7"}]}] Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1048817226 Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5d1c99724c394f358dfa1350682d77b7 Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1048817226 Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsAccessNegativeTestJSON-1048817226-project Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: fbc5b5840eac4ffc8768ffbe826f6e14 Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1048817226-project Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: {"addTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} Sep 19 14:41:01.694591 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1409167498', 'body': {'addTenantAccess': {'tenant': '5d1c99724c394f358dfa1350682d77b7'}}} Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:41:01.696028 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 19 14:41:01.699677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:01.707881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-378f06e3-f57e-4904-bbfb-0a207caaaa2d tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:01.709964 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-378f06e3-f57e-4904-bbfb-0a207caaaa2d tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] 10.222.0.81 "POST /compute/v2.1/flavors/1409167498/action" status: 403 len: 130 microversion: 2.1 time: 0.282347 Sep 19 14:41:01.716251 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 500/955] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:41:01 2022] POST /compute/v2.1/flavors/1409167498/action => generated 130 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:01.739548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:01.752477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:01.780432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:01.781678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:01.782710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:01.795316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:01.796603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:01.797887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:01.951047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:01.952195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:01.953333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:01.954324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:01.955397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:02.099791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:02.109189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.109997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.110629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.111720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.112648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.113406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.153963 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f32904b3-2822-4125-9694-54979370377a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 1068 microversion: 2.1 time: 0.430280 Sep 19 14:41:02.176302 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 501/956] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:01 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 1068 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 19 14:41:02.184317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:02.185473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:02.194045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.195151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.196125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.197529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.198272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.199042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.420929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:02.442788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:02.444498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:02.457122 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abc754b3-8125-46c6-9043-93b6a7bef1bb tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.277214 Sep 19 14:41:02.457122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 502/957] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:02 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:02.466423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55a76da4-3467-47e8-9530-6e9e9e1106b1 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde29de4430>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:02.480388 n-d-858384-1 devstack@n-api.service[128730]: WARNING oslo_db.sqlalchemy.utils [None req-55a76da4-3467-47e8-9530-6e9e9e1106b1 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 19 14:41:02.499602 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55a76da4-3467-47e8-9530-6e9e9e1106b1 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.041932 Sep 19 14:41:02.506006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 503/958] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:41:02 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:02.512861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82254286-e0a5-410f-bf6c-37522e932575 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:02.541886 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82254286-e0a5-410f-bf6c-37522e932575 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1409167498" status: 202 len: 0 microversion: 2.1 time: 0.033807 Sep 19 14:41:02.546103 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 504/959] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:41:02 2022] DELETE /compute/v2.1/flavors/1409167498 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:02.554403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1091957871", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:02.605596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:02.651798 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3c6f64c-573c-4881-a41d-5c7d5bc6e4d0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.037631 Sep 19 14:41:02.663015 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 456/960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:01 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:02.674658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:02.684501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:02.709653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.711203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.712196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.714803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.716126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.716800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.722073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:41:02.878667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:02.890813 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a8db16a-d870-4f8c-b1d4-9c92962f2321 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1273 microversion: 2.1 time: 0.225996 Sep 19 14:41:02.892492 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 457/961] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:02 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:02.898713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:02.899768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:02.923420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.924398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.925121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:02.926129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:02.926610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:02.927077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.261503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:03.273803 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-afd7135b-19b6-4073-aeee-cff4f5a0da1e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.379873 Sep 19 14:41:03.275435 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 458/962] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:02 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:03.280975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:03.282048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:03.290796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.292244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.292934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.293935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.294624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.295321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.437908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:03.438493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:03.440958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:03.440958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:03.440958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:03.455332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.456211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.456904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.457942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.458965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.459106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.486253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Getting quotas for project 7a9404a412184ccfbacbdbf438e4b496. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:03.498498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Getting quotas for user a130f01dc587496296ac76c50fb62388 and project 7a9404a412184ccfbacbdbf438e4b496. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:03.519689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:41:03.523689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:41:03.588208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:03.597377 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-597426f7-8508-4107-aee8-bf391472e2f3 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052838 Sep 19 14:41:03.603008 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 505/963] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:41:03.615918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:03.620121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffe216f5-09ad-4af1-860f-903e4c168169 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde29de05e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:03.623174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:03.624752 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b5e09b32-2361-456c-9eee-f4ed255ff812 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1411 microversion: 2.25 time: 0.347989 Sep 19 14:41:03.625347 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 459/964] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:03 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1411 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:03.641874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-421989dc-35b9-435d-848e-437c5b99ed63 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:03.686691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-421989dc-35b9-435d-848e-437c5b99ed63 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052953 Sep 19 14:41:03.692120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffe216f5-09ad-4af1-860f-903e4c168169 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1509029342" status: 202 len: 0 microversion: 2.1 time: 0.086747 Sep 19 14:41:03.693089 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 506/965] 10.222.0.81 () {58 vars in 1278 bytes} [Mon Sep 19 14:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1509029342 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:03.698417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-45ebe435-a9e1-4ed4-bfc9-491d1321a553 req-ca1105cc-095b-4272-912c-b0e0ca2c76c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fba3b9-9528-42c7-a666-cbd5f158103d", "name": "network-vif-plugged", "status": "completed", "tag": "7c91d2c7-d1d4-4305-b4a1-488ce3e7e978"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:03.699204 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 460/966] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:41:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:03.710717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:03.711727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:03.718269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-45ebe435-a9e1-4ed4-bfc9-491d1321a553 req-ca1105cc-095b-4272-912c-b0e0ca2c76c4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.718785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-45ebe435-a9e1-4ed4-bfc9-491d1321a553 req-ca1105cc-095b-4272-912c-b0e0ca2c76c4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.720130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.720880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.721560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.722517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:03.723262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:03.723919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.727651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-45ebe435-a9e1-4ed4-bfc9-491d1321a553 req-ca1105cc-095b-4272-912c-b0e0ca2c76c4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:03.749175 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-45ebe435-a9e1-4ed4-bfc9-491d1321a553 req-ca1105cc-095b-4272-912c-b0e0ca2c76c4 service nova] Creating event network-vif-plugged:7c91d2c7-d1d4-4305-b4a1-488ce3e7e978 for instance 94fba3b9-9528-42c7-a666-cbd5f158103d on n-h1-858384-1 Sep 19 14:41:03.765075 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-45ebe435-a9e1-4ed4-bfc9-491d1321a553 req-ca1105cc-095b-4272-912c-b0e0ca2c76c4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070628 Sep 19 14:41:03.766121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 507/967] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:03.783175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e5741bd-ae79-4da5-821c-d5e9dd68e90f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:03.786605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9e5741bd-ae79-4da5-821c-d5e9dd68e90f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:04.019710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9e5741bd-ae79-4da5-821c-d5e9dd68e90f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:04.033212 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e5741bd-ae79-4da5-821c-d5e9dd68e90f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1222 microversion: 2.1 time: 0.265721 Sep 19 14:41:04.034441 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 508/968] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:03 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:04.039211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:04.039846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:04.052203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:04.067520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:04.068032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:04.068628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:04.081297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:04.084261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:04.086888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:04.087558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:04.088511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:04.113688 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08bcec25-c1d7-495f-9ab5-7d72d8f768d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.412292 Sep 19 14:41:04.115275 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 461/969] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:03 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:04.121584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b76fb304-221d-45cd-8c8f-3b3e4165b64c tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde29e3d940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:04.190966 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b76fb304-221d-45cd-8c8f-3b3e4165b64c tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-91260470" status: 202 len: 0 microversion: 2.1 time: 0.074277 Sep 19 14:41:04.192130 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 462/970] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-91260470 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:04.209236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eae54aed-2afd-4efb-ae74-32d7c1640ca6 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1166502395", "id": 1542387423, "os-flavor-access:is_public": "False"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:04.255733 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eae54aed-2afd-4efb-ae74-32d7c1640ca6 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.062352 Sep 19 14:41:04.256361 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 463/971] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:04 2022] POST /compute/v2.1/flavors => generated 439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:04.264531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:04.265530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:04.292181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:04.296412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:04.300124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:04.301432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:04.301625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:04.302068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:04.825790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:04.833056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:04.841885 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1606ace5-dcd8-4f9e-a2ab-0258e1491e60 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.584439 Sep 19 14:41:04.844077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-322af052-e911-43b3-a409-a9e747279060 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.807598 Sep 19 14:41:04.846082 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 464/972] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:04 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:04.866781 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 509/973] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:04 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:04.870135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1cb53af-e3e4-4cbf-bff8-bfa889f760d8 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] Calling method '.version_select at 0x7fde29dd6310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:04.883262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f5f42fb-d073-4c5b-a3d4-34453fdc5ce5 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:04.937614 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1cb53af-e3e4-4cbf-bff8-bfa889f760d8 tempest-KeyPairsV2TestJSON-1543471816 tempest-KeyPairsV2TestJSON-1543471816-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2117480413" status: 202 len: 0 microversion: 2.1 time: 0.090204 Sep 19 14:41:04.938700 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 465/974] 10.222.0.81 () {58 vars in 1278 bytes} [Mon Sep 19 14:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2117480413 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:04.959458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:04.964669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:04.977527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:04.984930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:04.985783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:04.989588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:04.990718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:04.993788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:05.071276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f5f42fb-d073-4c5b-a3d4-34453fdc5ce5 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1542387423/action" status: 200 len: 97 microversion: 2.1 time: 0.194812 Sep 19 14:41:05.073535 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 510/975] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:41:04 2022] POST /compute/v2.1/flavors/1542387423/action => generated 97 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:41:05.099588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:05.102332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:05.140271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:05.142951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:05.144503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:05.147087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:05.148474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:05.151921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:05.994159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.005922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81e8a64e-1994-46ce-a955-5b7565a99ca6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 1.062773 Sep 19 14:41:06.006605 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 466/976] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:04 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:06.017549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:06.018526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:06.035876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.043797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.044260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.045009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.045474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.045903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.068077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.089838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.096235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.099058 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b96bc0f3-7857-403f-b2d7-3035c6f0bbbd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1411 microversion: 2.25 time: 1.016534 Sep 19 14:41:06.122897 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 511/977] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:05 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1411 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:06.122897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef895f9f-d9ae-413d-946a-59a026fa0098 tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:06.122897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ef895f9f-d9ae-413d-946a-59a026fa0098 tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fbc5b5840eac4ffc8768ffbe826f6e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c99724c394f358dfa1350682d77b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef895f9f-d9ae-413d-946a-59a026fa0098 tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Request method failure captured: Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/flavors/1542387423/action HTTP/1.1 Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 70 Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH9uzUxhiMd_nC3LV3Hltoe7SY5E_aVFgQ7UxcM0_t0_B6fWmxMjVawTiSl8cEu4xOz_1WAZtmZDOyOT99_U4XwaTYqXWpSNMJvFipDAr6-6PCTVcgHkcWWLssuu3K-rp6pyQATbBVbtU8yOtRsFxtnUWI0R-E7Xp4Fv73I-BPxScbM Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5d1c99724c394f358dfa1350682d77b7 Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1048817226 Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:06.123770 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d1c99724c394f358dfa1350682d77b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d1c99724c394f358dfa1350682d77b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d1c99724c394f358dfa1350682d77b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d1c99724c394f358dfa1350682d77b7"}]}] Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1048817226 Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5d1c99724c394f358dfa1350682d77b7 Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1048817226 Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FlavorsAccessNegativeTestJSON-1048817226-project Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: fbc5b5840eac4ffc8768ffbe826f6e14 Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1048817226-project Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: {"removeTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} Sep 19 14:41:06.125150 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1542387423', 'body': {'removeTenantAccess': {'tenant': '5d1c99724c394f358dfa1350682d77b7'}}} Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can( Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:41:06.125876 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 19 14:41:06.128108 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:06.131975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef895f9f-d9ae-413d-946a-59a026fa0098 tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:06.133063 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef895f9f-d9ae-413d-946a-59a026fa0098 tempest-FlavorsAccessNegativeTestJSON-1048817226 tempest-FlavorsAccessNegativeTestJSON-1048817226-project] 10.222.0.81 "POST /compute/v2.1/flavors/1542387423/action" status: 403 len: 133 microversion: 2.1 time: 0.024187 Sep 19 14:41:06.138693 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 512/978] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:41:06 2022] POST /compute/v2.1/flavors/1542387423/action => generated 133 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:06.147927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:06.148989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:06.170456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.171446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.172229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.173497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.174599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.176222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.350611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.365748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.371862 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7656f016-cb92-43f8-bb39-310456b6483d tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1274 microversion: 2.1 time: 0.363919 Sep 19 14:41:06.382103 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 467/979] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:06 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:06.386706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.397545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:06.404768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:06.406737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:06.417542 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7adc60b1-bbc2-46b0-9e5e-557f73ebc270 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.277197 Sep 19 14:41:06.425770 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 513/980] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:06 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:06.438702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:06.439479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.440314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.440994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.441970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.445685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.447671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.448284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:06.470259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.475770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.477710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:06.485129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:06.487837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:06.488648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:07.198096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:07.217605 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f26e11bd-00c4-47d0-8355-e34b30ac22bb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.790247 Sep 19 14:41:07.221910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:07.245061 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 514/981] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:06 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:07.263965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-384eabab-e192-468e-bf15-88942fbb905f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.879853 Sep 19 14:41:07.266392 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 468/982] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:06 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:07.273637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20dab961-9897-4456-890b-da618514d77a tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5d1c99724c394f358dfa1350682d77b7"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:07.280127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:07.281635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:07.320148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:07.321225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:07.325289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:07.326739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:07.332823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:07.333718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:07.649635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:07.661153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:07.670674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e2d1586a-5b7b-4eb8-8ecf-9b653b51d1f0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.402373 Sep 19 14:41:07.671933 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 469/983] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:07 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:07.685044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:07.687031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:07.702920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:07.703858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:07.706083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:07.707705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:07.712498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:07.713656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.045630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.076572 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20dab961-9897-4456-890b-da618514d77a tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1542387423/action" status: 200 len: 21 microversion: 2.1 time: 0.829225 Sep 19 14:41:08.077460 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 515/984] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:41:07 2022] POST /compute/v2.1/flavors/1542387423/action => generated 21 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:41:08.091307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:08.092048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:08.116091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.116795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.117266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.117985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.118448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.124243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.264967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.309690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.320723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.326983 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f71152f-a504-4d1c-9845-954d82ebbea6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1606 microversion: 2.25 time: 0.653484 Sep 19 14:41:08.327814 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 470/985] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:07 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1606 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:08.351110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:08.352048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:08.368094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.386978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.387563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.388364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.388862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.389307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.480285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.492258 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3295fc2a-9791-4123-ba12-152e3efd5da8 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1292 microversion: 2.1 time: 0.405534 Sep 19 14:41:08.507013 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 516/986] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:08 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1292 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:08.507013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f067a659-1a0b-4664-9b48-b8796a229185 req-ab91264a-267b-49d4-a799-3e1e35c61acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d00bb9-7d71-471f-83f3-edc1c740d441", "tag": "8b9b59f5-8f84-4527-bdea-047c84c4a78b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:08.536260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f067a659-1a0b-4664-9b48-b8796a229185 req-ab91264a-267b-49d4-a799-3e1e35c61acc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.542797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f067a659-1a0b-4664-9b48-b8796a229185 req-ab91264a-267b-49d4-a799-3e1e35c61acc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.544598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f067a659-1a0b-4664-9b48-b8796a229185 req-ab91264a-267b-49d4-a799-3e1e35c61acc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.574065 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f067a659-1a0b-4664-9b48-b8796a229185 req-ab91264a-267b-49d4-a799-3e1e35c61acc service nova] Creating event network-changed:8b9b59f5-8f84-4527-bdea-047c84c4a78b for instance 15d00bb9-7d71-471f-83f3-edc1c740d441 on n-h1-858384-1 Sep 19 14:41:08.585230 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f067a659-1a0b-4664-9b48-b8796a229185 req-ab91264a-267b-49d4-a799-3e1e35c61acc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086143 Sep 19 14:41:08.587064 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 517/987] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:08.713876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.750123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.752950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:08.781435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-90b6deb0-cd87-4af6-936e-b8623892c817 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.445025 Sep 19 14:41:08.796470 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 471/988] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:08 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:08.831065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01ab3383-f0d1-45d2-a32b-fe7220134921 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:08.852796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-923830ac-8c49-45e7-9e01-8f687ad8599f tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29dfeaf0>, body: {"keypair": {"name": "tempest-keypair-385949024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6b+kctRfJTUTYUVfjntXwcdOf8WZOEulgiAtfOf9LEfKBDAu4mkoX8hYHHiUcKc+bika71IPYsT8hizQVuc3yZTiyGOaTmqT/0CofVsC9K6GwdlQXA5M5cwKyWs3h/9w=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:08.892828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01ab3383-f0d1-45d2-a32b-fe7220134921 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1542387423" status: 202 len: 0 microversion: 2.1 time: 0.094494 Sep 19 14:41:08.895619 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 472/989] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:41:08 2022] DELETE /compute/v2.1/flavors/1542387423 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:08.907613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:08.910201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:08.918205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=41 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.927544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.928411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.929842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.931223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:08.932708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-923830ac-8c49-45e7-9e01-8f687ad8599f tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:08.933140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:08.933820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:08.948817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-923830ac-8c49-45e7-9e01-8f687ad8599f tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:09.015961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-923830ac-8c49-45e7-9e01-8f687ad8599f tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.426086 Sep 19 14:41:09.016999 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 518/990] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 429 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:41:09.022461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:09.027351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:09.045615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:09.046481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:09.047680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:09.058621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:09.059586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:09.060117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:09.403304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.532845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:09.542106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4942bed9-c906-480d-a040-dcb4131b89c5 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.644929 Sep 19 14:41:09.564012 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 473/991] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:08 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:09.573650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:09.574428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:09.581846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:09.582588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:09.583259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:09.584152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:09.584766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:09.585371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:09.673410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:09.694363 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aea54b6b-ed06-4c5a-82f5-7c4102a1f53c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.674402 Sep 19 14:41:09.696056 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 519/992] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:09 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:09.703343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:09.704314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:09.721388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:09.722342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:09.723055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:09.724802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:09.725896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:09.727025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:09.910607 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b6c6f13f-9b47-4809-9a48-c94638e7ea2b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.345351 Sep 19 14:41:09.911756 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 474/993] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 14:41:09 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-interface => generated 284 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:41:09.917425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aae762cb-dfed-41cb-9d72-e9a686bfa78a tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:09.974954 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aae762cb-dfed-41cb-9d72-e9a686bfa78a tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061602 Sep 19 14:41:09.986794 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 475/994] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:41:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:09.991918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e57d8195-1d4d-4949-b0ee-77ada95a5f42 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29fae0d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.007215 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e57d8195-1d4d-4949-b0ee-77ada95a5f42 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-385949024" status: 200 len: 512 microversion: 2.2 time: 0.030144 Sep 19 14:41:10.008299 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 476/995] 10.222.0.81 () {60 vars in 1255 bytes} [Mon Sep 19 14:41:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-385949024 => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:10.013721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.014575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:10.028374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.029430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.031411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.032665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.034533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.035212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.140354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:10.160070 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c96b9013-f8e3-4bf2-ab65-74586957f926 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.460244 Sep 19 14:41:10.160944 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 520/996] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:09 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:10.182629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.185379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:10.186217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:10.202314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.202894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.203336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.204053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.204503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.204930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.206106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a7756ea-dd3d-4fbc-bbaf-3c559471d30f tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1280 microversion: 2.1 time: 0.196056 Sep 19 14:41:10.220274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 477/997] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:10 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:10.234963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28d5d89c-ebb4-429b-a013-122d7902abd7 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1081900103", "id": 2144734673, "os-flavor-access:is_public": "False"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:10.266798 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28d5d89c-ebb4-429b-a013-122d7902abd7 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.044795 Sep 19 14:41:10.271516 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 478/998] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:10.283325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-448a1478-c509-431d-8286-2a01a2ff4388 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29dd6a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.309760 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-448a1478-c509-431d-8286-2a01a2ff4388 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385949024" status: 204 len: 0 microversion: 2.2 time: 0.034842 Sep 19 14:41:10.311129 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 479/999] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Sep 19 14:41:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385949024 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:10.325848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:10.326190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cf1b4a3-2878-469c-931e-f49adc3010f2 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1748ad5dcb3140ff8cf621e883795f2a"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:10.337210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:10.340341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:10.346948 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e3a6c7b-2869-405e-90de-24cf65292827 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1553 microversion: 2.91 time: 0.184637 Sep 19 14:41:10.347645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 521/1000] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:10 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:10.354650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc28ad26-4bd4-4f8c-a194-df63ed789e2c tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29f7d820>, body: {"keypair": {"name": "tempest-keypair-874502846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUovDabSlIphE4GkdDxNiX47PwaurRq/FQah5JfTmtgZ1Yd64adqR48volUKU7PlQAn2ZiAau0OumKvjLDIeEKm7kCzAiBuYsvLZbOVBqln+sZOZuAjA84t1fbf6UU6nw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:10.374730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-cc28ad26-4bd4-4f8c-a194-df63ed789e2c tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:10.381002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-cc28ad26-4bd4-4f8c-a194-df63ed789e2c tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:10.419274 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc28ad26-4bd4-4f8c-a194-df63ed789e2c tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.070029 Sep 19 14:41:10.420068 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 522/1001] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:41:10.433485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-139abc51-dc0b-42fd-9db0-57a2812b54fc tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29db95e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.479712 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-139abc51-dc0b-42fd-9db0-57a2812b54fc tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874502846" status: 204 len: 0 microversion: 2.2 time: 0.051557 Sep 19 14:41:10.483106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 523/1002] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Sep 19 14:41:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874502846 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:10.497058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96dbbee3-b067-4e39-8e7e-5daac6090ac6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29de0670>, body: {"keypair": {"name": "tempest-keypair-973163844", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:10.527819 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9cf1b4a3-2878-469c-931e-f49adc3010f2 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] HTTP exception thrown: Flavor access not found for 38 / 1748ad5dcb3140ff8cf621e883795f2a combination. Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cf1b4a3-2878-469c-931e-f49adc3010f2 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Request method failure captured: Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/flavors/2144734673/action HTTP/1.1 Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 70 Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9vo60ZiI0SQ2xTDfEU1sOvBgMB1FV-EBgwpiAT2NT_yuLkRXKzpR5vePzo9tmM7xHQCKwvpFVVUygKTq1Gu4YOjkZzaA2BfmKQGODk9r8SQf-bZ6weaSm2VRH0LVg7H46alVeUFAqCPkw8q3TAxBjZfA6vdobdHpMUujDQpdYpYxE Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: be5f67ab39554c08ad736cf73fddd3c3 Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:41:10.531300 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be5f67ab39554c08ad736cf73fddd3c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be5f67ab39554c08ad736cf73fddd3c3"}]}] Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: be5f67ab39554c08ad736cf73fddd3c3 Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-909694953 Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d65e8cb7ec14a27907bf107b1e27f36 Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: {"removeTenantAccess": {"tenant": "1748ad5dcb3140ff8cf621e883795f2a"}} Sep 19 14:41:10.534246 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: exception: Flavor access not found for 38 / 1748ad5dcb3140ff8cf621e883795f2a combination. Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '2144734673', 'body': {'removeTenantAccess': {'tenant': '1748ad5dcb3140ff8cf621e883795f2a'}}} Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 19 14:41:10.535662 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / 1748ad5dcb3140ff8cf621e883795f2a combination. Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / 1748ad5dcb3140ff8cf621e883795f2a combination. Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:10.538579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / 1748ad5dcb3140ff8cf621e883795f2a combination. Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cf1b4a3-2878-469c-931e-f49adc3010f2 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Returning 404 to user: Flavor access not found for 38 / 1748ad5dcb3140ff8cf621e883795f2a combination. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:10.542835 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cf1b4a3-2878-469c-931e-f49adc3010f2 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/2144734673/action" status: 404 len: 124 microversion: 2.1 time: 0.216324 Sep 19 14:41:10.549510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 480/1003] 10.222.0.81 () {60 vars in 1200 bytes} [Mon Sep 19 14:41:10 2022] POST /compute/v2.1/flavors/2144734673/action => generated 124 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:10.554476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-96dbbee3-b067-4e39-8e7e-5daac6090ac6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:10.560700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f3e7df1-2010-48c2-baba-3986250b7d1b tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.565124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-96dbbee3-b067-4e39-8e7e-5daac6090ac6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:10.621160 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f3e7df1-2010-48c2-baba-3986250b7d1b tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/2144734673" status: 202 len: 0 microversion: 2.1 time: 0.069679 Sep 19 14:41:10.621907 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 481/1004] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:41:10 2022] DELETE /compute/v2.1/flavors/2144734673 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:10.629758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.638703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:10.651836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96dbbee3-b067-4e39-8e7e-5daac6090ac6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.160949 Sep 19 14:41:10.652820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 524/1005] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:10 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 19 14:41:10.653089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.654143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.654706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.655586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.656154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.656847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.667836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6f6c8d7-2f2a-40e3-9a42-5d34866f0ee4 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.722807 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f6f6c8d7-2f2a-40e3-9a42-5d34866f0ee4 tempest-FlavorsAccessNegativeTestJSON-909694953 tempest-FlavorsAccessNegativeTestJSON-909694953-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068374 Sep 19 14:41:10.780744 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 525/1006] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:41:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:10.808874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8992f2ba-de8e-4d94-beba-6ebc900ebaa8 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29fadaf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.906404 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8992f2ba-de8e-4d94-beba-6ebc900ebaa8 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973163844" status: 204 len: 0 microversion: 2.2 time: 0.123077 Sep 19 14:41:10.923006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 526/1007] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Sep 19 14:41:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973163844 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:10.932006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:10.933173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:10.946357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.948003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.948435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:10.949646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:10.951235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:10.951506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:11.117163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:11.611389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:11.623740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5c7bf3bd-2f60-4a64-9a98-48ae40173775 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.000449 Sep 19 14:41:11.625332 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 482/1008] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:10 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:11.631750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3a7cd357-f6d8-42d8-a6b2-ac5a873dbe1c req-78071b84-3c60-407f-a985-46eb8f9ccb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e03d5dc-b937-4876-a4ca-43dc55f3dc77", "name": "network-vif-unplugged", "status": "completed", "tag": "b2d523b2-6a3a-47a4-a07f-f8bb721d78de"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:11.644740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3a7cd357-f6d8-42d8-a6b2-ac5a873dbe1c req-78071b84-3c60-407f-a985-46eb8f9ccb31 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:11.645605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3a7cd357-f6d8-42d8-a6b2-ac5a873dbe1c req-78071b84-3c60-407f-a985-46eb8f9ccb31 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:11.646247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3a7cd357-f6d8-42d8-a6b2-ac5a873dbe1c req-78071b84-3c60-407f-a985-46eb8f9ccb31 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:11.660968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3a7cd357-f6d8-42d8-a6b2-ac5a873dbe1c req-78071b84-3c60-407f-a985-46eb8f9ccb31 service nova] Creating event network-vif-unplugged:b2d523b2-6a3a-47a4-a07f-f8bb721d78de for instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 on n-h1-858384-1 Sep 19 14:41:11.671237 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3a7cd357-f6d8-42d8-a6b2-ac5a873dbe1c req-78071b84-3c60-407f-a985-46eb8f9ccb31 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044026 Sep 19 14:41:11.673970 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 483/1009] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:11.684376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e51171bc-d846-474a-aa35-f8cdb91e6e1e tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29de4280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-708097390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4pvwVoys+1Q+b+Y64sTF3oD7n0PQCvCZY5QjWD7Up6vLUCBz+bqqmCHJjDs4Hao0V+NMOAs5uAc7Wbt6rqr3bfvPtitPd2lS/T5A2n0fxv2r9byaogxEbJdlJSHeP6WQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:11.694180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:11.710111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-e51171bc-d846-474a-aa35-f8cdb91e6e1e tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:11.722579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-e51171bc-d846-474a-aa35-f8cdb91e6e1e tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:11.757615 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e51171bc-d846-474a-aa35-f8cdb91e6e1e tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.081744 Sep 19 14:41:11.760197 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 484/1010] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:41:11.767895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:11.769961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:11.783285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:11.784422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:11.785429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:11.786555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:11.787514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:11.788272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:12.190800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:12.208366 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da5a1e4e-7768-48b8-aa36-cf21fdbf7336 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 1.283724 Sep 19 14:41:12.209569 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 527/1011] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:10 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:12.217770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:12.218697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:12.231669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:12.233964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:12.234948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:12.235915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:12.236619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:12.238735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:12.577916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:12.599493 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56abc589-2cc3-447f-b470-73fa49c035d2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.837166 Sep 19 14:41:12.623106 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 485/1012] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:11 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:12.639692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:12.641058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:12.655273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:12.656168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:12.656968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:12.658403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:12.659370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:12.660590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:12.852174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:12.877913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:12.884113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:12.888379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:12.896325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8284915-26a8-4a3a-aae6-09d1edac7804 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.685352 Sep 19 14:41:12.896903 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 528/1013] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:12 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:12.902153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d7525b64-ee7f-4262-aecb-c1480b7e00e1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1535 microversion: 2.91 time: 0.274445 Sep 19 14:41:12.905379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 486/1014] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:12 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1535 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:12.920316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1b07effb-8b47-4925-9b8f-7af19bf0dfa4 req-a8c4deb9-43b9-4059-bfe6-22e3a81370b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fba3b9-9528-42c7-a666-cbd5f158103d", "tag": "7c91d2c7-d1d4-4305-b4a1-488ce3e7e978"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:12.930780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ead18708-3740-4d0b-bd5e-bee42acc912a tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29dd4ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-613405157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoxbtlvU1A2ioKeZa/TayykthCqsmfRwh3YyXkQ9D/pe5aKMSEbgQx7UJnH9ZpawoBx73Z5/aD86/heUOkOhtsZiGxCtIiaEcqZPaGBnxmzBe2v+c1pGR+U+FMjbczJVQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:12.953685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1b07effb-8b47-4925-9b8f-7af19bf0dfa4 req-a8c4deb9-43b9-4059-bfe6-22e3a81370b4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:12.954688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1b07effb-8b47-4925-9b8f-7af19bf0dfa4 req-a8c4deb9-43b9-4059-bfe6-22e3a81370b4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:12.955640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1b07effb-8b47-4925-9b8f-7af19bf0dfa4 req-a8c4deb9-43b9-4059-bfe6-22e3a81370b4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:12.966693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-ead18708-3740-4d0b-bd5e-bee42acc912a tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:12.983871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-ead18708-3740-4d0b-bd5e-bee42acc912a tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:12.987307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1b07effb-8b47-4925-9b8f-7af19bf0dfa4 req-a8c4deb9-43b9-4059-bfe6-22e3a81370b4 service nova] Creating event network-changed:7c91d2c7-d1d4-4305-b4a1-488ce3e7e978 for instance 94fba3b9-9528-42c7-a666-cbd5f158103d on n-h1-858384-1 Sep 19 14:41:12.999243 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1b07effb-8b47-4925-9b8f-7af19bf0dfa4 req-a8c4deb9-43b9-4059-bfe6-22e3a81370b4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090778 Sep 19 14:41:13.001519 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 487/1015] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:13.044081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:13.051248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:13.079800 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ead18708-3740-4d0b-bd5e-bee42acc912a tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.161003 Sep 19 14:41:13.082805 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 529/1016] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:12 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:41:13.108828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:13.114219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da907ffe-6fe9-4c7f-a676-7322a4122e50 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29e27160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1523464112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRJE+7esSn2q0r7vTlBmIJMBg8cfKbL4+9weC1kHlaJ0recCpj/gnKNw6FpTb5CxeptPPLE904sgQ4yAdqMNA3TQxfNO/u0WyOQC7ShPfQQ5k29pLxVQ4T4Fo0Lz29eA=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:13.117743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:13.120641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:13.122019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:13.124907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:13.125765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:13.235897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-da907ffe-6fe9-4c7f-a676-7322a4122e50 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:13.258716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-da907ffe-6fe9-4c7f-a676-7322a4122e50 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:13.362092 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da907ffe-6fe9-4c7f-a676-7322a4122e50 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.265023 Sep 19 14:41:13.367115 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 530/1017] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:13 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:41:13.407986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:13.410024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:13.429412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:13.432022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:13.433190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:13.434663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:13.436597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:13.437714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:13.504649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=18 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.020105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.032888 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc0f2e65-7508-48f0-89ac-c58b98fc3103 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.660915 Sep 19 14:41:14.034128 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 531/1018] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:13 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:14.055749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.059453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0ce20592-6459-46d1-bdaa-23d67a46ccf6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29dd4310>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.068906 n-d-858384-1 devstack@n-api.service[128730]: WARNING oslo_db.sqlalchemy.utils [None req-0ce20592-6459-46d1-bdaa-23d67a46ccf6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 19 14:41:14.069238 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3613fe91-edff-414d-a5bc-e3e6e026c3ea tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.065482 Sep 19 14:41:14.083047 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0ce20592-6459-46d1-bdaa-23d67a46ccf6 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.047036 Sep 19 14:41:14.083713 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 488/1019] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:13 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:14.085751 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 532/1020] 10.222.0.81 () {60 vars in 1177 bytes} [Mon Sep 19 14:41:14 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:14.093134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.093758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:14.094923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.095919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:14.103419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.104656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.105108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.105466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.106416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.107299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.108296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.109531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.111437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.113702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.114262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.114676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.121003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.562489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.582202 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-309f19fe-0077-4fcf-9447-b7bd77ec90b7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.494191 Sep 19 14:41:14.583255 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 533/1021] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:14 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:14.589747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.590376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:14.617477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.617988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.618429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.621662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.622160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.622607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.658464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.673649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb9621a1-2aaf-45af-bec1-fd3e8f81c5c5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.588731 Sep 19 14:41:14.674235 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 489/1022] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:14 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:14.679858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8a8c646d-3796-4bb7-aa07-d2fc1cd8230f req-4f487dc7-0474-4aed-8247-27d50e4080dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e03d5dc-b937-4876-a4ca-43dc55f3dc77", "tag": "b2d523b2-6a3a-47a4-a07f-f8bb721d78de"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:14.695601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8a8c646d-3796-4bb7-aa07-d2fc1cd8230f req-4f487dc7-0474-4aed-8247-27d50e4080dc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.696101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8a8c646d-3796-4bb7-aa07-d2fc1cd8230f req-4f487dc7-0474-4aed-8247-27d50e4080dc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.696769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8a8c646d-3796-4bb7-aa07-d2fc1cd8230f req-4f487dc7-0474-4aed-8247-27d50e4080dc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.714904 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8a8c646d-3796-4bb7-aa07-d2fc1cd8230f req-4f487dc7-0474-4aed-8247-27d50e4080dc service nova] Creating event network-changed:b2d523b2-6a3a-47a4-a07f-f8bb721d78de for instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 on n-h1-858384-1 Sep 19 14:41:14.721206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8a8c646d-3796-4bb7-aa07-d2fc1cd8230f req-4f487dc7-0474-4aed-8247-27d50e4080dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044772 Sep 19 14:41:14.722094 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 490/1023] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:14.728370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab0ba018-7382-4920-ba2a-04439567051a tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29f9db80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.758665 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab0ba018-7382-4920-ba2a-04439567051a tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1523464112" status: 204 len: 0 microversion: 2.2 time: 0.034916 Sep 19 14:41:14.763868 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 491/1024] 10.222.0.81 () {60 vars in 1321 bytes} [Mon Sep 19 14:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1523464112 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:14.770843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c76bfb7-3020-4cf8-8294-d884c9e2cac4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29e3d430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.797793 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c76bfb7-3020-4cf8-8294-d884c9e2cac4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-613405157" status: 204 len: 0 microversion: 2.2 time: 0.031738 Sep 19 14:41:14.798639 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 492/1025] 10.222.0.81 () {60 vars in 1318 bytes} [Mon Sep 19 14:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-613405157 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:14.809343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c441bed9-cf35-446e-bd11-48bf214859d9 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29da03a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.837038 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c441bed9-cf35-446e-bd11-48bf214859d9 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-708097390" status: 204 len: 0 microversion: 2.2 time: 0.032473 Sep 19 14:41:14.839756 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 493/1026] 10.222.0.81 () {60 vars in 1318 bytes} [Mon Sep 19 14:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-708097390 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:14.854270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d9c76bed-1016-443a-87e0-f2bbfb3065da tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29da0dc0>, body: {"keypair": {"name": "tempest-keypair-2035742258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1djWWcHJdr/ra6DeCxiGX1LRy+QfBLK6ZtTWb3eDWasVYxmMXrnFIV74vRMhgCGSmlbv/4PGuU4FWuGues6b+1C5DzYoc5s5utfrkj4vbdagJoaM13osWpQORhKuo+Wg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:14.876150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d9c76bed-1016-443a-87e0-f2bbfb3065da tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:14.878055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.883714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d9c76bed-1016-443a-87e0-f2bbfb3065da tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:14.894266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.896025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:14.905792 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8aebb8a9-352c-40c7-a57d-019ad26eef2a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1478 microversion: 2.91 time: 0.321346 Sep 19 14:41:14.906713 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 534/1027] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:14 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1478 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:14.927448 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d9c76bed-1016-443a-87e0-f2bbfb3065da tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.070463 Sep 19 14:41:14.927448 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 494/1028] 10.222.0.81 () {62 vars in 1199 bytes} [Mon Sep 19 14:41:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 19 14:41:14.938885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7fbe8a1c-2168-410c-a1e9-24879247debd tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29e4a670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.946115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.953248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858384-1"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:14.955819 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7fbe8a1c-2168-410c-a1e9-24879247debd tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-2035742258" status: 200 len: 513 microversion: 2.2 time: 0.026561 Sep 19 14:41:14.956702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:14.957415 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 535/1029] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Sep 19 14:41:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2035742258 => generated 513 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:14.966626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.972972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b80ff444-76fd-4fa9-a359-5351af5b1570 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29f7db80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:14.976893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.977805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.979964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:14.982710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:14.983582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:14.984819 n-d-858384-1 devstack@n-api.service[128730]: WARNING oslo_db.sqlalchemy.utils [None req-b80ff444-76fd-4fa9-a359-5351af5b1570 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 19 14:41:15.001515 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b80ff444-76fd-4fa9-a359-5351af5b1570 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.033269 Sep 19 14:41:15.008763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 536/1030] 10.222.0.81 () {60 vars in 1177 bytes} [Mon Sep 19 14:41:14 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:41:15.021590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f96cc3d7-83fa-4758-9513-5ca91d0789fc tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29db9280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:15.065000 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f96cc3d7-83fa-4758-9513-5ca91d0789fc tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035742258" status: 204 len: 0 microversion: 2.2 time: 0.047769 Sep 19 14:41:15.066001 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 537/1031] 10.222.0.81 () {60 vars in 1261 bytes} [Mon Sep 19 14:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035742258 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:15.074067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:15.075228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:15.082548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:15.083398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:15.083861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:15.084586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:15.085049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:15.085488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:15.170617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858384-1". {{(pid=128731) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 14:41:15.254022 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb75819c-848d-4dc4-9f50-ad98cb0455fa tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action" status: 202 len: 0 microversion: 2.91 time: 0.310547 Sep 19 14:41:15.258341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 495/1032] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:41:14 2022] POST /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:15.262671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Action: 'create', calling method: .version_select at 0x7fde29ee3dc0>, body: {"keypair": {"name": "tempest-keypair-1205350868", "type": "x509"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:15.280288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:15.285445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:15.304817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.processutils [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp91v0iif5/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp91v0iif5/temp.key -subj /CN=1a609a4a803e4b368e692153a6745f41 -extensions v3_req_client {{(pid=128731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 19 14:41:15.561625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.processutils [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp91v0iif5/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp91v0iif5/temp.key -subj /CN=1a609a4a803e4b368e692153a6745f41 -extensions v3_req_client" returned: 0 in 0.256s {{(pid=128731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 19 14:41:15.564725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.processutils [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp91v0iif5/temp.key -password pass: {{(pid=128731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 19 14:41:15.603026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.processutils [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp91v0iif5/temp.key -password pass:" returned: 0 in 0.038s {{(pid=128731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 19 14:41:15.687691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:15.698591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Getting quotas for user 1a609a4a803e4b368e692153a6745f41 and project e3a4e78781ae40289411f6d63a2d053e. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:15.730654 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d07a3c8-dae9-4b71-9303-fc31aa839fe4 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.474262 Sep 19 14:41:15.732424 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 496/1033] 10.222.0.81 () {62 vars in 1198 bytes} [Mon Sep 19 14:41:15 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 477 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:15.743715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:15.744851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:15.754086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:15.755208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:15.756235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:15.757532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:15.759097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:15.759292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:15.907290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:15.943162 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41db9263-c7a6-4a91-8123-e6068db10ee1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.875149 Sep 19 14:41:15.955318 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 538/1034] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:15 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:15.985350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:15.986584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:16.006993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:16.009330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:16.011742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:16.017360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:16.018966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:16.020024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:16.541674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:16.559013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:16.563986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:16.595259 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe3c5e7c-d600-4b4b-80de-01921c150c9a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1486 microversion: 2.91 time: 0.635895 Sep 19 14:41:16.598902 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 539/1035] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:15 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1486 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:16.623285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:16.624113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:16.638560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:16.639785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:16.640929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:16.642094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:16.643420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:16.644447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:16.835159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:16.851854 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f90fddd2-0d99-412e-b938-0baa0b05da9d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.117143 Sep 19 14:41:16.853124 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 497/1036] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:15 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:16.865572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:16.867067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:16.883817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:16.885520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:16.886566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:16.888120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:16.889214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:16.890221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.098714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:17.133395 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-01365fe5-3c51-477e-85a9-5742b0e81ee7 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.532547 Sep 19 14:41:17.134556 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 540/1037] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:16 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.147312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-536f2d32-2c8d-418e-bbf9-313e4a63ad62 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29f7daf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:17.158237 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-536f2d32-2c8d-418e-bbf9-313e4a63ad62 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-1205350868" status: 200 len: 1534 microversion: 2.2 time: 0.021424 Sep 19 14:41:17.159415 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 541/1038] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Sep 19 14:41:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1205350868 => generated 1534 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.164587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fbffe0b4-adf7-41fa-9887-a4499453976e req-74872e7f-19ef-44ca-9df3-05aa550739ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d00bb9-7d71-471f-83f3-edc1c740d441", "name": "network-vif-plugged", "status": "completed", "tag": "8b9b59f5-8f84-4527-bdea-047c84c4a78b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:17.177005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fbffe0b4-adf7-41fa-9887-a4499453976e req-74872e7f-19ef-44ca-9df3-05aa550739ac service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.177686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fbffe0b4-adf7-41fa-9887-a4499453976e req-74872e7f-19ef-44ca-9df3-05aa550739ac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.178296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fbffe0b4-adf7-41fa-9887-a4499453976e req-74872e7f-19ef-44ca-9df3-05aa550739ac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.193713 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fbffe0b4-adf7-41fa-9887-a4499453976e req-74872e7f-19ef-44ca-9df3-05aa550739ac service nova] Creating event network-vif-plugged:8b9b59f5-8f84-4527-bdea-047c84c4a78b for instance 15d00bb9-7d71-471f-83f3-edc1c740d441 on n-h1-858384-1 Sep 19 14:41:17.200573 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fbffe0b4-adf7-41fa-9887-a4499453976e req-74872e7f-19ef-44ca-9df3-05aa550739ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039676 Sep 19 14:41:17.201233 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 542/1039] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:17.206973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ba3eeaf4-3aee-44fe-91ba-af3971202857 req-881a7fb8-1944-4990-936f-34144dfc81b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609d06b2-02f1-4a91-b2ce-7af7cb6dffb9", "tag": "cc1c0eb9-1e08-4a8f-a253-8dd08ebc0f1a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:17.218042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ba3eeaf4-3aee-44fe-91ba-af3971202857 req-881a7fb8-1944-4990-936f-34144dfc81b6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.218796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ba3eeaf4-3aee-44fe-91ba-af3971202857 req-881a7fb8-1944-4990-936f-34144dfc81b6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.219381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ba3eeaf4-3aee-44fe-91ba-af3971202857 req-881a7fb8-1944-4990-936f-34144dfc81b6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.232980 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ba3eeaf4-3aee-44fe-91ba-af3971202857 req-881a7fb8-1944-4990-936f-34144dfc81b6 service nova] Creating event network-changed:cc1c0eb9-1e08-4a8f-a253-8dd08ebc0f1a for instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 on n-h2-858384-1 Sep 19 14:41:17.239092 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ba3eeaf4-3aee-44fe-91ba-af3971202857 req-881a7fb8-1944-4990-936f-34144dfc81b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036248 Sep 19 14:41:17.239989 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 543/1040] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:17.245883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:17.246739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:17.254120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.254613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.255140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.255848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.256468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.256931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.309028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:17.319670 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc059e5b-9481-4588-8a82-d9535adfb3f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.464145 Sep 19 14:41:17.320917 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 498/1041] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:16 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.326291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-420dc2b6-6c41-46f3-a010-95d1e4e9a692 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde2a50f8b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:17.331464 n-d-858384-1 devstack@n-api.service[128731]: WARNING oslo_db.sqlalchemy.utils [None req-420dc2b6-6c41-46f3-a010-95d1e4e9a692 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 19 14:41:17.341003 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-420dc2b6-6c41-46f3-a010-95d1e4e9a692 tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.018670 Sep 19 14:41:17.341849 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 499/1042] 10.222.0.81 () {60 vars in 1177 bytes} [Mon Sep 19 14:41:17 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.352968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-002c7d1a-3565-420e-aa23-ef35cea415bb tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] Calling method '.version_select at 0x7fde29e3d430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:17.378667 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-002c7d1a-3565-420e-aa23-ef35cea415bb tempest-KeyPairsV22TestJSON-279048665 tempest-KeyPairsV22TestJSON-279048665-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205350868" status: 204 len: 0 microversion: 2.2 time: 0.029552 Sep 19 14:41:17.379367 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 500/1043] 10.222.0.81 () {60 vars in 1261 bytes} [Mon Sep 19 14:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205350868 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:17.619824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:17.628785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:17.630013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:17.631232 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a17d8c5a-e8a9-484c-9e9c-61462d050b3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.389950 Sep 19 14:41:17.632426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 544/1044] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:17 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.645732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.647187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.647938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.649446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.650891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.651683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.809767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:17.828182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:17.830853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:17.838233 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eb168c51-8f9d-4f3c-9846-8e6f69c7b281 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.214679 Sep 19 14:41:17.839589 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 501/1045] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:17 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:41:17.876253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:17.877213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:17.884859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.885543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.886160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:17.887007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:17.887564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:17.888086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.047439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5aece608-4f02-48cb-bd5a-f2ed23295d8a tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1136984553", "id": 1452512762, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:18.075070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5aece608-4f02-48cb-bd5a-f2ed23295d8a tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.160319 Sep 19 14:41:18.076487 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 502/1046] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:41:17 2022] POST /compute/v2.1/flavors => generated 468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:41:18.088667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:18.098347 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-209e1941-a980-473b-a9ba-31b7d48e6c1e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.225836 Sep 19 14:41:18.099110 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 545/1047] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:17 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:18.157823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.158454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:18.164630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.165392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.165862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.166797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.167263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.167693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.278713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2297f81c-be03-40f2-8288-304f09081e84 tempest-FlavorsV261TestJSON-1136212140 tempest-FlavorsV261TestJSON-1136212140-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.289149 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2297f81c-be03-40f2-8288-304f09081e84 tempest-FlavorsV261TestJSON-1136212140 tempest-FlavorsV261TestJSON-1136212140-project] 10.222.0.81 "GET /compute/v2.1/flavors/1452512762" status: 200 len: 468 microversion: 2.61 time: 0.198336 Sep 19 14:41:18.289799 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 503/1048] 10.222.0.81 () {60 vars in 1199 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/flavors/1452512762 => generated 468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:41:18.304763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e540d8c-c9da-4d97-987b-4260e922f9ee tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:18.315472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.337651 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e540d8c-c9da-4d97-987b-4260e922f9ee tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/1452512762" status: 200 len: 469 microversion: 2.61 time: 0.036789 Sep 19 14:41:18.338511 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 504/1049] 10.222.0.81 () {62 vars in 1219 bytes} [Mon Sep 19 14:41:18 2022] PUT /compute/v2.1/flavors/1452512762 => generated 469 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:41:18.353937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6131978e-4821-4dea-96fb-20659500c176 tempest-FlavorsV261TestJSON-1136212140 tempest-FlavorsV261TestJSON-1136212140-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.382702 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6131978e-4821-4dea-96fb-20659500c176 tempest-FlavorsV261TestJSON-1136212140 tempest-FlavorsV261TestJSON-1136212140-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.034157 Sep 19 14:41:18.396300 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 505/1050] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:41:18.396300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.396769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:18.404906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.405775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.406608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.407591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.408256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.408882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.431926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.507667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:18.518414 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc0ac398-2cd3-4620-9b83-d5670ca4ae02 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.364363 Sep 19 14:41:18.519718 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 546/1051] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:18.526625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-641de68f-0b9e-4a50-9ccc-4b0790050b8b tempest-FlavorsV261TestJSON-1136212140 tempest-FlavorsV261TestJSON-1136212140-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.557447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-641de68f-0b9e-4a50-9ccc-4b0790050b8b tempest-FlavorsV261TestJSON-1136212140 tempest-FlavorsV261TestJSON-1136212140-project] 10.222.0.81 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.035506 Sep 19 14:41:18.558287 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 547/1052] 10.222.0.81 () {60 vars in 1166 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:18.576594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-791639e2-43af-4ebb-a4e4-1f5f0b94f2a3 tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.597969 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-791639e2-43af-4ebb-a4e4-1f5f0b94f2a3 tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1452512762" status: 202 len: 0 microversion: 2.61 time: 0.026136 Sep 19 14:41:18.603671 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 548/1053] 10.222.0.81 () {60 vars in 1202 bytes} [Mon Sep 19 14:41:18 2022] DELETE /compute/v2.1/flavors/1452512762 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:18.610643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54d98ebf-34a3-4f39-90f2-5fb16d32b068 tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.638169 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54d98ebf-34a3-4f39-90f2-5fb16d32b068 tempest-FlavorsV261TestJSON-1459259016 tempest-FlavorsV261TestJSON-1459259016-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.031996 Sep 19 14:41:18.638782 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 549/1054] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:18.656281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.663974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:18.676888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.677381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.677816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.678542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.679037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.679616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.794273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:18.804829 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2cf43005-ddb9-4543-a41b-67b2e88914f5 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.420203 Sep 19 14:41:18.806090 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 506/1055] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:18.889554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:18.906601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:18.936902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.937935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.938897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.940098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:18.941868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:18.942627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:18.988904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:19.004091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e3571ffd-1f73-413a-9c15-df28fac1d024 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1315 microversion: 2.1 time: 0.349050 Sep 19 14:41:19.004851 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 550/1056] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:19.111083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:19.125360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:19.125986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:19.132932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:19.135884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:19.136377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:19.136820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:19.137550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:19.138017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:19.138453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:19.138902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:19.153691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e1d045e0-5601-42ac-81ef-747b18f8ef5d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.274695 Sep 19 14:41:19.157974 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 507/1057] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:18 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:41:19.527542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:19.544523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:19.551098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:19.553516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc43a437-0158-4874-b42b-2f1c013d236e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.432772 Sep 19 14:41:19.555213 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 551/1058] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:19 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:19.567553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:19.567553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:19.567553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:19.567553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:19.568713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:19.568713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:19.803919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:19.813839 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-10fdc32f-5b54-4493-b220-ba0decfc1610 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.273890 Sep 19 14:41:19.828286 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 508/1059] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:19 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:19.836627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:19.838617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:19.847339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:19.848159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:19.848625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:19.849923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:19.850589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:19.851395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.033737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:20.034805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:20.053899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.055018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.058291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.059967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.063197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.068718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.106238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:20.122296 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cccd3c0e-6b3e-4936-ba7d-9951887ac82b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.291902 Sep 19 14:41:20.125594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 552/1060] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:19 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:20.201649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:20.202646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:20.231261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.232426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.233200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.235392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.237200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.238222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.685283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:20.722027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:20.726848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:20.737225 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59833e1d-75e0-422a-aa41-19ec66f91af1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.557118 Sep 19 14:41:20.738496 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 553/1061] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:20 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:20.747034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:20.748176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:20.756962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.758111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.758801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.773628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.775789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.777961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.870533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:20.893043 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f304e04-6571-4fd5-8a86-29320863d138 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1465 microversion: 2.1 time: 0.866945 Sep 19 14:41:20.893662 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 509/1062] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:20 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1465 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:20.912879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:20.919587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:20.949967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.951221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.952105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:20.953384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:20.954298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:20.955270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:21.189249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:21.216241 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a94572d8-6370-4036-b0c9-c617a72ef753 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.476066 Sep 19 14:41:21.217531 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 554/1063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:20 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:21.238939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:21.240132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:21.247281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:21.248193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:21.248883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:21.249911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:21.250665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:21.251455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:21.427428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:21.446310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e3d6ea3-aab7-4ab2-8640-6a9edb57224b tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.537395 Sep 19 14:41:21.451625 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 510/1064] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:20 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:21.465257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:21.469731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:21.491102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:21.492615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:21.496550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:21.497732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:21.500715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:21.501564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:21.936201 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ebe4575-b615-4829-989c-b192d65669ae tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1616 microversion: 2.1 time: 0.706703 Sep 19 14:41:21.960122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 555/1065] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:21 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1616 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:21.968832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:21.969959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:21.978029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:21.979020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:21.979744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:21.980883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:21.981669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:21.982355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:22.193482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:22.206688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:22.216511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed713336-5bd4-4805-bc1e-d45e5603cf51 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.762661 Sep 19 14:41:22.219492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:22.220843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 511/1066] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:21 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:22.226168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:22.244807 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fedcc196-6037-4385-acd9-357c81f5dcdd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.279468 Sep 19 14:41:22.245668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:22.245892 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 556/1067] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:21 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:22.248324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:22.265734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:22.266912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:22.268707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:22.272893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:22.284484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:22.292801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1175241489", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c9085e40-1d2e-49e2-b258-cf1528c9877b"]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:22.299412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:22.454407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:41:23.284133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:23.298867 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46956c38-d09a-4b80-a9a7-2252dd868d99 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.061620 Sep 19 14:41:23.305107 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 512/1068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:22 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:23.307192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=19 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:23.312148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:23.313160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:23.332609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:23.333441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:23.335282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:23.335962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:23.337418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:23.345216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:23.348095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:23.348799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:23.349903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:23.352372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:23.357205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:23.365162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:23.372147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:23.372863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:23.374011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:23.374903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:23.375607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:23.439913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:23.469304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:23.506169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:41:23.510141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:41:23.583996 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-feb1052d-19e6-4217-90a3-dfa15eb4e1be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.296059 Sep 19 14:41:23.585382 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 557/1069] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:41:23.592907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:23.594226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:23.605116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:23.606091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:23.606791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:23.607762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:23.609432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:23.610634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:24.073559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:24.085127 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c95ed3aa-bdaa-4023-8fb8-3719bf4e6e89 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.778215 Sep 19 14:41:24.093721 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 513/1070] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:23 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:24.136408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:24.137054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:24.160660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:24.165009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:24.165943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:24.167099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:24.167838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:24.168504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:24.307434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:24.310940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:24.326222 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c77e539-cf41-4902-b56e-cb04e0133a6b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 0.735058 Sep 19 14:41:24.346023 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 558/1071] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:23 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:24.386462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d77b8b4-b437-4f9e-8d9a-f045e850d8ac tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:24.389758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d77b8b4-b437-4f9e-8d9a-f045e850d8ac tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:24.497134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:24.568401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:24.579549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:24.602432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e2c2e747-e5d5-420c-b03b-b69af264af96 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.492147 Sep 19 14:41:24.651166 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 514/1072] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:24 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:24.669763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:24.683067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:24.740573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:24.742384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:24.745717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:24.749841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:24.751214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:24.755158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:24.835758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d77b8b4-b437-4f9e-8d9a-f045e850d8ac tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:24.887227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d77b8b4-b437-4f9e-8d9a-f045e850d8ac tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1217 microversion: 2.1 time: 0.510312 Sep 19 14:41:24.891909 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 559/1073] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:24 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1217 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:25.126325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:25.127408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:25.204315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:25.205519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:25.223739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:25.225112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:25.226203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:25.226650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:25.269971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:25.283984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-544e757e-d098-4072-9a31-0c1da93039d3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.639989 Sep 19 14:41:25.287838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 515/1074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:24 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:25.371286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:25.376621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:25.418415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:25.419981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:25.421262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:25.431174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:25.437985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:25.443102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:25.715892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.239238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:26.254181 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad980627-9ead-45ea-b5ee-5d2ab54d1e61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 1.130222 Sep 19 14:41:26.256830 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 560/1075] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:25 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:26.295466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:26.296126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:26.330713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:26.332796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:26.334297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:26.340575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:26.341245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:26.342616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:26.744790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:26.759740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-937001a0-92e9-49fc-9b90-a24dc0b78181 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 1.403387 Sep 19 14:41:26.770850 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 516/1076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:25 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:26.780336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:26.780961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:26.792002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:26.804736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:26.815363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:26.822803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:26.825424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:26.830425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:26.832943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:26.841981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:26.843631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:26.849653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73af787f-7f22-4f58-88ce-7d840d8627a4 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.590103 Sep 19 14:41:26.859685 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 561/1077] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:26 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:26.877812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0cdf5604-4194-4ad4-85e0-56adf43e6a74 req-80e1627d-fbda-41d7-85c2-87222e66222a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609d06b2-02f1-4a91-b2ce-7af7cb6dffb9", "name": "network-vif-plugged", "status": "completed", "tag": "cc1c0eb9-1e08-4a8f-a253-8dd08ebc0f1a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:26.920766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0cdf5604-4194-4ad4-85e0-56adf43e6a74 req-80e1627d-fbda-41d7-85c2-87222e66222a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:26.925315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0cdf5604-4194-4ad4-85e0-56adf43e6a74 req-80e1627d-fbda-41d7-85c2-87222e66222a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:26.930812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0cdf5604-4194-4ad4-85e0-56adf43e6a74 req-80e1627d-fbda-41d7-85c2-87222e66222a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:27.008348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0cdf5604-4194-4ad4-85e0-56adf43e6a74 req-80e1627d-fbda-41d7-85c2-87222e66222a service nova] Creating event network-vif-plugged:cc1c0eb9-1e08-4a8f-a253-8dd08ebc0f1a for instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 on n-h2-858384-1 Sep 19 14:41:27.043187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0cdf5604-4194-4ad4-85e0-56adf43e6a74 req-80e1627d-fbda-41d7-85c2-87222e66222a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179128 Sep 19 14:41:27.045480 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 562/1078] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:27.073584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:27.092403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:27.116417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:27.124077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:27.124901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:27.129928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:27.141511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:27.149880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:27.252719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:27.290632 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70c32c68-904d-4ff3-abb2-d44d9c9ee655 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1269 microversion: 2.1 time: 0.528386 Sep 19 14:41:27.292616 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 517/1079] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:26 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1269 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:27.656897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8ea86e6-0cd0-47fe-8ea8-93631ca3dbd4 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:27.668364 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d8ea86e6-0cd0-47fe-8ea8-93631ca3dbd4 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8ea86e6-0cd0-47fe-8ea8-93631ca3dbd4 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin] Request method failure captured: Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-WW24sT0_RUOdh01sYxUoEs2E2xXm2iP8D8M445_9rYZBvWejf0rEtIzyptWnvMp_wokCwQVYAg_dr6FSkJwkr0E7GBUEAOl0ikyYK-BHviqKkTxFIRJ5mLDHO04oDDF9FX2LFaLwyamLPRkQzHViK8lxFji5VQ0Y8cUo6yMEsTMs Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e30452e604da4dd2bc6074f89e22b16b Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:41:27.686552 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e30452e604da4dd2bc6074f89e22b16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e30452e604da4dd2bc6074f89e22b16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e30452e604da4dd2bc6074f89e22b16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e30452e604da4dd2bc6074f89e22b16b"}]}] Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e30452e604da4dd2bc6074f89e22b16b Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 63e0b7e6b2b449588f221839066a42fd Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:27.688055 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid timestamp for date invalid_time Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'invalid_time'} Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:27.688775 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8ea86e6-0cd0-47fe-8ea8-93631ca3dbd4 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:27.690024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8ea86e6-0cd0-47fe-8ea8-93631ca3dbd4 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472 tempest-InstanceUsageAuditLogNegativeTestJSON-32347472-project-admin] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.392346 Sep 19 14:41:27.693308 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 518/1080] 10.222.0.81 () {58 vars in 1224 bytes} [Mon Sep 19 14:41:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 394 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:41:27.695865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:27.698821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:27.718376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:27.720083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:27.721997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:27.723316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:27.724186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:27.724642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:28.344778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:28.361085 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3d71408b-2820-48e6-bec6-b6959fb63735 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.670152 Sep 19 14:41:28.362125 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 519/1081] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:27 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:28.401463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:28.461576 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e320865-6328-4cbb-82f0-a42332411d46 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.409980 Sep 19 14:41:28.479605 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 563/1082] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:27 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:28.505106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:28.506553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:28.542366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:28.543558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:28.544363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:28.545664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:28.570459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:28.571343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:28.683965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1696419c-91b2-4ecf-b159-c09fcff67bee tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:28.687286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1696419c-91b2-4ecf-b159-c09fcff67bee tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '8971bac9478a4ad8a22d51af6b975b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9914c94a1be04a0592573a6ab9ce6638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1696419c-91b2-4ecf-b159-c09fcff67bee tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Request method failure captured: Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-U0rMoxytrDMl7EM-tux5h9zyQfpX8gWt0rUvxexc7qNNi8Tq0LRcRm5akns-o2WtrCK61r8zgwGL8Bwu-acztXfRg-u-2hWGiklPgmMSZT3RpZODCiukcoPKxq1d6qoHynm3i9DZ8erqvMbm4r8IXdTRFBAArzBTB0yPg4lscU94 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 9914c94a1be04a0592573a6ab9ce6638 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:28.691187 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9914c94a1be04a0592573a6ab9ce6638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9914c94a1be04a0592573a6ab9ce6638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9914c94a1be04a0592573a6ab9ce6638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9914c94a1be04a0592573a6ab9ce6638"}]}] Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 9914c94a1be04a0592573a6ab9ce6638 Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8971bac9478a4ad8a22d51af6b975b68 Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project Sep 19 14:41:28.693247 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:41:28.694232 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 19 14:41:28.696425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:28.700328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1696419c-91b2-4ecf-b159-c09fcff67bee tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:28.706513 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1696419c-91b2-4ecf-b159-c09fcff67bee tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.339826 Sep 19 14:41:28.713224 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 520/1083] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 14:41:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 349 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:28.732985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:28.734075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:28.761222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:28.765743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:28.767189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:28.771051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:28.771742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:28.779491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:29.563261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:29.571701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:29.576670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:29.593614 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba8e7a82-6085-4dc7-9df9-692461de21cd tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.879014 Sep 19 14:41:29.597992 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 521/1084] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:28 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:29.606305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:29.614690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:29.631738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:29.633458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:29.634110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:29.636172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:29.637884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:29.638563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:29.669272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:29.688227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7a3ce77-fe37-40bd-b2a7-a9a512964b8c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1472 microversion: 2.1 time: 1.206147 Sep 19 14:41:29.703872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 564/1085] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:28 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1472 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:29.736001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd03cafa-78d5-4260-ad10-40d6ea1e3894 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:29.741738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cd03cafa-78d5-4260-ad10-40d6ea1e3894 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '8971bac9478a4ad8a22d51af6b975b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9914c94a1be04a0592573a6ab9ce6638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd03cafa-78d5-4260-ad10-40d6ea1e3894 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Request method failure captured: Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-19%2014:41:28 HTTP/1.1 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-U0rMoxytrDMl7EM-tux5h9zyQfpX8gWt0rUvxexc7qNNi8Tq0LRcRm5akns-o2WtrCK61r8zgwGL8Bwu-acztXfRg-u-2hWGiklPgmMSZT3RpZODCiukcoPKxq1d6qoHynm3i9DZ8erqvMbm4r8IXdTRFBAArzBTB0yPg4lscU94 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 9914c94a1be04a0592573a6ab9ce6638 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:29.747496 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9914c94a1be04a0592573a6ab9ce6638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9914c94a1be04a0592573a6ab9ce6638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9914c94a1be04a0592573a6ab9ce6638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9914c94a1be04a0592573a6ab9ce6638"}]}] Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 9914c94a1be04a0592573a6ab9ce6638 Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8971bac9478a4ad8a22d51af6b975b68 Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project Sep 19 14:41:29.750257 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2022-09-19 14:41:28'} Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:41:29.753430 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 19 14:41:29.758884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:29.765976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd03cafa-78d5-4260-ad10-40d6ea1e3894 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:29.767894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:29.772460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd03cafa-78d5-4260-ad10-40d6ea1e3894 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383 tempest-InstanceUsageAuditLogNegativeTestJSON-2049368383-project] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-19 14:41:28" status: 403 len: 128 microversion: 2.1 time: 0.061906 Sep 19 14:41:29.774015 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 565/1086] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 14:41:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-19%2014%3A41%3A28 => generated 128 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:29.796683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a856f6e-eac2-4a88-a228-15a6aa38d1c1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1269 microversion: 2.1 time: 0.191286 Sep 19 14:41:29.803414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:29.804661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:29.805285 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 522/1087] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:29 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1269 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:29.822771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:29.823712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:29.861845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:29.863390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:29.865530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:29.868554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:29.871122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:29.873052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:29.880911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:29.892911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:29.893873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:29.898015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:29.911580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:29.919614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.576932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:30.590365 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f979b8a-26b9-4b3c-8498-542f67f2cce7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.783702 Sep 19 14:41:30.595965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:30.605935 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 523/1088] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:29 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:30.607314 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b42c1b1-b7ca-46c6-98af-8ba92cbb2b12 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1322 microversion: 2.1 time: 0.829205 Sep 19 14:41:30.608614 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 566/1089] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:29 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1322 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:30.630271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:30.631571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:30.649431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:30.650842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:30.653098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.655134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:30.656251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:30.657497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.740571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:30.742071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:30.756158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:30.757830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:30.761544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.765227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:30.765227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:30.765227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.836007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:30.859667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:30.864665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:30.880606 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a576a4c1-f178-44a2-b477-420cf5e3dd50 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.254654 Sep 19 14:41:30.914639 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 524/1090] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:30 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:30.936913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:30.940404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:30.968614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:30.969136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:30.969581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.970344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:30.970854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:30.972595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:30.991694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.245454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:31.283356 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37d95734-27d1-4ce1-9b03-a0109fb281ef tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1275 microversion: 2.1 time: 0.364240 Sep 19 14:41:31.289870 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 525/1091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:30 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1275 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:31.462053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:31.483385 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-424b6417-b082-4ced-ab29-479019f78edf tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1478 microversion: 2.1 time: 0.744675 Sep 19 14:41:31.491048 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 567/1092] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:30 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1478 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:31.637722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:31.659826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:31.668189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:31.676231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:31.711928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:31.715200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:31.725356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:31.730952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:31.732288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:31.733703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:31.737255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:31.739142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:31.748112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:31.757246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:31.764647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:31.766058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:33.359321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:33.370568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:33.375226 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c95fb1f-f814-4f41-b945-9ddb42a45681 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1471 microversion: 2.1 time: 1.724422 Sep 19 14:41:33.376342 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 568/1093] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:31 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1471 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:33.394401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:33.396037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:33.428799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:33.446506 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b969431-d83c-4361-9a5e-99a0c9f7f1c1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 1.815740 Sep 19 14:41:33.449786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:33.450653 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 526/1094] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:31 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:33.462297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:33.477813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:33.489480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:33.490274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:33.499572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:33.517356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:33.518889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:33.544047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:33.559017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:33.560197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:33.561834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:33.572559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:33.583972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.003383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:34.020986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:34.027595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:34.059558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:34.068460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-192403c2-7a70-44a8-a3d0-aa61f57c0e84 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.689752 Sep 19 14:41:34.074565 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 569/1095] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:33 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:34.090013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:34.095597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:34.112612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:34.123331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:34.128180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:34.133756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.137553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:34.157557 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3d54198-6d72-4a08-b7a6-1e6347ccfef2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1275 microversion: 2.1 time: 0.697932 Sep 19 14:41:34.157795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:34.157974 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 527/1096] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:33 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1275 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:34.168352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.183153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:34.184005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:34.209827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:34.211619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:34.212297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.214957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:34.215641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:34.216263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.293598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lazy-loading 'flavor' on Instance uuid 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:41:34.436118 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f17ba19-4b85-443b-90ad-f6884c3324f8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9/action" status: 202 len: 0 microversion: 2.1 time: 0.278539 Sep 19 14:41:34.441449 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 528/1097] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:34 2022] POST /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:34.481940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:34.486498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:34.532798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:34.533971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:34.545029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.554734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:34.558882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:34.561048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:34.852440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.737191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:35.761800 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa26e126-1cd9-4f5c-8808-811ac8443600 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1478 microversion: 2.1 time: 1.681018 Sep 19 14:41:35.773655 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 570/1098] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:34 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1478 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:36.447709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c638b6a7-044c-44a4-9cdf-17d24cefefaa tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d62c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-144017423", "description": "tempest-description-1086390909"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:37.061544 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7ce2d48d-9440-4fb2-8659-d5037f24ffa2 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1630 microversion: 2.1 time: 2.616141 Sep 19 14:41:37.069742 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 529/1099] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:34 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1630 bytes in 2627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:37.081156 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c638b6a7-044c-44a4-9cdf-17d24cefefaa tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.305887 Sep 19 14:41:37.091912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:37.092914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:37.100460 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 571/1100] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:41:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:37.113742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.114251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.117451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c4d7fa68-c360-42c8-a58c-55e2e57148ce req-9775baf9-68d5-4a1c-89d7-336825e77892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "name": "network-vif-unplugged", "status": "completed", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:37.118064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.122263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.123566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.124189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.145464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4d7fa68-c360-42c8-a58c-55e2e57148ce req-9775baf9-68d5-4a1c-89d7-336825e77892 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.147757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4d7fa68-c360-42c8-a58c-55e2e57148ce req-9775baf9-68d5-4a1c-89d7-336825e77892 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.155586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4d7fa68-c360-42c8-a58c-55e2e57148ce req-9775baf9-68d5-4a1c-89d7-336825e77892 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.183187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c4d7fa68-c360-42c8-a58c-55e2e57148ce req-9775baf9-68d5-4a1c-89d7-336825e77892 service nova] Creating event network-vif-unplugged:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:41:37.194494 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c4d7fa68-c360-42c8-a58c-55e2e57148ce req-9775baf9-68d5-4a1c-89d7-336825e77892 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091934 Sep 19 14:41:37.195682 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 572/1101] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:37.205122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:37.207305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:37.215958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.217296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.217951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.219253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.219939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.222644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.418069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:37.429773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:37.446683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:37.462141 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a61353f-c8f6-40f6-8950-6543dd80bb4a tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.264940 Sep 19 14:41:37.464130 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 573/1102] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:37 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:37.477174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:37.479698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:37.490363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.491153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.491599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.501068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.501579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.502225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.699940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:37.720199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-22196d9d-558b-4264-938d-4a38ce1a1dbe tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1719 microversion: 2.1 time: 0.640514 Sep 19 14:41:37.735092 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 530/1103] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:37 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1719 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:37.743095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:37.749099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:37.756630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.757426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.758036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.758978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:37.760196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:37.761156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:37.939135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:37.951297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d6df084-a71f-4fd4-b071-b0d38bb237a1 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.482941 Sep 19 14:41:37.952601 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 574/1104] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:37 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:37.962204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d0bdf2f-c305-419d-821d-8556e2a66a63 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29de4d30>, body: {"security_group_rule": {"parent_group_id": "226ad335-c1b0-4183-8c4b-f9ca3426d143", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:38.135282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:38.154293 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ec024b8-4bee-4ad8-b574-66599064ee3c tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1478 microversion: 2.1 time: 0.416167 Sep 19 14:41:38.170782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 531/1105] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:37 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1478 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:38.198452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d5e73e74-7d7d-4fbd-8acc-ba1d70df8fbe req-9a0e902b-6f8f-4eed-81e7-035a23f3aa36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "456ef8bb-1f6e-4d2d-954d-b23bc0ef569f", "tag": "56598dac-a090-4016-ba8e-0c5ebf68092a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:38.223265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d5e73e74-7d7d-4fbd-8acc-ba1d70df8fbe req-9a0e902b-6f8f-4eed-81e7-035a23f3aa36 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.224867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d5e73e74-7d7d-4fbd-8acc-ba1d70df8fbe req-9a0e902b-6f8f-4eed-81e7-035a23f3aa36 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.226099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d5e73e74-7d7d-4fbd-8acc-ba1d70df8fbe req-9a0e902b-6f8f-4eed-81e7-035a23f3aa36 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.251163 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d5e73e74-7d7d-4fbd-8acc-ba1d70df8fbe req-9a0e902b-6f8f-4eed-81e7-035a23f3aa36 service nova] Creating event network-changed:56598dac-a090-4016-ba8e-0c5ebf68092a for instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f on n-h1-858384-1 Sep 19 14:41:38.269604 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d5e73e74-7d7d-4fbd-8acc-ba1d70df8fbe req-9a0e902b-6f8f-4eed-81e7-035a23f3aa36 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098082 Sep 19 14:41:38.271868 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 532/1106] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:38.282125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:38.283744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:38.297938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.300642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.301733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.303243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.304333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.305794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.467323 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d0bdf2f-c305-419d-821d-8556e2a66a63 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.510215 Sep 19 14:41:38.480710 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 575/1107] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:38.521679 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0b7ab1d-820f-47b5-8ffc-9fa8e9acbb92 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1613 microversion: 2.1 time: 0.247665 Sep 19 14:41:38.522667 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 533/1108] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:38 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:38.527744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-007a045f-c517-47f2-a441-08174bf77138 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29dd68b0>, body: {"security_group_rule": {"parent_group_id": "226ad335-c1b0-4183-8c4b-f9ca3426d143", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:38.640293 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-007a045f-c517-47f2-a441-08174bf77138 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: This rule already exists in group 226ad335-c1b0-4183-8c4b-f9ca3426d143 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-007a045f-c517-47f2-a441-08174bf77138 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 138 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:38.643522 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: {"security_group_rule": {"parent_group_id": "226ad335-c1b0-4183-8c4b-f9ca3426d143", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 19 14:41:38.645290 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: exception: This rule already exists in group 226ad335-c1b0-4183-8c4b-f9ca3426d143 Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'security_group_rule': {'parent_group_id': '226ad335-c1b0-4183-8c4b-f9ca3426d143', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 226ad335-c1b0-4183-8c4b-f9ca3426d143 Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:38.646263 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 226ad335-c1b0-4183-8c4b-f9ca3426d143 Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 226ad335-c1b0-4183-8c4b-f9ca3426d143 Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.647853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-007a045f-c517-47f2-a441-08174bf77138 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 400 to user: This rule already exists in group 226ad335-c1b0-4183-8c4b-f9ca3426d143 {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:38.653208 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-007a045f-c517-47f2-a441-08174bf77138 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.122107 Sep 19 14:41:38.653208 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 534/1109] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:41:38.658227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:38.659744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:38.678179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.678695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.679196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.679922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.680388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.680819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.752653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b28f6a2-f470-4ede-8580-c371f53736b9 tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] Calling method '.version_select at 0x7fde29dcf0d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:38.776811 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b28f6a2-f470-4ede-8580-c371f53736b9 tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.293930 Sep 19 14:41:38.779663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 576/1110] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 14:41:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:38.791593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:38.795803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:38.805851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:38.809589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.810452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.811116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.811979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.812726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.813353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.824617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:38.826122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:38.834614 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9e03b55-dcee-4b29-82e3-9e01a7f40a3d tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.184978 Sep 19 14:41:38.846046 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 535/1111] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:38 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:38.863579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08066d33-4354-4ef3-a300-3f81084fd1c6 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29dfc280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:38.914689 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] HTTP exception thrown: Cannot 'migrate' instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 while it is in vm_state suspended Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Request method failure captured: Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9/action HTTP/1.1 Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH9m3rLJK_klA6IFt77dd9yIjBwQwLAT8YVIZt-wNjJ8PSHrovZdfA-BhgYiJKMFRAyypa7_Xt9Nt6U3ivRtyMfClDYFugZyfW8VLggf9PzpgfviVlomjSCAmBJF1RtkBaMgKMnwycuUSdFYhqLCiPqw_3_4oJFd4iuoAagHMVXFD5I Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:41:38.917836 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8837ae3f574dc2a9bb507a2f2c416d"}]}] Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abd1eb70579f43f0be2d597ad0b1955e Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: {"migrate": {}} Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:38.920705 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'migrate' instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 while it is in vm_state suspended Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '609d06b2-02f1-4a91-b2ce-7af7cb6dffb9', 'body': {'migrate': {}}} Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 in vm_state suspended. Cannot resize while the instance is in this state. Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.922121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 while it is in vm_state suspended Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:38.926624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 while it is in vm_state suspended Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Returning 409 to user: Cannot 'migrate' instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 while it is in vm_state suspended {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a4ea1e3-706a-4903-81a6-d013f0ad2dd8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9/action" status: 409 len: 148 microversion: 2.1 time: 0.138410 Sep 19 14:41:38.928590 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 577/1112] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:38 2022] POST /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9/action => generated 148 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:41:38.929753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:38.930318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:38.939087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.939732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.941380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:38.942900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:38.943795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:38.944589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:39.283892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08066d33-4354-4ef3-a300-3f81084fd1c6 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-group-rules/68bca786-a51c-4e33-902d-c99164767efd" status: 202 len: 0 microversion: 2.1 time: 0.435777 Sep 19 14:41:39.291719 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 536/1113] 10.222.0.81 () {58 vars in 1287 bytes} [Mon Sep 19 14:41:38 2022] DELETE /compute/v2.1/os-security-group-rules/68bca786-a51c-4e33-902d-c99164767efd => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:39.298704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:39.306872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20800e0a-f667-451e-b8be-72de77047887 tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] Action: 'update', calling method: .version_select at 0x7fde29dfc820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:39.313068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d4925eb-9615-4746-9f13-df4ab5cc3042 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1709 microversion: 2.1 time: 0.390496 Sep 19 14:41:39.320866 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 578/1114] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:38 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1709 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:39.340475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b298d5c-1ece-4d2f-8725-879e87e72ad8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b298d5c-1ece-4d2f-8725-879e87e72ad8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Request method failure captured: Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141/action HTTP/1.1 Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 39 Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH9m3rLJK_klA6IFt77dd9yIjBwQwLAT8YVIZt-wNjJ8PSHrovZdfA-BhgYiJKMFRAyypa7_Xt9Nt6U3ivRtyMfClDYFugZyfW8VLggf9PzpgfviVlomjSCAmBJF1RtkBaMgKMnwycuUSdFYhqLCiPqw_3_4oJFd4iuoAagHMVXFD5I Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:41:39.358721 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8837ae3f574dc2a9bb507a2f2c416d"}]}] Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abd1eb70579f43f0be2d597ad0b1955e Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: {"os-resetState": {"state": "invalid"}} Sep 19 14:41:39.360509 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6d2cd608-9f79-4b8e-a65e-f2cf48304141', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'invalid' Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:39.361437 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:41:39.363419 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 19 14:41:39.365811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:39.366431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b298d5c-1ece-4d2f-8725-879e87e72ad8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:39.368561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b298d5c-1ece-4d2f-8725-879e87e72ad8 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141/action" status: 400 len: 144 microversion: 2.1 time: 0.043052 Sep 19 14:41:39.371913 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 579/1115] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:39 2022] POST /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141/action => generated 144 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:41:39.389444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:39.390232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:39.400578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:39.401378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:39.402313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:39.404011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:39.412280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:39.412280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:39.576885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=8,nova_api:INSERT=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:39.700412 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20800e0a-f667-451e-b8be-72de77047887 tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.406677 Sep 19 14:41:39.702102 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 537/1116] 10.222.0.81 () {60 vars in 1206 bytes} [Mon Sep 19 14:41:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:39.707485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:39.709050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:39.718618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:39.719220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:39.719662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:39.720392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:39.720867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:39.721302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.253798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:40.278415 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d572db9-7fff-4768-a391-6c30fb5b402c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.898658 Sep 19 14:41:40.303013 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 580/1117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:39 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:40.320504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fc97b26d-3cae-40df-947d-bfeb013737ac req-6603972f-a496-40da-a131-e1870688f659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "name": "network-vif-plugged", "status": "completed", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:40.336862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc97b26d-3cae-40df-947d-bfeb013737ac req-6603972f-a496-40da-a131-e1870688f659 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:40.338264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc97b26d-3cae-40df-947d-bfeb013737ac req-6603972f-a496-40da-a131-e1870688f659 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:40.342324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc97b26d-3cae-40df-947d-bfeb013737ac req-6603972f-a496-40da-a131-e1870688f659 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.375034 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fc97b26d-3cae-40df-947d-bfeb013737ac req-6603972f-a496-40da-a131-e1870688f659 service nova] Creating event network-vif-plugged:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:41:40.388596 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fc97b26d-3cae-40df-947d-bfeb013737ac req-6603972f-a496-40da-a131-e1870688f659 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082938 Sep 19 14:41:40.389817 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 581/1118] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:40.417493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14afecdf-452f-4930-b4c5-9790d84f9a2f tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d1e040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1242270533", "description": "tempest-description-963456211"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:40.425838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:40.467662 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-363e3702-cd10-4295-b015-5e34c9e900f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1478 microversion: 2.1 time: 0.763956 Sep 19 14:41:40.469292 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 538/1119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:39 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1478 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:40.489289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-005cd770-cc3a-4265-8466-62c1fe52b3f4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '.version_select at 0x7fde29d79280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:40.512442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-005cd770-cc3a-4265-8466-62c1fe52b3f4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:40.513301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-005cd770-cc3a-4265-8466-62c1fe52b3f4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:40.514261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-005cd770-cc3a-4265-8466-62c1fe52b3f4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.579219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-005cd770-cc3a-4265-8466-62c1fe52b3f4 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1936 microversion: 2.1 time: 0.107808 Sep 19 14:41:40.580136 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 539/1120] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:41:40 2022] GET /compute/v2.1/os-migrations => generated 1936 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:40.602548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e42ac30-7e32-45a3-9db7-e725d3fb4c54 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e42ac30-7e32-45a3-9db7-e725d3fb4c54 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Request method failure captured: Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141/action HTTP/1.1 Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 31 Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9m3rLJK_klA6IFt77dd9yIjBwQwLAT8YVIZt-wNjJ8PSHrovZdfA-BhgYiJKMFRAyypa7_Xt9Nt6U3ivRtyMfClDYFugZyfW8VLggf9PzpgfviVlomjSCAmBJF1RtkBaMgKMnwycuUSdFYhqLCiPqw_3_4oJFd4iuoAagHMVXFD5I Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:41:40.623024 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8837ae3f574dc2a9bb507a2f2c416d"}]}] Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abd1eb70579f43f0be2d597ad0b1955e Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: {"os-resetState": {"state": 1}} Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:40.625555 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6d2cd608-9f79-4b8e-a65e-f2cf48304141', 'body': {'os-resetState': {'state': 1}}} Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 1 Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:40.627157 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 19 14:41:40.631733 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:40.634160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e42ac30-7e32-45a3-9db7-e725d3fb4c54 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:40.634160 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e42ac30-7e32-45a3-9db7-e725d3fb4c54 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141/action" status: 400 len: 120 microversion: 2.1 time: 0.043705 Sep 19 14:41:40.634160 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 540/1121] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:40 2022] POST /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141/action => generated 120 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:41:40.654108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2196a28e-5fac-45c0-b0db-4dabedfdc704 tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] Calling method '.version_select at 0x7fde29d9ac10>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:40.725470 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2196a28e-5fac-45c0-b0db-4dabedfdc704 tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.089920 Sep 19 14:41:40.727719 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 541/1122] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 14:41:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:40.739961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:40.742211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:40.767412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:40.768283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:40.785605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.793062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:40.796718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:40.797503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.904271 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14afecdf-452f-4930-b4c5-9790d84f9a2f tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.512109 Sep 19 14:41:40.905168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 582/1123] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:41:40 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:40.920092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:40.921196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:40.938994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:40.939703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:40.939881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.940598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:40.941047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:40.941973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:40.981794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:40.995840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:40.997453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:41.003284 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e794f47-75d7-442d-a92a-79d872d5e3c0 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.273774 Sep 19 14:41:41.004101 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 542/1124] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:40 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:41.022836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d990f762-3d35-41bd-b696-ff296ed7c9c5 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:41.026026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d990f762-3d35-41bd-b696-ff296ed7c9c5 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Failed to fetch instance by id 999 {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 14:41:41.026436 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d990f762-3d35-41bd-b696-ff296ed7c9c5 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d990f762-3d35-41bd-b696-ff296ed7c9c5 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Request method failure captured: Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 37 Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9m3rLJK_klA6IFt77dd9yIjBwQwLAT8YVIZt-wNjJ8PSHrovZdfA-BhgYiJKMFRAyypa7_Xt9Nt6U3ivRtyMfClDYFugZyfW8VLggf9PzpgfviVlomjSCAmBJF1RtkBaMgKMnwycuUSdFYhqLCiPqw_3_4oJFd4iuoAagHMVXFD5I Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:41:41.028421 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8837ae3f574dc2a9bb507a2f2c416d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8837ae3f574dc2a9bb507a2f2c416d"}]}] Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1a8837ae3f574dc2a9bb507a2f2c416d Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-284761641 Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abd1eb70579f43f0be2d597ad0b1955e Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAdminNegativeTestJSON-284761641-project-admin Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: {"os-resetState": {"state": "error"}} Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:41.029808 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 999 could not be found. Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:41.030616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d990f762-3d35-41bd-b696-ff296ed7c9c5 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:41.032574 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d990f762-3d35-41bd-b696-ff296ed7c9c5 tempest-ServersAdminNegativeTestJSON-284761641 tempest-ServersAdminNegativeTestJSON-284761641-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.024780 Sep 19 14:41:41.033579 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 543/1125] 10.222.0.81 () {60 vars in 1179 bytes} [Mon Sep 19 14:41:41 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:41:41.035935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7482858e-cee7-4ac4-aada-52f592d23cfd tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a50f8b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:41.231080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7482858e-cee7-4ac4-aada-52f592d23cfd tempest-QuotaClassesAdminTestJSON-1345481931 tempest-QuotaClassesAdminTestJSON-1345481931-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.199506 Sep 19 14:41:41.231872 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 544/1126] 10.222.0.81 () {60 vars in 1206 bytes} [Mon Sep 19 14:41:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:41.237130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a99878d9-17cb-4fd7-8919-497c802dfc8e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d79b80>, body: {"security_group_rule": {"parent_group_id": "18d8f9ad-a35b-4ec3-9023-0327d89d9042", "ip_protocol": "tcp", "from_port": 1291284368, "to_port": 22}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:41.256836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-352dae12-15a4-437d-8d1b-86c249b2584e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1860 microversion: 2.1 time: 0.350031 Sep 19 14:41:41.259772 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 583/1127] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:40 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1860 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:41.271178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:41.272348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:41.289306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.290311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.291706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.292789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.293491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.294233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.304538 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a99878d9-17cb-4fd7-8919-497c802dfc8e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Invalid port range 1291284368:22. Former value cannot be greater than the later Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a99878d9-17cb-4fd7-8919-497c802dfc8e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 146 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:41.307638 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: {"security_group_rule": {"parent_group_id": "18d8f9ad-a35b-4ec3-9023-0327d89d9042", "ip_protocol": "tcp", "from_port": 1291284368, "to_port": 22}} Sep 19 14:41:41.310897 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid port range 1291284368:22. Former value cannot be greater than the later Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'security_group_rule': {'parent_group_id': '18d8f9ad-a35b-4ec3-9023-0327d89d9042', 'ip_protocol': 'tcp', 'from_port': 1291284368, 'to_port': 22}}} Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1291284368:22. Former value cannot be greater than the later Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:41.314029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1291284368:22. Former value cannot be greater than the later Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1291284368:22. Former value cannot be greater than the later Sep 19 14:41:41.316851 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.320583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a99878d9-17cb-4fd7-8919-497c802dfc8e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 400 to user: Invalid port range 1291284368:22. Former value cannot be greater than the later {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:41.320583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a99878d9-17cb-4fd7-8919-497c802dfc8e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.076207 Sep 19 14:41:41.320583 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 545/1128] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:41 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:41:41.321234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:41.321495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:41.328775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.329499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.330109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.331005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.331632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.332444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.358111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:41:41.369750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:41.497540 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e125baa9-25f4-472b-8379-0317270dc087 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "DELETE /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 204 len: 0 microversion: 2.1 time: 0.235037 Sep 19 14:41:41.498165 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 584/1129] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:41:41 2022] DELETE /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:41.503699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:41.504418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:41.512225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.512998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.513429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.514304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.515121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.515552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.582011 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9bc5f187-f443-4c02-9997-50325183b9ec tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1860 microversion: 2.1 time: 0.266610 Sep 19 14:41:41.583002 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 546/1130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:41 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1860 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:41.588452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2cad4c1-746e-4759-8562-af97ade78494 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d79940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-416156023", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:41.590551 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f2cad4c1-746e-4759-8562-af97ade78494 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Security group id should be uuid Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2cad4c1-746e-4759-8562-af97ade78494 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 130 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:41.591986 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-416156023", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:41:41.593440 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group id should be uuid Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-416156023', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:41.594262 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 19 14:41:41.595599 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:41.597214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2cad4c1-746e-4759-8562-af97ade78494 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 400 to user: Security group id should be uuid {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:41.598062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2cad4c1-746e-4759-8562-af97ade78494 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.013985 Sep 19 14:41:41.598622 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 547/1131] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:41 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:41:41.605222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:41.606031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:41.616638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.617264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.617709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.618431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.619619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.620016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.777656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:41.789171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf6f0674-4b24-4b68-ac71-798b79009c16 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.289674 Sep 19 14:41:41.790144 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 585/1132] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:41 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:41.811997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:41.813803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:41.822786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.823555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.824098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.825102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:41.825662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:41.826213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:41.828770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:41.838297 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06833e8b-7422-4e0e-bee7-b765a435c64e tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1478 microversion: 2.1 time: 0.237864 Sep 19 14:41:41.848506 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 548/1133] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:41 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1478 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:41.855016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04d90ce7-4f4a-4f70-b36c-70e5aa276b41 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29da0550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1195754828", "description": "tempest-description-1690764533"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:42.076813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:42.097416 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cdd1bc6d-cf28-4005-b9a2-f703191c48a9 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1468 microversion: 2.1 time: 0.291827 Sep 19 14:41:42.111789 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 586/1134] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:41 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:42.122472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:42.123634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:42.131101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.132109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.132984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.134071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.134938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.135844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.141387 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04d90ce7-4f4a-4f70-b36c-70e5aa276b41 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.291431 Sep 19 14:41:42.142232 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 549/1135] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:41:41 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:42.155019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:42.156396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:42.163945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.165131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.166332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.167778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.168404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.168989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.319969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:42.328520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lazy-loading 'services' on Instance uuid 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:41:42.339508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:42.340853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:42.356547 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bdbba453-fd24-4b22-83d1-b4f3d1e544d8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1544 microversion: 2.91 time: 0.211685 Sep 19 14:41:42.358781 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 550/1136] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:42 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:42.365535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-113fc563-0b17-4199-ae7f-5af0fc44bee1 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29f9da60>, body: {"security_group_rule": {"parent_group_id": "a760c7ff-fe58-4c1f-9eef-d0579b3f0163", "ip_protocol": "tempest-999-1977334684", "from_port": 22, "to_port": 22}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:42.535725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-113fc563-0b17-4199-ae7f-5af0fc44bee1 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Invalid IP protocol tempest-999-1977334684. Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-113fc563-0b17-4199-ae7f-5af0fc44bee1 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 157 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:42.539905 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: {"security_group_rule": {"parent_group_id": "a760c7ff-fe58-4c1f-9eef-d0579b3f0163", "ip_protocol": "tempest-999-1977334684", "from_port": 22, "to_port": 22}} Sep 19 14:41:42.542449 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid IP protocol tempest-999-1977334684. Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a760c7ff-fe58-4c1f-9eef-d0579b3f0163', 'ip_protocol': 'tempest-999-1977334684', 'from_port': 22, 'to_port': 22}}} Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1977334684. Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:42.543676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1977334684. Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1977334684. Sep 19 14:41:42.544882 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:42.546965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-113fc563-0b17-4199-ae7f-5af0fc44bee1 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 400 to user: Invalid IP protocol tempest-999-1977334684. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:42.546965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-113fc563-0b17-4199-ae7f-5af0fc44bee1 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.182808 Sep 19 14:41:42.546965 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 551/1137] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:42 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:41:42.558106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdf09953-f0aa-480a-ad0a-fcf40973a252 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29dfc940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-11950501", "description": "tempest-description-1176239708"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:42.633979 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62be8b09-f712-4cf1-b0b0-e3d139b816d1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments/6201d369-0b7b-4d88-87bf-266491387356" status: 202 len: 0 microversion: 2.1 time: 0.518919 Sep 19 14:41:42.636340 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 587/1138] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 14:41:42 2022] DELETE /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments/6201d369-0b7b-4d88-87bf-266491387356 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:42.654780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:42.659769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:42.675384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.677525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.678933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.683116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.684694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.686811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.762038 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ad12694-0a60-4c57-b609-d1d9ed905276 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118636 Sep 19 14:41:42.763613 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 588/1139] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:42 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:42.830301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:42.830856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:42.839454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.840656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.842200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:42.843668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:42.844939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:42.847420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.166709 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdf09953-f0aa-480a-ad0a-fcf40973a252 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.613690 Sep 19 14:41:43.172354 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 552/1140] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:41:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:41:43.178161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:43.179131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:43.203350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.203890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.204307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.205108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.205572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.206011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.242127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.585780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:43.594442 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9ed33be7-93e1-478e-acd5-081df6cf05bc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.768131 Sep 19 14:41:43.595757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 589/1141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:42 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:43.615223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:43.615223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:43.617453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.618395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.620498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.622285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.623558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.624565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.719449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:43.732542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f6ed588-8850-4885-9fef-5a1d4034c091 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1478 microversion: 2.1 time: 0.557777 Sep 19 14:41:43.733472 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 553/1142] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:43 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1478 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:43.739999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b2b3f5d-9152-4999-ac0c-ee58a5d62353 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d6a550>, body: {"security_group_rule": {"parent_group_id": "187bf78e-787c-4adc-bddb-fac8d259b60e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:43.842300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1b2b3f5d-9152-4999-ac0c-ee58a5d62353 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b2b3f5d-9152-4999-ac0c-ee58a5d62353 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 138 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:43.844885 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: {"security_group_rule": {"parent_group_id": "187bf78e-787c-4adc-bddb-fac8d259b60e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 19 14:41:43.847365 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'security_group_rule': {'parent_group_id': '187bf78e-787c-4adc-bddb-fac8d259b60e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:43.848816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 19 14:41:43.851681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:43.855519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b2b3f5d-9152-4999-ac0c-ee58a5d62353 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:43.856606 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1b2b3f5d-9152-4999-ac0c-ee58a5d62353 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.121995 Sep 19 14:41:43.857538 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 554/1143] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:43 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:41:43.862804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:43.863410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:43.867616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:43.872446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.873094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.873373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.874087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.874547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.875186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.879398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-44a15878-f948-427e-b2ca-c245a0b88504 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1468 microversion: 2.1 time: 0.282222 Sep 19 14:41:43.880094 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 590/1144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:43 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:43.886249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:43.888743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:43.895026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.895595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.896268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.897054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:43.897582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:43.898197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:43.933585 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9cfd2595-5d8e-4b1f-b638-2bd5e22b6119 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052021 Sep 19 14:41:43.940212 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 591/1145] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:43 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:43.940212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a77e12db-112e-4ab1-8ea5-5d49a0723092 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d5b790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-278879552", "description": "tempest-description-629831267"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:44.057144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:44.079355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:44.083579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:44.096661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7ddbf092-c56e-4c04-969a-617e086503d1 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1531 microversion: 2.91 time: 0.237411 Sep 19 14:41:44.098261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 555/1146] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:43 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1531 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:44.124838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:44.125719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:44.135506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.136439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.137110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.138151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.138919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.139413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.350182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] Lazy-loading 'services' on Instance uuid 18e172dc-fe01-426d-bcaf-51f504be487b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:41:44.416910 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c63a19e1-b104-4709-a8d6-25b415cb2890 tempest-UnshelveToHostMultiNodesTest-672767786 tempest-UnshelveToHostMultiNodesTest-672767786-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1936 microversion: 2.91 time: 0.295002 Sep 19 14:41:44.418304 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 556/1147] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:44 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1936 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:41:44.524019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:44.528095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:44.539550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.541138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.541923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.542986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.544457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.545189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.589860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:41:44.614002 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a77e12db-112e-4ab1-8ea5-5d49a0723092 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.678277 Sep 19 14:41:44.614621 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 592/1148] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:41:43 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:44.628864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b89fcbf1-72be-475b-9770-a4b847f4982e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29d1e1f0>, body: {"security_group_rule": {"parent_group_id": "b96a4c07-e2da-4d2e-8e3f-fa919400cb6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 453253450}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:44.736081 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e4c4f78-4548-463a-9b0d-8f64992f12cc tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "DELETE /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 204 len: 0 microversion: 2.91 time: 0.238506 Sep 19 14:41:44.742516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b89fcbf1-72be-475b-9770-a4b847f4982e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Invalid port range 22:453253450. Valid TCP ports should be between 1-65535 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b89fcbf1-72be-475b-9770-a4b847f4982e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 145 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:44.750621 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: {"security_group_rule": {"parent_group_id": "b96a4c07-e2da-4d2e-8e3f-fa919400cb6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 453253450}} Sep 19 14:41:44.753744 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid port range 22:453253450. Valid TCP ports should be between 1-65535 Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b96a4c07-e2da-4d2e-8e3f-fa919400cb6b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 453253450}}} Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:453253450. Valid TCP ports should be between 1-65535 Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:44.755302 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:453253450. Valid TCP ports should be between 1-65535 Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:453253450. Valid TCP ports should be between 1-65535 Sep 19 14:41:44.769369 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:44.775987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 557/1149] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:41:44 2022] DELETE /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:41:44.780368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b89fcbf1-72be-475b-9770-a4b847f4982e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 400 to user: Invalid port range 22:453253450. Valid TCP ports should be between 1-65535 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:44.781692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:44.782423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:44.783302 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b89fcbf1-72be-475b-9770-a4b847f4982e tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.157655 Sep 19 14:41:44.786720 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 593/1150] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:44 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:41:44.802559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:44.804225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:44.805508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.811444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.812012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.812788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.813643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.813770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.817858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.821006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.824425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:44.825569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:44.826185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:44.828231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.055058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:45.082054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:45.111117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:45.137941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aeb188e9-67fc-475c-9cf3-e3aaadb60906 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.344851 Sep 19 14:41:45.143640 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 594/1151] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:44 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:45.176428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:45.186362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:45.208920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.211082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.211859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.215932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.217096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.218045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.573338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:45.592347 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79756ed6-ee5e-4c71-a285-9fd78f880a3e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.827127 Sep 19 14:41:45.613520 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 558/1152] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:44 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:45.620484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Action: 'create', calling method: .version_select at 0x7fde29ee3d30>, body: {"security_group_rule": {"parent_group_id": "484e52b3-7041-44c2-aa33-264495806283", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:45.692531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:41:45.693713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Neutron security group 484e52b3-7041-44c2-aa33-264495806283 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:41:45.694885 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.694885 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 138 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:45.723043 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: {"security_group_rule": {"parent_group_id": "484e52b3-7041-44c2-aa33-264495806283", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 19 14:41:45.724740 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'security_group_rule': {'parent_group_id': '484e52b3-7041-44c2-aa33-264495806283', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:41:45.725737 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 19 14:41:45.727752 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] Sep 19 14:41:45.729675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 404 to user: Security group 484e52b3-7041-44c2-aa33-264495806283 does not exist Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-64c71d06-0076-453f-a2ab-5eee965933e9'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:45.730962 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95cbe0f8-91a6-457f-8e54-348b16ce1ed7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.110521 Sep 19 14:41:45.734792 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 559/1153] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:41:45 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:45.753313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:45.754563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:45.775073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.779690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.780606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.786285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.787604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.794222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.825832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:45.857115 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3a71418-c589-4139-96a8-bdbfe2d4c307 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1464 microversion: 2.1 time: 0.711005 Sep 19 14:41:45.859037 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 595/1154] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:45 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1464 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:45.871040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:45.875771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:45.889662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.891013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.893514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.895347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.896539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.897840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.906154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:45.907530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:45.908516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:45.909529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lazy-loading 'fault' on Instance uuid 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:41:45.978737 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09a77af3-5848-484e-9da1-c1fb1f6b0954 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117197 Sep 19 14:41:45.980179 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 596/1155] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:45 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:45.984996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:45.989265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-39301a08-63b0-495a-ab0b-9bac51f5fa79 req-704bd9fb-c6fc-4b50-85de-6844bc1af368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609d06b2-02f1-4a91-b2ce-7af7cb6dffb9", "name": "network-vif-deleted", "tag": "cc1c0eb9-1e08-4a8f-a253-8dd08ebc0f1a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:45.996198 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27f7eeb0-2dca-4159-ba54-39b09ed2db61 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 200 len: 1312 microversion: 2.1 time: 0.259349 Sep 19 14:41:45.996912 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 560/1156] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:45 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:46.012896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-39301a08-63b0-495a-ab0b-9bac51f5fa79 req-704bd9fb-c6fc-4b50-85de-6844bc1af368 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.014667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-39301a08-63b0-495a-ab0b-9bac51f5fa79 req-704bd9fb-c6fc-4b50-85de-6844bc1af368 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.015864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-39301a08-63b0-495a-ab0b-9bac51f5fa79 req-704bd9fb-c6fc-4b50-85de-6844bc1af368 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.019801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-33667672-b96c-4d17-94aa-ec96c3f5e24e req-958deff1-cbd3-4772-8a88-8a9d8bfc8e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456ef8bb-1f6e-4d2d-954d-b23bc0ef569f", "name": "network-vif-plugged", "status": "completed", "tag": "56598dac-a090-4016-ba8e-0c5ebf68092a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:46.033167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-33667672-b96c-4d17-94aa-ec96c3f5e24e req-958deff1-cbd3-4772-8a88-8a9d8bfc8e60 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.033638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-33667672-b96c-4d17-94aa-ec96c3f5e24e req-958deff1-cbd3-4772-8a88-8a9d8bfc8e60 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.034194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-33667672-b96c-4d17-94aa-ec96c3f5e24e req-958deff1-cbd3-4772-8a88-8a9d8bfc8e60 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.040529 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-39301a08-63b0-495a-ab0b-9bac51f5fa79 req-704bd9fb-c6fc-4b50-85de-6844bc1af368 service nova] Creating event network-vif-deleted:cc1c0eb9-1e08-4a8f-a253-8dd08ebc0f1a for instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 on n-h2-858384-1 Sep 19 14:41:46.049181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-33667672-b96c-4d17-94aa-ec96c3f5e24e req-958deff1-cbd3-4772-8a88-8a9d8bfc8e60 service nova] Creating event network-vif-plugged:56598dac-a090-4016-ba8e-0c5ebf68092a for instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f on n-h1-858384-1 Sep 19 14:41:46.050996 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-39301a08-63b0-495a-ab0b-9bac51f5fa79 req-704bd9fb-c6fc-4b50-85de-6844bc1af368 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068477 Sep 19 14:41:46.052807 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 597/1157] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:46.060437 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-33667672-b96c-4d17-94aa-ec96c3f5e24e req-958deff1-cbd3-4772-8a88-8a9d8bfc8e60 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047037 Sep 19 14:41:46.064824 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 561/1158] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:46.067515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29e4a700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:46.073445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:46.074361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:46.082183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.082816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.084126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.085325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.085791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.095525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.144586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:41:46.146687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Neutron security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 not found {{(pid=128730) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 19 14:41:46.148342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] HTTP exception thrown: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.148342 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Request method failure captured: Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-security-group-rules/4dee2b82-95cd-41e5-ac9e-42a8b83550a3 HTTP/1.1 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-eX6v802k5-1ICV5C8mQ7FMTxuf16KSndv9Oe4EXgidYRD3OZw2WkWoJ7z9BG650C1txfPhBwpM5UKgoAJdc7sn5zIO6mm7DXTdvMz8huJI7HcTASdPFDy8vjy90Tk4lSZBxNKD3SRrRlC9bdkTtDQ9J9Ud8hkIFzvqZL5cb8eDl0 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:46.159747 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7cfbf69dc87941ddab19e7e80259e702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7cfbf69dc87941ddab19e7e80259e702"}]}] Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7cfbf69dc87941ddab19e7e80259e702 Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158 Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 26d8be2ce3554010afd93d2475996cc1 Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.162411 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4dee2b82-95cd-41e5-ac9e-42a8b83550a3'} Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:46.165083 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 19 14:41:46.172860 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.178446 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Returning 404 to user: Security group rule 4dee2b82-95cd-41e5-ac9e-42a8b83550a3 does not exist Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-314d377c-d13b-4e76-a7bb-356b328c3144'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:46.183684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb6d6d96-0e52-41cb-82a8-19b7b8ee1f18 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-group-rules/4dee2b82-95cd-41e5-ac9e-42a8b83550a3" status: 404 len: 199 microversion: 2.1 time: 0.108676 Sep 19 14:41:46.187286 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 598/1159] 10.222.0.81 () {58 vars in 1287 bytes} [Mon Sep 19 14:41:46 2022] DELETE /compute/v2.1/os-security-group-rules/4dee2b82-95cd-41e5-ac9e-42a8b83550a3 => generated 199 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:46.187286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e2df637-ce8d-44aa-9ff9-aa3e5ab04074 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29e353a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:46.441678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:46.475164 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1104fa7c-6029-4b42-8ffe-5ab4a781034b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1464 microversion: 2.1 time: 0.408562 Sep 19 14:41:46.478578 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 562/1160] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:46 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:46.495901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:46.498501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:46.522305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.524294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.527475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.531993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.535098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.539193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.652398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:46.664249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:46.666473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af68e3d765f14854b4823ee57f5f9d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561898f9ac344d4bc9c06a04cff776d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:46.673015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-076bc967-8f9f-4a3d-a193-fefa31242b48 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 200 len: 1537 microversion: 2.91 time: 0.192131 Sep 19 14:41:46.674675 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 563/1161] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:46 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:41:46.676882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e2df637-ce8d-44aa-9ff9-aa3e5ab04074 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/b96a4c07-e2da-4d2e-8e3f-fa919400cb6b" status: 202 len: 0 microversion: 2.1 time: 0.503500 Sep 19 14:41:46.678156 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 599/1162] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:41:46 2022] DELETE /compute/v2.1/os-security-groups/b96a4c07-e2da-4d2e-8e3f-fa919400cb6b => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:46.707676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:46.716448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:46.729561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.730437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.731539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.733086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.734145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.735197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.837058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:46.838465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:46.838465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:46.838702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:46.839145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:46.903309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13eb5f75-4208-47c5-8303-243f46bc384d tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Calling method '.version_select at 0x7fde2a7d91f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:46.920210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:46.927756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.928813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.929477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.930405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:46.932813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:46.933676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:46.973407 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d62aa28e-68d6-449c-8e73-90af6f10d052 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 1068 microversion: 2.1 time: 0.293536 Sep 19 14:41:46.987313 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 600/1163] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:41:46 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 1068 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 19 14:41:47.013195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.014906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:47.031827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.035984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.038706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.039443 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13eb5f75-4208-47c5-8303-243f46bc384d tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 371 microversion: 2.1 time: 0.363357 Sep 19 14:41:47.041161 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 564/1164] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:41:46 2022] GET /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:47.043380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.044630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.045525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.048669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03fe0c94-d9c3-4d17-9193-0bc63686d1d7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29c71ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.392286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:47.394949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:47.408481 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a49c1153-3cc2-4d9a-b2ff-9a38d81e0a97 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.432873 Sep 19 14:41:47.426923 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 601/1165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:46 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:47.432079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.437285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:47.453628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.454471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.454701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.455449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.455938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.456368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.498077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f190750-a83d-47ee-b81b-5f65bdf76e8e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070079 Sep 19 14:41:47.502976 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 602/1166] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:47 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:47.509807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.510699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:47.517669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.518432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.519072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.519974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.520438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.520868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.552444 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03fe0c94-d9c3-4d17-9193-0bc63686d1d7 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/187bf78e-787c-4adc-bddb-fac8d259b60e" status: 202 len: 0 microversion: 2.1 time: 0.509022 Sep 19 14:41:47.553776 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 565/1167] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:41:47 2022] DELETE /compute/v2.1/os-security-groups/187bf78e-787c-4adc-bddb-fac8d259b60e => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:47.564394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.566239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:47.579341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.580348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.581237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.582646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.583650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.584517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.605716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] HTTP exception thrown: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 could not be found. Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Request method failure captured: Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 HTTP/1.1 Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH9lGDeO-yaBbvYVNNRrIC4Uq_fq_L-fdXiK4acW10iX1i4Kg9f9Wu_MByZPyNb626-CAqPsbgSH6ehiTAcflD0LzUPKA7EfRt9kuKSyb5MxcdaJMXauQf8PE6J85uPU4BkEvVk3uiA971_VkWyu3WmmmQxsDvrvAblYYwKLOO_CXWE Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7a9404a412184ccfbacbdbf438e4b496 Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1612399692 Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:47.607760 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7a9404a412184ccfbacbdbf438e4b496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7a9404a412184ccfbacbdbf438e4b496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7a9404a412184ccfbacbdbf438e4b496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7a9404a412184ccfbacbdbf438e4b496"}]}] Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1612399692 Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7a9404a412184ccfbacbdbf438e4b496 Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1612399692 Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAdminNegativeTestJSON-1612399692-project Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a130f01dc587496296ac76c50fb62388 Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1612399692-project Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 could not be found. Sep 19 14:41:47.609336 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '609d06b2-02f1-4a91-b2ce-7af7cb6dffb9'} Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 could not be found. Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:47.610209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 could not be found. Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 could not be found. Sep 19 14:41:47.611659 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:47.616442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Returning 404 to user: Instance 609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:47.617618 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c6035b08-e045-4303-b1b6-01c8f4303fcd tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9" status: 404 len: 111 microversion: 2.1 time: 0.062014 Sep 19 14:41:47.619449 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 566/1168] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:47 2022] GET /compute/v2.1/servers/609d06b2-02f1-4a91-b2ce-7af7cb6dffb9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:47.624290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Action: 'update', calling method: .version_select at 0x7fde29d30af0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:47.748190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:47.756299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.757304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.759272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.761276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.762325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab8a0f85-4e06-4c16-bbcc-464e2516bf5d tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.261425 Sep 19 14:41:47.763677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.763966 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 603/1169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:47 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:47.765069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.793265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48093908-b1f0-420b-bbc1-1639ea240200 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29e4a1f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.799526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:UPDATE=18,nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:47.865699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8fecf690-6746-4283-aec3-424dd01f074c tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 328 microversion: 2.1 time: 0.244629 Sep 19 14:41:47.866821 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 567/1170] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:41:47 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:47.877113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:47.878378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:47.891874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.893232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.895042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.896636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:47.897748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:47.898821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:47.954217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:41:48.109877 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3a291de4-1d1a-4882-85d3-6eadb3a07112 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 204 len: 0 microversion: 2.1 time: 0.240790 Sep 19 14:41:48.112261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 568/1171] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:41:47 2022] DELETE /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:48.123511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:48.125342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] [instance: 18e172dc-fe01-426d-bcaf-51f504be487b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:48.138845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:48.139894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:48.140574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:48.141962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:48.142646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:48.143394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:48.152341 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48093908-b1f0-420b-bbc1-1639ea240200 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/a760c7ff-fe58-4c1f-9eef-d0579b3f0163" status: 202 len: 0 microversion: 2.1 time: 0.385741 Sep 19 14:41:48.154432 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 604/1172] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:41:47 2022] DELETE /compute/v2.1/os-security-groups/a760c7ff-fe58-4c1f-9eef-d0579b3f0163 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:48.183043 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] HTTP exception thrown: Instance 18e172dc-fe01-426d-bcaf-51f504be487b could not be found. Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Request method failure captured: Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b HTTP/1.1 Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7zRPx1zaBc7fW9AFCpcEiCoZR0sp_OQCh14X8NuAi9BfTRlhakw_CYXXlPbUO-iLqsaD-d_l0opJza623CcYPAilsVhYFBVqZGFxx5lBOC_czkQZqemBSX2q7SbVBNy1BeY1XHXV98fp_vY3tI1MZQeTBEVIZITG0fEZO70WeS2uU Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.91 Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: c561898f9ac344d4bc9c06a04cff776d Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-422748417 Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:48.189729 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c561898f9ac344d4bc9c06a04cff776d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c561898f9ac344d4bc9c06a04cff776d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c561898f9ac344d4bc9c06a04cff776d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c561898f9ac344d4bc9c06a04cff776d"}]}] Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-422748417 Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: c561898f9ac344d4bc9c06a04cff776d Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-422748417 Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-UnshelveToHostMultiNodesTest-422748417-project Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: af68e3d765f14854b4823ee57f5f9d5c Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-422748417-project Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 18e172dc-fe01-426d-bcaf-51f504be487b could not be found. Sep 19 14:41:48.191473 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '18e172dc-fe01-426d-bcaf-51f504be487b'} Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e172dc-fe01-426d-bcaf-51f504be487b could not be found. Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:48.192388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e172dc-fe01-426d-bcaf-51f504be487b could not be found. Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e172dc-fe01-426d-bcaf-51f504be487b could not be found. Sep 19 14:41:48.193835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.196016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] Returning 404 to user: Instance 18e172dc-fe01-426d-bcaf-51f504be487b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:48.198510 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7dfd837-199c-4531-ac7b-f01cc2a0d0a8 tempest-UnshelveToHostMultiNodesTest-422748417 tempest-UnshelveToHostMultiNodesTest-422748417-project] 10.222.0.81 "GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b" status: 404 len: 111 microversion: 2.91 time: 0.084556 Sep 19 14:41:48.204866 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 569/1173] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:48 2022] GET /compute/v2.1/servers/18e172dc-fe01-426d-bcaf-51f504be487b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:41:48.216537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:48.218126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:48.230010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:48.231006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:48.232027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:48.233362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:48.234236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:48.235094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:48.303680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-314583938", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:48.433054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:41:48.597664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:48.612494 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8d9bc350-ab59-498c-82ab-1203a2b4124c tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1478 microversion: 2.1 time: 0.405721 Sep 19 14:41:48.627351 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 570/1174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:48 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1478 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:48.647009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-809ef8e3-807e-442d-859d-5831d0399f05 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29d30ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:48.767101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:48.859572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:48.860722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:48.863055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:48.863870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:48.864591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:48.880130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:48.881290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:48.882008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:48.883554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:48.885421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:48.886196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:48.919410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Getting quotas for project 6351841a3c9c4951a53f9df2f149c1f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:48.930397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Getting quotas for user 83c7b47dae154a05b954751b31dcdd24 and project 6351841a3c9c4951a53f9df2f149c1f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:48.955533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.utils [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] cores quota exceeded for 6351841a3c9c4951a53f9df2f149c1f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128730) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 19 14:41:48.957190 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Request method failure captured: Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 144 Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-oiiP3Aen4A42ZWniRy0QtTg7TrvjGH0w82jBLYnWm35O0k12e9YFNU9qUdt3gXJtoNTv4AdODHLEjtpdo7CYq-cK0IQwZZGQuVVpe1lRx6jzR747EcRPfJv_tmgpT_44hPyjsKRFFJK-lC7IKyX14onQkVtSoPuLrUF5l8u6b5IU Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:48.966666 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6351841a3c9c4951a53f9df2f149c1f7"}]}] Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 83c7b47dae154a05b954751b31dcdd24 Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-314583938", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} Sep 19 14:41:48.969735 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-314583938', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452'}}} Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 19 14:41:48.971422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:48.973846 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.976706 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:48.980949 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:48.980949 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:48.980949 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:48.980949 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:48.980949 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 19 14:41:48.980949 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:48.981778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:48.985541 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-db6c3546-7bac-4f72-b813-ef886ddbf3e2 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.824080 Sep 19 14:41:48.985541 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 605/1175] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:48 2022] POST /compute/v2.1/servers => generated 111 bytes in 828 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:49.001325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:49.004064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:49.016853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.017803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.018666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.023476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.024582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.026432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.175074 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-809ef8e3-807e-442d-859d-5831d0399f05 tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/18d8f9ad-a35b-4ec3-9023-0327d89d9042" status: 202 len: 0 microversion: 2.1 time: 0.543602 Sep 19 14:41:49.182888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 571/1176] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:41:48 2022] DELETE /compute/v2.1/os-security-groups/18d8f9ad-a35b-4ec3-9023-0327d89d9042 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:49.192367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:49.199810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:49.217101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.219074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.220580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.223188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.225058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.226377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.295925 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff6a6f64-d72c-408e-95ad-aa038e2e8151 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110737 Sep 19 14:41:49.305172 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 572/1177] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:49 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:49.319731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:49.320963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:49.333377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.334234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.335074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.336309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.337140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.339350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.388204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:49.398492 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-60259547-bffe-45ef-bf7c-dc4a010d6f7f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1317 microversion: 2.1 time: 0.407087 Sep 19 14:41:49.399116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 606/1178] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:48 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:49.414228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a00e820>, body: {"quota_set": {"cores": 20}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:49.591820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:49.597290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:49.624403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5637b022-ea43-4b40-b3f0-2a2e392141ca tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.315580 Sep 19 14:41:49.625794 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 573/1179] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:49 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:49.643385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee284f01-5efb-462b-a086-48022b9417bb tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] Calling method '.version_select at 0x7fde29d30d30>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:49.748271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.748814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.749208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.749974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.750487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.759214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.906119 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96333afd-1c96-4a1e-963c-6576befaefee tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 329 microversion: 2.1 time: 0.503081 Sep 19 14:41:49.919941 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 607/1180] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:41:49 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 329 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:49.926863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:49.927488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:49.935333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.935825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.936263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:49.936980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:49.937439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:49.937876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:50.053668 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee284f01-5efb-462b-a086-48022b9417bb tempest-SecurityGroupRulesNegativeTestJSON-1828619158 tempest-SecurityGroupRulesNegativeTestJSON-1828619158-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/226ad335-c1b0-4183-8c4b-f9ca3426d143" status: 202 len: 0 microversion: 2.1 time: 0.425741 Sep 19 14:41:50.058452 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 574/1181] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:41:49 2022] DELETE /compute/v2.1/os-security-groups/226ad335-c1b0-4183-8c4b-f9ca3426d143 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:41:50.067423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e0a3de8-4f75-4559-9aa6-69568a8b8d57 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Calling method '.version_select at 0x7fde29c7bf70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:50.256409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:50.285448 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-886247b2-9135-4434-a08a-8caa7d7b9a25 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1478 microversion: 2.1 time: 0.354125 Sep 19 14:41:50.288475 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 608/1182] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:49 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1478 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:50.321669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:50.330877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:50.358555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:50.372446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:50.373456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:50.374295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:50.375843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:50.377132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:50.378029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:50.472229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6cf1f22d-4d9b-43e5-bf9e-bb2ec62954f3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162169 Sep 19 14:41:50.478978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 609/1183] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:50 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:50.493094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:50.495086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:50.505492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:50.506224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:50.506686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:50.507603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:50.508081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:50.508612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:50.692568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e0a3de8-4f75-4559-9aa6-69568a8b8d57 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 371 microversion: 2.1 time: 0.636421 Sep 19 14:41:50.698700 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 575/1184] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:41:50 2022] GET /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 371 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:50.706563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:50.707509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:50.714679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:50.715464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:50.716094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:50.717026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:50.717623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:50.718014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.098716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:51.113549 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5cbb413-9356-4b11-af61-d1de1d20e107 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1467 microversion: 2.1 time: 0.632530 Sep 19 14:41:51.126855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 610/1185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:50 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1467 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:51.127224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:51.127332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Action: 'update', calling method: .version_select at 0x7fde29ffbaf0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:51.127541 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5f8c69a-5715-4d19-a016-8a07e87886db tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.427029 Sep 19 14:41:51.128735 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 576/1186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:50 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:51.154160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:51.154818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:51.164297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.165388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.168467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.169643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.170489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.171173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.367473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.371744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.372622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.374381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.375595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.376713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.504581 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b0ba80e-643b-4b8a-b4ef-08894699e194 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1618 microversion: 2.1 time: 0.354620 Sep 19 14:41:51.521284 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 577/1187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:51 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1618 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:51.555487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d4c8523d-91aa-412f-8cfc-1ac0fa5001ae tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 328 microversion: 2.1 time: 0.438751 Sep 19 14:41:51.560054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:51.561036 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 611/1188] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:41:51 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 328 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:51.567398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:51.567892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-22f604c6-445a-4b33-b559-abe99ca99224 req-9d3b33d0-cbe7-4525-b5e0-4a9bda0ad7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cd608-9f79-4b8e-a65e-f2cf48304141", "name": "network-vif-deleted", "tag": "0a7f5f4a-8fc1-4658-8690-b360d264cbaf"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:51.582841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.583640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.584367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.584887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22f604c6-445a-4b33-b559-abe99ca99224 req-9d3b33d0-cbe7-4525-b5e0-4a9bda0ad7ce service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.585704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22f604c6-445a-4b33-b559-abe99ca99224 req-9d3b33d0-cbe7-4525-b5e0-4a9bda0ad7ce service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.586638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22f604c6-445a-4b33-b559-abe99ca99224 req-9d3b33d0-cbe7-4525-b5e0-4a9bda0ad7ce service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.587018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.588155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.588685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.602666 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-22f604c6-445a-4b33-b559-abe99ca99224 req-9d3b33d0-cbe7-4525-b5e0-4a9bda0ad7ce service nova] Creating event network-vif-deleted:0a7f5f4a-8fc1-4658-8690-b360d264cbaf for instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 on n-h1-858384-1 Sep 19 14:41:51.612484 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-22f604c6-445a-4b33-b559-abe99ca99224 req-9d3b33d0-cbe7-4525-b5e0-4a9bda0ad7ce service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049879 Sep 19 14:41:51.614338 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 612/1189] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:51.624275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:51.627563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:51.636693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.637414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.638031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.638966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:51.639849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:51.640597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:51.687447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e4b51243-1963-4a6f-b657-9f903d4f4225 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071201 Sep 19 14:41:51.703157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a130f01dc587496296ac76c50fb62388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9404a412184ccfbacbdbf438e4b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:51.706710 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 613/1190] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:41:51 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:41:51.718107 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89b61747-6587-4f7c-9b92-12ad851afcdb tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 200 len: 1307 microversion: 2.1 time: 0.193959 Sep 19 14:41:51.731571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 578/1191] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:51 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:51.804118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1960125072", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c9085e40-1d2e-49e2-b258-cf1528c9877b"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:51.904766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:41:51.926454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-8689601", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:52.019339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:41:52.441184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:52.442822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:52.444093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:52.445051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:52.445862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:52.469416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:52.470245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:52.471350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:52.473145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:52.474310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:52.475348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:52.506626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:52.525837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Getting quotas for user a0108349524048938b8e8dad78cf2189 and project 32c474c76d064369addb54e031ce368b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:52.548308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:41:52.551996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:41:52.642373 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-201dcb16-47ca-46e8-8acf-1a39f1d7bdd7 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869100 Sep 19 14:41:52.655559 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 614/1192] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:41:52.677938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:52.679976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:52.714409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:52.715842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:52.716795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:52.718241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:52.719450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:52.720235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:53.356482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:53.367535 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91d13f70-63ef-4610-bd98-95679e55029f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.709991 Sep 19 14:41:53.370416 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 615/1193] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:52 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:53.379177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-19bb6d60-39e1-4987-8d68-2899767b44d2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:53.380930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-19bb6d60-39e1-4987-8d68-2899767b44d2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:53.501134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-19bb6d60-39e1-4987-8d68-2899767b44d2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:53.510934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-19bb6d60-39e1-4987-8d68-2899767b44d2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1217 microversion: 2.1 time: 0.139018 Sep 19 14:41:53.514630 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 616/1194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:53 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:53.526780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:53.532421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] [instance: 6d2cd608-9f79-4b8e-a65e-f2cf48304141] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:53.558275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:53.558825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:53.559289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:53.560014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:53.560483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:53.560917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:53.563560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:53.565121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:53.566154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:53.567081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:53.570960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:53.602369 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] HTTP exception thrown: Instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 could not be found. Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Request method failure captured: Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 HTTP/1.1 Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH9lGDeO-yaBbvYVNNRrIC4Uq_fq_L-fdXiK4acW10iX1i4Kg9f9Wu_MByZPyNb626-CAqPsbgSH6ehiTAcflD0LzUPKA7EfRt9kuKSyb5MxcdaJMXauQf8PE6J85uPU4BkEvVk3uiA971_VkWyu3WmmmQxsDvrvAblYYwKLOO_CXWE Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7a9404a412184ccfbacbdbf438e4b496 Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1612399692 Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:53.611795 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7a9404a412184ccfbacbdbf438e4b496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7a9404a412184ccfbacbdbf438e4b496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7a9404a412184ccfbacbdbf438e4b496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7a9404a412184ccfbacbdbf438e4b496"}]}] Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1612399692 Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7a9404a412184ccfbacbdbf438e4b496 Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1612399692 Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminNegativeTestJSON-1612399692-project Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a130f01dc587496296ac76c50fb62388 Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1612399692-project Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 could not be found. Sep 19 14:41:53.613448 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6d2cd608-9f79-4b8e-a65e-f2cf48304141'} Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 could not be found. Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:53.614384 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 could not be found. Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 could not be found. Sep 19 14:41:53.619282 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.620627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] Returning 404 to user: Instance 6d2cd608-9f79-4b8e-a65e-f2cf48304141 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:53.620627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-171f7163-665c-42f0-a2ae-8c030e001619 tempest-ServersAdminNegativeTestJSON-1612399692 tempest-ServersAdminNegativeTestJSON-1612399692-project] 10.222.0.81 "GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141" status: 404 len: 111 microversion: 2.1 time: 0.098276 Sep 19 14:41:53.620627 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 617/1195] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:53 2022] GET /compute/v2.1/servers/6d2cd608-9f79-4b8e-a65e-f2cf48304141 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:53.627889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:53.632621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:53.638483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:53.643779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:53.644822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:53.649052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:53.692772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Getting quotas for project 6351841a3c9c4951a53f9df2f149c1f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:53.713553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Getting quotas for user 83c7b47dae154a05b954751b31dcdd24 and project 6351841a3c9c4951a53f9df2f149c1f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:53.738309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.utils [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] instances quota exceeded for 6351841a3c9c4951a53f9df2f149c1f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128731) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 19 14:41:53.739453 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Request method failure captured: Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 142 Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-oiiP3Aen4A42ZWniRy0QtTg7TrvjGH0w82jBLYnWm35O0k12e9YFNU9qUdt3gXJtoNTv4AdODHLEjtpdo7CYq-cK0IQwZZGQuVVpe1lRx6jzR747EcRPfJv_tmgpT_44hPyjsKRFFJK-lC7IKyX14onQkVtSoPuLrUF5l8u6b5IU Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:41:53.745480 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6351841a3c9c4951a53f9df2f149c1f7"}]}] Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 83c7b47dae154a05b954751b31dcdd24 Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-8689601", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} Sep 19 14:41:53.747184 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-8689601', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452'}}} Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 19 14:41:53.748359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:53.749628 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.751169 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:53.752670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:53.752670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:53.752670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:53.752670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:53.752670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 19 14:41:53.752670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:41:53.754161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:53.755280 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f974a20-6b93-4d3c-91d8-700a10c14ce3 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.833048 Sep 19 14:41:53.768659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a03bdc0>, body: {"quota_set": {"instances": 10}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:53.780743 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 579/1196] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:51 2022] POST /compute/v2.1/servers => generated 119 bytes in 1859 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:54.398378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:54.399040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:54.424177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:54.424351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:54.429559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:54.433537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:54.435469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:54.437454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:54.499180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:54.500351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:54.503012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:54.506383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:54.508595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:54.518071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:54.698526 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3c350b1-66e0-4168-b1bb-b7f6d033e123 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 329 microversion: 2.1 time: 0.937393 Sep 19 14:41:54.707520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 618/1197] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:41:53 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 329 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:41:54.740553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:54.745126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:54.777205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:54.780504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:54.783609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:54.786415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:54.788471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:54.789531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:54.874657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:54.887979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-adfa5ae0-bdf5-4449-b85f-f371e215fb02 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.494040 Sep 19 14:41:54.889536 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 580/1198] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:54 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:54.895678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00650fe3-14a8-411b-9f25-94f26a7c1527 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Calling method '.version_select at 0x7fde29e3d430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:54.938356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:54.965094 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd51884d-a2f3-49e2-9943-c9d067ccbfe5 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1269 microversion: 2.1 time: 0.255512 Sep 19 14:41:54.965724 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 619/1199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:54 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1269 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:55.275441 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00650fe3-14a8-411b-9f25-94f26a7c1527 tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 371 microversion: 2.1 time: 0.383916 Sep 19 14:41:55.280224 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 581/1200] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:41:54 2022] GET /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 371 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:55.290118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Action: 'update', calling method: .version_select at 0x7fde29e358b0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:55.530463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:55.532674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:55.534198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:55.536480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:55.538347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:55.540111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:55.776495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a3efa2f-ba19-4f35-8f7e-929e19ba3d0a tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 325 microversion: 2.1 time: 0.490886 Sep 19 14:41:55.791265 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 620/1201] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:41:55 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 325 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:55.921977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:55.924383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:55.957404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:55.959613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:55.961061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:55.966349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:55.968210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:55.970960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:56.007837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:56.009107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:56.060988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:56.060988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:56.061276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:56.062024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:56.062503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:56.063086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:56.579248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:56.602450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67448348-7dbf-48c9-931b-ef0bc0a283ea tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1275 microversion: 2.1 time: 0.600956 Sep 19 14:41:56.604761 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 621/1202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:55 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1275 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:56.636464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-53516598", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:56.800507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:41:57.187874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:57.203980 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59e1a034-fd2d-416c-97c8-cb9ce7e64cb2 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.293410 Sep 19 14:41:57.208964 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 582/1203] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:55 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:57.512000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:41:57.512434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:41:57.513175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:41:57.513831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:41:57.514462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:41:57.546704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:57.547632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:57.548253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:57.553973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:57.554889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:57.555495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:57.618227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Getting quotas for project 6351841a3c9c4951a53f9df2f149c1f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:41:57.633181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:57.633836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:57.664397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:57.664897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:57.665421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:57.666143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:57.667176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Getting quotas for user 83c7b47dae154a05b954751b31dcdd24 and project 6351841a3c9c4951a53f9df2f149c1f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:41:57.680434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:57.683701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:57.755858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.utils [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] ram quota exceeded for 6351841a3c9c4951a53f9df2f149c1f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128730) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 19 14:41:57.756489 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Request method failure captured: Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 143 Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-oiiP3Aen4A42ZWniRy0QtTg7TrvjGH0w82jBLYnWm35O0k12e9YFNU9qUdt3gXJtoNTv4AdODHLEjtpdo7CYq-cK0IQwZZGQuVVpe1lRx6jzR747EcRPfJv_tmgpT_44hPyjsKRFFJK-lC7IKyX14onQkVtSoPuLrUF5l8u6b5IU Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:41:57.758580 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6351841a3c9c4951a53f9df2f149c1f7"}]}] Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 83c7b47dae154a05b954751b31dcdd24 Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-53516598", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} Sep 19 14:41:57.763397 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-53516598', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452'}}} Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 19 14:41:57.765582 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:57.769050 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.774255 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d0f75997-4ad6-41ea-a8ba-6a5a34220eb9 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.169630 Sep 19 14:41:57.780491 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 622/1204] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:41:56 2022] POST /compute/v2.1/servers => generated 110 bytes in 1174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:41:57.789885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a092a60>, body: {"quota_set": {"ram": 51200}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:41:57.959211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:41:57.979934 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-728b8b2f-ff22-4cfa-bfba-3ebed3619519 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1275 microversion: 2.1 time: 0.347999 Sep 19 14:41:57.997290 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 583/1205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:57 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:58.141441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:58.142080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:58.159032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:58.159458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:58.171733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:58.172752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:58.173263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:58.173972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:58.679642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:58.684783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:58.689712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:58.691045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:58.698703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:58.701537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:58.864293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:58.984636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c7aca007-2072-494a-b329-8c608cbfa93b tempest-QuotasAdminNegativeTest-1961981658 tempest-QuotasAdminNegativeTest-1961981658-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 200 len: 329 microversion: 2.1 time: 1.198277 Sep 19 14:41:58.985645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 623/1206] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:41:57 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 329 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:41:58.991440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:58.992453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:59.004331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:59.005437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:59.006241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:59.007313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:59.008025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:59.008691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:59.254216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 94fba3b9-9528-42c7-a666-cbd5f158103d {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:41:59.292894 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ea292374-0376-4abd-90a9-ffe780286304 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 2344 microversion: 2.25 time: 1.154916 Sep 19 14:41:59.295704 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 584/1207] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:41:58 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 2344 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:41:59.305550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:41:59.310008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:41:59.331457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:59.338951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:59.343049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:41:59.345709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:41:59.346235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:41:59.346718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:00.459426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:00.476908 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-388523fb-bf41-4d6e-b6ec-15bc078f9c0b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.489429 Sep 19 14:42:00.479059 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 624/1208] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:58 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:00.485929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d784522-cc59-468a-b667-9a7ddd3a4735 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Action: 'update', calling method: .version_select at 0x7fde29fe1c10>, body: {"quota_set": {"ram": 0}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:00.492854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d784522-cc59-468a-b667-9a7ddd3a4735 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '83c7b47dae154a05b954751b31dcdd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6351841a3c9c4951a53f9df2f149c1f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d784522-cc59-468a-b667-9a7ddd3a4735 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Request method failure captured: Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 HTTP/1.1 Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 25 Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-oiiP3Aen4A42ZWniRy0QtTg7TrvjGH0w82jBLYnWm35O0k12e9YFNU9qUdt3gXJtoNTv4AdODHLEjtpdo7CYq-cK0IQwZZGQuVVpe1lRx6jzR747EcRPfJv_tmgpT_44hPyjsKRFFJK-lC7IKyX14onQkVtSoPuLrUF5l8u6b5IU Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:42:00.497153 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6351841a3c9c4951a53f9df2f149c1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6351841a3c9c4951a53f9df2f149c1f7"}]}] Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6351841a3c9c4951a53f9df2f149c1f7 Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723219520 Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 83c7b47dae154a05b954751b31dcdd24 Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-QuotasAdminNegativeTest-723219520-project Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: {"quota_set": {"ram": 0}} Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 19 14:42:00.498716 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6351841a3c9c4951a53f9df2f149c1f7', 'body': {'quota_set': {'ram': 0}}} Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:00.499710 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:00.501021 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:00.502411 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:00.502411 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:00.502411 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:42:00.502411 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:42:00.502411 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 19 14:42:00.502411 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:00.504173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d784522-cc59-468a-b667-9a7ddd3a4735 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:00.505389 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d784522-cc59-468a-b667-9a7ddd3a4735 tempest-QuotasAdminNegativeTest-723219520 tempest-QuotasAdminNegativeTest-723219520-project] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7" status: 403 len: 116 microversion: 2.1 time: 0.024854 Sep 19 14:42:00.507365 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 625/1209] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:42:00 2022] PUT /compute/v2.1/os-quota-sets/6351841a3c9c4951a53f9df2f149c1f7 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:00.517749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:00.527285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:00.530638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:00.531791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:00.533750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:00.534454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:00.535138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:00.582668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-370054b6-49c5-4dc6-b652-df43e0ba3397 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072739 Sep 19 14:42:00.584535 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 626/1210] 10.222.0.81 () {60 vars in 1217 bytes} [Mon Sep 19 14:42:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:00.629334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:00.638228 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20554e0e-49bf-47b8-ae89-d7ebeeec1f96 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 1.341103 Sep 19 14:42:00.659237 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 585/1211] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:41:59 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:01.504527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:01.505143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:01.520359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:01.527032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:01.533300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:01.539814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:01.542043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:01.545137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:01.671326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:01.671950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:01.684852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:01.687666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:01.691089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:01.692059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:01.693548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:01.694615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:02.766556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:02.791999 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9d04bd8-902c-43dd-bc24-4ed1d62e9d72 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.290082 Sep 19 14:42:02.793195 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 627/1212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:01 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:42:02.961435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:02.972380 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f9a1e266-e622-47bf-90f0-611076814b72 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 1.305345 Sep 19 14:42:02.986168 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 586/1213] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:01 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:03.670003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:03.680729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:03.682534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.683141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.683768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.684359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.684828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.685267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.756069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Action: 'update', calling method: .version_select at 0x7fde2a14b820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:03.763747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.765596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.768009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.786436 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7743c5e3-e699-4e0c-b1e3-5c67246f4b8b tempest-AZV2TestJSON-664362557 tempest-AZV2TestJSON-664362557-project] 10.222.0.81 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.275343 Sep 19 14:42:03.787901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.789306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.791234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.791649 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 587/1214] 10.222.0.81 () {58 vars in 1164 bytes} [Mon Sep 19 14:42:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:42:03.820468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250a0b21-a8c7-46f6-bb6d-9ec709e90dbb", "device": "/dev/xvdb"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:03.820952 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] HTTP exception thrown: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:03.829060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Request method failure captured: Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25 HTTP/1.1 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 56 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-5IuMGEJ-r18uw3Iex0pUjE-U9CwsTwq6rQLNRO5PhtgiEHpqHexb7J5gTo66cX9nDXvMpC3BT8y68MpJFDyHbiZkfF34C_-3KKFDG-YkMI00SGALvKxQ_e6-KXbjQgCKw86nyWbAYU7ZtS1oM7oAZsrr4AOj_CVklrGJwuE0B9GU Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.53 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f436a6d71ccd47268a3c0a3ef9c716f7 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:42:03.829931 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f436a6d71ccd47268a3c0a3ef9c716f7"}]}] Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f436a6d71ccd47268a3c0a3ef9c716f7 Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: bb1136acc1454c1cb1c8f51f94331cdf Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:42:03.831719 n-d-858384-1 devstack@n-api.service[128730]: exception: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'fbbaa94e-544d-4a7d-8cb1-2c0679995d25', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.832795 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:03.834523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:03.836513 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:03.836513 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:03.836513 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:03.851201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Returning 404 to user: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:03.859096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.859654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.861458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.863324 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1997976b-f413-4029-8985-ffcdfca6deb7 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25" status: 404 len: 110 microversion: 2.53 time: 1.067450 Sep 19 14:42:03.866432 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 628/1215] 10.222.0.81 () {62 vars in 1309 bytes} [Mon Sep 19 14:42:02 2022] PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25 => generated 110 bytes in 1072 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:42:03.876193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.880832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:03.882020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.885012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:03.886432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.904157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.904875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.905342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.907162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:03.907648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:03.916317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:03.993251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.089291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70f71a40-4b6b-4e20-bf1d-aae8fa515915 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "POST /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.294844 Sep 19 14:42:05.111763 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 588/1216] 10.222.0.81 () {62 vars in 1364 bytes} [Mon Sep 19 14:42:03 2022] POST /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 194 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:05.137275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2c589757-0c35-4b74-8339-671c5f4b35b6 req-2d3d1c8e-026a-422d-8ef2-34d659335aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285fd94c-c054-41dd-be1c-24663ec76ab9", "tag": "1db631f5-4b0d-4bbc-9e4c-2e04a6ee7815"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:05.211888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2c589757-0c35-4b74-8339-671c5f4b35b6 req-2d3d1c8e-026a-422d-8ef2-34d659335aa9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.213304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2c589757-0c35-4b74-8339-671c5f4b35b6 req-2d3d1c8e-026a-422d-8ef2-34d659335aa9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.214493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2c589757-0c35-4b74-8339-671c5f4b35b6 req-2d3d1c8e-026a-422d-8ef2-34d659335aa9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.266526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=47,nova_cell0:UPDATE=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.280780 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2c589757-0c35-4b74-8339-671c5f4b35b6 req-2d3d1c8e-026a-422d-8ef2-34d659335aa9 service nova] Creating event network-changed:1db631f5-4b0d-4bbc-9e4c-2e04a6ee7815 for instance 285fd94c-c054-41dd-be1c-24663ec76ab9 on n-h2-858384-1 Sep 19 14:42:05.318575 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2c589757-0c35-4b74-8339-671c5f4b35b6 req-2d3d1c8e-026a-422d-8ef2-34d659335aa9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203365 Sep 19 14:42:05.330112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 589/1217] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:05.333455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:05.365412 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c31947a2-81bb-40f2-bef3-2fc76fc48412 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.494738 Sep 19 14:42:05.368418 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 629/1218] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:03 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:05.393568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:05.397649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:05.398673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Action: 'update', calling method: .version_select at 0x7fde29bbfdc0>, body: {"status": "disabled"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:05.411078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.412137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.412853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.436804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.439739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.440491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.442370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.443170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.444495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.447068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.448051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.448765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.495815 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] HTTP exception thrown: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Request method failure captured: Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25 HTTP/1.1 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 22 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-5IuMGEJ-r18uw3Iex0pUjE-U9CwsTwq6rQLNRO5PhtgiEHpqHexb7J5gTo66cX9nDXvMpC3BT8y68MpJFDyHbiZkfF34C_-3KKFDG-YkMI00SGALvKxQ_e6-KXbjQgCKw86nyWbAYU7ZtS1oM7oAZsrr4AOj_CVklrGJwuE0B9GU Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.53 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f436a6d71ccd47268a3c0a3ef9c716f7 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:42:05.499229 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f436a6d71ccd47268a3c0a3ef9c716f7"}]}] Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f436a6d71ccd47268a3c0a3ef9c716f7 Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: bb1136acc1454c1cb1c8f51f94331cdf Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: {"status": "disabled"} Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: exception: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.502255 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'fbbaa94e-544d-4a7d-8cb1-2c0679995d25', 'body': {'status': 'disabled'}} Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.504059 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:05.506319 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:05.508963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.508963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.517052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Returning 404 to user: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:05.519220 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f0cc23e-046c-4e8d-8ae0-7c27a3cdadeb tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25" status: 404 len: 110 microversion: 2.53 time: 0.184025 Sep 19 14:42:05.520279 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 590/1219] 10.222.0.81 () {62 vars in 1309 bytes} [Mon Sep 19 14:42:05 2022] PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25 => generated 110 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:42:05.544636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Action: 'update', calling method: .version_select at 0x7fde29ba6040>, body: {"status": "enabled"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:05.571106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.573500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.586913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.610957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.611876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.613040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.628018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] HTTP exception thrown: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Request method failure captured: Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25 HTTP/1.1 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 21 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH-5IuMGEJ-r18uw3Iex0pUjE-U9CwsTwq6rQLNRO5PhtgiEHpqHexb7J5gTo66cX9nDXvMpC3BT8y68MpJFDyHbiZkfF34C_-3KKFDG-YkMI00SGALvKxQ_e6-KXbjQgCKw86nyWbAYU7ZtS1oM7oAZsrr4AOj_CVklrGJwuE0B9GU Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.53 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f436a6d71ccd47268a3c0a3ef9c716f7 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:42:05.631557 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f436a6d71ccd47268a3c0a3ef9c716f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f436a6d71ccd47268a3c0a3ef9c716f7"}]}] Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f436a6d71ccd47268a3c0a3ef9c716f7 Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198 Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: bb1136acc1454c1cb1c8f51f94331cdf Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: {"status": "enabled"} Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: exception: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.633217 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'fbbaa94e-544d-4a7d-8cb1-2c0679995d25', 'body': {'status': 'enabled'}} Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.634159 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:05.635470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:05.636766 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. Sep 19 14:42:05.636766 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:05.636766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Returning 404 to user: Service fbbaa94e-544d-4a7d-8cb1-2c0679995d25 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:05.636766 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad3ba8c6-2099-4561-bb27-5c267553e926 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25" status: 404 len: 110 microversion: 2.53 time: 0.104833 Sep 19 14:42:05.643734 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 591/1220] 10.222.0.81 () {62 vars in 1309 bytes} [Mon Sep 19 14:42:05 2022] PUT /compute/v2.1/os-services/fbbaa94e-544d-4a7d-8cb1-2c0679995d25 => generated 110 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:42:05.656161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:05.666437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.667562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.668474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.670213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.671881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.672977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.735980 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a6570709-c750-4899-9ad9-673747b1fe31 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.089984 Sep 19 14:42:05.747213 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 592/1221] 10.222.0.81 () {60 vars in 1178 bytes} [Mon Sep 19 14:42:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:05.764789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:05.773551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.776993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.781445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.789979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.795058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:05.797727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:05.935592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48dfdb80-bdc6-408d-9249-30f9ab01f958 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.177992 Sep 19 14:42:05.956510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 593/1222] 10.222.0.81 () {60 vars in 1211 bytes} [Mon Sep 19 14:42:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:42:05.969455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:05.994644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:05.997301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.000803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.006055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.007570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.010623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.101615 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4923596b-4a74-4386-a0cb-3c82874006a9 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.141357 Sep 19 14:42:06.108300 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 594/1223] 10.222.0.81 () {60 vars in 1178 bytes} [Mon Sep 19 14:42:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:06.148830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:06.164330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.166797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.167883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.169660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.171069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.175034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.252843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87f8a0b6-b015-4819-8446-a68705b07011 tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=n-d-858384-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.119601 Sep 19 14:42:06.253845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 595/1224] 10.222.0.81 () {60 vars in 1235 bytes} [Mon Sep 19 14:42:06 2022] GET /compute/v2.1/os-services?host=n-d-858384-1&binary=xxx => generated 16 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:06.283467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:06.291567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.295124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.296124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.299674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.302898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.304027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.351020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d46e2fcd-aeb0-403e-9e55-2a85ff6aeb0b tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.078088 Sep 19 14:42:06.352180 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 596/1225] 10.222.0.81 () {60 vars in 1178 bytes} [Mon Sep 19 14:42:06 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:06.376927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:06.382452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.390724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.393067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.394415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.395245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.395938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.496373 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7eb0228a-6cae-4d44-8e6b-f7ecb5749ada tempest-ServicesAdminNegativeV253TestJSON-717576198 tempest-ServicesAdminNegativeV253TestJSON-717576198-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.123178 Sep 19 14:42:06.500838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 597/1226] 10.222.0.81 () {60 vars in 1239 bytes} [Mon Sep 19 14:42:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:06.515499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:06.517212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:06.544833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.550641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.553278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:06.556813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:06.557642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:06.558097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:07.004688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:07.023598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5be84cec-90a8-44f8-b4df-fdbb51b8e9f2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 1.650496 Sep 19 14:42:07.031132 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 630/1227] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:05 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:07.070998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:07.085178 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f0581b3-3e8b-4e1a-b505-86781d393f04 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.581161 Sep 19 14:42:07.094805 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 598/1228] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:06 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:07.586152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e6867c3-e7e0-4701-b169-05eaa8c3fc74 tempest-ServicesAdminNegativeV253TestJSON-783558784 tempest-ServicesAdminNegativeV253TestJSON-783558784-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:07.594862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9e6867c3-e7e0-4701-b169-05eaa8c3fc74 tempest-ServicesAdminNegativeV253TestJSON-783558784 tempest-ServicesAdminNegativeV253TestJSON-783558784-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3d0086c414974f0a83ad099c01cb5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4948f64e40d446a8686b942cde81904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e6867c3-e7e0-4701-b169-05eaa8c3fc74 tempest-ServicesAdminNegativeV253TestJSON-783558784 tempest-ServicesAdminNegativeV253TestJSON-783558784-project] Request method failure captured: Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH-3_TfrRUyhC9PZuWz0AF6Y1Ceiqs4WKWG_BuNNJO4IdJ9LE4sD1hq8fCzzZjoHzFAV1sZbAnSKDdfIUFVzAIHuD-tEltf2KV3nlQ6KQ63JPrdelf7UcnOcikmLUb6TBIGo8XUkPaZ8OGavqv0DIPbxc69vKqXYgVHoym_MZbobpVA Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.53 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e4948f64e40d446a8686b942cde81904 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-783558784 Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:42:07.596592 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e4948f64e40d446a8686b942cde81904"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e4948f64e40d446a8686b942cde81904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e4948f64e40d446a8686b942cde81904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e4948f64e40d446a8686b942cde81904"}]}] Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-783558784 Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e4948f64e40d446a8686b942cde81904 Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-783558784 Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServicesAdminNegativeV253TestJSON-783558784-project Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3d0086c414974f0a83ad099c01cb5d16 Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-783558784-project Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 19 14:42:07.599566 n-d-858384-1 devstack@n-api.service[128730]: action_args: {} Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:42:07.601501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 19 14:42:07.619327 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:07.635571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e6867c3-e7e0-4701-b169-05eaa8c3fc74 tempest-ServicesAdminNegativeV253TestJSON-783558784 tempest-ServicesAdminNegativeV253TestJSON-783558784-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:07.635571 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e6867c3-e7e0-4701-b169-05eaa8c3fc74 tempest-ServicesAdminNegativeV253TestJSON-783558784 tempest-ServicesAdminNegativeV253TestJSON-783558784-project] 10.222.0.81 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.565606 Sep 19 14:42:07.635571 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 631/1229] 10.222.0.81 () {60 vars in 1178 bytes} [Mon Sep 19 14:42:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 567 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:42:08.051946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:08.053733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:08.066494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.068392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:08.070257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:08.073783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:08.104126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:08.112362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:08.113099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:08.117462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:08.118278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:08.130547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:08.132857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.143225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:08.146067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:08.149120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:08.150959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:08.152803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:08.951964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=60 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:09.492814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:09.536481 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82ca5a68-8032-4386-93a4-9f5d05d2f37c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 1.485150 Sep 19 14:42:09.551192 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 599/1230] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:08 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:09.621425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:09.631276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4cd73f11-3e12-4ee8-ae61-95e977cc1925 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.524080 Sep 19 14:42:09.639859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 632/1231] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:08 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:42:10.581369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:10.583255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:10.615373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:10.619796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:10.621015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:10.626676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:10.630441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:10.632993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:10.916653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-05edb004-8b9a-401b-9141-340f8ac88d6f tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Action: 'create', calling method: .version_select at 0x7fde29bab1f0>, body: {"pool": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:11.708438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:11.719466 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a323cef5-f3c3-4033-8a01-008331ffa976 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 1.143821 Sep 19 14:42:11.724078 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 633/1232] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:10 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:11.742594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:11.753256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:11.777125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:11.781051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:11.781925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:11.783199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:11.783911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:11.784580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:13.366880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:13.375783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8981cac-bcb8-4c18-8def-86f774e45057 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.648981 Sep 19 14:42:13.383207 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 634/1233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:11 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:13.389901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:13.395325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:13.409820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:13.411837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:13.412510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:13.413488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:13.417672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:13.418441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:13.780266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=20 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.539659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:14.599344 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e0803722-548e-44a7-8f6a-c6e281369090 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 1.213372 Sep 19 14:42:14.600052 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 635/1234] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:13 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:15.492409 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-22e57229-7f5f-471c-bbfa-9a9dbe3c92f7 tempest-TenantUsagesNegativeTestJSON-215308233 tempest-TenantUsagesNegativeTestJSON-215308233-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-18T14%3A42%3A13.863630&end=2022-09-20T14%3A42%3A13.863630" status: 404 len: 112 microversion: - time: 0.883393 Sep 19 14:42:15.492409 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 636/1235] 10.222.0.81 () {58 vars in 1316 bytes} [Mon Sep 19 14:42:14 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-18T14%3A42%3A13.863630&end=2022-09-20T14%3A42%3A13.863630 => generated 112 bytes in 885 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 14:42:15.510829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f9c7408f-cdee-45d6-b066-e65875807f43 req-09cd946e-5406-46db-bc90-13275f9b3dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285fd94c-c054-41dd-be1c-24663ec76ab9", "name": "network-vif-plugged", "status": "completed", "tag": "1db631f5-4b0d-4bbc-9e4c-2e04a6ee7815"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:15.523054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f9c7408f-cdee-45d6-b066-e65875807f43 req-09cd946e-5406-46db-bc90-13275f9b3dc9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:15.523542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f9c7408f-cdee-45d6-b066-e65875807f43 req-09cd946e-5406-46db-bc90-13275f9b3dc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:15.529992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f9c7408f-cdee-45d6-b066-e65875807f43 req-09cd946e-5406-46db-bc90-13275f9b3dc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:15.554258 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f9c7408f-cdee-45d6-b066-e65875807f43 req-09cd946e-5406-46db-bc90-13275f9b3dc9 service nova] Creating event network-vif-plugged:1db631f5-4b0d-4bbc-9e4c-2e04a6ee7815 for instance 285fd94c-c054-41dd-be1c-24663ec76ab9 on n-h2-858384-1 Sep 19 14:42:15.564636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f9c7408f-cdee-45d6-b066-e65875807f43 req-09cd946e-5406-46db-bc90-13275f9b3dc9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066305 Sep 19 14:42:15.570578 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 637/1236] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:15.592859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:15.595935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:15.617194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:15.626223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:15.626967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:15.627901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:15.628526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:15.629111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:16.260706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:16.299093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bee2c59a-8ddc-47b7-830b-41fc60c1d2e0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 0.726690 Sep 19 14:42:16.307454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 638/1237] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:15 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:16.345791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d5e9540-f3ce-46ac-9fb1-75a7d651aea2 tempest-TenantUsagesNegativeTestJSON-215308233 tempest-TenantUsagesNegativeTestJSON-215308233-project-admin] Calling method '.version_select at 0x7fde2a0923a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:16.363410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0d5e9540-f3ce-46ac-9fb1-75a7d651aea2 tempest-TenantUsagesNegativeTestJSON-215308233 tempest-TenantUsagesNegativeTestJSON-215308233-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d5e9540-f3ce-46ac-9fb1-75a7d651aea2 tempest-TenantUsagesNegativeTestJSON-215308233 tempest-TenantUsagesNegativeTestJSON-215308233-project-admin] Request method failure captured: Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-simple-tenant-usage/a648cd7a61e24f639939855da886bbeb?start=2022-09-20T14%3A42%3A13.863630&end=2022-09-18T14%3A42%3A13.863630 HTTP/1.1 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH_FDxr9eY-LngE-ptMukUxi60jYNQw3eD-v03ByJmEwAe0J6POiu_-1MODinunPVN3ibHTzJ3ReSZLZ8sk_q_HB9A-E2l3pds8L_sx-HFam0d0FazlmrbXjzc7o0sEv0iF234cHnXeIHjNXw3-NDj7OYTgzd4JQc8cEA53n2cieQC4 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 243a2d1fc940405fa14a655060461a52 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-215308233 Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:42:16.373244 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_243a2d1fc940405fa14a655060461a52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243a2d1fc940405fa14a655060461a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/243a2d1fc940405fa14a655060461a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/243a2d1fc940405fa14a655060461a52"}]}] Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-215308233 Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 243a2d1fc940405fa14a655060461a52 Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-215308233 Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TenantUsagesNegativeTestJSON-215308233-project-admin Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 0c9abd55022a42cca06a0ccf5a92c7e4 Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-215308233-project-admin Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid start time. The start time cannot occur after the end time. Sep 19 14:42:16.376153 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a648cd7a61e24f639939855da886bbeb'} Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 19 14:42:16.378189 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d5e9540-f3ce-46ac-9fb1-75a7d651aea2 tempest-TenantUsagesNegativeTestJSON-215308233 tempest-TenantUsagesNegativeTestJSON-215308233-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:16.385723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d5e9540-f3ce-46ac-9fb1-75a7d651aea2 tempest-TenantUsagesNegativeTestJSON-215308233 tempest-TenantUsagesNegativeTestJSON-215308233-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/a648cd7a61e24f639939855da886bbeb?start=2022-09-20T14%3A42%3A13.863630&end=2022-09-18T14%3A42%3A13.863630" status: 400 len: 111 microversion: 2.1 time: 0.067460 Sep 19 14:42:16.394405 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 639/1238] 10.222.0.81 () {58 vars in 1412 bytes} [Mon Sep 19 14:42:16 2022] GET /compute/v2.1/os-simple-tenant-usage/a648cd7a61e24f639939855da886bbeb?start=2022-09-20T14%3A42%3A13.863630&end=2022-09-18T14%3A42%3A13.863630 => generated 111 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:42:16.394405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:16.394405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:16.418949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:16.421623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:16.422381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:16.423393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:16.426492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=18 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.428766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:16.430398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:16.480949 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-05edb004-8b9a-401b-9141-340f8ac88d6f tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.069833 Sep 19 14:42:16.481692 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 600/1239] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:42:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:16.858395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:16.878058 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-897caae9-e002-4754-a239-e3df4d19eda6 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1317 microversion: 2.1 time: 0.492576 Sep 19 14:42:16.886979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 640/1240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:16 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:16.893504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6cd0149e-feea-41a8-b8fa-20eed29ca010 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Calling method '.version_select at 0x7fde2a5f6040>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:17.022905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-823e6b7c-0e18-443b-8add-ca5aa76f63ac tempest-TenantUsagesNegativeTestJSON-1312327308 tempest-TenantUsagesNegativeTestJSON-1312327308-project] Calling method '.version_select at 0x7fde29bf4280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:17.031147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-823e6b7c-0e18-443b-8add-ca5aa76f63ac tempest-TenantUsagesNegativeTestJSON-1312327308 tempest-TenantUsagesNegativeTestJSON-1312327308-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ad3195d4a2d64519bf1716bffafc4e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a648cd7a61e24f639939855da886bbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-823e6b7c-0e18-443b-8add-ca5aa76f63ac tempest-TenantUsagesNegativeTestJSON-1312327308 tempest-TenantUsagesNegativeTestJSON-1312327308-project] Request method failure captured: Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-18T14%3A42%3A13.863630&end=2022-09-20T14%3A42%3A13.863630&detailed=1 HTTP/1.1 Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH_DS-a6vkzWfJqA0vlpxBlT_GuWt1AQ7w3qQC6F70Cuwxz3rvus2VnaVx35GVJJH5Mgqm76I9iqEMRoXLaS8CB0u9rqDzy42WLPEyvlis3AcMbuZBihL23vp4KE8U7bDhB9y2-SOGisWR1CYEYQKYrk1O_7SuHUw3SJKITUuitPIBE Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a648cd7a61e24f639939855da886bbeb Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1312327308 Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:42:17.047803 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a648cd7a61e24f639939855da886bbeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a648cd7a61e24f639939855da886bbeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a648cd7a61e24f639939855da886bbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a648cd7a61e24f639939855da886bbeb"}]}] Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1312327308 Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a648cd7a61e24f639939855da886bbeb Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1312327308 Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TenantUsagesNegativeTestJSON-1312327308-project Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ad3195d4a2d64519bf1716bffafc4e3d Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1312327308-project Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:42:17.049803 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 19 14:42:17.050675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 19 14:42:17.051908 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 19 14:42:17.053532 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 19 14:42:17.053532 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:17.053532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-823e6b7c-0e18-443b-8add-ca5aa76f63ac tempest-TenantUsagesNegativeTestJSON-1312327308 tempest-TenantUsagesNegativeTestJSON-1312327308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:17.055222 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-823e6b7c-0e18-443b-8add-ca5aa76f63ac tempest-TenantUsagesNegativeTestJSON-1312327308 tempest-TenantUsagesNegativeTestJSON-1312327308-project] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-18T14%3A42%3A13.863630&end=2022-09-20T14%3A42%3A13.863630&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.566797 Sep 19 14:42:17.061341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 601/1241] 10.222.0.81 () {58 vars in 1335 bytes} [Mon Sep 19 14:42:16 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-18T14%3A42%3A13.863630&end=2022-09-20T14%3A42%3A13.863630&detailed=1 => generated 123 bytes in 579 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:17.332379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:17.333248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:17.364174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:17.370846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:17.373704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:17.376577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:17.379530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:17.380758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:17.622687 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6cd0149e-feea-41a8-b8fa-20eed29ca010 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/97845978-0e07-4411-a3da-33f4f1652f47" status: 200 len: 142 microversion: 2.1 time: 0.733547 Sep 19 14:42:17.626436 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 641/1242] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:42:16 2022] GET /compute/v2.1/os-floating-ips/97845978-0e07-4411-a3da-33f4f1652f47 => generated 142 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:17.660759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-961a0965-6ce6-4162-9436-eec2aa60f62f tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Calling method '.version_select at 0x7fde29fe1ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:18.354471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:18.388017 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c1d0833-c62d-4102-b65c-c1faaa89a2a4 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1473 microversion: 2.1 time: 1.060446 Sep 19 14:42:18.396299 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 602/1243] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:17 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1473 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:18.418295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:18.421232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:18.436761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:18.442026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:18.444606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:18.449516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:18.452120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:18.457737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:18.545919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-961a0965-6ce6-4162-9436-eec2aa60f62f tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.896729 Sep 19 14:42:18.557308 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 642/1244] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:42:17 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:18.602353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-46078ec3-1b45-41d4-bdef-11bc1271f2b0 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Calling method '.version_select at 0x7fde2a5f6670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:20.221261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:20.248041 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d58cb99-5a92-4341-bbb3-5269736be395 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1466 microversion: 2.1 time: 1.849671 Sep 19 14:42:20.249154 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 603/1245] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:18 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1466 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:20.275867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:20.280005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:20.311743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:20.313041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:20.314148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:20.316597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:20.323373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:20.324687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:22.819756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:22.850065 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b72c8625-b385-4e77-8f0d-2d77e618494a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1479 microversion: 2.1 time: 2.592552 Sep 19 14:42:22.857337 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 604/1246] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:20 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1479 bytes in 2602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:22.891461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:22.900964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:22.941073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:22.942245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:22.945403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:22.947014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:22.948221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:22.958151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:23.075502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-46078ec3-1b45-41d4-bdef-11bc1271f2b0 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/97845978-0e07-4411-a3da-33f4f1652f47" status: 202 len: 0 microversion: 2.1 time: 4.512009 Sep 19 14:42:23.077829 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 643/1247] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:42:18 2022] DELETE /compute/v2.1/os-floating-ips/97845978-0e07-4411-a3da-33f4f1652f47 => generated 0 bytes in 4517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:42:23.107599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad759a4e-f12d-496a-913f-2d6ea5737806 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Action: 'create', calling method: .version_select at 0x7fde29f7d3a0>, body: {"pool": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:24.020386 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-77695631-d840-4b28-934b-b8cb27172935 tempest-ServersOnMultiNodesTest-1804457706 tempest-ServersOnMultiNodesTest-1804457706-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1617 microversion: 2.1 time: 1.147676 Sep 19 14:42:24.024147 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 605/1248] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:22 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1617 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:24.034444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f73c52d5-69bf-4b01-8136-a1b22677e662 req-0c7752ed-61b0-4aa6-9b38-659feaa7508d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "name": "network-vif-unplugged", "status": "completed", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:24.100488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f73c52d5-69bf-4b01-8136-a1b22677e662 req-0c7752ed-61b0-4aa6-9b38-659feaa7508d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:24.101454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f73c52d5-69bf-4b01-8136-a1b22677e662 req-0c7752ed-61b0-4aa6-9b38-659feaa7508d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:24.102270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f73c52d5-69bf-4b01-8136-a1b22677e662 req-0c7752ed-61b0-4aa6-9b38-659feaa7508d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:24.167656 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f73c52d5-69bf-4b01-8136-a1b22677e662 req-0c7752ed-61b0-4aa6-9b38-659feaa7508d service nova] Creating event network-vif-unplugged:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:42:24.178006 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f73c52d5-69bf-4b01-8136-a1b22677e662 req-0c7752ed-61b0-4aa6-9b38-659feaa7508d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150414 Sep 19 14:42:24.179249 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 606/1249] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:24.184902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:24.195155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:24.222487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:24.229207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:24.230143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:24.235041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:24.238558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:24.239392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:25.140958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:25.157647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f1963079-4804-4fd9-ae45-f1ced25813ad tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1479 microversion: 2.1 time: 0.976819 Sep 19 14:42:25.158849 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 607/1250] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:24 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1479 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:25.171088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:25.171088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:25.199001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:25.200571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:25.201344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:25.204733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:25.207171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:25.211124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:25.314531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:42:25.589583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9757c7ca-c0ec-453d-a7b5-b332be6166fc tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 204 len: 0 microversion: 2.1 time: 0.428758 Sep 19 14:42:25.591411 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 608/1251] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:42:25 2022] DELETE /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:25.614937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:25.617617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:25.664920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:25.666183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:25.667194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:25.668775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:25.669884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:25.670559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:26.411887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:26.875075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=47 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.094141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:27.128783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5dd42862-43a0-443b-993f-637afb2aca32 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1472 microversion: 2.1 time: 1.521121 Sep 19 14:42:27.133684 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 609/1252] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:25 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1472 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:27.160995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:27.167867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:27.201576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:27.207912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:27.208572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:27.215570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:27.218608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:27.221726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:28.858589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:28.900281 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-af1cd8db-eaaf-49df-a5c4-2cfe83962215 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1479 microversion: 2.1 time: 1.763932 Sep 19 14:42:28.902291 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 610/1253] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:27 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1479 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:29.249628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d41bbc61-28db-4825-85aa-b5edea66779d tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Action: 'create', calling method: .version_select at 0x7fde29c1aca0>, body: {"keypair": {"name": "tempest-keypair-468477494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTQ9mJv2s8/ttVcBOELElEh4LnaY+Phkq7pwfNJ/7UT+ol/4WmxcZOazmG+cFEhy3CfX/LVfPdAJOKqpBC85MIgjQQ1otKlMIHbVtOvL+vkYZKhlRCKeeJl5UgH93X+mw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:29.307260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d41bbc61-28db-4825-85aa-b5edea66779d tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Getting quotas for project 8ddd6495c7f94f6c9246d2228f9b2371. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:42:29.333625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d41bbc61-28db-4825-85aa-b5edea66779d tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Getting quotas for user 92452449e1694e7b9d30fccbcae0ebf4 and project 8ddd6495c7f94f6c9246d2228f9b2371. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:42:29.430107 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d41bbc61-28db-4825-85aa-b5edea66779d tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.524600 Sep 19 14:42:29.447996 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 611/1254] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:42:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:29.474975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:29.476966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:29.508188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:29.509998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:29.511863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:29.516582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:29.520095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:29.526326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:30.410474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:30.427659 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bf8cfd3-9ddb-41cc-90cb-355d2dc677b0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1472 microversion: 2.1 time: 0.977470 Sep 19 14:42:30.431899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 612/1255] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:29 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1472 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:30.445961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:30.447618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:30.463975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:30.465085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:30.466468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:30.470283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:30.472947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:30.475929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:30.911839 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad759a4e-f12d-496a-913f-2d6ea5737806 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.826035 Sep 19 14:42:30.921560 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 644/1256] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:42:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:30.927517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-10f4b5e6-d7cf-406f-8c0e-cb892f2b2cda req-a1e62840-ba8d-47eb-84e7-a171003a5ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "name": "network-vif-plugged", "status": "completed", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:30.953743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-10f4b5e6-d7cf-406f-8c0e-cb892f2b2cda req-a1e62840-ba8d-47eb-84e7-a171003a5ece service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:30.954822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-10f4b5e6-d7cf-406f-8c0e-cb892f2b2cda req-a1e62840-ba8d-47eb-84e7-a171003a5ece service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:30.955439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-10f4b5e6-d7cf-406f-8c0e-cb892f2b2cda req-a1e62840-ba8d-47eb-84e7-a171003a5ece service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:30.984317 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-10f4b5e6-d7cf-406f-8c0e-cb892f2b2cda req-a1e62840-ba8d-47eb-84e7-a171003a5ece service nova] Creating event network-vif-plugged:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:42:30.993817 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-10f4b5e6-d7cf-406f-8c0e-cb892f2b2cda req-a1e62840-ba8d-47eb-84e7-a171003a5ece service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069868 Sep 19 14:42:31.000269 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 645/1257] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:31.035494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:31.037604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:31.087588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:31.088499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:31.089141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:31.090066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:31.090703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:31.091383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:31.560188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 94fba3b9-9528-42c7-a666-cbd5f158103d {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:42:31.651015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-827562d2-40e8-4d91-a90b-fbe3785f28b8 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 2422 microversion: 2.25 time: 1.214984 Sep 19 14:42:31.656086 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 613/1258] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:42:30 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 2422 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:31.679939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5022893-c479-4613-afd6-7261057b0485 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Calling method '.version_select at 0x7fde29bf4280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:31.944829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:31.980620 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-77447706-c164-41ca-bdaf-d02bf0a50092 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1479 microversion: 2.1 time: 0.978655 Sep 19 14:42:31.999134 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 646/1259] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:31 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1479 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:32.011247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fd54e1ed-1a1b-44a6-bd2d-b04a10645d73 req-42ca5b64-0dd0-45d5-8c77-ee71c753c886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285fd94c-c054-41dd-be1c-24663ec76ab9", "name": "network-vif-deleted", "tag": "1db631f5-4b0d-4bbc-9e4c-2e04a6ee7815"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:32.044930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fd54e1ed-1a1b-44a6-bd2d-b04a10645d73 req-42ca5b64-0dd0-45d5-8c77-ee71c753c886 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:32.044930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fd54e1ed-1a1b-44a6-bd2d-b04a10645d73 req-42ca5b64-0dd0-45d5-8c77-ee71c753c886 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:32.045400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fd54e1ed-1a1b-44a6-bd2d-b04a10645d73 req-42ca5b64-0dd0-45d5-8c77-ee71c753c886 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:32.100775 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fd54e1ed-1a1b-44a6-bd2d-b04a10645d73 req-42ca5b64-0dd0-45d5-8c77-ee71c753c886 service nova] Creating event network-vif-deleted:1db631f5-4b0d-4bbc-9e4c-2e04a6ee7815 for instance 285fd94c-c054-41dd-be1c-24663ec76ab9 on n-h2-858384-1 Sep 19 14:42:32.119238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fd54e1ed-1a1b-44a6-bd2d-b04a10645d73 req-42ca5b64-0dd0-45d5-8c77-ee71c753c886 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129046 Sep 19 14:42:32.126314 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 647/1260] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:32.147362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:32.148840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:32.167739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:32.168971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:32.171429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:32.172798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:32.175832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:32.178280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:32.252795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:32.253692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:32.254381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:32.255220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lazy-loading 'fault' on Instance uuid 285fd94c-c054-41dd-be1c-24663ec76ab9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:42:32.581087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:32.593934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5902eb9c-9cb2-43b7-87bf-07d949b4ea33 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 200 len: 1307 microversion: 2.1 time: 0.465749 Sep 19 14:42:32.600052 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 648/1261] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:32 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 1307 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:32.607794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": "auto"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:32.625548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:32.646523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:32.654770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:32.655773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:32.656908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:32.657715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:32.658685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:32.741812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'flavor' on Instance uuid 94fba3b9-9528-42c7-a666-cbd5f158103d {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:42:32.770935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Going to try to live migrate instance to n-h2-858384-1 {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:42:36.029242 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5022893-c479-4613-afd6-7261057b0485 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54" status: 202 len: 0 microversion: 2.1 time: 4.370526 Sep 19 14:42:36.030066 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 614/1262] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:42:31 2022] DELETE /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54 => generated 0 bytes in 4373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:42:36.034640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:36.035319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:36.052691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:36.054681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:36.055227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:36.056985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:36.058700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:36.059392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:36.515333 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-47f8ee7a-95fc-4b69-b95c-91f450eb3773 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/action" status: 202 len: 0 microversion: 2.25 time: 3.912864 Sep 19 14:42:36.522308 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 649/1263] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:42:32 2022] POST /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/action => generated 0 bytes in 3921 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:36.543551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:36.544891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 285fd94c-c054-41dd-be1c-24663ec76ab9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:36.573924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:36.574432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:36.574910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:36.575653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:36.576226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:36.576664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:36.619788 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance 285fd94c-c054-41dd-be1c-24663ec76ab9 could not be found. Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 HTTP/1.1 Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:42:36.626284 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 285fd94c-c054-41dd-be1c-24663ec76ab9 could not be found. Sep 19 14:42:36.629016 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '285fd94c-c054-41dd-be1c-24663ec76ab9'} Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285fd94c-c054-41dd-be1c-24663ec76ab9 could not be found. Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:36.630692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285fd94c-c054-41dd-be1c-24663ec76ab9 could not be found. Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285fd94c-c054-41dd-be1c-24663ec76ab9 could not be found. Sep 19 14:42:36.633471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:36.640899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance 285fd94c-c054-41dd-be1c-24663ec76ab9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:36.640899 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-366f1111-ff95-41e8-8402-b422907fb322 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9" status: 404 len: 111 microversion: 2.1 time: 0.104663 Sep 19 14:42:36.640899 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 650/1264] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:36 2022] GET /compute/v2.1/servers/285fd94c-c054-41dd-be1c-24663ec76ab9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:36.640899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1398407280", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "eb86d89b-8fd6-474f-a09d-aade8cfee6cf"}], "block_device_mapping_v2": [{"uuid": "5fb0859f-1b3d-47bc-96ec-f234d7dee737", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:36.771872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] validate_networks() for [('eb86d89b-8fd6-474f-a09d-aade8cfee6cf', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:42:37.518442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:37.571583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-220d354a-176d-4083-b145-f370d92cde3b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1464 microversion: 2.1 time: 1.529814 Sep 19 14:42:37.573939 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 615/1265] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:36 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1464 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:37.585385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-198ec6b5-80a8-4f02-b3fe-7e3a5c780926 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Calling method '.version_select at 0x7fde29dd69d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:37.842837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-198ec6b5-80a8-4f02-b3fe-7e3a5c780926 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a7f63712-b3a5-4ef0-91c6-779284c50c54 could not be found", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:42:37.844070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-198ec6b5-80a8-4f02-b3fe-7e3a5c780926 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] HTTP exception thrown: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-198ec6b5-80a8-4f02-b3fe-7e3a5c780926 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Request method failure captured: Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54 HTTP/1.1 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH_CeHuHMNcxiLF0vdP6tasu8Olp8BqgiIqMbdSrOgIJApDDEEqbjKtK2b3EjngQbFsfTKIwrKtnVIgF6ZI8_8eMamM3EVw161xI4pyIbh0DEJ4KYWPsUngCR1GbdLQsRg-PrYgPhJdTxmf9cVC6c_GkPA4Z-e98gIZhwgPaeP4GUhA Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 8fb779f7a09d4e728de18564447f1053 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsTestJSON-237310691 Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:42:37.848972 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8fb779f7a09d4e728de18564447f1053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fb779f7a09d4e728de18564447f1053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fb779f7a09d4e728de18564447f1053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8fb779f7a09d4e728de18564447f1053"}]}] Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsTestJSON-237310691 Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 8fb779f7a09d4e728de18564447f1053 Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsTestJSON-237310691 Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsTestJSON-237310691-project Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a264c30adabe4eb2bcc1bd097bfda33e Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsTestJSON-237310691-project Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: exception: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'a7f63712-b3a5-4ef0-91c6-779284c50c54'} Sep 19 14:42:37.852162 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:42:37.854082 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a7f63712-b3a5-4ef0-91c6-779284c50c54 could not be found Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef590000-7753-4b35-80ce-9ace448cb965'] Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54. Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:37.856779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:37.861879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:37.865070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:37.865070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:37.865070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-198ec6b5-80a8-4f02-b3fe-7e3a5c780926 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Returning 404 to user: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:37.876170 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-198ec6b5-80a8-4f02-b3fe-7e3a5c780926 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54" status: 404 len: 111 microversion: 2.1 time: 0.294976 Sep 19 14:42:37.878240 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 616/1266] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:42:37 2022] GET /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54 => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:37.919863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c503eec8-b9d0-4d4e-9d08-d964ce1a82cc"}], "security_groups": [{"name": "tempest-securitygroup--2043123585"}], "key_name": "tempest-keypair-468477494", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:38.453294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] validate_networks() for [('c503eec8-b9d0-4d4e-9d08-d964ce1a82cc', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:42:39.374835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.994140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:42:39.996254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:42:39.997294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:42:39.998101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:42:40.001134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:42:40.019087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:40.019806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:40.020489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:40.021579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:40.022287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:40.022952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:40.053897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:42:40.063522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Getting quotas for user a989536b40ed41ddaa1554bf40378758 and project 512934300eb6480bab9b4394114bbc30. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:42:40.082346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.231418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:42:40.236773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fb0859f-1b3d-47bc-96ec-f234d7dee737',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:42:40.561474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8eca563a-36bc-46bb-ba1a-419986bb4355 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.925949 Sep 19 14:42:40.562401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 651/1267] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:42:40.567481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:40.568334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:40.576350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:40.577120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:40.577749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:40.578661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:40.579387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:40.579992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:41.258194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:41.314984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:41.327776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:41.334187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a9fc4979-efeb-4f49-a536-11fd14c58b77 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 0.768995 Sep 19 14:42:41.356869 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 652/1268] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:42:40 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:41.428248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:41.429184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:41.485054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:42:41.485903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:42:41.486472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:42:41.487089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:42:41.489856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:42:41.494166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:41.495834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:41.505548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:41.507530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:41.510920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:41.515228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:41.527479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:41.528327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:41.529100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:41.536720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:41.543601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:41.544464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:41.620770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.659684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:42:41.694111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Getting quotas for project 8ddd6495c7f94f6c9246d2228f9b2371. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:42:41.736075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Getting quotas for user 92452449e1694e7b9d30fccbcae0ebf4 and project 8ddd6495c7f94f6c9246d2228f9b2371. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:42:41.811005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:42:41.830291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:42:42.051258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20073d27-4805-43cf-b9f8-721028f3e27b tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.171091 Sep 19 14:42:42.070493 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 617/1269] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:42:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 4191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:42:42.088149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:42.101905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:42.121099 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1313a86a-def3-4e08-9940-5ad8d1bff5f4 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 204 len: 0 microversion: 2.1 time: 0.738812 Sep 19 14:42:42.127112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:42.132142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:42.132345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:42.133046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:42.135968 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 653/1270] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:42:41 2022] DELETE /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:42.141341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:42.141957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:42.156096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-257b646c-7e4d-4ebd-acd1-79f35d81c589 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Calling method '.version_select at 0x7fde2a0bf790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:42.357456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-346c1911-8ad4-4fdd-a101-af90bdfd5617 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 0 microversion: 2.1 time: 0.284511 Sep 19 14:42:42.359851 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 618/1271] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:42:42 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:42:42.381695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5e5ef10-4c17-4e5d-a624-fd2b34aa7374 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:42.387468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5e5ef10-4c17-4e5d-a624-fd2b34aa7374 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:42.581666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-257b646c-7e4d-4ebd-acd1-79f35d81c589 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a7f63712-b3a5-4ef0-91c6-779284c50c54 could not be found", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:42:42.582828 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-257b646c-7e4d-4ebd-acd1-79f35d81c589 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] HTTP exception thrown: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-257b646c-7e4d-4ebd-acd1-79f35d81c589 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Request method failure captured: Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54 HTTP/1.1 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH_CeHuHMNcxiLF0vdP6tasu8Olp8BqgiIqMbdSrOgIJApDDEEqbjKtK2b3EjngQbFsfTKIwrKtnVIgF6ZI8_8eMamM3EVw161xI4pyIbh0DEJ4KYWPsUngCR1GbdLQsRg-PrYgPhJdTxmf9cVC6c_GkPA4Z-e98gIZhwgPaeP4GUhA Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 8fb779f7a09d4e728de18564447f1053 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FloatingIPsTestJSON-237310691 Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:42:42.589789 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8fb779f7a09d4e728de18564447f1053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fb779f7a09d4e728de18564447f1053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fb779f7a09d4e728de18564447f1053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8fb779f7a09d4e728de18564447f1053"}]}] Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FloatingIPsTestJSON-237310691 Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 8fb779f7a09d4e728de18564447f1053 Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FloatingIPsTestJSON-237310691 Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FloatingIPsTestJSON-237310691-project Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a264c30adabe4eb2bcc1bd097bfda33e Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FloatingIPsTestJSON-237310691-project Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: exception: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a7f63712-b3a5-4ef0-91c6-779284c50c54'} Sep 19 14:42:42.592766 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:42:42.594549 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a7f63712-b3a5-4ef0-91c6-779284c50c54 could not be found Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c52d0c88-5928-4c67-a9ca-3dcf56245642'] Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54. Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:42.600540 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:42.604946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:42.607653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 Sep 19 14:42:42.607653 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:42.607653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-257b646c-7e4d-4ebd-acd1-79f35d81c589 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] Returning 404 to user: Floating IP not found for ID a7f63712-b3a5-4ef0-91c6-779284c50c54 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:42.607653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-257b646c-7e4d-4ebd-acd1-79f35d81c589 tempest-FloatingIPsTestJSON-237310691 tempest-FloatingIPsTestJSON-237310691-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54" status: 404 len: 111 microversion: 2.1 time: 0.453944 Sep 19 14:42:42.623133 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 654/1272] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:42:42 2022] DELETE /compute/v2.1/os-floating-ips/a7f63712-b3a5-4ef0-91c6-779284c50c54 => generated 111 bytes in 486 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:42.644550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6217b0b-df14-4e21-9dc1-30ab9e90c7f4 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:42.654904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6217b0b-df14-4e21-9dc1-30ab9e90c7f4 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:42.709899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c5e5ef10-4c17-4e5d-a624-fd2b34aa7374 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:42.726738 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5e5ef10-4c17-4e5d-a624-fd2b34aa7374 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1053 microversion: 2.1 time: 0.365507 Sep 19 14:42:42.740601 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 619/1273] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:42 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1053 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:42.761017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:42.768052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:42.821790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:42.825772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:42.826550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:42.837940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:42.839768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:42.839948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:43.183127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6217b0b-df14-4e21-9dc1-30ab9e90c7f4 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:43.224113 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6217b0b-df14-4e21-9dc1-30ab9e90c7f4 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1225 microversion: 2.1 time: 0.597667 Sep 19 14:42:43.228892 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 655/1274] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:42 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1225 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:43.256847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:43.258043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:43.296494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:43.297598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:43.302243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:43.303706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:43.316052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:43.321239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:43.509588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:43.511890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:43.515690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:43.519067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lazy-loading 'fault' on Instance uuid cb0edfc6-3572-4040-881b-4a1785ac4895 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:42:44.795874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:44.814212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-903c4bcf-3603-491b-b451-d53c611f129d tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1473 microversion: 2.1 time: 2.068305 Sep 19 14:42:44.819046 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 620/1275] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:42 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1473 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:44.836694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:44.838680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:44.858105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:44.859223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:44.860103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:44.861133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:44.861841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:44.862502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:46.000588 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf00478d-6829-4f03-bd44-57a796f4e7d5 tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1598 microversion: 2.1 time: 2.770045 Sep 19 14:42:46.027545 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 656/1276] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:43 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1598 bytes in 2798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:46.045540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:46.047473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:46.068588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:46.070132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:46.072887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:46.075140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:46.076703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:46.078189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:46.863773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:46.882566 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d7043ed-8624-4837-be7a-c85acc71de59 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1169 microversion: 2.1 time: 0.852779 Sep 19 14:42:46.883201 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 657/1277] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:46 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1169 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:46.913193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:46.914337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:46.930114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:46.936652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:46.936976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:46.939516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:46.940355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:46.941426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:47.339681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:47.357713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:47.362420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:47.363972 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-409e3b4e-a880-4a41-aa99-0c244dc59f49 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 2.543579 Sep 19 14:42:47.366886 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 621/1278] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:42:44 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 2547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:47.374004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:47.380605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:47.418357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:47.422665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:47.423635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:47.424400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:47.424878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:47.425577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:47.989125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:48.007220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59f25901-6784-4c5d-b4ed-1b319a374359 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1283 microversion: 2.1 time: 1.101175 Sep 19 14:42:48.007808 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 658/1279] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:46 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1283 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:48.018581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:48.028397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:48.050904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:48.051707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:48.052364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:48.053335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:48.054123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:48.054784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:48.252580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:48.262120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b7de35da-8026-4c14-9486-250a1e64b72e tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action" status: 202 len: 0 microversion: 2.1 time: 0.247378 Sep 19 14:42:48.262796 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 659/1280] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:42:48 2022] POST /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:42:48.265184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-93e85030-925b-4cf1-ba93-4b9a71a20386 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 200 len: 1431 microversion: 2.1 time: 0.896990 Sep 19 14:42:48.287895 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 622/1281] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:47 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 1431 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:49.110204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c4354880-8b9e-46a5-bf47-ed0e4b251604 req-2588cdc7-8be5-4ece-af19-c660528efe2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456ef8bb-1f6e-4d2d-954d-b23bc0ef569f", "name": "network-vif-deleted", "tag": "56598dac-a090-4016-ba8e-0c5ebf68092a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:49.152181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c4354880-8b9e-46a5-bf47-ed0e4b251604 req-2588cdc7-8be5-4ece-af19-c660528efe2f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:49.179751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c4354880-8b9e-46a5-bf47-ed0e4b251604 req-2588cdc7-8be5-4ece-af19-c660528efe2f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:49.181224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c4354880-8b9e-46a5-bf47-ed0e4b251604 req-2588cdc7-8be5-4ece-af19-c660528efe2f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:49.263591 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c4354880-8b9e-46a5-bf47-ed0e4b251604 req-2588cdc7-8be5-4ece-af19-c660528efe2f service nova] Creating event network-vif-deleted:56598dac-a090-4016-ba8e-0c5ebf68092a for instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f on n-h1-858384-1 Sep 19 14:42:49.293503 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c4354880-8b9e-46a5-bf47-ed0e4b251604 req-2588cdc7-8be5-4ece-af19-c660528efe2f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.003676 Sep 19 14:42:49.299982 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 623/1282] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:49.313260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:49.314321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:49.335710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:49.343336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:49.344404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:49.346471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:49.348020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:49.349151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:49.552720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:49.553838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:49.585210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:49.586406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:49.588191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:49.589872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:49.590994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:49.591978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:49.684122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.036068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.612705 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca280bef-96ef-4dfb-a8b7-5c56dbf622ee tempest-ServersAdminTestJSON-323131367 tempest-ServersAdminTestJSON-323131367-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1615 microversion: 2.1 time: 1.310076 Sep 19 14:42:50.613644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:50.619697 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 624/1283] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:49 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1615 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:50.624873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:50.630073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:50.645397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-31fcf9d2-f0aa-4991-8d06-df4f79b9e2c9 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1211 microversion: 2.1 time: 2.378183 Sep 19 14:42:50.646476 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 660/1284] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:48 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1211 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:50.663199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:50.663714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:50.664170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:50.665029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:50.665777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:50.666390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:50.677165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:50.678482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:50.744354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:50.753494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:50.754332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:50.765632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:50.789365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:50.789884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.443491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:51.471167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:51.480734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7395ba1f-fee7-49c5-9473-c0d688ae5e6c tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 0.825782 Sep 19 14:42:51.483695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:51.496679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:51.502519 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-36bca037-c420-41f7-ad1b-e670bfe06483 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 0.877766 Sep 19 14:42:51.504993 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 661/1285] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:50 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:51.507211 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 625/1286] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:42:50 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:51.537981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:51.538533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:51.545710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:51.551030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:51.560842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.561442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.561908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.562802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.563289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.564645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.590700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f could not be found. Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f HTTP/1.1 Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:42:51.592398 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f could not be found. Sep 19 14:42:51.593845 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '456ef8bb-1f6e-4d2d-954d-b23bc0ef569f'} Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f could not be found. Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:51.594685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f could not be found. Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f could not be found. Sep 19 14:42:51.596085 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:42:51.597287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance 456ef8bb-1f6e-4d2d-954d-b23bc0ef569f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:51.597372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.599000 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e740a25f-7ee4-4cde-8ce4-836c6cfafd9b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f" status: 404 len: 111 microversion: 2.1 time: 0.077597 Sep 19 14:42:51.599564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.600055 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 662/1287] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:51 2022] GET /compute/v2.1/servers/456ef8bb-1f6e-4d2d-954d-b23bc0ef569f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:51.605433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.607756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.611144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:51.611671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:51.613745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.615418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.626467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.627093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.627468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.628212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.628679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.629112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.697115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:42:51.753936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.787142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:42:51.928675 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6a6f413f-2c4b-4e7e-991b-291c133b2cd8 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 204 len: 0 microversion: 2.1 time: 0.321778 Sep 19 14:42:51.935026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 663/1288] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:42:51 2022] DELETE /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:51.944349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:51.950017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:51.966897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.975114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.975664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:51.976463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:51.977077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:51.978608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:52.154716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e19d74b-e876-45d1-849c-f9645b6f120b tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "DELETE /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 204 len: 0 microversion: 2.1 time: 0.635834 Sep 19 14:42:52.155980 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 626/1289] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:42:51 2022] DELETE /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:52.176995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:52.178047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:52.190866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:52.192495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:52.193137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:52.194306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:52.195036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:52.195814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:52.677329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:52.696668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a983cb0-f2bb-4b00-bf94-d89dfe3deab1 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1211 microversion: 2.1 time: 0.756284 Sep 19 14:42:52.704097 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 664/1290] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:51 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1211 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:52.726398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.757870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:52.760555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:52.788719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:52.791228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:52.792250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:52.794872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:52.796833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:52.799392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:53.190995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.943905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:53.968983 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9da61923-84b0-4607-adbf-3551df6f12d0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1471 microversion: 2.1 time: 1.808375 Sep 19 14:42:53.969679 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 627/1291] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:52 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1471 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:53.991364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:53.991973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:54.001800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:54.006663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:54.007589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:54.008680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:54.009887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:54.010680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:54.290814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:54.301750 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-acafd846-2e58-4339-a1c7-3dfc06590f7f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1470 microversion: 2.1 time: 1.580745 Sep 19 14:42:54.305353 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 665/1292] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:52 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1470 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:54.320451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:54.320680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:54.337703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:54.338296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:54.338858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:54.339508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:54.339973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:54.340410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:55.562840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:55.614544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:55.617402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:55.623922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d5320f6-9b5f-499d-bd85-22ed94534b3f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.636719 Sep 19 14:42:55.624891 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 628/1293] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:42:53 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:55.637843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-44ded974-2768-4ea5-8301-c71b6aa1797c req-0dd1f006-c557-4dde-971d-d83b9db9af69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79aa5ee2-e9a7-4c00-b134-6038827ed547", "tag": "a887118d-871a-4250-bdb1-61d05b1899b8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:55.677576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-44ded974-2768-4ea5-8301-c71b6aa1797c req-0dd1f006-c557-4dde-971d-d83b9db9af69 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:55.678646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-44ded974-2768-4ea5-8301-c71b6aa1797c req-0dd1f006-c557-4dde-971d-d83b9db9af69 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:55.679397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-44ded974-2768-4ea5-8301-c71b6aa1797c req-0dd1f006-c557-4dde-971d-d83b9db9af69 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:55.709575 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-44ded974-2768-4ea5-8301-c71b6aa1797c req-0dd1f006-c557-4dde-971d-d83b9db9af69 service nova] Creating event network-changed:a887118d-871a-4250-bdb1-61d05b1899b8 for instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 on n-h1-858384-1 Sep 19 14:42:55.723044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-44ded974-2768-4ea5-8301-c71b6aa1797c req-0dd1f006-c557-4dde-971d-d83b9db9af69 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092574 Sep 19 14:42:55.724635 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 629/1294] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:42:55.731112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:55.732471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:55.740833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:55.741766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:55.742606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:55.744358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:55.745077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:55.745765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:56.185594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:56.194319 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91bad5bc-073d-4438-96b4-20b337f40cdb tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 1.878285 Sep 19 14:42:56.201966 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 666/1295] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:54 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:56.213491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:56.217474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:56.236662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:56.237364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:56.237979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:56.241535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:56.247202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:56.248002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:56.785866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:56.798085 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0122328-7a26-4d3b-9ba3-7496ff25613b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 200 len: 1471 microversion: 2.1 time: 0.589438 Sep 19 14:42:56.806447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 667/1296] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:56 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:56.828769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:56.845823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:56.862355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:56.914085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:56.922367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:56.923532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:56.925785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:56.932771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:56.938091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:57.150941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:57.169284 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e6e41b3b-9f16-4bc3-9588-aa8a26cddaee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1211 microversion: 2.1 time: 1.443147 Sep 19 14:42:57.169898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 630/1297] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:55 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1211 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:57.201854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:57.202514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:57.232733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:57.233280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:57.233729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:57.234468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:57.235203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:57.235945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:57.858061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:57.932418 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e9132127-fa8f-457d-96d6-d886ea59e37a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1470 microversion: 2.1 time: 1.122688 Sep 19 14:42:57.942205 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 668/1298] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:56 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1470 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:57.977876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:57.985250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:58.030244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:58.031176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:58.033942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:58.036642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:58.037462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:58.041120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:59.568142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:59.606996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:59.614791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:59.629139 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c67e38b0-ab17-4022-bdab-bc2cdc7ee1a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 2.454466 Sep 19 14:42:59.655265 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 631/1299] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:42:57 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:42:59.677980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:59.691146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 15d00bb9-7d71-471f-83f3-edc1c740d441] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:59.724976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:59.725604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:59.727786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:59.732128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:59.736835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:59.739471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:59.760401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:42:59.796922 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a6b16c8d-7436-42e9-99c2-fe26cc6f4124 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 1.852328 Sep 19 14:42:59.800109 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance 15d00bb9-7d71-471f-83f3-edc1c740d441 could not be found. Sep 19 14:42:59.808673 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 669/1300] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:57 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 HTTP/1.1 Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:42:59.809971 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 15d00bb9-7d71-471f-83f3-edc1c740d441 could not be found. Sep 19 14:42:59.812595 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '15d00bb9-7d71-471f-83f3-edc1c740d441'} Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d00bb9-7d71-471f-83f3-edc1c740d441 could not be found. Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:42:59.814068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d00bb9-7d71-471f-83f3-edc1c740d441 could not be found. Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d00bb9-7d71-471f-83f3-edc1c740d441 could not be found. Sep 19 14:42:59.820794 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:42:59.830075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance 15d00bb9-7d71-471f-83f3-edc1c740d441 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:42:59.830075 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ccb2489-1795-4f14-8157-77caf736c01b tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441" status: 404 len: 111 microversion: 2.1 time: 0.167613 Sep 19 14:42:59.830075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 632/1301] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:59 2022] GET /compute/v2.1/servers/15d00bb9-7d71-471f-83f3-edc1c740d441 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:59.847783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5fa653d2-c028-4c39-9333-a0f531a9e75c req-8810def4-a8a3-4d62-a1c9-52ef3cbaac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d00bb9-7d71-471f-83f3-edc1c740d441", "name": "network-vif-deleted", "tag": "8b9b59f5-8f84-4527-bdea-047c84c4a78b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:42:59.867411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:42:59.875007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:42:59.892314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:59.894440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:59.899623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:59.900781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:59.901495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:59.902162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:42:59.913901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5fa653d2-c028-4c39-9333-a0f531a9e75c req-8810def4-a8a3-4d62-a1c9-52ef3cbaac34 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:42:59.917869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5fa653d2-c028-4c39-9333-a0f531a9e75c req-8810def4-a8a3-4d62-a1c9-52ef3cbaac34 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:42:59.918777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5fa653d2-c028-4c39-9333-a0f531a9e75c req-8810def4-a8a3-4d62-a1c9-52ef3cbaac34 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:00.013965 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5fa653d2-c028-4c39-9333-a0f531a9e75c req-8810def4-a8a3-4d62-a1c9-52ef3cbaac34 service nova] Creating event network-vif-deleted:8b9b59f5-8f84-4527-bdea-047c84c4a78b for instance 15d00bb9-7d71-471f-83f3-edc1c740d441 on n-h1-858384-1 Sep 19 14:43:00.040563 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5fa653d2-c028-4c39-9333-a0f531a9e75c req-8810def4-a8a3-4d62-a1c9-52ef3cbaac34 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229680 Sep 19 14:43:00.043142 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 670/1302] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:00.063336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:00.068052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:00.090258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:00.091794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:00.093116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:00.094975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:00.111371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:00.112912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:00.273654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:00.275223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:00.276113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:00.279080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lazy-loading 'fault' on Instance uuid 75170b67-f117-49e1-a9ce-a972a6205a9e {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:00.397070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:00.434875 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0c2add7-1484-4d19-9a9d-6d0d642494e8 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 200 len: 1304 microversion: 2.1 time: 0.377236 Sep 19 14:43:00.439616 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 671/1303] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:00 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 1304 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:00.680928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:00.692720 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e7ffdf81-a023-4f0e-a2a4-05b54e6a288e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1211 microversion: 2.1 time: 0.854053 Sep 19 14:43:00.715193 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 633/1304] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:42:59 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1211 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:00.752867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:00.753534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:00.782944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:00.784922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:00.786067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:00.789319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:00.790595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:00.795474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:00.827672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:00.935597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:01.192216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a20bd92e-182b-4d1d-a926-d0dced6f1a9c tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 204 len: 0 microversion: 2.1 time: 0.475438 Sep 19 14:43:01.196801 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 634/1305] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:00 2022] DELETE /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:01.224437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:01.225379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:01.248757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:01.249284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:01.249805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:01.250536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:01.251055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:01.251498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:01.488467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7c77bb88-f370-4afe-8aa4-b8cc1cda5cd9 req-82ee37d0-7413-4daa-80f4-7e9f1b15d400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d5ba1-8891-4546-8cbd-cf1bb093680f", "tag": "a5ade408-3403-4e42-8df3-6047f3e2e730"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:01.516285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7c77bb88-f370-4afe-8aa4-b8cc1cda5cd9 req-82ee37d0-7413-4daa-80f4-7e9f1b15d400 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:01.517593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7c77bb88-f370-4afe-8aa4-b8cc1cda5cd9 req-82ee37d0-7413-4daa-80f4-7e9f1b15d400 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:01.518228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7c77bb88-f370-4afe-8aa4-b8cc1cda5cd9 req-82ee37d0-7413-4daa-80f4-7e9f1b15d400 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:01.554158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7c77bb88-f370-4afe-8aa4-b8cc1cda5cd9 req-82ee37d0-7413-4daa-80f4-7e9f1b15d400 service nova] Creating event network-changed:a5ade408-3403-4e42-8df3-6047f3e2e730 for instance 232d5ba1-8891-4546-8cbd-cf1bb093680f on n-h1-858384-1 Sep 19 14:43:01.566213 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7c77bb88-f370-4afe-8aa4-b8cc1cda5cd9 req-82ee37d0-7413-4daa-80f4-7e9f1b15d400 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.124764 Sep 19 14:43:01.568659 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 672/1306] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:01.584098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:01.585144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:01.608366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:01.609498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:01.610140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:01.614505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:01.615324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:01.615781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:02.634034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:02.652156 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebbfad43-08f2-4086-99c1-22f0d0176675 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 1.080887 Sep 19 14:43:02.653531 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 673/1307] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:01 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:02.670199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:02.670966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:02.686269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:02.686933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:02.688847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:02.689693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:02.690973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:02.692505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:02.751569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:02.902914 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a353fe8d-fd80-42d5-8277-a192602c2908 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 204 len: 0 microversion: 2.1 time: 0.245441 Sep 19 14:43:02.904009 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 674/1308] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:02 2022] DELETE /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:02.919748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:02.923356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: 75170b67-f117-49e1-a9ce-a972a6205a9e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:02.948291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:02.948816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:02.949268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:02.950013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:02.950478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:02.950947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:02.989936 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] HTTP exception thrown: Instance 75170b67-f117-49e1-a9ce-a972a6205a9e could not be found. Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Request method failure captured: Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e HTTP/1.1 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8luv2eSrt4c-pLO2DG052KzwTh5zEQASGirkLY7Kdo2b1Ou6laWRpp8zI43PyrwIk0GAnfgF-LWc4r_56wITNR7DyjZ7QQMRsA4WopVUGgNRa1vITTcaB1gnionV4eG4oRHvKNjHSxeeEPC_9uzSsf4M5t8Dl-CDKoVO4qpa5x3e8 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d6f0ada3b2a1446db012bcbdd2334e94 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:43:02.991966 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d6f0ada3b2a1446db012bcbdd2334e94"}]}] Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d6f0ada3b2a1446db012bcbdd2334e94 Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminTestJSON-190860652-project Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 12de6f76b4c3407ead7ece5ff764c913 Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminTestJSON-190860652-project Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 75170b67-f117-49e1-a9ce-a972a6205a9e could not be found. Sep 19 14:43:02.996353 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '75170b67-f117-49e1-a9ce-a972a6205a9e'} Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75170b67-f117-49e1-a9ce-a972a6205a9e could not be found. Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:02.997948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75170b67-f117-49e1-a9ce-a972a6205a9e could not be found. Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75170b67-f117-49e1-a9ce-a972a6205a9e could not be found. Sep 19 14:43:02.999305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:03.000474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Returning 404 to user: Instance 75170b67-f117-49e1-a9ce-a972a6205a9e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:03.000474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3dbb5b53-db89-4bbf-b3e9-51b74710ee93 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e" status: 404 len: 111 microversion: 2.1 time: 0.089017 Sep 19 14:43:03.000474 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 675/1309] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:02 2022] GET /compute/v2.1/servers/75170b67-f117-49e1-a9ce-a972a6205a9e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:03.011046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:03.013890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:03.022961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.023337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.028025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.028988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.029491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.029942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.040774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.089222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:03.108889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:03.110378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:03.111642 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7adc3e4d-8c5e-40ab-8430-fd05ff740b3b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.908162 Sep 19 14:43:03.127692 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 635/1310] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:01 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:03.141110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-85382c78-e9a4-4cde-b2de-e15d5d498d52 req-d66592be-4278-4e53-a5e2-1c930dc37560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75170b67-f117-49e1-a9ce-a972a6205a9e", "name": "network-vif-deleted", "tag": "d844333e-bee5-4ff6-933f-9cf66a9234ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:03.167784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-85382c78-e9a4-4cde-b2de-e15d5d498d52 req-d66592be-4278-4e53-a5e2-1c930dc37560 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.168285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-85382c78-e9a4-4cde-b2de-e15d5d498d52 req-d66592be-4278-4e53-a5e2-1c930dc37560 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.168731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-85382c78-e9a4-4cde-b2de-e15d5d498d52 req-d66592be-4278-4e53-a5e2-1c930dc37560 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.191319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-85382c78-e9a4-4cde-b2de-e15d5d498d52 req-d66592be-4278-4e53-a5e2-1c930dc37560 service nova] Creating event network-vif-deleted:d844333e-bee5-4ff6-933f-9cf66a9234ed for instance 75170b67-f117-49e1-a9ce-a972a6205a9e on n-h2-858384-1 Sep 19 14:43:03.204796 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-85382c78-e9a4-4cde-b2de-e15d5d498d52 req-d66592be-4278-4e53-a5e2-1c930dc37560 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075660 Sep 19 14:43:03.205955 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 636/1311] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:03.216323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:03.217065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:03.236407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.236924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.237376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.238120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.238591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.239066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.788988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:03.807863 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-090f51de-34a6-4255-89d8-c76b9ae4d86e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1211 microversion: 2.1 time: 0.808855 Sep 19 14:43:03.826245 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 676/1312] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:02 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1211 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:03.840710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:03.842958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:03.859864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.862166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.863034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.864594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:03.866509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:03.867259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:03.960900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:04.138394 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9113ec60-2c88-4ed4-8f44-8e23172c79c0 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 204 len: 0 microversion: 2.1 time: 0.309921 Sep 19 14:43:04.139754 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 677/1313] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:03 2022] DELETE /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:04.150415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:04.151828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:04.164703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:04.166421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:04.167181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:04.168406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:04.169185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:04.169840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:04.984285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:04.993910 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d4c738d-041a-4d51-99bb-183a20e54625 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 0.851549 Sep 19 14:43:05.010339 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 678/1314] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:04 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:05.015456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:05.016105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:05.023023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:05.023528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:05.024002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:05.025560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:05.025896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:05.026334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:05.073624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:05.085457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6b5ad269-3da2-49bf-9d32-7a0c96148b9e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1474 microversion: 2.1 time: 1.877261 Sep 19 14:43:05.088611 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 637/1315] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:03 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1474 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:05.104727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:05.106550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:05.121020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:05.122273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:05.122952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:05.124316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:05.124985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:05.126549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:06.293063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:06.316488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:06.319314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:06.322300 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61aef20d-56aa-45d5-90d8-347fcc39c549 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.311516 Sep 19 14:43:06.335395 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 679/1316] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:05 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:06.352816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:06.354021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:06.371075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:06.373070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:06.374040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:06.375799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:06.376916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:06.377971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:06.491962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:06.505331 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e90ad466-be8c-4805-a3af-ca325ce84e13 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1470 microversion: 2.1 time: 1.415202 Sep 19 14:43:06.512813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 638/1317] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:05 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1470 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:06.797113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b48f69e9-db0c-4431-bac5-0320dd227f13 req-18e23da1-5d88-4928-9c50-f70792e31f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acae3af4-40cc-4a06-8e7d-0603e92dcfa7", "name": "network-vif-unplugged", "status": "completed", "tag": "f32e0873-60a6-42b3-b820-3f4ac1305909"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:06.831879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b48f69e9-db0c-4431-bac5-0320dd227f13 req-18e23da1-5d88-4928-9c50-f70792e31f13 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:06.842270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b48f69e9-db0c-4431-bac5-0320dd227f13 req-18e23da1-5d88-4928-9c50-f70792e31f13 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:06.843545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b48f69e9-db0c-4431-bac5-0320dd227f13 req-18e23da1-5d88-4928-9c50-f70792e31f13 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:06.896707 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b48f69e9-db0c-4431-bac5-0320dd227f13 req-18e23da1-5d88-4928-9c50-f70792e31f13 service nova] Creating event network-vif-unplugged:f32e0873-60a6-42b3-b820-3f4ac1305909 for instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 on n-h2-858384-1 Sep 19 14:43:06.918307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b48f69e9-db0c-4431-bac5-0320dd227f13 req-18e23da1-5d88-4928-9c50-f70792e31f13 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.392994 Sep 19 14:43:06.919996 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 639/1318] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:06.934339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:06.936746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:06.975531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:06.979638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:06.980758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:06.983854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:06.985058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:06.986114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.083883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:08.114074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-01fe3cb9-d0ab-4862-afe3-354bbbf368cb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 1.776675 Sep 19 14:43:08.119487 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 680/1319] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:06 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:08.133040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:08.135729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:08.151222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.153238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.155215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.156991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.159058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.161261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.322497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.327814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.328788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.329651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lazy-loading 'fault' on Instance uuid acae3af4-40cc-4a06-8e7d-0603e92dcfa7 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:08.689077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:08.699088 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7e1bb825-520f-4db5-b54a-9775b78423be tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 200 len: 1309 microversion: 2.1 time: 0.576869 Sep 19 14:43:08.710809 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 681/1320] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:08 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:08.710809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-913a497e-cfe2-404c-ad2f-2ef51ee67d81 req-9d60ef07-663f-40df-927d-0f327b8aeec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fba3b9-9528-42c7-a666-cbd5f158103d", "name": "network-vif-unplugged", "status": "completed", "tag": "7c91d2c7-d1d4-4305-b4a1-488ce3e7e978"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:08.738225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-913a497e-cfe2-404c-ad2f-2ef51ee67d81 req-9d60ef07-663f-40df-927d-0f327b8aeec9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.738732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-913a497e-cfe2-404c-ad2f-2ef51ee67d81 req-9d60ef07-663f-40df-927d-0f327b8aeec9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.742869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-913a497e-cfe2-404c-ad2f-2ef51ee67d81 req-9d60ef07-663f-40df-927d-0f327b8aeec9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.769199 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-913a497e-cfe2-404c-ad2f-2ef51ee67d81 req-9d60ef07-663f-40df-927d-0f327b8aeec9 service nova] Creating event network-vif-unplugged:7c91d2c7-d1d4-4305-b4a1-488ce3e7e978 for instance 94fba3b9-9528-42c7-a666-cbd5f158103d on n-h1-858384-1 Sep 19 14:43:08.806948 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-913a497e-cfe2-404c-ad2f-2ef51ee67d81 req-9d60ef07-663f-40df-927d-0f327b8aeec9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101591 Sep 19 14:43:08.808786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 682/1321] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:08.816588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:08.830044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:08.838515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:08.851424 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bbd949be-c50f-47cf-8184-d447da21bc4a tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 1.929260 Sep 19 14:43:08.854443 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 640/1322] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:06 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:08.864487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.871435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.872740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.874419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.877516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.882631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.891211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:08.891915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:08.908417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.915863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.925477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:08.930123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:08.932856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:08.935563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:09.615437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:09.632622 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91e030e6-a5b4-4e3d-bb65-31a00bb66235 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 200 len: 1428 microversion: 2.1 time: 0.773285 Sep 19 14:43:09.635763 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 641/1323] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:08 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 1428 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:09.659783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:09.661173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:09.691907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:09.692948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:09.698180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:09.702296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:09.703304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:09.706277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:10.710841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:10.756388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:10.757908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:10.759723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab7bea8c-7b99-4cd4-9cb8-e2c7d2adda18 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.948733 Sep 19 14:43:10.760305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 683/1324] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:08 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:10.784481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-17a6c8d8-73ad-47c8-bed8-47147c3d8bea req-ed37244f-56d2-4d04-980e-aaddbce8ea2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef523061-9b8f-4105-8bbd-8a439e6a847c", "name": "network-vif-deleted", "tag": "3824cb1b-7519-470c-8f9f-4bb74e33833b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:10.848107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-17a6c8d8-73ad-47c8-bed8-47147c3d8bea req-ed37244f-56d2-4d04-980e-aaddbce8ea2d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:10.848608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-17a6c8d8-73ad-47c8-bed8-47147c3d8bea req-ed37244f-56d2-4d04-980e-aaddbce8ea2d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:10.866420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-17a6c8d8-73ad-47c8-bed8-47147c3d8bea req-ed37244f-56d2-4d04-980e-aaddbce8ea2d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:10.928504 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-17a6c8d8-73ad-47c8-bed8-47147c3d8bea req-ed37244f-56d2-4d04-980e-aaddbce8ea2d service nova] Creating event network-vif-deleted:3824cb1b-7519-470c-8f9f-4bb74e33833b for instance ef523061-9b8f-4105-8bbd-8a439e6a847c on n-h1-858384-1 Sep 19 14:43:10.950603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-17a6c8d8-73ad-47c8-bed8-47147c3d8bea req-ed37244f-56d2-4d04-980e-aaddbce8ea2d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181540 Sep 19 14:43:10.951536 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 684/1325] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:10.982421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:10.987607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: acae3af4-40cc-4a06-8e7d-0603e92dcfa7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:11.027687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.028699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:11.030451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.031610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.038426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.046017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.048880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.053439 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bf56d1af-5561-439f-a545-6a08578fd992 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 1.412457 Sep 19 14:43:11.077919 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 642/1326] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:09 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:11.095324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:11.099459 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 could not be found. Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 HTTP/1.1 Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:43:11.103879 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 could not be found. Sep 19 14:43:11.105765 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'acae3af4-40cc-4a06-8e7d-0603e92dcfa7'} Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 could not be found. Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:11.106960 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 could not be found. Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 could not be found. Sep 19 14:43:11.108649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.110103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:11.112135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:11.113464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56cc0f8b-1436-4800-b608-c47329e8f3c9 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7" status: 404 len: 111 microversion: 2.1 time: 0.160602 Sep 19 14:43:11.115290 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 685/1327] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:10 2022] GET /compute/v2.1/servers/acae3af4-40cc-4a06-8e7d-0603e92dcfa7 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:11.122116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:11.123194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: ef523061-9b8f-4105-8bbd-8a439e6a847c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:11.133619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.134404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.135522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.136491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.137140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.137742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.148626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.163036 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] HTTP exception thrown: Instance ef523061-9b8f-4105-8bbd-8a439e6a847c could not be found. Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Request method failure captured: Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c HTTP/1.1 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8luv2eSrt4c-pLO2DG052KzwTh5zEQASGirkLY7Kdo2b1Ou6laWRpp8zI43PyrwIk0GAnfgF-LWc4r_56wITNR7DyjZ7QQMRsA4WopVUGgNRa1vITTcaB1gnionV4eG4oRHvKNjHSxeeEPC_9uzSsf4M5t8Dl-CDKoVO4qpa5x3e8 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d6f0ada3b2a1446db012bcbdd2334e94 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:43:11.166185 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d6f0ada3b2a1446db012bcbdd2334e94"}]}] Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d6f0ada3b2a1446db012bcbdd2334e94 Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminTestJSON-190860652-project Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 12de6f76b4c3407ead7ece5ff764c913 Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminTestJSON-190860652-project Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ef523061-9b8f-4105-8bbd-8a439e6a847c could not be found. Sep 19 14:43:11.167967 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ef523061-9b8f-4105-8bbd-8a439e6a847c'} Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef523061-9b8f-4105-8bbd-8a439e6a847c could not be found. Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:11.168804 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef523061-9b8f-4105-8bbd-8a439e6a847c could not be found. Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef523061-9b8f-4105-8bbd-8a439e6a847c could not be found. Sep 19 14:43:11.170161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.173314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Returning 404 to user: Instance ef523061-9b8f-4105-8bbd-8a439e6a847c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:11.174549 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b6d73502-a193-413a-a8ef-e4cc91f2742f tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c" status: 404 len: 111 microversion: 2.1 time: 0.058098 Sep 19 14:43:11.178956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 686/1328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:11 2022] GET /compute/v2.1/servers/ef523061-9b8f-4105-8bbd-8a439e6a847c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:11.187400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acae3af4-40cc-4a06-8e7d-0603e92dcfa7", "name": "network-vif-deleted", "tag": "f32e0873-60a6-42b3-b820-3f4ac1305909"}, {"server_uuid": "af008c9b-060d-4b4b-9fbf-5d98074b4ebf", "name": "network-vif-deleted", "tag": "b5129d39-a81b-4b33-bdf4-60e47b2765de"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:11.240553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.241391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.242099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.255944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.268557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.269132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.269926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.279576 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] Creating event network-vif-deleted:f32e0873-60a6-42b3-b820-3f4ac1305909 for instance acae3af4-40cc-4a06-8e7d-0603e92dcfa7 on n-h2-858384-1 Sep 19 14:43:11.280402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] Creating event network-vif-deleted:b5129d39-a81b-4b33-bdf4-60e47b2765de for instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf on n-h1-858384-1 Sep 19 14:43:11.285163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.285626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.313331 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-93ad6609-1cd2-4830-bc37-c677fed191c2 req-65f96df4-2aab-40b3-8339-036d172d3692 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114769 Sep 19 14:43:11.314538 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 687/1329] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:11.322558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:11.323962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: af008c9b-060d-4b4b-9fbf-5d98074b4ebf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:11.333633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.334446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.335388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.336388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.337170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.337814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.365640 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf could not be found. Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf HTTP/1.1 Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:43:11.367749 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf could not be found. Sep 19 14:43:11.369983 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'af008c9b-060d-4b4b-9fbf-5d98074b4ebf'} Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf could not be found. Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:11.370970 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf could not be found. Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf could not be found. Sep 19 14:43:11.372631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:11.378262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance af008c9b-060d-4b4b-9fbf-5d98074b4ebf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:11.382400 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe44d83c-c22e-4969-b90a-636635819cf2 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf" status: 404 len: 111 microversion: 2.1 time: 0.066230 Sep 19 14:43:11.386028 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 688/1330] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:11 2022] GET /compute/v2.1/servers/af008c9b-060d-4b4b-9fbf-5d98074b4ebf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:11.425567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:11.430684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:11.453322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.456967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.459002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.463100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:11.463899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:11.464704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:11.548321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:11.866676 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be7a08b8-a3b6-483d-9b1b-9be94550f33a tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 204 len: 0 microversion: 2.1 time: 0.477691 Sep 19 14:43:11.873383 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 689/1331] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:11 2022] DELETE /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:11.887593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff0f1284-7a77-4b8c-be81-db197a105f40 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:11.970267 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff0f1284-7a77-4b8c-be81-db197a105f40 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/f400c482-d1b8-4170-ac92-582c6c5bc0c8" status: 204 len: 0 microversion: 2.1 time: 0.093680 Sep 19 14:43:11.970950 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 690/1332] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 14:43:11 2022] DELETE /compute/v2.1/os-server-groups/f400c482-d1b8-4170-ac92-582c6c5bc0c8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:11.991645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:11.993854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:12.018190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:12.018694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:12.019305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:12.023075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:12.024317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:12.030721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:13.921120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:13.958579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7cadb98-571a-497f-b8ef-b7571bd8eddd tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 2.879162 Sep 19 14:43:13.969826 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 643/1333] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:11 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 2892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:14.007623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:14.016749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:14.075080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.084533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.088215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:14.091225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.096814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.105716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:14.241018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:14.260141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:14.269383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:14.272073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-369d44ed-f0ae-4e0b-9151-8ff59f925e69 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 2.300033 Sep 19 14:43:14.284426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 691/1334] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:11 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:14.301570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:14.304638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:14.320448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.321391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.322103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:14.324676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.325809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.331412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:14.395815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:14.657181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.708906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:14.722357 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e65c5b4d-2e88-4266-ad30-fedf0604e5da tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1470 microversion: 2.1 time: 0.745926 Sep 19 14:43:14.739409 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 644/1335] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:13 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1470 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:14.753236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:14.754287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:14.771068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.771971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.772677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:14.773736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.775564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.776296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:14.865747 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d3553b3-ff03-4389-81cd-7b2e4d94b0c0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633" status: 204 len: 0 microversion: 2.1 time: 0.578439 Sep 19 14:43:14.870286 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 692/1336] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:14 2022] DELETE /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:14.902545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9a1dcc3d-a489-460c-bf04-4761e5932852 req-aecc6e96-4676-499d-b5da-962a0173863c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d5ba1-8891-4546-8cbd-cf1bb093680f", "name": "network-vif-plugged", "status": "completed", "tag": "a5ade408-3403-4e42-8df3-6047f3e2e730"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:14.959062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9a1dcc3d-a489-460c-bf04-4761e5932852 req-aecc6e96-4676-499d-b5da-962a0173863c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:14.959961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9a1dcc3d-a489-460c-bf04-4761e5932852 req-aecc6e96-4676-499d-b5da-962a0173863c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:14.960741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9a1dcc3d-a489-460c-bf04-4761e5932852 req-aecc6e96-4676-499d-b5da-962a0173863c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.043037 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9a1dcc3d-a489-460c-bf04-4761e5932852 req-aecc6e96-4676-499d-b5da-962a0173863c service nova] Creating event network-vif-plugged:a5ade408-3403-4e42-8df3-6047f3e2e730 for instance 232d5ba1-8891-4546-8cbd-cf1bb093680f on n-h1-858384-1 Sep 19 14:43:15.068923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9a1dcc3d-a489-460c-bf04-4761e5932852 req-aecc6e96-4676-499d-b5da-962a0173863c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193414 Sep 19 14:43:15.078030 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 693/1337] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:15.104693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-55479d59-92e5-49bb-b27b-52fb42d2065b req-7ec0e24a-c802-431d-9bee-e69147ac9701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fba3b9-9528-42c7-a666-cbd5f158103d", "tag": "7c91d2c7-d1d4-4305-b4a1-488ce3e7e978"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:15.166853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55479d59-92e5-49bb-b27b-52fb42d2065b req-7ec0e24a-c802-431d-9bee-e69147ac9701 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.167761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55479d59-92e5-49bb-b27b-52fb42d2065b req-7ec0e24a-c802-431d-9bee-e69147ac9701 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.168493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55479d59-92e5-49bb-b27b-52fb42d2065b req-7ec0e24a-c802-431d-9bee-e69147ac9701 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.236816 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-55479d59-92e5-49bb-b27b-52fb42d2065b req-7ec0e24a-c802-431d-9bee-e69147ac9701 service nova] Creating event network-changed:7c91d2c7-d1d4-4305-b4a1-488ce3e7e978 for instance 94fba3b9-9528-42c7-a666-cbd5f158103d on n-h1-858384-1 Sep 19 14:43:15.239611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:15.251543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-303f923a-68cf-4efc-be4f-4661efa84cbb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 0.510361 Sep 19 14:43:15.254318 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 645/1338] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:14 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:15.275447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-55479d59-92e5-49bb-b27b-52fb42d2065b req-7ec0e24a-c802-431d-9bee-e69147ac9701 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183694 Sep 19 14:43:15.275447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 694/1339] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:15.292730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:15.293680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:15.312037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:15.313915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.314969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:15.315952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.318063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.319453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.321373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.324532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.345753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.349312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.350181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.357074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.364904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.365826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.385865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:15.662092 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc5d8d3c-dc4c-4bf4-bdf9-00a3eca7bedd tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 204 len: 0 microversion: 2.1 time: 0.391673 Sep 19 14:43:15.672261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 646/1340] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:15 2022] DELETE /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:15.696310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:15.697707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:15.719082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.719758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.720444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.721246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:15.721742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:15.722242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:15.996121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:16.021695 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98f73cd7-7efc-4a43-9178-a427b247eda0 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 0.740892 Sep 19 14:43:16.029362 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 695/1341] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:15 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:16.044408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:16.045051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:16.079319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.079827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.080272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.080992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.081445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.081870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.669044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:16.688223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:16.692591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:16.696844 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ebae2104-22ee-4e9e-9056-d655d224a05b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.026033 Sep 19 14:43:16.709290 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 647/1342] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:15 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:16.728083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:16.734324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:16.752896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.753853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.756457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.760244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.761030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.762251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.824579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:16.847706 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-63c5b186-2df3-4cd7-baec-8276a3ec3200 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633" status: 200 len: 1475 microversion: 2.1 time: 0.817021 Sep 19 14:43:16.858443 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 696/1343] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:16 2022] GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 => generated 1475 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:16.866494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:16.869993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:16.893812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.895004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.895885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.897336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.903647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.904713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.923664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:16.925064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:16.927706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:16.935223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lazy-loading 'fault' on Instance uuid cb0edfc6-3572-4040-881b-4a1785ac4895 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:16.976115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:17.162578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de6f76b4c3407ead7ece5ff764c913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f0ada3b2a1446db012bcbdd2334e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:17.201799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-84ae3af8-2827-4f74-a821-8cba114353f6 tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 200 len: 1304 microversion: 2.1 time: 0.490194 Sep 19 14:43:17.223938 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 648/1344] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:16 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 1304 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:17.281305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:17.289533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:17.326715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:17.329054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:17.331385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:17.334877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:17.337276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:17.339603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:18.998381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:19.047095 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7bdb96f1-d046-4b6a-b917-b09f8913fafc tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1351 microversion: 2.1 time: 1.815765 Sep 19 14:43:19.058130 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 649/1345] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:17 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1351 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:19.085421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6a1f56e9-ccbc-447d-be84-b25bd56bee69 req-6614a2c5-261d-4e31-911f-b76032ade1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0edfc6-3572-4040-881b-4a1785ac4895", "name": "network-vif-deleted", "tag": "275a84b0-d6be-45af-8003-d51afe0e3e1b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:19.128550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6a1f56e9-ccbc-447d-be84-b25bd56bee69 req-6614a2c5-261d-4e31-911f-b76032ade1d2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:19.133552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6a1f56e9-ccbc-447d-be84-b25bd56bee69 req-6614a2c5-261d-4e31-911f-b76032ade1d2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:19.137093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6a1f56e9-ccbc-447d-be84-b25bd56bee69 req-6614a2c5-261d-4e31-911f-b76032ade1d2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:19.188189 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6a1f56e9-ccbc-447d-be84-b25bd56bee69 req-6614a2c5-261d-4e31-911f-b76032ade1d2 service nova] Creating event network-vif-deleted:275a84b0-d6be-45af-8003-d51afe0e3e1b for instance cb0edfc6-3572-4040-881b-4a1785ac4895 on n-h2-858384-1 Sep 19 14:43:19.209383 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6a1f56e9-ccbc-447d-be84-b25bd56bee69 req-6614a2c5-261d-4e31-911f-b76032ade1d2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143523 Sep 19 14:43:19.214662 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 650/1346] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:19.235907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:19.236632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:19.256919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:19.271152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:19.272106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:19.273139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:19.273804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:19.275132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:19.405686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:19.426451 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2a38efd-7f05-4d03-b6f2-4e3510b6a91e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 2.570132 Sep 19 14:43:19.428631 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 697/1347] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:16 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 2576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:19.456037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:19.461865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:19.496892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:19.497403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:19.499275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:19.505061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:19.506735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:19.510394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:20.383525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:20.407591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:20.416750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:20.418223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-252b5829-ffc5-49f3-ac97-2fc9b2089fd4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.201868 Sep 19 14:43:20.427176 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 651/1348] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:19 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:20.435443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:20.451631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] [instance: cb0edfc6-3572-4040-881b-4a1785ac4895] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:20.478780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:20.480296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:20.482309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:20.483299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:20.487421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:20.489726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:20.545303 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] HTTP exception thrown: Instance cb0edfc6-3572-4040-881b-4a1785ac4895 could not be found. Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Request method failure captured: Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 HTTP/1.1 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8luv2eSrt4c-pLO2DG052KzwTh5zEQASGirkLY7Kdo2b1Ou6laWRpp8zI43PyrwIk0GAnfgF-LWc4r_56wITNR7DyjZ7QQMRsA4WopVUGgNRa1vITTcaB1gnionV4eG4oRHvKNjHSxeeEPC_9uzSsf4M5t8Dl-CDKoVO4qpa5x3e8 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d6f0ada3b2a1446db012bcbdd2334e94 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:20.556912 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d6f0ada3b2a1446db012bcbdd2334e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d6f0ada3b2a1446db012bcbdd2334e94"}]}] Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d6f0ada3b2a1446db012bcbdd2334e94 Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAdminTestJSON-190860652 Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAdminTestJSON-190860652-project Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 12de6f76b4c3407ead7ece5ff764c913 Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAdminTestJSON-190860652-project Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance cb0edfc6-3572-4040-881b-4a1785ac4895 could not be found. Sep 19 14:43:20.558501 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'cb0edfc6-3572-4040-881b-4a1785ac4895'} Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb0edfc6-3572-4040-881b-4a1785ac4895 could not be found. Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:20.559341 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb0edfc6-3572-4040-881b-4a1785ac4895 could not be found. Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb0edfc6-3572-4040-881b-4a1785ac4895 could not be found. Sep 19 14:43:20.560780 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:20.562079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] Returning 404 to user: Instance cb0edfc6-3572-4040-881b-4a1785ac4895 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:20.565513 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-295cf26d-c69d-4aa6-84c8-816cddc28ada tempest-ServersAdminTestJSON-190860652 tempest-ServersAdminTestJSON-190860652-project] 10.222.0.81 "GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895" status: 404 len: 111 microversion: 2.1 time: 0.136790 Sep 19 14:43:20.572023 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 652/1349] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:20 2022] GET /compute/v2.1/servers/cb0edfc6-3572-4040-881b-4a1785ac4895 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:20.592018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:20.592645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:20.615790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:20.616300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:20.616747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:20.617480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:20.618525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:20.628678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:21.643159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:21.655859 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-65b55506-ff6b-4bb2-9f3b-106eadb431ff tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633" status: 200 len: 1475 microversion: 2.1 time: 2.219399 Sep 19 14:43:21.659116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 698/1350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:19 2022] GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 => generated 1475 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:21.668363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:21.671511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:21.690308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:21.693203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:21.694817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:21.695855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:21.699431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:21.700527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:22.823168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:22.847259 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-34213892-da73-45bb-a231-113b7b9aa1be tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1541 microversion: 2.1 time: 2.274225 Sep 19 14:43:22.851705 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 653/1351] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:20 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1541 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:22.858649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ffbdb8b3-d27a-46fc-bb29-69abfe9bfe81 req-7ab15da6-f3e3-44a3-8823-9aa02b41b3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f", "name": "network-vif-unplugged", "status": "completed", "tag": "64f45d91-a8b5-407b-8a52-7529acd6c48f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:22.916571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ffbdb8b3-d27a-46fc-bb29-69abfe9bfe81 req-7ab15da6-f3e3-44a3-8823-9aa02b41b3cf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:22.917548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ffbdb8b3-d27a-46fc-bb29-69abfe9bfe81 req-7ab15da6-f3e3-44a3-8823-9aa02b41b3cf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:22.918309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ffbdb8b3-d27a-46fc-bb29-69abfe9bfe81 req-7ab15da6-f3e3-44a3-8823-9aa02b41b3cf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:22.951422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ffbdb8b3-d27a-46fc-bb29-69abfe9bfe81 req-7ab15da6-f3e3-44a3-8823-9aa02b41b3cf service nova] Creating event network-vif-unplugged:64f45d91-a8b5-407b-8a52-7529acd6c48f for instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f on n-h1-858384-1 Sep 19 14:43:22.966114 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ffbdb8b3-d27a-46fc-bb29-69abfe9bfe81 req-7ab15da6-f3e3-44a3-8823-9aa02b41b3cf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111787 Sep 19 14:43:22.966442 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 654/1352] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:22.999420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:23.000586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:23.046069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:23.050830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:23.054123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:23.056724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:23.059447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:23.061564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:23.256911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:23.284324 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9ec80dbb-44d2-4ef7-b90c-c6f4faf128ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 1.623765 Sep 19 14:43:23.304407 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 699/1353] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:21 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:23.856848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-972748213", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "7862b33f-da6f-4cc0-a3ea-682779620bca"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:24.281022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] validate_networks() for [('7862b33f-da6f-4cc0-a3ea-682779620bca', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:43:26.111879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:26.144943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:26.149533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:26.156990 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2887fd92-c606-4426-b138-59ac4d8de5ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 3.173219 Sep 19 14:43:26.158163 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 655/1354] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:22 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 3191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:26.167921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:26.168634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 5a1394eb-90c8-4b69-9f2c-a9d5834cf633] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:26.198942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:26.199844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:26.203367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:26.205092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:26.213446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:26.214915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:26.277534 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 could not be found. Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 HTTP/1.1 Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:26.281304 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 could not be found. Sep 19 14:43:26.284165 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5a1394eb-90c8-4b69-9f2c-a9d5834cf633'} Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 could not be found. Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:26.285700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 could not be found. Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 could not be found. Sep 19 14:43:26.288242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:26.293107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:26.295002 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb984de4-6ee5-4fbe-9fd4-445472882f69 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633" status: 404 len: 111 microversion: 2.1 time: 0.135245 Sep 19 14:43:26.296289 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 656/1355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:26 2022] GET /compute/v2.1/servers/5a1394eb-90c8-4b69-9f2c-a9d5834cf633 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:26.313748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:26.316479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:26.343641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:26.350195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:26.351387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:26.353949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:26.355200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:26.368051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:26.769795 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4455bbf8-f8e4-40be-8391-03279f17fb98 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.471699 Sep 19 14:43:26.772489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 657/1356] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:43:26 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f/os-interface => generated 284 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:26.784541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-903fbc85-5f74-45e1-a6f0-67bcffd12891 req-cc49f7ec-233d-49bf-9d59-736b75503f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f", "name": "network-vif-deleted", "tag": "64f45d91-a8b5-407b-8a52-7529acd6c48f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:26.827369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-903fbc85-5f74-45e1-a6f0-67bcffd12891 req-cc49f7ec-233d-49bf-9d59-736b75503f2d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:26.828089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-903fbc85-5f74-45e1-a6f0-67bcffd12891 req-cc49f7ec-233d-49bf-9d59-736b75503f2d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:26.828653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-903fbc85-5f74-45e1-a6f0-67bcffd12891 req-cc49f7ec-233d-49bf-9d59-736b75503f2d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:26.856438 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-903fbc85-5f74-45e1-a6f0-67bcffd12891 req-cc49f7ec-233d-49bf-9d59-736b75503f2d service nova] Creating event network-vif-deleted:64f45d91-a8b5-407b-8a52-7529acd6c48f for instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f on n-h1-858384-1 Sep 19 14:43:26.882805 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-903fbc85-5f74-45e1-a6f0-67bcffd12891 req-cc49f7ec-233d-49bf-9d59-736b75503f2d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108197 Sep 19 14:43:26.883975 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 658/1357] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:26.937075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-47e05d10-8956-4379-ac41-32fc19d5963d req-1fabebfc-2822-4c5c-82d4-8f08bdc8e63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1394eb-90c8-4b69-9f2c-a9d5834cf633", "name": "network-vif-deleted", "tag": "a58ef42b-4694-4396-b183-28ed5e188474"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:27.002287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47e05d10-8956-4379-ac41-32fc19d5963d req-1fabebfc-2822-4c5c-82d4-8f08bdc8e63c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:27.002812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47e05d10-8956-4379-ac41-32fc19d5963d req-1fabebfc-2822-4c5c-82d4-8f08bdc8e63c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:27.003257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47e05d10-8956-4379-ac41-32fc19d5963d req-1fabebfc-2822-4c5c-82d4-8f08bdc8e63c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:27.056884 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-47e05d10-8956-4379-ac41-32fc19d5963d req-1fabebfc-2822-4c5c-82d4-8f08bdc8e63c service nova] Creating event network-vif-deleted:a58ef42b-4694-4396-b183-28ed5e188474 for instance 5a1394eb-90c8-4b69-9f2c-a9d5834cf633 on n-h1-858384-1 Sep 19 14:43:27.070172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-47e05d10-8956-4379-ac41-32fc19d5963d req-1fabebfc-2822-4c5c-82d4-8f08bdc8e63c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174225 Sep 19 14:43:27.073874 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 659/1358] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:27.082637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:27.083586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:27.092264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:27.093051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:27.093688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:27.094713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:27.095420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:27.096039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.592024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:43:28.592538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:43:28.592920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:43:28.593339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:43:28.593762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:43:28.639051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:28.670990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:28.671498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:28.671950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.672700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:28.676030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:28.676826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.710526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Getting quotas for project 790c18f8122348fcb13f683ceb27a507. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:43:28.717408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Getting quotas for user 4aa36c5ae29f43ddaaa73287caa77464 and project 790c18f8122348fcb13f683ceb27a507. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:43:28.734723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:43:28.737555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:43:28.826882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2310b7aa-bc12-4eca-9026-c056753fde88 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.513192 Sep 19 14:43:28.828157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 700/1359] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:43:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:43:28.836283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:28.839188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:28.862859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:28.863942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:28.864661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.867182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:28.869239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:28.869954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.887628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:28.905498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-afe27a4a-8d8a-4ecb-8997-4c0ac7ed5cf7 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 1.830241 Sep 19 14:43:28.908184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 660/1360] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:27 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:28.914601 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f could not be found. Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f HTTP/1.1 Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:43:28.917339 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f could not be found. Sep 19 14:43:28.918719 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f'} Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f could not be found. Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:28.919521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f could not be found. Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f could not be found. Sep 19 14:43:28.920812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:28.921962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:28.923651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:28.928086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance 8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:28.934577 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14bef6d8-79e7-4905-a27d-19b55cf75d50 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f" status: 404 len: 111 microversion: 2.1 time: 0.102835 Sep 19 14:43:28.939409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:28.940735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:28.940976 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 701/1361] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:28 2022] GET /compute/v2.1/servers/8c7af889-d8f1-40e4-aa5a-4ffcc1f1e94f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:28.942678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.944328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:28.946340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:28.947114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:28.950780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7bb82f86-0d0d-450a-95bb-5c7200170048 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:28.967278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7bb82f86-0d0d-450a-95bb-5c7200170048 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:29.356323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7bb82f86-0d0d-450a-95bb-5c7200170048 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:29.363842 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7bb82f86-0d0d-450a-95bb-5c7200170048 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1215 microversion: 2.1 time: 0.421551 Sep 19 14:43:29.364578 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 702/1362] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:28 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1215 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:29.371255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-670e0f54-625a-42a8-96c5-584fbd027c6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:29.431261 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-670e0f54-625a-42a8-96c5-584fbd027c6e tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/295b47a1-efb2-424b-84d9-e8e135348118" status: 204 len: 0 microversion: 2.1 time: 0.062258 Sep 19 14:43:29.432942 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 703/1363] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 14:43:29 2022] DELETE /compute/v2.1/os-server-groups/295b47a1-efb2-424b-84d9-e8e135348118 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:29.899683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1532567409", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:29.908020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:29.934517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:29.941639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:29.945615 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5d5b4ef-897b-4a0b-b389-8065ee455282 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.036056 Sep 19 14:43:29.980417 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 661/1364] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:28 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:30.003930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a169ab8d-d4b1-4985-bb99-51bb4d8d6997 req-c286aa3c-9e5a-4864-b0af-ae02978e2d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79aa5ee2-e9a7-4c00-b134-6038827ed547", "name": "network-vif-plugged", "status": "completed", "tag": "a887118d-871a-4250-bdb1-61d05b1899b8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:30.028681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:43:30.047289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a169ab8d-d4b1-4985-bb99-51bb4d8d6997 req-c286aa3c-9e5a-4864-b0af-ae02978e2d4a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:30.049205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a169ab8d-d4b1-4985-bb99-51bb4d8d6997 req-c286aa3c-9e5a-4864-b0af-ae02978e2d4a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:30.050049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a169ab8d-d4b1-4985-bb99-51bb4d8d6997 req-c286aa3c-9e5a-4864-b0af-ae02978e2d4a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:30.089541 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a169ab8d-d4b1-4985-bb99-51bb4d8d6997 req-c286aa3c-9e5a-4864-b0af-ae02978e2d4a service nova] Creating event network-vif-plugged:a887118d-871a-4250-bdb1-61d05b1899b8 for instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 on n-h1-858384-1 Sep 19 14:43:30.096731 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a169ab8d-d4b1-4985-bb99-51bb4d8d6997 req-c286aa3c-9e5a-4864-b0af-ae02978e2d4a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113451 Sep 19 14:43:30.098143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 662/1365] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:30.104471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:30.105987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:30.126271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:30.130318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:30.131233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:30.132256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:30.132981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:30.134183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:30.193299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:30.363327 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2c94722-6912-47be-ae51-2cdd46dde260 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 204 len: 0 microversion: 2.1 time: 0.263300 Sep 19 14:43:30.367950 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 663/1366] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:30 2022] DELETE /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:30.470826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-af7e0279-8929-4255-a6ae-58146f0367b5 req-07d4bcc8-2549-4a66-bd8c-1d65e709aa49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d5ba1-8891-4546-8cbd-cf1bb093680f", "tag": "a5ade408-3403-4e42-8df3-6047f3e2e730"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:30.542095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-af7e0279-8929-4255-a6ae-58146f0367b5 req-07d4bcc8-2549-4a66-bd8c-1d65e709aa49 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:30.542609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-af7e0279-8929-4255-a6ae-58146f0367b5 req-07d4bcc8-2549-4a66-bd8c-1d65e709aa49 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:30.543088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-af7e0279-8929-4255-a6ae-58146f0367b5 req-07d4bcc8-2549-4a66-bd8c-1d65e709aa49 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:30.605719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-af7e0279-8929-4255-a6ae-58146f0367b5 req-07d4bcc8-2549-4a66-bd8c-1d65e709aa49 service nova] Creating event network-changed:a5ade408-3403-4e42-8df3-6047f3e2e730 for instance 232d5ba1-8891-4546-8cbd-cf1bb093680f on n-h1-858384-1 Sep 19 14:43:30.620232 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-af7e0279-8929-4255-a6ae-58146f0367b5 req-07d4bcc8-2549-4a66-bd8c-1d65e709aa49 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200689 Sep 19 14:43:30.624404 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 664/1367] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:30.630034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:30.630957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:30.639547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:30.640063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:30.640511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:30.641279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:30.641747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:30.642180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:31.012717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:31.026850 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c0bb2b1-e8d7-40f7-815a-06b4b361c80b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1199 microversion: 2.1 time: 0.400986 Sep 19 14:43:31.035707 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 665/1368] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:30 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1199 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:31.058729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:31.069228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:31.094683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:31.095650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:31.096481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:31.100201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:31.103700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:31.108474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:31.299387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:43:31.299877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:43:31.300723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:43:31.300723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:43:31.301980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:43:31.325529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:31.326651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:31.329832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:31.332755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:31.333451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:31.336403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:31.387253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Getting quotas for project fbf6967d28fc4b16a0883a5c8a2c473e. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:43:31.405651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Getting quotas for user 41b72628bee74704936d97b9391238a8 and project fbf6967d28fc4b16a0883a5c8a2c473e. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:43:31.486300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:43:31.495737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:43:31.672155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-247a2e6e-8a57-4df5-8260-d245b9d8bf35 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237730 Sep 19 14:43:31.672825 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 704/1369] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:43:31.720318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:31.721552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:31.765301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:31.768904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:31.770051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:31.771439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:31.776035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:31.780343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:32.210988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:32.228371 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da5a0efd-1dfe-4414-b4a6-8a637a8109f1 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1211 microversion: 2.1 time: 0.543830 Sep 19 14:43:32.247687 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 705/1370] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:31 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1211 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:32.293868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:32.306707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:32.330739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:32.334661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:32.335450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:32.337063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:32.338558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:32.341675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:32.674568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:32.700236 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-69f81ae9-3bcc-494f-919b-a17e91357bd0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1473 microversion: 2.1 time: 1.657405 Sep 19 14:43:32.714840 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 666/1371] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:31 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1473 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:33.024819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbae9608-7ac4-4435-86d0-c5cb8a213356 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Action: 'create', calling method: .version_select at 0x7fde29ee33a0>, body: {"keypair": {"name": "tempest-keypair-130472108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaDcTpxquLJ/CV78OxcIaFNqfqT4oYGP0vEBMnVgw7oauWk629cY5GgDy0RRJO94wrvDiy1ai+0S+epGzew+QYtxrqxNZ+WjBEx3cXCx6qJwilfmkf/6JxciOyAhajohA=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:33.106878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-dbae9608-7ac4-4435-86d0-c5cb8a213356 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Getting quotas for project c204b981d98b46c29a36a09c38266982. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:43:33.137395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-dbae9608-7ac4-4435-86d0-c5cb8a213356 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Getting quotas for user c157ab3e33fe4f648c425f54f7347b39 and project c204b981d98b46c29a36a09c38266982. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:43:33.225434 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbae9608-7ac4-4435-86d0-c5cb8a213356 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.518511 Sep 19 14:43:33.236922 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 667/1372] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:43:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:33.252739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-732bb3a3-b577-42a2-a8f0-cfe4aa667d3d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:33.255768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-732bb3a3-b577-42a2-a8f0-cfe4aa667d3d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:34.170700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-732bb3a3-b577-42a2-a8f0-cfe4aa667d3d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:34.179025 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-732bb3a3-b577-42a2-a8f0-cfe4aa667d3d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1214 microversion: 2.1 time: 0.933526 Sep 19 14:43:34.195621 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 668/1373] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:33 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1214 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:34.212228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:34.213457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:34.232898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:34.233657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:34.235990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:34.237049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:34.239249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:34.239990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:34.257716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:34.281086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:34.289459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:34.292942 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d70b3e95-905f-4ffa-845d-44dc61945983 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 2.031201 Sep 19 14:43:34.296141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 706/1374] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:32 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:34.311317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:34.313483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:34.329937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:34.332115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:34.338592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:34.340092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:34.340752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:34.342580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:34.697507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:34.732478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ed4da65-91e5-4422-88a1-2bf781c0afcd tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1273 microversion: 2.1 time: 0.434303 Sep 19 14:43:34.734208 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 707/1375] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:34 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1273 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:34.752854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:34.756880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:34.796955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:34.797605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:34.798069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:34.798866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:34.812093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:34.814214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:35.149648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0108349524048938b8e8dad78cf2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c474c76d064369addb54e031ce368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:35.173991 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa6342c3-4dd8-401b-95aa-3c9e48b524a0 tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 200 len: 1302 microversion: 2.1 time: 0.436098 Sep 19 14:43:35.174992 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 708/1376] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:34 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 1302 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:35.195396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-cbc8db04-3a92-4aad-9a4d-02ed87113366 req-dd3b8dd5-3df7-443a-9b67-7723565f146b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9085e40-1d2e-49e2-b258-cf1528c9877b", "name": "network-vif-deleted", "tag": "ecb476e9-c2c4-486c-a74a-06020674886d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:35.252209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cbc8db04-3a92-4aad-9a4d-02ed87113366 req-dd3b8dd5-3df7-443a-9b67-7723565f146b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:35.253376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cbc8db04-3a92-4aad-9a4d-02ed87113366 req-dd3b8dd5-3df7-443a-9b67-7723565f146b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:35.256023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cbc8db04-3a92-4aad-9a4d-02ed87113366 req-dd3b8dd5-3df7-443a-9b67-7723565f146b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:35.292926 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-cbc8db04-3a92-4aad-9a4d-02ed87113366 req-dd3b8dd5-3df7-443a-9b67-7723565f146b service nova] Creating event network-vif-deleted:ecb476e9-c2c4-486c-a74a-06020674886d for instance c9085e40-1d2e-49e2-b258-cf1528c9877b on n-h2-858384-1 Sep 19 14:43:35.324505 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-cbc8db04-3a92-4aad-9a4d-02ed87113366 req-dd3b8dd5-3df7-443a-9b67-7723565f146b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142439 Sep 19 14:43:35.325221 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 709/1377] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:35.349735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:35.356127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:35.381332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:35.381846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:35.382295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:35.383109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:35.383637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:35.384101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:36.078921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:36.097693 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ef79302-f873-4488-b4c3-6a1b1e5ab12d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1383 microversion: 2.1 time: 1.900151 Sep 19 14:43:36.101068 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 669/1378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:34 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1383 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:36.141562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:36.144175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:36.163050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:36.170402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:36.170991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:36.172471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:36.172471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:36.172707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:36.377251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:36.391128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-28e3292a-9e11-457a-bd9a-7d743731b4ce tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1272 microversion: 2.1 time: 1.060696 Sep 19 14:43:36.407817 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 710/1379] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:35 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1272 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:36.412619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:36.413260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:36.445358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:36.456751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:36.457324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:36.458110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:36.458602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:36.459077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:37.331143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:37.372573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:37.394683 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d3fde601-052c-4f35-aff1-0b9e103b9d75 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1315 microversion: 2.1 time: 0.986149 Sep 19 14:43:37.396010 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 711/1380] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:36 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:37.445534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:37.459437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:37.476722 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d27deb72-e4cc-4900-8dad-32bce67ae854 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1813 microversion: 2.25 time: 1.358153 Sep 19 14:43:37.488380 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 670/1381] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:36 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1813 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:37.536766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:37.549946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] [instance: c9085e40-1d2e-49e2-b258-cf1528c9877b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:37.584709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:37.587118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:37.587832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:37.589290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:37.595811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:37.597555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:37.612175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.657287 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] HTTP exception thrown: Instance c9085e40-1d2e-49e2-b258-cf1528c9877b could not be found. Sep 19 14:43:37.664822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:37.666043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Request method failure captured: Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b HTTP/1.1 Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH8Ou2iEh6kMRp7Q1XcTQLer7eHkO8es-48Df45Gl_n1q_o086mmMgwGGSXskZGJ2-YDuG2NmSVCoafj3Y8mgboEYhKzIfVlSW1cbjkFRuvXZ28O4QesF6WB_WtGA9YXjI5Wsq1cfci5coAdasrcq68oHdBjQgbARX_jWrPK-udd5Ug Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:37.682515 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_32c474c76d064369addb54e031ce368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/32c474c76d064369addb54e031ce368b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/32c474c76d064369addb54e031ce368b"}]}] Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 32c474c76d064369addb54e031ce368b Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2124256156 Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a0108349524048938b8e8dad78cf2189 Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersOnMultiNodesTest-2124256156-project Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance c9085e40-1d2e-49e2-b258-cf1528c9877b could not be found. Sep 19 14:43:37.684382 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c9085e40-1d2e-49e2-b258-cf1528c9877b'} Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9085e40-1d2e-49e2-b258-cf1528c9877b could not be found. Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:37.685344 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9085e40-1d2e-49e2-b258-cf1528c9877b could not be found. Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9085e40-1d2e-49e2-b258-cf1528c9877b could not be found. Sep 19 14:43:37.686919 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:37.688159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] Returning 404 to user: Instance c9085e40-1d2e-49e2-b258-cf1528c9877b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:37.688159 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff694d96-b230-42db-8c66-28bd09122c3f tempest-ServersOnMultiNodesTest-2124256156 tempest-ServersOnMultiNodesTest-2124256156-project] 10.222.0.81 "GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b" status: 404 len: 111 microversion: 2.1 time: 0.194138 Sep 19 14:43:37.709126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:37.709709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:37.710175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:37.710968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:37.712068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:37.715264 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 671/1382] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:37 2022] GET /compute/v2.1/servers/c9085e40-1d2e-49e2-b258-cf1528c9877b => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:37.731819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:37.745313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:37.747326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:37.799902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:37.804720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:37.806016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:37.811124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:37.812686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:37.817728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:38.207779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:38.224203 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-841bb529-dd5c-45c1-a51d-4a466ed2100b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1272 microversion: 2.1 time: 0.507668 Sep 19 14:43:38.227464 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 672/1383] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:37 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1272 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:38.436488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:38.437541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:38.462813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:38.463393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:38.468834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:38.471779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:38.473880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:38.475326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:39.222856 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-80eb01d0-f765-41f4-a11b-3ae8dc1bc712 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1534 microversion: 2.1 time: 1.823256 Sep 19 14:43:39.223551 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 712/1384] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:37 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1534 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:39.241567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:39.242203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:39.274973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:39.276013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:39.284734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:39.285733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:39.286923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:39.287544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:39.733620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:39.760323 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1dcca865-f59b-4f4f-a9fb-dac85a341c4a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1315 microversion: 2.1 time: 1.326319 Sep 19 14:43:39.761823 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 673/1385] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:38 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1315 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:39.795039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4a44c553-3722-40a4-9357-e9bacb2a6934 req-688d4d96-5803-4391-bcf6-2b8b6990de59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c4eb4c-9dd4-4a9d-8287-59a4d868d21c", "tag": "58c34657-5b74-4e5b-a896-b5779b46a2bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:39.845085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4a44c553-3722-40a4-9357-e9bacb2a6934 req-688d4d96-5803-4391-bcf6-2b8b6990de59 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:39.845956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4a44c553-3722-40a4-9357-e9bacb2a6934 req-688d4d96-5803-4391-bcf6-2b8b6990de59 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:39.847994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4a44c553-3722-40a4-9357-e9bacb2a6934 req-688d4d96-5803-4391-bcf6-2b8b6990de59 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:39.937435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4a44c553-3722-40a4-9357-e9bacb2a6934 req-688d4d96-5803-4391-bcf6-2b8b6990de59 service nova] Creating event network-changed:58c34657-5b74-4e5b-a896-b5779b46a2bf for instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c on n-h2-858384-1 Sep 19 14:43:39.971344 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4a44c553-3722-40a4-9357-e9bacb2a6934 req-688d4d96-5803-4391-bcf6-2b8b6990de59 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203795 Sep 19 14:43:39.972563 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 674/1386] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:39.984850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:39.986837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:40.001014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.001844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.003125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.004467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.005782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.006404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.091086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:40.118678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:40.125440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:40.129947 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-34c7a081-dd4e-4d64-8225-eeb11b16b0e8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1803 microversion: 2.25 time: 0.904956 Sep 19 14:43:40.131268 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 713/1387] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:39 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1803 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:40.139339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:40.140546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:40.150595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.152839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.153567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.155381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.157936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.159313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.444138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:40.455661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d81552e-6254-49c8-b07e-85f21096b35f tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1272 microversion: 2.1 time: 0.481262 Sep 19 14:43:40.456252 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 675/1388] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:39 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1272 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:40.467598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8feb571f-00e4-454f-b3b1-21fe1f12e8e4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '.version_select at 0x7fde29dd6670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:40.485002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feb571f-00e4-454f-b3b1-21fe1f12e8e4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.490557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feb571f-00e4-454f-b3b1-21fe1f12e8e4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.491332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feb571f-00e4-454f-b3b1-21fe1f12e8e4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.517180 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8feb571f-00e4-454f-b3b1-21fe1f12e8e4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.053169 Sep 19 14:43:40.526521 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 676/1389] 10.222.0.81 () {60 vars in 1184 bytes} [Mon Sep 19 14:43:40 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:40.543234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:40.544144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:40.557576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.558365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.561698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.562618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.563136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.567852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.637521 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-532e2fc6-6c71-4086-b1cd-eefb797b046e tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1534 microversion: 2.1 time: 0.504601 Sep 19 14:43:40.639271 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 714/1390] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:40 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1534 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:40.669159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:40.676464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.677517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.678313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.679510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.682116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.683454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.700875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:40.733357 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b166aaa-09b8-4294-a7e5-88c790b3c297 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071089 Sep 19 14:43:40.743469 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 715/1391] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:43:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:40.749189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-1", "block_migration": false, "disk_over_commit": false}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:40.752375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:40.760560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.767248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.768117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.769640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:40.770328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:40.773236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:40.809994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lazy-loading 'flavor' on Instance uuid 79aa5ee2-e9a7-4c00-b134-6038827ed547 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:40.826070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Going to try to live migrate instance to n-h2-858384-1 {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:43:41.275423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 94fba3b9-9528-42c7-a666-cbd5f158103d {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:41.308680 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f63b6af1-16f4-4d6c-8bde-8bdc8b25a777 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 2422 microversion: 2.25 time: 0.770638 Sep 19 14:43:41.314107 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 677/1392] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:40 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 2422 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:43:41.327551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1854586612", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b8b5b1b5-4968-4be9-8320-4a3dc5b18d81"}], "security_groups": [{"name": "tempest-securitygroup--1899489515"}], "key_name": "tempest-keypair-130472108", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:41.444059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:41.578692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] validate_networks() for [('b8b5b1b5-4968-4be9-8320-4a3dc5b18d81', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:43:41.864577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.713382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:43:42.714003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:43:42.714274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:43:42.714686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:43:42.715225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:43:42.738295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:42.739213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:42.739846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:42.744551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:42.745320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:42.746121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:42.803234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Getting quotas for project c204b981d98b46c29a36a09c38266982. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:43:42.822166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Getting quotas for user c157ab3e33fe4f648c425f54f7347b39 and project c204b981d98b46c29a36a09c38266982. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:43:42.871136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:43:42.875891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:43:43.005846 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed53fcb1-46c5-4e4f-8c75-6bf5f8e81744 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.687762 Sep 19 14:43:43.006622 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 678/1393] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:43:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:43:43.036925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:43.043938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:43.059933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:43.061717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:43.062556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:43.064378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:43.065966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:43.066650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:43.445750 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0e8a1bc4-40e3-4343-b0b1-1002baacf184 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547/action" status: 202 len: 0 microversion: 2.1 time: 2.700285 Sep 19 14:43:43.447574 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 716/1394] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:43:40 2022] POST /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547/action => generated 0 bytes in 2703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:43:43.458514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:43.469098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:43.523258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:43.523899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:43.526429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:43.529076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:43.531198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:43.533187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:43.848650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:43.890469 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e3d9856-a5e3-4d9d-872f-d2098a269e68 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1315 microversion: 2.1 time: 0.873354 Sep 19 14:43:43.894084 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 679/1395] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:43 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:43.927502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:43.929425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:43.984819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:43.991051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:43.993296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:43.999087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.006003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.011971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.161127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 94fba3b9-9528-42c7-a666-cbd5f158103d {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:44.231342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bce3117d-ce76-43fb-8eb6-e0dbb5b8e034 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 2422 microversion: 2.25 time: 0.777997 Sep 19 14:43:44.233322 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 717/1396] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:43:43 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 2422 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:43:44.240145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-25d8ba6e-3e7a-4764-8287-14ada7655d9d req-e565af7b-7e10-4800-ade0-ce9bbcabf4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77bb2388-3726-4724-a067-f347a853cdb6", "tag": "234461cb-a1cd-4629-bf54-6bc1def9b30e"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:44.337260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25d8ba6e-3e7a-4764-8287-14ada7655d9d req-e565af7b-7e10-4800-ade0-ce9bbcabf4e6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.337691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25d8ba6e-3e7a-4764-8287-14ada7655d9d req-e565af7b-7e10-4800-ade0-ce9bbcabf4e6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.346987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25d8ba6e-3e7a-4764-8287-14ada7655d9d req-e565af7b-7e10-4800-ade0-ce9bbcabf4e6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.377216 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-25d8ba6e-3e7a-4764-8287-14ada7655d9d req-e565af7b-7e10-4800-ade0-ce9bbcabf4e6 service nova] Creating event network-changed:234461cb-a1cd-4629-bf54-6bc1def9b30e for instance 77bb2388-3726-4724-a067-f347a853cdb6 on n-h2-858384-1 Sep 19 14:43:44.392227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-25d8ba6e-3e7a-4764-8287-14ada7655d9d req-e565af7b-7e10-4800-ade0-ce9bbcabf4e6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155667 Sep 19 14:43:44.395189 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 718/1397] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:44.417635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:44.420192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:44.455832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.457198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.457893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.459820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.460555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.461615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.513856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:44.532231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-52e0a6ee-8cc9-409b-88e6-b89774bfa26e tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1314 microversion: 2.1 time: 0.635255 Sep 19 14:43:44.537643 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 680/1398] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:43 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:44.554795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:44.556098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:44.575202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.576016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.576572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.577490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.579391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.580150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.877531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:44.889649 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21a357d4-cc3b-46d2-869b-105f8badc6e9 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1245 microversion: 2.1 time: 0.491800 Sep 19 14:43:44.893273 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 719/1399] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:44 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1245 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:44.924464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:44.925487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:44.939036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.939861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.940994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:44.941971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:44.944692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:44.945471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.188529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:45.198072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-add9686b-e875-4dca-9dd2-178259eca48f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.658976 Sep 19 14:43:45.198663 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 681/1400] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:44 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:45.214209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:45.215011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:45.223407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.224135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.224748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.225633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.226290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.227920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.270816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:45.282978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7aa691e-65dc-4b40-aa1e-f05f8e74aa3f tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1315 microversion: 2.1 time: 0.363645 Sep 19 14:43:45.284028 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 720/1401] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:44 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:43:45.417187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lazy-loading 'services' on Instance uuid 94fba3b9-9528-42c7-a666-cbd5f158103d {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:45.642684 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5066f472-bf7e-425a-a1b8-30fd13950406 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "DELETE /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments/250a0b21-a8c7-46f6-bb6d-9ec709e90dbb" status: 202 len: 0 microversion: 2.25 time: 0.442671 Sep 19 14:43:45.643960 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 682/1402] 10.222.0.81 () {60 vars in 1457 bytes} [Mon Sep 19 14:43:45 2022] DELETE /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments/250a0b21-a8c7-46f6-bb6d-9ec709e90dbb => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:45.653166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-518e5846-b0be-434d-868d-2ae73a9b4911 req-528a16b3-e5d0-4471-bf4d-07e4f0eca1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4eb4c-9dd4-4a9d-8287-59a4d868d21c", "name": "network-vif-plugged", "status": "completed", "tag": "58c34657-5b74-4e5b-a896-b5779b46a2bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:45.667192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-518e5846-b0be-434d-868d-2ae73a9b4911 req-528a16b3-e5d0-4471-bf4d-07e4f0eca1cc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.668088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-518e5846-b0be-434d-868d-2ae73a9b4911 req-528a16b3-e5d0-4471-bf4d-07e4f0eca1cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.668970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-518e5846-b0be-434d-868d-2ae73a9b4911 req-528a16b3-e5d0-4471-bf4d-07e4f0eca1cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.698889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-518e5846-b0be-434d-868d-2ae73a9b4911 req-528a16b3-e5d0-4471-bf4d-07e4f0eca1cc service nova] Creating event network-vif-plugged:58c34657-5b74-4e5b-a896-b5779b46a2bf for instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c on n-h2-858384-1 Sep 19 14:43:45.706512 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-518e5846-b0be-434d-868d-2ae73a9b4911 req-528a16b3-e5d0-4471-bf4d-07e4f0eca1cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060881 Sep 19 14:43:45.712184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 683/1403] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:45.718484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:45.719349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:45.726782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.726782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.728091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.728971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.729550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.730079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.762025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:45.767030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.767833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.768537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.769491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.770153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.770810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.808501 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba9beb13-06c7-4bdc-8e47-f3b8e5579e15 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.523165 Sep 19 14:43:45.817926 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 721/1404] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:43:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:45.824409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:45.827242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:45.834735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.835663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.837054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.838401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.839173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.839907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.879375 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70c6b739-ac50-4a3a-9258-6a33c5f7d9cf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059723 Sep 19 14:43:45.885797 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 722/1405] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:45 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:45.891106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:45.895618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.896331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.897014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.897965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.898608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.900002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.933283 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94cf56a9-01f3-4c2e-b777-03ddb80669bd tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=n-d-858384-1" status: 200 len: 578 microversion: 2.1 time: 0.046108 Sep 19 14:43:45.939013 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 723/1406] 10.222.0.81 () {58 vars in 1172 bytes} [Mon Sep 19 14:43:45 2022] GET /compute/v2.1/os-services?host=n-d-858384-1 => generated 578 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:45.950173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:45.950869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:45.957833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.958620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.959247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:45.960133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:45.960761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:45.961405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.145824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:46.162967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38da2f41-2688-4b73-915c-5a6bd9dc82a0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1311 microversion: 2.1 time: 0.218510 Sep 19 14:43:46.170557 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 724/1407] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:45 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:46.193027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:46.210885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.221048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.224242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.227302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.231126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.233630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.236859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:46.250694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c7087f89-c1b2-4337-927d-80280d55097a tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1314 microversion: 2.1 time: 0.533530 Sep 19 14:43:46.251728 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 684/1408] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:45 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:46.260278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:46.263146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:46.287262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.288409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.288981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.289883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.292049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.293281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.370468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca7df0b0-dd64-4697-8840-87e4354bde74 tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.195094 Sep 19 14:43:46.381957 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 725/1409] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 14:43:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:46.398629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:46.399984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:46.424880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.425381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.425818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.426535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.442563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.444488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.554051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:46.568741 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc6776f1-ad1f-46be-9e5b-2a83cec654e2 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.312761 Sep 19 14:43:46.570265 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 685/1410] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:46 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:46.582943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:46.593802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.594479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.597472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.598413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.599069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.599621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.664300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ef68b71c-0171-4dff-9306-75b1d8ad70cc tempest-ServicesAdminTestJSON-542865422 tempest-ServicesAdminTestJSON-542865422-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091898 Sep 19 14:43:46.667501 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 686/1411] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:43:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:46.794643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:46.806833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1acc2d68-b656-4982-8366-facea72b2982 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1315 microversion: 2.1 time: 0.421333 Sep 19 14:43:46.807572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 726/1412] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:46 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:46.895576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:46.898237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:46.941349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.951045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.952569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:46.954486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:46.956613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:46.967233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:47.119827 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ebcf648-f9d4-4321-9980-e6247b1c17a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.229563 Sep 19 14:43:47.130523 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 687/1413] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:46 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:47.195062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:47.196534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:47.214307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:47.214835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:47.228307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:47.229356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:47.229864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:47.230290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:47.279887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:47.280679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:47.289813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:47.295074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:47.295638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:47.296465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:47.296967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:47.297433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:47.978216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:47.996172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7a12458e-c704-4d34-9fcc-2bf8bccfb39c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1314 microversion: 2.1 time: 0.719542 Sep 19 14:43:47.999125 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 688/1414] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:47 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:48.010366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:48.017990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:48.021361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:48.030307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:48.035611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:48.036523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:48.037528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:48.037659 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8f75deb-a6a3-44a2-af29-0c375274df1d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 0.846764 Sep 19 14:43:48.042427 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 727/1415] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:47 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:43:48.047724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:48.051707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:48.053668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:48.054419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:48.063384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.069510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:48.070246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:48.075638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:48.076647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:48.077326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:48.077951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:48.934988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:48.951441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:48.955844 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5b366b5-54b0-40e3-8f4c-8b9250d25dde tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.943846 Sep 19 14:43:48.959251 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 689/1416] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:48 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:48.968850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:48.971996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:48.980676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:48.981669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:48.982449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:48.983508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:48.983765 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-539dd495-9963-4a54-8fa8-7afa0e930709 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1503 microversion: 2.1 time: 0.939178 Sep 19 14:43:48.984448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:48.985102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:48.995592 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 728/1417] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:48 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1503 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:49.013156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:49.016888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:49.030501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.033149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.034868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.035605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.036574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.040904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.041944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.049658 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2c56126-1839-4352-95d4-ac13ff1611a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.086489 Sep 19 14:43:49.059110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 690/1418] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:48 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:49.073883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:49.076514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:49.088106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.092328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.094844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.097163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.099203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.100045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.120117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:49.313858 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03acd379-2996-4317-9fdc-cee2fbb7ec82 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 204 len: 0 microversion: 2.1 time: 0.309397 Sep 19 14:43:49.315542 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 729/1419] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:49 2022] DELETE /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:49.324364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:49.325327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:49.334122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.334971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.335640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.337598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.338584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.339302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.581127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:49.594073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75c85644-bc0a-4d92-9b86-e7632f64d956 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 0.276683 Sep 19 14:43:49.597359 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 730/1420] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:49 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:49.607179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:49.619432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-945747c3-305d-41bf-aee1-9f7389e3fe6c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1314 microversion: 2.1 time: 0.558828 Sep 19 14:43:49.620377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:49.621085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:49.623116 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 691/1421] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:49 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:49.627809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-778ffcc6-f220-40db-a768-f1c204849387 req-ffde1119-0f11-434f-95ef-d15cfb0edd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c1a3df-11b1-4178-b222-2f04d095f00e", "tag": "af9b7cd6-f390-4f70-b449-36b69fd19f29"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:49.640164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.640950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.641397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.642113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.642563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.643029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.653965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.654537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-778ffcc6-f220-40db-a768-f1c204849387 req-ffde1119-0f11-434f-95ef-d15cfb0edd6c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.655359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-778ffcc6-f220-40db-a768-f1c204849387 req-ffde1119-0f11-434f-95ef-d15cfb0edd6c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.655499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-778ffcc6-f220-40db-a768-f1c204849387 req-ffde1119-0f11-434f-95ef-d15cfb0edd6c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.687622 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-778ffcc6-f220-40db-a768-f1c204849387 req-ffde1119-0f11-434f-95ef-d15cfb0edd6c service nova] Creating event network-changed:af9b7cd6-f390-4f70-b449-36b69fd19f29 for instance 52c1a3df-11b1-4178-b222-2f04d095f00e on n-h1-858384-1 Sep 19 14:43:49.706555 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-778ffcc6-f220-40db-a768-f1c204849387 req-ffde1119-0f11-434f-95ef-d15cfb0edd6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080713 Sep 19 14:43:49.710470 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 692/1422] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:49.853230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7d464847-922a-4df9-a277-16a1fb825d92 req-2fd8702d-62fb-4434-9fb3-4e0a61d8b756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77bb2388-3726-4724-a067-f347a853cdb6", "name": "network-vif-plugged", "status": "completed", "tag": "234461cb-a1cd-4629-bf54-6bc1def9b30e"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:49.871617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7d464847-922a-4df9-a277-16a1fb825d92 req-2fd8702d-62fb-4434-9fb3-4e0a61d8b756 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:49.874512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7d464847-922a-4df9-a277-16a1fb825d92 req-2fd8702d-62fb-4434-9fb3-4e0a61d8b756 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:49.875136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7d464847-922a-4df9-a277-16a1fb825d92 req-2fd8702d-62fb-4434-9fb3-4e0a61d8b756 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:49.903583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7d464847-922a-4df9-a277-16a1fb825d92 req-2fd8702d-62fb-4434-9fb3-4e0a61d8b756 service nova] Creating event network-vif-plugged:234461cb-a1cd-4629-bf54-6bc1def9b30e for instance 77bb2388-3726-4724-a067-f347a853cdb6 on n-h2-858384-1 Sep 19 14:43:49.920017 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7d464847-922a-4df9-a277-16a1fb825d92 req-2fd8702d-62fb-4434-9fb3-4e0a61d8b756 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068316 Sep 19 14:43:49.921029 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 693/1423] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:43:49.984373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:49.985286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:50.001634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.002559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.003438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.005184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.006894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.008528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.060821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:50.074697 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c7573fa9-b42d-4827-a43d-7dada08893a6 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1509 microversion: 2.1 time: 0.477636 Sep 19 14:43:50.075384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 731/1424] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:49 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:50.091976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:50.100157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:50.114506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.115135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.115592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.116344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.116812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.117247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.191734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc94dceb-8aac-4d9f-9a42-dab1fa6cb99f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113008 Sep 19 14:43:50.191734 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 732/1425] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:50 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:50.339869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:50.350800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b0aae6f-e841-49fa-ac71-1c7c39ae91b0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.371685 Sep 19 14:43:50.370308 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 694/1426] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:49 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:50.621382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:50.622040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:50.642735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:50.643858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:50.652338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.657076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.658844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.659531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.662285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.662734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.663499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.663963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.665146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:50.668970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:50.669532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:50.669973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.023483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:51.049550 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f7c5db6-a227-4317-ade7-0f6985e30b80 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 0.431389 Sep 19 14:43:51.055640 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 733/1427] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:50 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:51.100031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:51.110001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:51.111518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:51.126794 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b584877e-35dd-4de1-861e-6c17ac808e91 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1314 microversion: 2.1 time: 0.489074 Sep 19 14:43:51.137128 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 695/1428] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:50 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:51.140044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.142259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.145104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.147699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.149701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.150577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.204528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:51.207959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:51.224896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.225833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.227921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.229174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.230143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.231941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.383751 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a7cb04f-798b-469a-bbab-3ec21b6f28bd tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.184621 Sep 19 14:43:51.385205 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 696/1429] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:51 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:51.403866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:51.412963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:51.450738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.454818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.458937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.460131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.462836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.465080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:51.467335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.475469 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a6ebcce7-d810-4b8c-8ce6-e1ef5dbc0da2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1509 microversion: 2.1 time: 0.377756 Sep 19 14:43:51.487635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 734/1430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:51 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:51.883936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:51.907498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e7d7e27-8105-4e8e-a8bd-6fae2ca919ca tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.517813 Sep 19 14:43:51.908327 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 697/1431] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:51 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:52.086180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:52.087538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:52.103541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.104148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.104670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.105583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.106033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.106422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.164180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:52.167276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:52.182653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.183750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.185452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.189028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.189886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.191465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.778684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:52.792309 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6572abb1-0087-490a-9efe-32012a338a00 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1464 microversion: 2.1 time: 0.629771 Sep 19 14:43:52.806781 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 698/1432] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:52 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1464 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:52.815580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-19f3aa2f-dfcb-440a-8097-e06872f83449 req-9b5dd30e-6458-47d0-928e-700f7223e837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4eb4c-9dd4-4a9d-8287-59a4d868d21c", "name": "network-vif-deleted", "tag": "58c34657-5b74-4e5b-a896-b5779b46a2bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:52.853200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.870131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19f3aa2f-dfcb-440a-8097-e06872f83449 req-9b5dd30e-6458-47d0-928e-700f7223e837 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.871258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19f3aa2f-dfcb-440a-8097-e06872f83449 req-9b5dd30e-6458-47d0-928e-700f7223e837 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.872135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19f3aa2f-dfcb-440a-8097-e06872f83449 req-9b5dd30e-6458-47d0-928e-700f7223e837 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.892608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:52.910324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-19f3aa2f-dfcb-440a-8097-e06872f83449 req-9b5dd30e-6458-47d0-928e-700f7223e837 service nova] Creating event network-vif-deleted:58c34657-5b74-4e5b-a896-b5779b46a2bf for instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c on n-h2-858384-1 Sep 19 14:43:52.912049 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac04c033-d264-4963-999b-60aa46dfd836 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 0.825749 Sep 19 14:43:52.925222 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-19f3aa2f-dfcb-440a-8097-e06872f83449 req-9b5dd30e-6458-47d0-928e-700f7223e837 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127499 Sep 19 14:43:52.929598 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 735/1433] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:52 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:52.933819 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 699/1434] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:52.937785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:52.941229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:52.947979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.948948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.949995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.951021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.951708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.952387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.959004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:52.959739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:52.975005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.976082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:52.977406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:52.991242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:52.992129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.000612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.037479 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c9ddb5d-0404-432d-8f9d-4bbbaefc8cc4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106409 Sep 19 14:43:53.045237 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 736/1435] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:52 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:53.098526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.099108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.103672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.104229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lazy-loading 'fault' on Instance uuid 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:53.187196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa36c5ae29f43ddaaa73287caa77464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c18f8122348fcb13f683ceb27a507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:53.197749 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b8597e7-1b46-49b6-ab90-27fc47fd750b tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 200 len: 1305 microversion: 2.1 time: 0.261948 Sep 19 14:43:53.198676 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 700/1436] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:52 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 1305 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:53.204679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:53.205531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:53.215328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.216144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.216896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.219255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.220945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.222106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.453533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Calling method '.version_select at 0x7fde2a473820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:53.470978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.471805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.472836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.495925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=13 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.498739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.499617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.500277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.524522 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8e012b5-fd9a-4da9-882e-0f6ec915b16d tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/fbf6967d28fc4b16a0883a5c8a2c473e?start=2022-09-18T14%3A43%3A52.819686&end=2022-09-20T14%3A43%3A52.819686" status: 200 len: 695 microversion: 2.1 time: 0.477216 Sep 19 14:43:53.525952 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 737/1437] 10.222.0.81 () {58 vars in 1412 bytes} [Mon Sep 19 14:43:53 2022] GET /compute/v2.1/os-simple-tenant-usage/fbf6967d28fc4b16a0883a5c8a2c473e?start=2022-09-18T14%3A43%3A52.819686&end=2022-09-20T14%3A43%3A52.819686 => generated 695 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:53.543617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '.version_select at 0x7fde2a539430>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:53.553726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.554522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.555841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.566597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.567621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.568258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.581662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebadbd2f-6b1d-46f0-a8eb-00ea1fb03a48 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/fbf6967d28fc4b16a0883a5c8a2c473e?start=2022-09-18T14%3A43%3A52.819686&end=2022-09-20T14%3A43%3A52.819686" status: 200 len: 695 microversion: 2.1 time: 0.042534 Sep 19 14:43:53.583184 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 738/1438] 10.222.0.81 () {58 vars in 1412 bytes} [Mon Sep 19 14:43:53 2022] GET /compute/v2.1/os-simple-tenant-usage/fbf6967d28fc4b16a0883a5c8a2c473e?start=2022-09-18T14%3A43%3A52.819686&end=2022-09-20T14%3A43%3A52.819686 => generated 695 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:43:53.595726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:53.606190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Calling method '.version_select at 0x7fde2a082820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:53.609289 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d9cd7b86-d7ab-4299-a7bb-dc03e9416eae tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.409229 Sep 19 14:43:53.610189 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 701/1439] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:53 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:53.620528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.621328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.621948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.639803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.640627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.641317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.745600 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c56e832a-10c7-42d6-ba0d-56c88a53d730 tempest-TenantUsagesTestJSON-617908020 tempest-TenantUsagesTestJSON-617908020-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-18T14%3A43%3A52.819686&end=2022-09-20T14%3A43%3A52.819686&detailed=1" status: 200 len: 17373 microversion: 2.1 time: 0.143316 Sep 19 14:43:53.747261 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 739/1440] 10.222.0.81 () {58 vars in 1335 bytes} [Mon Sep 19 14:43:53 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-18T14%3A43%3A52.819686&end=2022-09-20T14%3A43%3A52.819686&detailed=1 => generated 17373 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:53.779201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:53.780140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:53.789533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.790736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.791686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.792635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.793305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.794128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.857977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:53.941990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:53.944597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:53.957899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.959319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.961022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:53.963681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:53.964746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:53.966943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.013824 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e94dbd6b-f1e8-4c83-a2fa-048477de799d tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "DELETE /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 204 len: 0 microversion: 2.1 time: 0.239311 Sep 19 14:43:54.017910 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 702/1441] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:53 2022] DELETE /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:54.026224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:54.033303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:54.047100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.047614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.051578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.053771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.054311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.056238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.636397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:54.653225 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ece715d5-4c5c-4437-99e0-417e640c8ba7 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1470 microversion: 2.1 time: 0.632840 Sep 19 14:43:54.655537 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 703/1442] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:54 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1470 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:43:54.676199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:54.680969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:54.694124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:54.700135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.701643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.703261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.705222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.707089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.708112 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4dbffc41-7994-4963-b553-8ffb98fddcc5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 0.773742 Sep 19 14:43:54.708958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.725552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 740/1443] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:53 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:54.737614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:54.741996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:54.760243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.765065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.765897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.767105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.769922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.772067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.804671 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-959325a6-a9f9-4b6d-93d8-92530ebc4ece tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146618 Sep 19 14:43:54.805853 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 704/1444] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:54 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:54.816600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-602c7629-9f25-4823-bbe6-ef2d02d8995f req-20de3b83-1cfd-4d17-aa51-e65d73eaac31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c1a3df-11b1-4178-b222-2f04d095f00e", "name": "network-vif-plugged", "status": "completed", "tag": "af9b7cd6-f390-4f70-b449-36b69fd19f29"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:54.829423 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c HTTP/1.1 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:43:54.831624 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:54.833119 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '85c4eb4c-9dd4-4a9d-8287-59a4d868d21c'} Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:54.833937 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:54.835915 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:43:54.845887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:54.846727 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ff4346b-e9d9-40e3-abbb-035cad4788b0 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 404 len: 111 microversion: 2.1 time: 0.119756 Sep 19 14:43:54.847100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-602c7629-9f25-4823-bbe6-ef2d02d8995f req-20de3b83-1cfd-4d17-aa51-e65d73eaac31 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.849226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 741/1445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:54 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:54.856660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-602c7629-9f25-4823-bbe6-ef2d02d8995f req-20de3b83-1cfd-4d17-aa51-e65d73eaac31 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.859615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-602c7629-9f25-4823-bbe6-ef2d02d8995f req-20de3b83-1cfd-4d17-aa51-e65d73eaac31 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.878738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:54.879395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:54.889697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.890814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.891610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.892633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.893262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.893858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.899480 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-602c7629-9f25-4823-bbe6-ef2d02d8995f req-20de3b83-1cfd-4d17-aa51-e65d73eaac31 service nova] Creating event network-vif-plugged:af9b7cd6-f390-4f70-b449-36b69fd19f29 for instance 52c1a3df-11b1-4178-b222-2f04d095f00e on n-h1-858384-1 Sep 19 14:43:54.912418 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-602c7629-9f25-4823-bbe6-ef2d02d8995f req-20de3b83-1cfd-4d17-aa51-e65d73eaac31 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105299 Sep 19 14:43:54.917759 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 705/1446] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:54.939995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1779945008", "metadata": {"image_type": "test"}}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:54.948676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:54.968829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.969573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.971061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.971865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:54.976231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:54.976810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:54.999963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c/action HTTP/1.1 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 112 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:55.007186 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1779945008", "metadata": {"image_type": "test"}}} Sep 19 14:43:55.009876 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '85c4eb4c-9dd4-4a9d-8287-59a4d868d21c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1779945008', 'metadata': {'image_type': 'test'}}}} Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.010671 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.011950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:55.013212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cae292c6-b819-4308-9089-5fb90480e579 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "POST /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c/action" status: 404 len: 111 microversion: 2.1 time: 0.092921 Sep 19 14:43:55.021663 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 706/1447] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Sep 19 14:43:54 2022] POST /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:55.037087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6175cbcf-1046-43d5-857e-1de1e463560a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-835277763", "metadata": {"image_type": "test"}}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:55.045950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6175cbcf-1046-43d5-857e-1de1e463560a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Failed to fetch instance by id tempest-invalid-1207843335 {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 14:43:55.046479 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6175cbcf-1046-43d5-857e-1de1e463560a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance tempest-invalid-1207843335 could not be found. Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6175cbcf-1046-43d5-857e-1de1e463560a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/tempest-invalid-1207843335/action HTTP/1.1 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 111 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:55.051507 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-835277763", "metadata": {"image_type": "test"}}} Sep 19 14:43:55.053758 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance tempest-invalid-1207843335 could not be found. Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'tempest-invalid-1207843335', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-835277763', 'metadata': {'image_type': 'test'}}}} Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1207843335 could not be found. Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:55.054699 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1207843335 could not be found. Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1207843335 could not be found. Sep 19 14:43:55.056807 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.058322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6175cbcf-1046-43d5-857e-1de1e463560a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance tempest-invalid-1207843335 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:55.058322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6175cbcf-1046-43d5-857e-1de1e463560a tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "POST /compute/v2.1/servers/tempest-invalid-1207843335/action" status: 404 len: 101 microversion: 2.1 time: 0.032849 Sep 19 14:43:55.062781 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 707/1448] 10.222.0.81 () {60 vars in 1249 bytes} [Mon Sep 19 14:43:55 2022] POST /compute/v2.1/servers/tempest-invalid-1207843335/action => generated 101 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:55.097590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b5e3ae29-e223-4497-bef3-c5d3018f383e tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-48068351"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:55.110124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b5e3ae29-e223-4497-bef3-c5d3018f383e tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 14:43:55.111314 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b5e3ae29-e223-4497-bef3-c5d3018f383e tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b5e3ae29-e223-4497-bef3-c5d3018f383e tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 55 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:55.124326 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: {"createImage": {"name": "tempest-test-snap-48068351"}} Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:55.126847 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-48068351'}}} Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.128680 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.130818 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.132523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b5e3ae29-e223-4497-bef3-c5d3018f383e tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:55.132523 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b5e3ae29-e223-4497-bef3-c5d3018f383e tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.064271 Sep 19 14:43:55.135121 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 708/1449] 10.222.0.81 () {60 vars in 1275 bytes} [Mon Sep 19 14:43:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:55.149835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33a8e0e7-0bec-4aee-9dc9-da81d28889c2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1845055335"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:55.160244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-33a8e0e7-0bec-4aee-9dc9-da81d28889c2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 14:43:55.160846 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-33a8e0e7-0bec-4aee-9dc9-da81d28889c2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33a8e0e7-0bec-4aee-9dc9-da81d28889c2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 57 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:55.162476 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: {"createImage": {"name": "tempest-test-snap-1845055335"}} Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:55.165922 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1845055335'}}} Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.167091 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 19 14:43:55.169041 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.175084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33a8e0e7-0bec-4aee-9dc9-da81d28889c2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:55.175084 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-33a8e0e7-0bec-4aee-9dc9-da81d28889c2 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.026440 Sep 19 14:43:55.191420 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 709/1450] 10.222.0.81 () {60 vars in 1281 bytes} [Mon Sep 19 14:43:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:55.206248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:55.206782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:55.231656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.232174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.232622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.243853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.244372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.247811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.299091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c HTTP/1.1 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:55.300696 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.302671 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '85c4eb4c-9dd4-4a9d-8287-59a4d868d21c'} Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:55.303646 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.305700 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.307623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:55.308606 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e82421ac-9a3e-406a-ad4a-4b8a86c6a516 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 404 len: 111 microversion: 2.1 time: 0.115995 Sep 19 14:43:55.308772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:55.317668 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 710/1451] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:55 2022] DELETE /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:55.321820 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a3e3419-9681-4f4e-bc6c-4753d8ff27aa tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.467638 Sep 19 14:43:55.323123 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 742/1452] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:54 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:55.338784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:55.339448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] [instance: 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:55.360250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.360901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.361433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.363594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.364342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.368083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.414926 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] HTTP exception thrown: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Request method failure captured: Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c HTTP/1.1 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAK0hzuo5dXc5WyRS7oFjP777XT1yjSR8gMkZguBaU0ECQEGudnuiOTYG8xqZfpvuixBrTmUpE_H9h9p-bEzlIC9If-JzFiKsNZM7SmDnSdsbNNYgdx5wIqaWi45B7Q5f8OyrUYywzA1B5s3HWKVkMDAyxTDIX-RQajM-0MyWmbKQ4 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:55.416497 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_790c18f8122348fcb13f683ceb27a507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/790c18f8122348fcb13f683ceb27a507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/790c18f8122348fcb13f683ceb27a507"}]}] Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 790c18f8122348fcb13f683ceb27a507 Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2139893038 Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 4aa36c5ae29f43ddaaa73287caa77464 Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesNegativeTestJSON-2139893038-project Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.418256 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '85c4eb4c-9dd4-4a9d-8287-59a4d868d21c'} Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:55.420611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. Sep 19 14:43:55.424137 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:55.425292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] Returning 404 to user: Instance 85c4eb4c-9dd4-4a9d-8287-59a4d868d21c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:55.425292 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-af8acbd3-815d-4c40-87b5-ba4a505fd2e8 tempest-ImagesNegativeTestJSON-2139893038 tempest-ImagesNegativeTestJSON-2139893038-project] 10.222.0.81 "GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c" status: 404 len: 111 microversion: 2.1 time: 0.099209 Sep 19 14:43:55.425292 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 711/1453] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:55 2022] GET /compute/v2.1/servers/85c4eb4c-9dd4-4a9d-8287-59a4d868d21c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:55.435146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:55.435852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:55.456746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.457472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.458076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.459009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.459649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.463305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.516562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:43:55.697208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:55.697965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:55.706893 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-72f17f01-53c6-4399-a4fb-98e28781d880 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "DELETE /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 204 len: 0 microversion: 2.1 time: 0.275296 Sep 19 14:43:55.707497 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 743/1454] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:43:55 2022] DELETE /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:55.730294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.730837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.731292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.732020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:55.744039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:55.744590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:55.972169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3df561f-487a-489c-9e15-fc0714d69292 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Action: 'create', calling method: .version_select at 0x7fde2a539790>, body: {"keypair": {"name": "tempest-keypair-1194224372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb61M1AvW3OEcIsGGgTd+4k7hKGfTGOg6n8dk2WOPUF2+a/VUNvTKUR8Ta4R3hIofgqXdFv9DyTbuy96CH7EoX1b1QgzygjHZ9OTrBCoSphN/3r0/ItjMz/bIPS5gQpKg=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:55.992179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c3df561f-487a-489c-9e15-fc0714d69292 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Getting quotas for project e642fd9f7b364b87ad1dd7a23c5e787c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:43:56.003156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c3df561f-487a-489c-9e15-fc0714d69292 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Getting quotas for user c0a279d9a3d84ddea38f52728f8775dd and project e642fd9f7b364b87ad1dd7a23c5e787c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:43:56.048621 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3df561f-487a-489c-9e15-fc0714d69292 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.339485 Sep 19 14:43:56.057099 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 744/1455] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:43:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:56.058222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:56.066103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:56.069028 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01e27283-b5e7-4b61-ab4b-2673a475de0c tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1470 microversion: 2.1 time: 0.383004 Sep 19 14:43:56.069233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:56.077155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.078267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.078909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.079795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.080425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.081022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.087203 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 712/1456] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:55 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1470 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:56.095974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:56.099432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:56.112565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.115479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.117272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.118828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.121759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.122406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.135433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.588579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:56.613958 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-44f0fc4d-18c1-4d09-8b1b-e7ef9a431059 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1666 microversion: 2.1 time: 0.553011 Sep 19 14:43:56.616772 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 745/1457] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:56 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1666 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:56.618689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.633125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:56.646197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:56.649274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:56.658198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.658897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.659273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.660115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.662002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.663697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.667945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87399cba-323f-492b-8bf3-218160aa7eca tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 0.579193 Sep 19 14:43:56.668755 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 713/1458] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:56 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:56.678729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:56.679675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:56.704749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.713857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.714699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.715880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.716585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.717243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.753807 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-721a73a9-bf19-40ec-a554-f0de765252b0 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134932 Sep 19 14:43:56.754965 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 746/1459] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:56 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:56.765596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1c0729f9-b7ba-4101-8cfd-718742ba0375 req-f20851d9-840d-458d-bab8-cc0efae091ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77bb2388-3726-4724-a067-f347a853cdb6", "name": "network-vif-deleted", "tag": "234461cb-a1cd-4629-bf54-6bc1def9b30e"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:43:56.779755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1c0729f9-b7ba-4101-8cfd-718742ba0375 req-f20851d9-840d-458d-bab8-cc0efae091ef service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:56.780630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1c0729f9-b7ba-4101-8cfd-718742ba0375 req-f20851d9-840d-458d-bab8-cc0efae091ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:56.781441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1c0729f9-b7ba-4101-8cfd-718742ba0375 req-f20851d9-840d-458d-bab8-cc0efae091ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:56.799426 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1c0729f9-b7ba-4101-8cfd-718742ba0375 req-f20851d9-840d-458d-bab8-cc0efae091ef service nova] Creating event network-vif-deleted:234461cb-a1cd-4629-bf54-6bc1def9b30e for instance 77bb2388-3726-4724-a067-f347a853cdb6 on n-h2-858384-1 Sep 19 14:43:56.808536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1c0729f9-b7ba-4101-8cfd-718742ba0375 req-f20851d9-840d-458d-bab8-cc0efae091ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052174 Sep 19 14:43:56.809635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 747/1460] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:57.096660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:57.099231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:57.110283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.111191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.111879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:57.112882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.113917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.114658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:57.239253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.241248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.242331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:57.245152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lazy-loading 'fault' on Instance uuid 77bb2388-3726-4724-a067-f347a853cdb6 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:43:57.345893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:57.356779 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21e1e7e3-7768-4523-97c0-d54d8f3d325c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.687157 Sep 19 14:43:57.358147 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 714/1461] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:56 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:57.449795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b72628bee74704936d97b9391238a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf6967d28fc4b16a0883a5c8a2c473e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:57.466273 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8073b86-035a-404f-8d28-788a107a8300 tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 200 len: 1304 microversion: 2.1 time: 0.375092 Sep 19 14:43:57.472618 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 748/1462] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:57 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 1304 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:57.651428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:57.652261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:57.670563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.675249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.675966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:57.679194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.683319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.688467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:57.692434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:57.693059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:57.702199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.720380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.721032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:57.726854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:57.727349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:57.727929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:58.841582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:58.853068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90276bd3-83c5-46a1-bcbb-188c849eeb72 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1367 microversion: 2.1 time: 1.163789 Sep 19 14:43:58.868560 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 749/1463] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:57 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1367 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:58.879437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:58.882155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:58.890027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:58.890900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:58.891584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:58.892633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:58.893284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:58.894125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:58.899833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:58.935532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b7b260a3-49b3-42fc-ba1f-0d2641bbe37e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.065414 Sep 19 14:43:58.936872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 750/1464] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 14:43:58 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:58.942358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:58.943467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:58.951285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:58.952208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:58.952901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:58.953869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:58.954350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:58.955088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:58.973991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:58.998788 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae106b07-b3cd-4625-b089-ba7c5d42fb19 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1666 microversion: 2.1 time: 1.361019 Sep 19 14:43:59.004573 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 715/1465] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:57 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1666 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:59.017401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:59.019161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] [instance: 77bb2388-3726-4724-a067-f347a853cdb6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:59.047238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:59.049941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:59.051740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:59.053014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:59.056060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:59.056700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:59.088146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] HTTP exception thrown: Instance 77bb2388-3726-4724-a067-f347a853cdb6 could not be found. Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Request method failure captured: Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 HTTP/1.1 Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIAPuZ_1fz4Yi-HrRSToayjJLbUczl4ksHy1afc1LV9lvHiCZ4zaanDhBFUBAxEodP4s5-K5OPkj8m7YaMZioV3E8Ycqxtw49WLg19ZLHW8Sj9WnxfWwtlKSf-pbkjzuRqwVl-Aj0qv6HVxTuPx1Gh1G_RAe5b8tmsJGBoYn1lWdXBo Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: fbf6967d28fc4b16a0883a5c8a2c473e Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TenantUsagesTestJSON-1971934838 Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:43:59.089709 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fbf6967d28fc4b16a0883a5c8a2c473e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fbf6967d28fc4b16a0883a5c8a2c473e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fbf6967d28fc4b16a0883a5c8a2c473e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fbf6967d28fc4b16a0883a5c8a2c473e"}]}] Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TenantUsagesTestJSON-1971934838 Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: fbf6967d28fc4b16a0883a5c8a2c473e Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1971934838 Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TenantUsagesTestJSON-1971934838-project Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 41b72628bee74704936d97b9391238a8 Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TenantUsagesTestJSON-1971934838-project Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 77bb2388-3726-4724-a067-f347a853cdb6 could not be found. Sep 19 14:43:59.091516 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '77bb2388-3726-4724-a067-f347a853cdb6'} Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77bb2388-3726-4724-a067-f347a853cdb6 could not be found. Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:43:59.092541 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77bb2388-3726-4724-a067-f347a853cdb6 could not be found. Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77bb2388-3726-4724-a067-f347a853cdb6 could not be found. Sep 19 14:43:59.094174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:43:59.102604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] Returning 404 to user: Instance 77bb2388-3726-4724-a067-f347a853cdb6 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:43:59.107973 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-810a3a33-7631-449a-918d-f5a5e96b9c9b tempest-TenantUsagesTestJSON-1971934838 tempest-TenantUsagesTestJSON-1971934838-project] 10.222.0.81 "GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6" status: 404 len: 111 microversion: 2.1 time: 0.101979 Sep 19 14:43:59.115141 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 716/1466] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:59 2022] GET /compute/v2.1/servers/77bb2388-3726-4724-a067-f347a853cdb6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:43:59.528335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:43:59.544391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1cda7df-1a82-4dde-8e49-e510ee699a51 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.605986 Sep 19 14:43:59.545004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 751/1467] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:58 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:59.892739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:59.893572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:43:59.912369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:59.912880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:59.916044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:59.919222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:59.926904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:59.927913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:00.032461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:00.033071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:00.059425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:00.059920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:00.062468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:00.063764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:00.068899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:00.071360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:00.675049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:00.690185 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e9dc5ecf-1217-4381-ac2d-71b7636d43f0 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1558 microversion: 2.1 time: 0.810217 Sep 19 14:44:00.702557 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 717/1468] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:43:59 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1558 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:00.713137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8b0ffdbc-7642-4c01-a670-3a84cf302077 req-11960953-a844-4647-8aa8-85a1828659d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d5ba1-8891-4546-8cbd-cf1bb093680f", "name": "network-vif-unplugged", "status": "completed", "tag": "a5ade408-3403-4e42-8df3-6047f3e2e730"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:00.736739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.739434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8b0ffdbc-7642-4c01-a670-3a84cf302077 req-11960953-a844-4647-8aa8-85a1828659d2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:00.740377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8b0ffdbc-7642-4c01-a670-3a84cf302077 req-11960953-a844-4647-8aa8-85a1828659d2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:00.741462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8b0ffdbc-7642-4c01-a670-3a84cf302077 req-11960953-a844-4647-8aa8-85a1828659d2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:00.791511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8b0ffdbc-7642-4c01-a670-3a84cf302077 req-11960953-a844-4647-8aa8-85a1828659d2 service nova] Creating event network-vif-unplugged:a5ade408-3403-4e42-8df3-6047f3e2e730 for instance 232d5ba1-8891-4546-8cbd-cf1bb093680f on n-h1-858384-1 Sep 19 14:44:00.804680 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8b0ffdbc-7642-4c01-a670-3a84cf302077 req-11960953-a844-4647-8aa8-85a1828659d2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100152 Sep 19 14:44:00.820585 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 718/1469] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:00.860274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:00.863140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:00.881666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:00.882258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:00.882803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:00.884298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:00.884814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:00.885278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:00.984702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:00.996757 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b04160fc-395d-4667-bc6d-2b4e936c6148 tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1666 microversion: 2.1 time: 0.968296 Sep 19 14:44:01.002282 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 752/1470] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:00 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1666 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:01.013006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:01.013914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:01.026585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:01.032837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:01.034174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:01.035178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:01.035849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:01.040107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:01.463809 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb247dee-3137-49ab-b1c6-3f722c8e3db4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.460284 Sep 19 14:44:01.464767 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 753/1471] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:44:01 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-interface => generated 285 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:02.023103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:02.024206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:02.042485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:02.043153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:02.043502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:02.044239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:02.044712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:02.048335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:03.455452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92452449e1694e7b9d30fccbcae0ebf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddd6495c7f94f6c9246d2228f9b2371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:03.472837 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-afeb8f7f-05a4-4b07-bf79-bdda5a8b190e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 200 len: 1598 microversion: 2.1 time: 1.453195 Sep 19 14:44:03.475896 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 754/1472] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:02 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 1598 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:03.488854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-134349560", "imageRef": "c255e8a3-eb69-400f-926f-3c82c39112b3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a04c29d7-35a9-46f6-85f9-39dacac7dee0"}], "security_groups": [{"name": "tempest-securitygroup--836309356"}], "key_name": "tempest-keypair-1194224372", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:03.640011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.691706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:03.701199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e012974-1408-4c61-a550-c07e535abb3b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 2.867610 Sep 19 14:44:03.720704 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 719/1473] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:00 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 2899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:03.728632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c0c15252-918d-4758-a2dd-d126324af644 req-90daccb0-a3fe-4dc0-92cb-5c86d831a819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d5ba1-8891-4546-8cbd-cf1bb093680f", "name": "network-vif-deleted", "tag": "a5ade408-3403-4e42-8df3-6047f3e2e730"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:03.752492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c0c15252-918d-4758-a2dd-d126324af644 req-90daccb0-a3fe-4dc0-92cb-5c86d831a819 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:03.752942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c0c15252-918d-4758-a2dd-d126324af644 req-90daccb0-a3fe-4dc0-92cb-5c86d831a819 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:03.761224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c0c15252-918d-4758-a2dd-d126324af644 req-90daccb0-a3fe-4dc0-92cb-5c86d831a819 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:03.790082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c0c15252-918d-4758-a2dd-d126324af644 req-90daccb0-a3fe-4dc0-92cb-5c86d831a819 service nova] Creating event network-vif-deleted:a5ade408-3403-4e42-8df3-6047f3e2e730 for instance 232d5ba1-8891-4546-8cbd-cf1bb093680f on n-h1-858384-1 Sep 19 14:44:03.834100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c0c15252-918d-4758-a2dd-d126324af644 req-90daccb0-a3fe-4dc0-92cb-5c86d831a819 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108033 Sep 19 14:44:03.855016 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 720/1474] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:04.483249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] validate_networks() for [('a04c29d7-35a9-46f6-85f9-39dacac7dee0', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:44:04.505352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:04.506081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] [instance: 232d5ba1-8891-4546-8cbd-cf1bb093680f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:04.524248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:04.524801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:04.525213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:04.526001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:04.526409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:04.527073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:04.565411 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] HTTP exception thrown: Instance 232d5ba1-8891-4546-8cbd-cf1bb093680f could not be found. Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Request method failure captured: Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f HTTP/1.1 Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH_TNpg6guxMrGBa-2SUJcJiL7t9d1QlWFC89BppD7c9bTn4ycRTZaT42lV0xB0M-uKNZAFxEwOEwiDuQMRzOBI-q7flfHjeXZRK8vk_wFWVtiiLPTMkMYvH-4KCW1lu-lmVCJ_87k7XBb2S8FogV6p17CN3BGh9gf-upwhZf71zcSQ Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 8ddd6495c7f94f6c9246d2228f9b2371 Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestFqdnHostnames-1367031996 Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:44:04.568250 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8ddd6495c7f94f6c9246d2228f9b2371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8ddd6495c7f94f6c9246d2228f9b2371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8ddd6495c7f94f6c9246d2228f9b2371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8ddd6495c7f94f6c9246d2228f9b2371"}]}] Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestFqdnHostnames-1367031996 Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 8ddd6495c7f94f6c9246d2228f9b2371 Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1367031996 Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestFqdnHostnames-1367031996-project Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 92452449e1694e7b9d30fccbcae0ebf4 Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestFqdnHostnames-1367031996-project Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 232d5ba1-8891-4546-8cbd-cf1bb093680f could not be found. Sep 19 14:44:04.569964 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '232d5ba1-8891-4546-8cbd-cf1bb093680f'} Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232d5ba1-8891-4546-8cbd-cf1bb093680f could not be found. Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:04.571083 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232d5ba1-8891-4546-8cbd-cf1bb093680f could not be found. Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232d5ba1-8891-4546-8cbd-cf1bb093680f could not be found. Sep 19 14:44:04.572658 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:04.573813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Returning 404 to user: Instance 232d5ba1-8891-4546-8cbd-cf1bb093680f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:04.573813 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ce053b24-2806-4ca9-a12c-858e26e00fba tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f" status: 404 len: 111 microversion: 2.1 time: 0.071962 Sep 19 14:44:04.573813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 721/1475] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:04 2022] GET /compute/v2.1/servers/232d5ba1-8891-4546-8cbd-cf1bb093680f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:44:04.591912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e04c4d63-13e3-490d-afeb-be760029955e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] Calling method '.version_select at 0x7fde29ad8550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:04.637048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e04c4d63-13e3-490d-afeb-be760029955e tempest-ServersTestFqdnHostnames-1367031996 tempest-ServersTestFqdnHostnames-1367031996-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468477494" status: 202 len: 0 microversion: 2.1 time: 0.049081 Sep 19 14:44:04.638271 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 722/1476] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 14:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468477494 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:44:04.730109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:04.730787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:04.748980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:04.749505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:04.750071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:04.751399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:04.751499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:04.751900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:05.537564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:05.552786 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2d599be-1635-43e6-b419-c4d70066d6ee tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.827500 Sep 19 14:44:05.555419 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 723/1477] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:04 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:06.015487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:06.579191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:06.580013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:06.590154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:06.591154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:06.591857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:06.592893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:06.594296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:06.595109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:07.718322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:07.727134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:44:07.727786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:44:07.728040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:44:07.728458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:44:07.728864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:44:07.748905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:07.749431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:07.749873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:07.750615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:07.751126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:07.751616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:07.756024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a732fd60-d529-49e8-b31d-24d62e9de88b tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 1.179684 Sep 19 14:44:07.756675 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 724/1478] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:06 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:07.801519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Getting quotas for project e642fd9f7b364b87ad1dd7a23c5e787c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:07.821295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Getting quotas for user c0a279d9a3d84ddea38f52728f8775dd and project e642fd9f7b364b87ad1dd7a23c5e787c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:07.860788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:44:07.869406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c255e8a3-eb69-400f-926f-3c82c39112b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:44:07.941749 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-57673c25-7b1f-4f35-aa4e-9f641425ddfd tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.464330 Sep 19 14:44:07.944112 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 755/1479] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 4467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:44:07.955391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91a47c4e-af88-45fc-8bec-33f2b602bc7b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:07.955894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-91a47c4e-af88-45fc-8bec-33f2b602bc7b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:08.363364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-91a47c4e-af88-45fc-8bec-33f2b602bc7b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:08.375442 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91a47c4e-af88-45fc-8bec-33f2b602bc7b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1245 microversion: 2.1 time: 0.423939 Sep 19 14:44:08.376050 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 725/1480] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:07 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1245 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:08.626583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-93f1e918-bbf0-4090-9895-9ab43d09be9b req-ea2d0fb3-fa86-4bf5-9a7d-ed75a6077f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c1a3df-11b1-4178-b222-2f04d095f00e", "tag": "af9b7cd6-f390-4f70-b449-36b69fd19f29"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:08.647606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93f1e918-bbf0-4090-9895-9ab43d09be9b req-ea2d0fb3-fa86-4bf5-9a7d-ed75a6077f27 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:08.648092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93f1e918-bbf0-4090-9895-9ab43d09be9b req-ea2d0fb3-fa86-4bf5-9a7d-ed75a6077f27 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:08.663552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93f1e918-bbf0-4090-9895-9ab43d09be9b req-ea2d0fb3-fa86-4bf5-9a7d-ed75a6077f27 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:08.683598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-93f1e918-bbf0-4090-9895-9ab43d09be9b req-ea2d0fb3-fa86-4bf5-9a7d-ed75a6077f27 service nova] Creating event network-changed:af9b7cd6-f390-4f70-b449-36b69fd19f29 for instance 52c1a3df-11b1-4178-b222-2f04d095f00e on n-h1-858384-1 Sep 19 14:44:08.692569 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-93f1e918-bbf0-4090-9895-9ab43d09be9b req-ea2d0fb3-fa86-4bf5-9a7d-ed75a6077f27 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069638 Sep 19 14:44:08.693429 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 756/1481] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:08.783552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:08.785000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:08.801780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:08.802969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:08.803589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:08.804514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:08.805319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:08.805979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:09.404070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:09.405453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:09.412205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:09.413107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:09.413726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:09.415462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:09.416127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:09.420369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:09.655020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:09.668250 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1fd34460-0731-46a5-b41b-9cdf20ac7ecb tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.887253 Sep 19 14:44:09.669437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 726/1482] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:08 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:09.681741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-38d45d2f-49dd-4273-9718-e61f1864e31e req-fd7f333f-59f4-46ac-b0fb-cac6f164cf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79aa5ee2-e9a7-4c00-b134-6038827ed547", "name": "network-vif-unplugged", "status": "completed", "tag": "a887118d-871a-4250-bdb1-61d05b1899b8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:09.705777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:09.722375 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1688ab70-8863-457d-8ab4-ed717e8a455f tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1249 microversion: 2.1 time: 0.322594 Sep 19 14:44:09.723061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-38d45d2f-49dd-4273-9718-e61f1864e31e req-fd7f333f-59f4-46ac-b0fb-cac6f164cf09 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:09.724161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-38d45d2f-49dd-4273-9718-e61f1864e31e req-fd7f333f-59f4-46ac-b0fb-cac6f164cf09 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:09.729418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-38d45d2f-49dd-4273-9718-e61f1864e31e req-fd7f333f-59f4-46ac-b0fb-cac6f164cf09 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:09.730108 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 757/1483] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:09 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1249 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:09.760455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-38d45d2f-49dd-4273-9718-e61f1864e31e req-fd7f333f-59f4-46ac-b0fb-cac6f164cf09 service nova] Creating event network-vif-unplugged:a887118d-871a-4250-bdb1-61d05b1899b8 for instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 on n-h1-858384-1 Sep 19 14:44:09.771282 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-38d45d2f-49dd-4273-9718-e61f1864e31e req-fd7f333f-59f4-46ac-b0fb-cac6f164cf09 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100104 Sep 19 14:44:09.779183 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 727/1484] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:10.699631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:10.713764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:10.734033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.754281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:10.755913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:10.764645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:10.766088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:10.772784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:10.774017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:10.775808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:10.778637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:10.780317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:10.782891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:10.784928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:10.786260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:10.791630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:10.792388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:11.682485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:11.692613 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04819550-8b27-46de-8d7e-d6451b7d3f7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1305 microversion: 2.1 time: 0.944271 Sep 19 14:44:11.701324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 728/1485] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:10 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1305 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:44:11.842480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:11.895711 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-398c99bc-48e8-4be6-89bf-c5b2bd83bd6a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 1.197998 Sep 19 14:44:11.899383 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 758/1486] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:10 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:12.362898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-43223799-712e-4528-94c2-b5b5295fa817 req-3b0efb65-ac81-4b79-9e92-4f4dd92fedf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79aa5ee2-e9a7-4c00-b134-6038827ed547", "tag": "a887118d-871a-4250-bdb1-61d05b1899b8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:12.400459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-43223799-712e-4528-94c2-b5b5295fa817 req-3b0efb65-ac81-4b79-9e92-4f4dd92fedf5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:12.401048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-43223799-712e-4528-94c2-b5b5295fa817 req-3b0efb65-ac81-4b79-9e92-4f4dd92fedf5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:12.401492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-43223799-712e-4528-94c2-b5b5295fa817 req-3b0efb65-ac81-4b79-9e92-4f4dd92fedf5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:12.475497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-43223799-712e-4528-94c2-b5b5295fa817 req-3b0efb65-ac81-4b79-9e92-4f4dd92fedf5 service nova] Creating event network-changed:a887118d-871a-4250-bdb1-61d05b1899b8 for instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 on n-h1-858384-1 Sep 19 14:44:12.498491 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-43223799-712e-4528-94c2-b5b5295fa817 req-3b0efb65-ac81-4b79-9e92-4f4dd92fedf5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139356 Sep 19 14:44:12.505305 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 729/1487] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:12.730818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:12.731696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:12.757050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:12.757555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:12.761484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:12.765096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:12.766774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:12.767255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:12.924911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:12.925692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:12.937250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:12.937754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:12.938196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:12.938964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:12.939433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:12.939859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:13.592858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:13.611329 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aad4923f-bc39-46de-bd63-557d6d352025 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1303 microversion: 2.1 time: 0.879059 Sep 19 14:44:13.613416 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 759/1488] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:12 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1303 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:14.636776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:14.637530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:14.660826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:14.661637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:14.662270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:14.665431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:14.666647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:14.673099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:14.875548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:14.878827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:14.889031 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-524ec829-d666-499d-b8fb-cc9422302a82 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1303 microversion: 2.1 time: 0.256992 Sep 19 14:44:14.889625 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 760/1489] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:14 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:44:14.896232 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd22c449-84ac-452c-948d-b8d01ba21295 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 1.975946 Sep 19 14:44:14.899652 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 730/1490] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:12 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:15.377362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-898169829", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e9efff2d-14e3-46cc-8852-37758a7c9828"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:15.913757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:15.915597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:15.931986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:15.940502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:15.943154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:15.944859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:15.951343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:15.969453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:17.773702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:17.780801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:17.789280 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ec8a8986-d5c4-48c3-aec4-e6be2b48e770 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1370 microversion: 2.1 time: 1.879269 Sep 19 14:44:17.815142 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 731/1491] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:15 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1370 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:44:17.841038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:17.844162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:17.850623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:17.880903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:17.881433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:17.881880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:17.886590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:17.887381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:17.887837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:18.369608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:18.701304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:18.724567 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ae9487f-cb88-4247-a198-960e51c0c091 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1393 microversion: 2.1 time: 0.908201 Sep 19 14:44:18.726965 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 732/1492] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:17 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1393 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:19.116705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1229910273", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:23.146393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] validate_networks() for [('e9efff2d-14e3-46cc-8852-37758a7c9828', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:44:23.187902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:44:24.888238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=55 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.393464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=7 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.506011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:44:26.511007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:44:26.515180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:44:26.515961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:44:26.522775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:44:26.584958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:26.585516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:26.586144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:26.587083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:26.587599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:26.588050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:26.618151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=83 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.654295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Getting quotas for project 77c95dfb9f2743c9a07677bb17deabb0. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:26.668706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Getting quotas for user c4260762e3f74323bac74a519aeff94f and project 77c95dfb9f2743c9a07677bb17deabb0. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:26.713007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:44:26.721387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:44:26.845704 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ef053066-4acf-45b0-bb5d-6eabce01ec58 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.117090 Sep 19 14:44:26.846381 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 733/1493] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 8119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:44:26.869129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:26.869757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:26.889769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:26.890329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:26.890795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:26.891560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:26.892059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:26.892490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:27.302097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:44:27.302592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:44:27.303535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:44:27.303912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:44:27.304322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:44:27.333866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:27.334353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:27.334809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:27.336465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:27.344468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:27.344954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:27.352491 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3dbfbae-2adb-47f5-af3c-daa0bdbae6ed tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1370 microversion: 2.1 time: 0.501129 Sep 19 14:44:27.354692 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 734/1494] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:26 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1370 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:27.369120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:27.370899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:27.379829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:27.389924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:27.394502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:27.395011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:27.395924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:27.396400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:27.396831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:27.424055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Getting quotas for project 6af088fe0e6047ccaa484e35f24a69d6. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:27.436138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Getting quotas for user ae47961de16a4a71a315100608f7efc3 and project 6af088fe0e6047ccaa484e35f24a69d6. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:27.542328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:44:27.555857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:44:27.797409 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b76ac241-9265-4872-9f17-683afcb4696c tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.786450 Sep 19 14:44:27.798102 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 761/1495] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 12788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:44:27.849508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-41a8568e-9b27-4e34-9f6b-692de408bd25 req-91f27034-f846-42ad-a2a5-c2f6e1b43ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae3f971-6de7-44e5-a5c3-65900357963c", "tag": "42658f3f-48bf-4f7f-b156-2821c8e0c313"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:27.901792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-41a8568e-9b27-4e34-9f6b-692de408bd25 req-91f27034-f846-42ad-a2a5-c2f6e1b43ea5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:27.902681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-41a8568e-9b27-4e34-9f6b-692de408bd25 req-91f27034-f846-42ad-a2a5-c2f6e1b43ea5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:27.903193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-41a8568e-9b27-4e34-9f6b-692de408bd25 req-91f27034-f846-42ad-a2a5-c2f6e1b43ea5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:27.944152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-41a8568e-9b27-4e34-9f6b-692de408bd25 req-91f27034-f846-42ad-a2a5-c2f6e1b43ea5 service nova] Creating event network-changed:42658f3f-48bf-4f7f-b156-2821c8e0c313 for instance 4ae3f971-6de7-44e5-a5c3-65900357963c on n-h2-858384-1 Sep 19 14:44:27.957608 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-41a8568e-9b27-4e34-9f6b-692de408bd25 req-91f27034-f846-42ad-a2a5-c2f6e1b43ea5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155812 Sep 19 14:44:27.963343 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 762/1496] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:28.032072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:28.048012 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e7a40e5d-53c7-4c06-badf-3645d707d4a3 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1383 microversion: 2.1 time: 0.691751 Sep 19 14:44:28.064651 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 735/1497] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:27 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1383 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:28.109477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ccf3b581-507f-4ef2-a103-67f8c3d39932 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:28.110954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ccf3b581-507f-4ef2-a103-67f8c3d39932 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:28.458681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ccf3b581-507f-4ef2-a103-67f8c3d39932 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:28.471025 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ccf3b581-507f-4ef2-a103-67f8c3d39932 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1217 microversion: 2.1 time: 0.384991 Sep 19 14:44:28.474817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 736/1498] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:28 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1217 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:28.491087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04a63f10-68a7-4c03-9553-88c35dcb66b7 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:28.493853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04a63f10-68a7-4c03-9553-88c35dcb66b7 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:28.620986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-04a63f10-68a7-4c03-9553-88c35dcb66b7 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:28.641338 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04a63f10-68a7-4c03-9553-88c35dcb66b7 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1231 microversion: 2.1 time: 0.164984 Sep 19 14:44:28.642364 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 737/1499] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:28 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1231 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:28.668426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fbdbf050-6aaf-4cd1-a051-4c5cd0bf79cd tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '.version_select at 0x7fde29ee3280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:28.689027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbdbf050-6aaf-4cd1-a051-4c5cd0bf79cd tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:28.692331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbdbf050-6aaf-4cd1-a051-4c5cd0bf79cd tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:28.695007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbdbf050-6aaf-4cd1-a051-4c5cd0bf79cd tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:28.775635 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fbdbf050-6aaf-4cd1-a051-4c5cd0bf79cd tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 2702 microversion: 2.1 time: 0.123056 Sep 19 14:44:28.787938 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 738/1500] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:44:28 2022] GET /compute/v2.1/os-migrations => generated 2702 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:28.807665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:28.808281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:28.856828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:28.862534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:28.868704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1079588663", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "f05b3455-618c-4083-add0-0e4bab7610d4"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:28.871333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:28.872747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:28.879459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:28.880321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:29.020521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] validate_networks() for [('f05b3455-618c-4083-add0-0e4bab7610d4', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:44:29.756909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:29.765499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3129a39b-507a-40f1-8f01-a20ab4eb8204 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1370 microversion: 2.1 time: 0.988105 Sep 19 14:44:29.774176 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 739/1501] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:28 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1370 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:29.778843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:29.787612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:29.807279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:29.807791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:29.808435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:29.809162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:29.809794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:29.810396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.068155 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-514bf3a8-9aec-4995-8136-ca587bf8a9d5 tempest-LiveMigrationTest-2112590023 tempest-LiveMigrationTest-2112590023-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1534 microversion: 2.1 time: 0.292570 Sep 19 14:44:30.069135 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 740/1502] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:29 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1534 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:30.076873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:30.078160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:30.085497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.112924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.116974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.118925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.119754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.123065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.218647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:44:30.219285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:44:30.219786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:44:30.220308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:44:30.220837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:44:30.248466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.248958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.249400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.250101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.250560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.251041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.324561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Getting quotas for project b1afbbefb33447b2871b1c40b2bc6cc5. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:30.358149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Getting quotas for user ee0cfca622a34b55828b768b57f8697a and project b1afbbefb33447b2871b1c40b2bc6cc5. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:30.382453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:44:30.385774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:44:30.411428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:30.423537 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71b263af-a551-46f7-be79-a01e8b9c2551 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1269 microversion: 2.1 time: 0.351804 Sep 19 14:44:30.424797 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 741/1503] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:30 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1269 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:30.438739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:30.439875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:30.452821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.453548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.458272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.459516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.465936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.466647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.495892 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59495d92-52dd-41ce-9a55-66145112dee7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.529893 Sep 19 14:44:30.500438 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 763/1504] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:44:30.521746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:30.522446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:30.541099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.541640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.542483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.544621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.552733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.553623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:30.626492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:44:30.635485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:30.650498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7afbb410-5bbc-4fb0-ad2c-a429c8534e1b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1283 microversion: 2.1 time: 0.221295 Sep 19 14:44:30.664970 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 742/1505] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:30 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1283 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:30.797270 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2122026-f05f-4117-8e45-33b863f8934f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "DELETE /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 204 len: 0 microversion: 2.1 time: 0.294480 Sep 19 14:44:30.798248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 764/1506] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:44:30 2022] DELETE /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:30.812136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06b19edb-0974-48f9-92ad-b9f24e7f7ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:30.813760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06b19edb-0974-48f9-92ad-b9f24e7f7ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:30.902449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06b19edb-0974-48f9-92ad-b9f24e7f7ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:30.936494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56378a90-619a-46f0-9e77-dbf80df0702a tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1784161175", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:30.940071 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-56378a90-619a-46f0-9e77-dbf80df0702a tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] HTTP exception thrown: min_count must be <= max_count Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56378a90-619a-46f0-9e77-dbf80df0702a tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Request method failure captured: Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 184 Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIBOoDmCHTyWHIW3u33AX2J4Xj7gxQg3xhrCsmqzCi3us3AhN_fBqNqEtptRFEZAIlQkWc42-E5mKegQ5xpTNoUqtQYj_hE854mSZ8x0xTzc54gznNoLec1iBM7IOd9hRXgCf6fxIPXtkBtiZhiXBEbUdC2q9Tcp1yBUtBj5NmZK0pg Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:44:30.942025 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/481ae11a5ddc42b89e481dc12dd84ad5"}]}] Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c0c7460f1f5f4d51b8c1cbb34d6be994 Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:44:30.944092 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1784161175", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: exception: min_count must be <= max_count Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1784161175', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:44:30.945063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56378a90-619a-46f0-9e77-dbf80df0702a tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Returning 400 to user: min_count must be <= max_count {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56378a90-619a-46f0-9e77-dbf80df0702a tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.277165 Sep 19 14:44:30.947037 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 743/1507] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:30 2022] POST /compute/v2.1/servers => generated 74 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:44:30.948144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06b19edb-0974-48f9-92ad-b9f24e7f7ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1224 microversion: 2.1 time: 0.137599 Sep 19 14:44:30.963436 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 765/1508] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:30 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:30.968287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:30.968912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:30.973548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:30.974163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:30.981464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:30.997077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:30.997577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:30.998019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.002455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.003011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.004552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.005283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.005751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.006212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.011010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.013036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.019077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.443545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:31.459443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:31.479269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b557dff-7e88-44be-af63-1a940a0f5c7e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1370 microversion: 2.1 time: 0.528266 Sep 19 14:44:31.479957 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f2c5681-9b0a-48cf-9737-8e83b36cc1ef tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1389 microversion: 2.1 time: 0.515293 Sep 19 14:44:31.480566 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 766/1509] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:30 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1389 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:31.494067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-947789db-1198-438e-a0a1-5b9620eb1260 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-811862861", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "max_count": 0}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:31.498983 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 744/1510] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:30 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1370 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-947789db-1198-438e-a0a1-5b9620eb1260 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Request method failure captured: Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 167 Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBOoDmCHTyWHIW3u33AX2J4Xj7gxQg3xhrCsmqzCi3us3AhN_fBqNqEtptRFEZAIlQkWc42-E5mKegQ5xpTNoUqtQYj_hE854mSZ8x0xTzc54gznNoLec1iBM7IOd9hRXgCf6fxIPXtkBtiZhiXBEbUdC2q9Tcp1yBUtBj5NmZK0pg Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:44:31.512879 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/481ae11a5ddc42b89e481dc12dd84ad5"}]}] Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c0c7460f1f5f4d51b8c1cbb34d6be994 Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:44:31.514817 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-811862861", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "max_count": 0}} Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-811862861', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'max_count': 0}}} Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 0 Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.515727 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.517677 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.519197 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.519197 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.519197 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:44:31.519197 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:44:31.519197 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 19 14:44:31.519197 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.522427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:31.525965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:31.528909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-947789db-1198-438e-a0a1-5b9620eb1260 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:31.529798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-947789db-1198-438e-a0a1-5b9620eb1260 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040704 Sep 19 14:44:31.530393 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 767/1511] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:44:31.569672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.571046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.572087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.574644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.575555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.577319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.622517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f77690a-d47a-41b0-9039-4eace68a2363 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1276538165", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "max_count": 2.5}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f77690a-d47a-41b0-9039-4eace68a2363 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Request method failure captured: Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 170 Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBOoDmCHTyWHIW3u33AX2J4Xj7gxQg3xhrCsmqzCi3us3AhN_fBqNqEtptRFEZAIlQkWc42-E5mKegQ5xpTNoUqtQYj_hE854mSZ8x0xTzc54gznNoLec1iBM7IOd9hRXgCf6fxIPXtkBtiZhiXBEbUdC2q9Tcp1yBUtBj5NmZK0pg Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:44:31.627984 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/481ae11a5ddc42b89e481dc12dd84ad5"}]}] Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c0c7460f1f5f4d51b8c1cbb34d6be994 Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:44:31.629568 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1276538165", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "max_count": 2.5}} Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1276538165', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'max_count': 2.5}}} Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 2.5 Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.630341 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.632201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.634377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f77690a-d47a-41b0-9039-4eace68a2363 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:31.639067 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f77690a-d47a-41b0-9039-4eace68a2363 tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015746 Sep 19 14:44:31.639067 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 768/1512] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:44:31.679551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:31.680695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:31.698327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.699255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.700685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.701932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.702724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.705078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.826661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:31.838348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc2b5523-7c8a-4c4e-9705-a6771729d6a9 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1289 microversion: 2.1 time: 0.164384 Sep 19 14:44:31.842365 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 769/1513] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:31 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1289 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:44:31.852414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6a705b4-2466-4025-9cf1-71f1ae13258b tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-803093103", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 0}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6a705b4-2466-4025-9cf1-71f1ae13258b tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Request method failure captured: Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 167 Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBOoDmCHTyWHIW3u33AX2J4Xj7gxQg3xhrCsmqzCi3us3AhN_fBqNqEtptRFEZAIlQkWc42-E5mKegQ5xpTNoUqtQYj_hE854mSZ8x0xTzc54gznNoLec1iBM7IOd9hRXgCf6fxIPXtkBtiZhiXBEbUdC2q9Tcp1yBUtBj5NmZK0pg Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:44:31.867629 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/481ae11a5ddc42b89e481dc12dd84ad5"}]}] Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c0c7460f1f5f4d51b8c1cbb34d6be994 Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:44:31.869486 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-803093103", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 0}} Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-803093103', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'min_count': 0}}} Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 0 Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.870277 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.871939 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.873334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.873334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.873334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:44:31.873334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:44:31.873334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 19 14:44:31.873334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.876365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6a705b4-2466-4025-9cf1-71f1ae13258b tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:31.877550 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f6a705b4-2466-4025-9cf1-71f1ae13258b tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033743 Sep 19 14:44:31.879001 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 770/1514] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:44:31.908014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:31.938442 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-effcf7cc-dcd2-4772-a5e2-e5dde7f562e6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1275 microversion: 2.1 time: 0.437479 Sep 19 14:44:31.950318 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 745/1515] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:31 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1275 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:31.965911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f579031e-99a1-432c-9557-04f7f6cdd2aa tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-386772095", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 2.5}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:31.968758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:31.969386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f579031e-99a1-432c-9557-04f7f6cdd2aa tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Request method failure captured: Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 169 Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBOoDmCHTyWHIW3u33AX2J4Xj7gxQg3xhrCsmqzCi3us3AhN_fBqNqEtptRFEZAIlQkWc42-E5mKegQ5xpTNoUqtQYj_hE854mSZ8x0xTzc54gznNoLec1iBM7IOd9hRXgCf6fxIPXtkBtiZhiXBEbUdC2q9Tcp1yBUtBj5NmZK0pg Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:44:31.970901 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/481ae11a5ddc42b89e481dc12dd84ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/481ae11a5ddc42b89e481dc12dd84ad5"}]}] Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 481ae11a5ddc42b89e481dc12dd84ad5 Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-445526310 Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c0c7460f1f5f4d51b8c1cbb34d6be994 Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-445526310-project Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:44:31.972439 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-386772095", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 2.5}} Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-386772095', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'min_count': 2.5}}} Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 2.5 Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.973203 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.975234 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f579031e-99a1-432c-9557-04f7f6cdd2aa tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:31.977372 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f579031e-99a1-432c-9557-04f7f6cdd2aa tempest-MultipleCreateNegativeTestJSON-445526310 tempest-MultipleCreateNegativeTestJSON-445526310-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012339 Sep 19 14:44:31.980465 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 771/1516] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:44:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:44:31.996457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:31.997184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:31.997817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:31.999960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:32.003217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:32.005645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:32.462129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:32.490889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae816d69-6c6b-40cf-85a4-ad3836671054 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1276 microversion: 2.1 time: 0.526001 Sep 19 14:44:32.491844 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 746/1517] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:31 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1276 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:44:32.508782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:32.509408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:32.511757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:32.512396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:32.522640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:32.524885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:32.525715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:32.526474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:32.527332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:32.527646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:32.528237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:32.530631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:32.530894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:32.532950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:32.533625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:32.535323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:33.782430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:33.798175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:33.817005 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea219e9a-4677-4619-b6ba-b1ebafb1093a tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1389 microversion: 2.1 time: 1.315111 Sep 19 14:44:33.829214 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7fa5d169-9adb-4adf-af62-4cc1f2e14f79 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1370 microversion: 2.1 time: 1.323143 Sep 19 14:44:33.839993 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 772/1518] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:32 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1389 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:33.842336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 747/1519] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:32 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1370 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:33.852155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:33.855539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:33.878080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:33.879280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:33.880009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:33.880574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:33.881117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:33.881687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:33.881910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:33.882494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:33.922100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:33.946355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:33.947362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:33.948679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:33.949498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:33.950282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.311599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:34.326846 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-84df8d11-842b-4cec-acc8-1c122f8cdcf2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.476736 Sep 19 14:44:34.345485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 748/1520] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:33 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:34.353579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-bd36cb4f-259d-4294-90c6-0af873f2060a req-8278387d-a664-4e02-824a-1b86147b11a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79aa5ee2-e9a7-4c00-b134-6038827ed547", "name": "network-vif-deleted", "tag": "a887118d-871a-4250-bdb1-61d05b1899b8"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:34.378858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bd36cb4f-259d-4294-90c6-0af873f2060a req-8278387d-a664-4e02-824a-1b86147b11a3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:34.381895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bd36cb4f-259d-4294-90c6-0af873f2060a req-8278387d-a664-4e02-824a-1b86147b11a3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:34.391246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bd36cb4f-259d-4294-90c6-0af873f2060a req-8278387d-a664-4e02-824a-1b86147b11a3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.413984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-bd36cb4f-259d-4294-90c6-0af873f2060a req-8278387d-a664-4e02-824a-1b86147b11a3 service nova] Creating event network-vif-deleted:a887118d-871a-4250-bdb1-61d05b1899b8 for instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 on n-h2-858384-1 Sep 19 14:44:34.425690 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-bd36cb4f-259d-4294-90c6-0af873f2060a req-8278387d-a664-4e02-824a-1b86147b11a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074204 Sep 19 14:44:34.426581 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 749/1521] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:34.433615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:34.435297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:34.445980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:34.447177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:34.447960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.448989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:34.449674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:34.450342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.609623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:34.627272 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1a5995a-812e-4a2e-b10c-33e5102da45b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1282 microversion: 2.1 time: 0.192337 Sep 19 14:44:34.631004 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 750/1522] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:34 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:34.636960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b2395ffa-dc52-4195-9d6f-08603ec2a2b5 req-006d433e-6386-4da8-9761-4153bd335918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae3f971-6de7-44e5-a5c3-65900357963c", "name": "network-vif-plugged", "status": "completed", "tag": "42658f3f-48bf-4f7f-b156-2821c8e0c313"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:34.684996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b2395ffa-dc52-4195-9d6f-08603ec2a2b5 req-006d433e-6386-4da8-9761-4153bd335918 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:34.685484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b2395ffa-dc52-4195-9d6f-08603ec2a2b5 req-006d433e-6386-4da8-9761-4153bd335918 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:34.685921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b2395ffa-dc52-4195-9d6f-08603ec2a2b5 req-006d433e-6386-4da8-9761-4153bd335918 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.731784 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b2395ffa-dc52-4195-9d6f-08603ec2a2b5 req-006d433e-6386-4da8-9761-4153bd335918 service nova] Creating event network-vif-plugged:42658f3f-48bf-4f7f-b156-2821c8e0c313 for instance 4ae3f971-6de7-44e5-a5c3-65900357963c on n-h2-858384-1 Sep 19 14:44:34.744648 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b2395ffa-dc52-4195-9d6f-08603ec2a2b5 req-006d433e-6386-4da8-9761-4153bd335918 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112118 Sep 19 14:44:34.748615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 751/1523] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:34.850386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:34.851982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:34.883966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:34.884480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:34.884922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.886646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:34.887675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:34.888127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:34.902569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:34.927608 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c0f17a5-5cc5-498e-af4a-516a9256733b tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1331 microversion: 2.1 time: 1.083359 Sep 19 14:44:34.951859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 773/1524] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:33 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1331 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:34.971606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:34.973433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:35.000228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:35.002224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:35.002681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:35.003508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:35.003988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:35.004416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:35.780714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:35.796233 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70aea1cf-504c-4765-84ac-98eab5a5794d tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1184 microversion: 2.1 time: 0.947808 Sep 19 14:44:35.806839 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 752/1525] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:34 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1184 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:44:35.839568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:35.842810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:35.863535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:35.870861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:35.874730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:35.880108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:35.881028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:35.884504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:36.618596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.216327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:37.233822 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3a5b53d2-87d1-4133-a82f-5dc9fa182e3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 1.425550 Sep 19 14:44:37.247775 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 753/1526] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:35 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:37.259429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:37.261544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:37.269278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:37.271113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:37.271819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:37.272843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:37.274188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:37.275024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:37.342708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:37.352937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5182199a-1c8a-405b-b75d-28f1ddf23cc8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1370 microversion: 2.1 time: 2.399802 Sep 19 14:44:37.354500 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 774/1527] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:34 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1370 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:37.362437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:37.363080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:37.371770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:37.372545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:37.373196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:37.374133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:37.375614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:37.375614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:37.948239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:37.962655 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6722b2c8-c781-4792-aa25-de95c99ceaad tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 0.713130 Sep 19 14:44:37.964045 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 754/1528] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:37 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:37.984176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-25eee5c8-c4a0-4a3d-873e-d0c4163d209a req-4c4929aa-6939-4510-896f-932603602622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b6370c-34cf-43ab-b117-37fa92d259b4", "tag": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:37.999489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-25eee5c8-c4a0-4a3d-873e-d0c4163d209a req-4c4929aa-6939-4510-896f-932603602622 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:37.999967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-25eee5c8-c4a0-4a3d-873e-d0c4163d209a req-4c4929aa-6939-4510-896f-932603602622 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.001173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-25eee5c8-c4a0-4a3d-873e-d0c4163d209a req-4c4929aa-6939-4510-896f-932603602622 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.014683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-25eee5c8-c4a0-4a3d-873e-d0c4163d209a req-4c4929aa-6939-4510-896f-932603602622 service nova] Creating event network-changed:9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f for instance c4b6370c-34cf-43ab-b117-37fa92d259b4 on n-h1-858384-1 Sep 19 14:44:38.020334 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-25eee5c8-c4a0-4a3d-873e-d0c4163d209a req-4c4929aa-6939-4510-896f-932603602622 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054460 Sep 19 14:44:38.021511 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 755/1529] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:38.027613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:38.028618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:38.036378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.037122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.037755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.038690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.039583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.040236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.043531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.121626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:38.131098 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd28182a-cf17-4ad9-b624-fb587c700227 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1331 microversion: 2.1 time: 0.774755 Sep 19 14:44:38.147402 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 775/1530] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:37 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1331 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:38.220588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:38.253757 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d41e5b72-f406-4e09-8eb2-be0f52b440da tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1184 microversion: 2.1 time: 0.230763 Sep 19 14:44:38.278390 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 756/1531] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:38 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1184 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:38.287362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c7aa81-4055-4970-9bae-79d9683f968c"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:38.290985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:38.309487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.310417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.314202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.315380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.316131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.316779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.438592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1183640698", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:38.526206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:44:38.527039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:44:38.528522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:44:38.529897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:44:38.530411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:44:38.541737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.542713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.543421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.544817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.545296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.546512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.578359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Getting quotas for project 0a03b88f217c4efaa349099cd98a580d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:38.595370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Getting quotas for user a70c306f38c64d56ab0d5dca49d79adf and project 0a03b88f217c4efaa349099cd98a580d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:38.636402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.650291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:44:38.655916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:44:38.749057 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2828678b-8de9-4df2-9f9a-76d68dd1f081 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.598230 Sep 19 14:44:38.751014 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 776/1532] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:44:38.756837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:38.757822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:38.760482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3d15d43-98a9-4747-a1aa-98d429231b0d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "POST /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480359 Sep 19 14:44:38.763722 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 757/1533] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 14:44:38 2022] POST /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:38.770552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.770552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.770552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.770552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.771006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.771006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.795990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:38.809247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:38.825521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.827293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.828491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:38.831016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:38.835113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:38.837267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:39.341525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:39.355924 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ecd25518-6dc7-4c03-b7b9-ac9829fc547e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.603315 Sep 19 14:44:39.379324 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 777/1534] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:38 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:39.381275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:39.387235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-839588802", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e31e1958-afee-4116-8310-ef2e73536125"}], "block_device_mapping_v2": [{"uuid": "46c7ae89-4f1d-44b8-af5a-ba2bd5848e06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:39.393165 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6de8b3bb-9e47-42a1-b500-15ecc11d512a tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1556 microversion: 2.1 time: 0.617223 Sep 19 14:44:39.393690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 758/1535] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:38 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1556 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:39.402551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a0bae54-77cb-46e0-bf46-cb083874f4e7 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:39.403444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a0bae54-77cb-46e0-bf46-cb083874f4e7 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:39.756545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6a0bae54-77cb-46e0-bf46-cb083874f4e7 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:39.777298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6a0bae54-77cb-46e0-bf46-cb083874f4e7 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:39.781763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6a0bae54-77cb-46e0-bf46-cb083874f4e7 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:39.788574 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a0bae54-77cb-46e0-bf46-cb083874f4e7 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 200 len: 1281 microversion: 2.47 time: 0.390404 Sep 19 14:44:39.790261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 759/1536] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:39 2022] GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 1281 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:39.812705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:39.814583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:39.832906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:39.833432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:39.834186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:39.834970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:39.848593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:39.851048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.240139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:40.250014 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7dad5493-ebec-44c2-9ec3-0aaf9cbc6f87 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 0.454763 Sep 19 14:44:40.263416 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 760/1537] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:39 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:40.272308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b924845c-a120-4298-8352-ec93fb6ef96a req-fc0b77fb-c24e-4dca-a811-33e0834c0bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:40.285066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b924845c-a120-4298-8352-ec93fb6ef96a req-fc0b77fb-c24e-4dca-a811-33e0834c0bc0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.285831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b924845c-a120-4298-8352-ec93fb6ef96a req-fc0b77fb-c24e-4dca-a811-33e0834c0bc0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.286532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b924845c-a120-4298-8352-ec93fb6ef96a req-fc0b77fb-c24e-4dca-a811-33e0834c0bc0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.300195 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b924845c-a120-4298-8352-ec93fb6ef96a req-fc0b77fb-c24e-4dca-a811-33e0834c0bc0 service nova] Creating event network-changed:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:44:40.308348 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b924845c-a120-4298-8352-ec93fb6ef96a req-fc0b77fb-c24e-4dca-a811-33e0834c0bc0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043414 Sep 19 14:44:40.310311 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 761/1538] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:40.319889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:40.321878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:40.332260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.333070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.333771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.334817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.335563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.337110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.653302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:40.663306 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94f54488-11b3-42b5-8bb8-787c9c19dbbc tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1331 microversion: 2.1 time: 0.350747 Sep 19 14:44:40.665193 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 762/1539] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:40 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1331 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:40.685565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:40.686526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:40.693884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.694814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.695564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.696790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.697468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.698123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.774554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:40.783343 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f92238af-2b92-4d1a-92b9-e3f24fce4a97 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 200 len: 1184 microversion: 2.1 time: 0.116554 Sep 19 14:44:40.799339 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 763/1540] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:40 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 1184 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:40.807498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:40.808385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:40.814873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.815375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.816670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.817944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.818665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.819355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.936935 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95270433-74bb-424a-b14e-75b1841c2e5b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135902 Sep 19 14:44:40.937590 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 764/1541] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:44:40 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:40.942339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:40.943002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:40.950501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.951074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.951482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:40.952226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:40.952694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:40.955504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:41.218429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] validate_networks() for [('e31e1958-afee-4116-8310-ef2e73536125', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:44:41.237855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:41.254099 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-263a948e-dae9-4c5f-bf6c-6fff1d5c0f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.314322 Sep 19 14:44:41.261823 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 765/1542] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:40 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:41.277739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:41.281557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:41.295229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:41.296120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:41.300568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:41.301539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:41.302093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:41.303797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:41.477502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:41.489170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:41.491242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:41.494141 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-551b0054-35f8-4059-a6d7-f4a020c6de46 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 200 len: 1333 microversion: 2.47 time: 0.230353 Sep 19 14:44:41.519705 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 766/1543] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:41 2022] GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 1333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:41.526512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:41.527173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:41.535949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:41.536688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:41.537141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:41.538003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:41.538455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:41.539797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:41.849837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:41.866161 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fc7429a1-b43e-4a7e-b2d5-f800e05de16a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 0.344625 Sep 19 14:44:41.866826 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 767/1544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:41 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:41.877153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:41.877843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:41.888408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:41.889014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:41.889940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:41.890682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:41.891378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:41.891908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.523048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:42.533182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c27aad83-1f9d-498d-8b04-244103bef315 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1331 microversion: 2.1 time: 0.664403 Sep 19 14:44:42.543161 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 768/1545] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:41 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1331 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:42.555731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:42.556802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 79aa5ee2-e9a7-4c00-b134-6038827ed547] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:42.563449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.564321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.565018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.566000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.566698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.567675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.586189 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] HTTP exception thrown: Instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 could not be found. Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Request method failure captured: Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 HTTP/1.1 Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6yp_DVBhq15SSWTj5FTgW_WVN8EjiNu5WCjMQ7xDKuQWJ4miw3FURKGmi_KcV_O6qaLNsfaUMxlJ3SlxT2C57qf2YP-M9CQS2v_d5SM--Iw54kAU05TqGd2pVTy9xubyrZckoZG9E83ZdavZ1ch9SwajxWK9uo_WISCOT10-NZL_A Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:44:42.590663 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_512934300eb6480bab9b4394114bbc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/512934300eb6480bab9b4394114bbc30"}]}] Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-LiveMigrationTest-1451098610 Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-LiveMigrationTest-1451098610-project Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a989536b40ed41ddaa1554bf40378758 Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-LiveMigrationTest-1451098610-project Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 could not be found. Sep 19 14:44:42.592593 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '79aa5ee2-e9a7-4c00-b134-6038827ed547'} Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 could not be found. Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:42.594248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 could not be found. Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 could not be found. Sep 19 14:44:42.595995 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:42.597515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Returning 404 to user: Instance 79aa5ee2-e9a7-4c00-b134-6038827ed547 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:42.599201 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de4e4563-5e43-430e-a797-c371ed33b689 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547" status: 404 len: 111 microversion: 2.1 time: 0.054400 Sep 19 14:44:42.605613 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 769/1546] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:42 2022] GET /compute/v2.1/servers/79aa5ee2-e9a7-4c00-b134-6038827ed547 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:44:42.607919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:44:42.609238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:44:42.610404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:42.611134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:44:42.611856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:44:42.612487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:44:42.614237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:42.627312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.628086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.628713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.630111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.630494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.631068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.631249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.631842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.631973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.634404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.635046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.644451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:42.657990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:42.667380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Getting quotas for user 79d78edfe25746049a02a43130f1df11 and project 6a64d6b46c4541198f372d1f74417498. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:42.882241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:44:42.887541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46c7ae89-4f1d-44b8-af5a-ba2bd5848e06',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:44:42.960267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:42.974795 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-902fb0ab-5618-46a9-8736-e380e5709524 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.370442 Sep 19 14:44:42.977050 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 770/1547] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:42 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:42.983291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7cc018f3-524c-4e61-a968-a9ced556651a req-13d6cf0a-941d-4ebf-9be0-48652151ab05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:42.994815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7cc018f3-524c-4e61-a968-a9ced556651a req-13d6cf0a-941d-4ebf-9be0-48652151ab05 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:42.995411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7cc018f3-524c-4e61-a968-a9ced556651a req-13d6cf0a-941d-4ebf-9be0-48652151ab05 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:42.996080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7cc018f3-524c-4e61-a968-a9ced556651a req-13d6cf0a-941d-4ebf-9be0-48652151ab05 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.022951 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7cc018f3-524c-4e61-a968-a9ced556651a req-13d6cf0a-941d-4ebf-9be0-48652151ab05 service nova] Creating event network-changed:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:44:43.039295 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7cc018f3-524c-4e61-a968-a9ced556651a req-13d6cf0a-941d-4ebf-9be0-48652151ab05 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056774 Sep 19 14:44:43.040565 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 771/1548] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:43.053118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f2a1cdb3-d07c-4f8b-8887-83dbfcd5ab0e req-fac22f29-98f4-447f-8959-8cafc495b681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b6370c-34cf-43ab-b117-37fa92d259b4", "name": "network-vif-plugged", "status": "completed", "tag": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:43.077698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f2a1cdb3-d07c-4f8b-8887-83dbfcd5ab0e req-fac22f29-98f4-447f-8959-8cafc495b681 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.081712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f2a1cdb3-d07c-4f8b-8887-83dbfcd5ab0e req-fac22f29-98f4-447f-8959-8cafc495b681 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.083551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f2a1cdb3-d07c-4f8b-8887-83dbfcd5ab0e req-fac22f29-98f4-447f-8959-8cafc495b681 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.104211 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f2a1cdb3-d07c-4f8b-8887-83dbfcd5ab0e req-fac22f29-98f4-447f-8959-8cafc495b681 service nova] Creating event network-vif-plugged:9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f for instance c4b6370c-34cf-43ab-b117-37fa92d259b4 on n-h1-858384-1 Sep 19 14:44:43.110903 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f2a1cdb3-d07c-4f8b-8887-83dbfcd5ab0e req-fac22f29-98f4-447f-8959-8cafc495b681 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068621 Sep 19 14:44:43.111510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 772/1549] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:43.119741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:43.120745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:43.129032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.129816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.130455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.131438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.132439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.133575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.189443 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-64519c23-6a26-4ccf-92ef-4e890c4bac8d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.808511 Sep 19 14:44:43.190825 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 778/1550] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3811 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:44:43.197313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:43.198399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:43.206215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.207411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.208091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.209260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.210007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.211210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.392942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.402684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.404613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.406072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b96fde1c-2ed2-42cf-b282-23a19eeef8b4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 200 len: 1339 microversion: 2.47 time: 0.292543 Sep 19 14:44:43.419395 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 773/1551] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:43 2022] GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 1339 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:43.432688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ab67d4e-115a-4e13-b013-5b718e14ef7e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:43.434000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9ab67d4e-115a-4e13-b013-5b718e14ef7e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:43.556648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ab67d4e-115a-4e13-b013-5b718e14ef7e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.565888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ab67d4e-115a-4e13-b013-5b718e14ef7e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.572488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ab67d4e-115a-4e13-b013-5b718e14ef7e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.575659 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ab67d4e-115a-4e13-b013-5b718e14ef7e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1103 microversion: 2.25 time: 0.155142 Sep 19 14:44:43.581422 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 774/1552] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:43 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1103 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:43.605175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:43.607109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:43.618567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.619477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.620543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.622111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:43.623126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:43.623821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:43.943986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:43.962586 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b643c682-81a6-4a9f-8f88-4243e161c9e2 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 0.770429 Sep 19 14:44:43.964425 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 779/1553] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:43 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:44.016057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:44.018208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:44.054316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.055650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.056127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.056900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.057379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.057825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.183749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.198940 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eabf439b-de7d-4c37-9c51-2b93a85d9933 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1331 microversion: 2.1 time: 0.614888 Sep 19 14:44:44.199577 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 775/1554] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:43 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1331 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:44.427952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.442656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06a3c98d-7267-4998-aef3-5691ce61f89c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.439439 Sep 19 14:44:44.444370 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 780/1555] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:44 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:44.463744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:44.464749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:44.494901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.497951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.498558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.503059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.504490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.506798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.595271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:44.623398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:44.623398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:44.639572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.640837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.641418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.643276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.643786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.644218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.723633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.736080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.737781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.739463 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7232da5-fe56-487f-82d1-b73a1c124df4 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 200 len: 1360 microversion: 2.47 time: 0.298539 Sep 19 14:44:44.740589 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 776/1556] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:44 2022] GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 1360 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:44:44.761485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.772437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1899529763"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:44.776227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:44.782566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.783658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.784436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.785148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.786229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:44.786984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:44.787774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:44.788653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:44.791019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13bcef03-8fc7-4468-814d-5fb30ba2ca6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1232 microversion: 2.25 time: 0.178861 Sep 19 14:44:44.791654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 781/1557] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:44 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1232 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:44:44.989811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:44.991389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:44.999966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.000888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.001698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.002779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.003535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.004206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.120421 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-36217fa3-1e34-432d-aa57-2ec37a134838 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "POST /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8/action" status: 202 len: 52 microversion: 2.47 time: 0.346463 Sep 19 14:44:45.125717 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 777/1558] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:44:44 2022] POST /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8/action => generated 52 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:45.149422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-85592e81-7f2e-4514-b230-8e8aa0770854 req-7e71abe5-00af-42e1-baef-6c02be9fb9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae3f971-6de7-44e5-a5c3-65900357963c", "tag": "42658f3f-48bf-4f7f-b156-2821c8e0c313"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:45.185986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-85592e81-7f2e-4514-b230-8e8aa0770854 req-7e71abe5-00af-42e1-baef-6c02be9fb9a6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.186782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-85592e81-7f2e-4514-b230-8e8aa0770854 req-7e71abe5-00af-42e1-baef-6c02be9fb9a6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.187277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-85592e81-7f2e-4514-b230-8e8aa0770854 req-7e71abe5-00af-42e1-baef-6c02be9fb9a6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.242737 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-85592e81-7f2e-4514-b230-8e8aa0770854 req-7e71abe5-00af-42e1-baef-6c02be9fb9a6 service nova] Creating event network-changed:42658f3f-48bf-4f7f-b156-2821c8e0c313 for instance 4ae3f971-6de7-44e5-a5c3-65900357963c on n-h2-858384-1 Sep 19 14:44:45.259320 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-85592e81-7f2e-4514-b230-8e8aa0770854 req-7e71abe5-00af-42e1-baef-6c02be9fb9a6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119201 Sep 19 14:44:45.260091 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 778/1559] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:45.280104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:45.281161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:45.291922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.293051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.294192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.295343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.296842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.297865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.344634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:44:45.495675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:45.506293 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ef8cf64-9d8b-436e-9de3-2993035d8706 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 0.520459 Sep 19 14:44:45.509747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 782/1560] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:44 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:45.525422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3331aefa-3eab-44c0-b5b3-b06c2f65f997 req-b652ee5d-0168-486d-a3fe-acd4c035080e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "name": "network-vif-plugged", "status": "completed", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:45.566231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:45.569596 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d27bbdd-06ab-4a13-9076-62d50439fa17 tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 204 len: 0 microversion: 2.47 time: 0.303246 Sep 19 14:44:45.578502 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 779/1561] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:44:45 2022] DELETE /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:44:45.582232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3331aefa-3eab-44c0-b5b3-b06c2f65f997 req-b652ee5d-0168-486d-a3fe-acd4c035080e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.589500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:45.591748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3331aefa-3eab-44c0-b5b3-b06c2f65f997 req-b652ee5d-0168-486d-a3fe-acd4c035080e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.592542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3331aefa-3eab-44c0-b5b3-b06c2f65f997 req-b652ee5d-0168-486d-a3fe-acd4c035080e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.593773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:45.613769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.614286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.614956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.615299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3331aefa-3eab-44c0-b5b3-b06c2f65f997 req-b652ee5d-0168-486d-a3fe-acd4c035080e service nova] Creating event network-vif-plugged:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:44:45.616094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.616558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.617624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.623186 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3331aefa-3eab-44c0-b5b3-b06c2f65f997 req-b652ee5d-0168-486d-a3fe-acd4c035080e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111403 Sep 19 14:44:45.624445 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 783/1562] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:45.631735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:45.634178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:45.645237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.648497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.649423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:45.653810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:45.654808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:45.655840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:46.167500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:46.184318 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a23bf42c-7aad-491b-97fe-020934b294b6 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1536 microversion: 2.1 time: 0.603524 Sep 19 14:44:46.187696 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 780/1563] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:45 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1536 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:46.219992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:46.221215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:46.237735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:46.240453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:46.243095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:46.243396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:46.244161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:46.247868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:46.249325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:46.250032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:46.268004 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5dfa9e5e-3824-4dd4-8ab9-e602979a516f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.638294 Sep 19 14:44:46.269060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 784/1564] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:45 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:46.294442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:46.297283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:46.325131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:46.331624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:46.332518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:46.333303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:46.333786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:46.334225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:46.527128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:46.543912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:46.547863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:46.552224 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-33bb322e-ce9f-4ca9-af00-3a839d6c8cc9 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1250 microversion: 2.25 time: 0.269513 Sep 19 14:44:46.553196 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 785/1565] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:46 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1250 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:46.579740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3566fe25-1d6d-43b0-912e-1512b7cee714 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'create', calling method: .version_select at 0x7fde29aaa790>, body: {"pool": "639a7146-e83b-4789-be3c-bfe8c8684fb1"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:47.014436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:47.026679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:47.032333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a70c306f38c64d56ab0d5dca49d79adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a03b88f217c4efaa349099cd98a580d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:47.033904 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62e68a66-4527-4ab0-b813-c925a8b8f80c tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 200 len: 1366 microversion: 2.47 time: 0.829095 Sep 19 14:44:47.034484 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 781/1566] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:46 2022] GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 1366 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:47.046137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:47.046735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:47.063581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:47.064492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:47.066387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:47.071798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:47.072303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:47.072750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:47.429322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:47.442895 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27869b28-5a69-47ac-9ddf-29a486a29642 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 0.407266 Sep 19 14:44:47.443602 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 782/1567] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:47 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:47.454896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:47.455744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:47.479644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:47.480515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:47.481154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:47.484853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:47.485552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:47.486813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:48.113218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:48.128767 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-163c636e-88c2-4111-bcd7-a5c1d624c4f6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1317 microversion: 2.1 time: 0.684185 Sep 19 14:44:48.132092 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 783/1568] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:47 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:48.139609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:48.140603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:48.148323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:48.149639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:48.150335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:48.151567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:48.152498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:48.153333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:49.721563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:49.737358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:49.744922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:49.746429 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00451419-1972-462d-a4c0-384198e218df tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1292 microversion: 2.25 time: 1.611888 Sep 19 14:44:49.747238 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 784/1569] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:48 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1292 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:49.752168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4064c49f-ee79-454b-8c78-5cb15b2a4544 req-23973a2f-3a7a-4d82-bb5f-3af42d36bfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "name": "network-vif-plugged", "status": "completed", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:49.763891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4064c49f-ee79-454b-8c78-5cb15b2a4544 req-23973a2f-3a7a-4d82-bb5f-3af42d36bfa7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:49.764645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4064c49f-ee79-454b-8c78-5cb15b2a4544 req-23973a2f-3a7a-4d82-bb5f-3af42d36bfa7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:49.765324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4064c49f-ee79-454b-8c78-5cb15b2a4544 req-23973a2f-3a7a-4d82-bb5f-3af42d36bfa7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:49.779426 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4064c49f-ee79-454b-8c78-5cb15b2a4544 req-23973a2f-3a7a-4d82-bb5f-3af42d36bfa7 service nova] Creating event network-vif-plugged:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:44:49.786965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4064c49f-ee79-454b-8c78-5cb15b2a4544 req-23973a2f-3a7a-4d82-bb5f-3af42d36bfa7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038256 Sep 19 14:44:49.787628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 785/1570] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:49.807290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:49.808075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] [instance: 8aff8678-2678-4884-a9bd-7622ad97f7e8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:49.817429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:49.818847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:49.819717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:49.820847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:49.821593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:49.822286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:49.841061 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] HTTP exception thrown: Instance 8aff8678-2678-4884-a9bd-7622ad97f7e8 could not be found. Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Request method failure captured: Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 HTTP/1.1 Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIBUABPLxtQZUlr60A2sP_VzIQHfUv6huiu_ljvPx8ts3bwnADorYCq3VPtKtPQik6qGuuZf9Y6CocJ7scvyk1VPmn8Zd3RQrpBNL8PXPYPK_duJcqLjN8cimYVIrAQ-DZqBW0QqxYMj3EZcAeai2mHYQKRtOQtv-xPZA3nfdtTfkrs Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.47 Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0a03b88f217c4efaa349099cd98a580d Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAaction247Test-1421985732 Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:44:49.843297 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0a03b88f217c4efaa349099cd98a580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0a03b88f217c4efaa349099cd98a580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0a03b88f217c4efaa349099cd98a580d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0a03b88f217c4efaa349099cd98a580d"}]}] Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAaction247Test-1421985732 Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0a03b88f217c4efaa349099cd98a580d Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAaction247Test-1421985732 Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAaction247Test-1421985732-project Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a70c306f38c64d56ab0d5dca49d79adf Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAaction247Test-1421985732-project Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 8aff8678-2678-4884-a9bd-7622ad97f7e8 could not be found. Sep 19 14:44:49.845027 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '8aff8678-2678-4884-a9bd-7622ad97f7e8'} Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aff8678-2678-4884-a9bd-7622ad97f7e8 could not be found. Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:49.845894 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aff8678-2678-4884-a9bd-7622ad97f7e8 could not be found. Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aff8678-2678-4884-a9bd-7622ad97f7e8 could not be found. Sep 19 14:44:49.847336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:49.854012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] Returning 404 to user: Instance 8aff8678-2678-4884-a9bd-7622ad97f7e8 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:49.855266 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11838c92-0aca-4b22-9ffc-97cb945be3fa tempest-ServersAaction247Test-1421985732 tempest-ServersAaction247Test-1421985732-project] 10.222.0.81 "GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8" status: 404 len: 111 microversion: 2.47 time: 0.060206 Sep 19 14:44:49.859896 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 786/1571] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:49 2022] GET /compute/v2.1/servers/8aff8678-2678-4884-a9bd-7622ad97f7e8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:44:49.868270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:49.869252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:49.877933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:49.890950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:49.892329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:49.894896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:49.897488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:49.899415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:50.848063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:50.865082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c432370-b1b3-4613-90aa-7097cc412a09 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1324 microversion: 2.1 time: 1.002844 Sep 19 14:44:50.866146 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 787/1572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:49 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1324 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:50.880595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:50.881592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:50.905222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:50.906162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:50.906899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:50.907925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:50.909720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:50.910405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:50.918423 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3566fe25-1d6d-43b0-912e-1512b7cee714 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.356217 Sep 19 14:44:50.919646 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 786/1573] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:44:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:50.926066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:50.926823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:50.953508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:50.954535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:50.956201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:50.958650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:50.976938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:50.981149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:51.043255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:44:51.174512 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c83b01fd-0d17-4418-92ee-1d33c7239c83 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 204 len: 0 microversion: 2.1 time: 0.253273 Sep 19 14:44:51.175274 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 787/1574] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:44:50 2022] DELETE /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:51.183311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:51.184554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:51.192492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:51.193452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:51.194260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:51.195851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:51.197007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:51.197723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:51.413346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:51.431756 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-146b0906-c12e-4924-a2bc-06c758b96f37 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1467 microversion: 2.1 time: 0.562978 Sep 19 14:44:51.433727 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 788/1575] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:50 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1467 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:51.448866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'action', calling method: .version_select at 0x7fde2bb9a670>, body: {"addFloatingIp": {"address": "172.25.9.13"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:51.455109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:51.458027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:51.466399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:51.466949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:51.467820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:51.468461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:51.468930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:51.469359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:51.552139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:44:51.552801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquired lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:44:51.772451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:51.786166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:51.787908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:51.791244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf1ace7a-fd50-4b5a-8809-43129afa7084 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1292 microversion: 2.25 time: 0.614279 Sep 19 14:44:51.792896 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 788/1576] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:51 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1292 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:51.814642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:51.815459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:51.824658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:51.825247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:51.825759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:51.827235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:51.827814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:51.829248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:52.331110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:52.339100 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1aee2f4d-8909-44c3-a500-10437a55b6f0 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1669 microversion: 2.1 time: 0.544204 Sep 19 14:44:52.347116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 789/1577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:51 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1669 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:52.352966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-62551194", "metadata": {"image_type": "test"}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:52.357665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:52.376553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:52.377836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:52.378290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:52.379333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:52.379803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:52.380240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:52.467031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Getting quotas for project 77c95dfb9f2743c9a07677bb17deabb0. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:44:52.482995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Getting quotas for user c4260762e3f74323bac74a519aeff94f and project 77c95dfb9f2743c9a07677bb17deabb0. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:44:52.647003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.678320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=26 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.819693 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06ff9fdb-0775-40a7-85fe-31fac04fcfc4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "POST /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe/action" status: 202 len: 0 microversion: 2.1 time: 0.470900 Sep 19 14:44:52.823325 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 790/1578] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:44:52 2022] POST /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:44:52.829978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-aea764c5-34f6-4127-9fda-a08f9babfdce req-e12a4bdb-c107-4d03-a48a-087216e4378b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cea384e-ffd7-4ffb-a325-149d8c5fbf62", "tag": "baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:52.868800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aea764c5-34f6-4127-9fda-a08f9babfdce req-e12a4bdb-c107-4d03-a48a-087216e4378b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:52.873165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aea764c5-34f6-4127-9fda-a08f9babfdce req-e12a4bdb-c107-4d03-a48a-087216e4378b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:52.873863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aea764c5-34f6-4127-9fda-a08f9babfdce req-e12a4bdb-c107-4d03-a48a-087216e4378b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:52.904072 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-aea764c5-34f6-4127-9fda-a08f9babfdce req-e12a4bdb-c107-4d03-a48a-087216e4378b service nova] Creating event network-changed:baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd for instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 on n-h2-858384-1 Sep 19 14:44:52.909798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-aea764c5-34f6-4127-9fda-a08f9babfdce req-e12a4bdb-c107-4d03-a48a-087216e4378b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084677 Sep 19 14:44:52.910725 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 791/1579] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:52.917977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:52.919075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:52.928502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:52.929677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:52.930696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:52.931862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:52.932813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:52.933458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:53.453585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:53.489322 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9f56152-8f3c-46d4-b54b-f685c25c5ed8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1520 microversion: 2.1 time: 0.577070 Sep 19 14:44:53.494707 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 792/1580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:52 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:53.523948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:53.531905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:53.559198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:53.564306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:53.566375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:53.566801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:53.570880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:53.571820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:53.575319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:54.340587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:54.352315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:54.356719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:54.360205 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a1555ac9-2312-42da-b0b7-c8cc1f36fd66 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1292 microversion: 2.25 time: 0.854333 Sep 19 14:44:54.361341 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 793/1581] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:53 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1292 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:54.373253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-065d0eeb-ab17-4528-8402-750d6100cb2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29b13550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:54.460240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-065d0eeb-ab17-4528-8402-750d6100cb2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.097588 Sep 19 14:44:54.463521 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 794/1582] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:44:54 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:54.477235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:54.477947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:54.498516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:54.506473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:54.507616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:54.508829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:54.509323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:54.509772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:54.573522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:54.574260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:54.575128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:54.575928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lazy-loading 'fault' on Instance uuid 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:44:54.707383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:54.718586 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c165233d-8c73-48cb-a658-5814e98d596f tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 200 len: 1325 microversion: 2.1 time: 0.252428 Sep 19 14:44:54.719247 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 795/1583] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:54 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:54.733234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a4ebd27-b661-4ba7-9e0b-4ff7276b40ee tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'create', calling method: .version_select at 0x7fde29ab5f70>, body: {"pool": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:55.353999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:44:57.060672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Updating instance_info_cache with network_info: [{"id": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f", "address": "fa:16:3e:10:a6:7b", "network": {"id": "e9efff2d-14e3-46cc-8852-37758a7c9828", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1278010663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6af088fe0e6047ccaa484e35f24a69d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9aa5d7ff-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:44:57.093887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Releasing lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:44:57.095152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31e18132-0188-4104-872d-bebc042875f3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action" status: 202 len: 0 microversion: 2.1 time: 5.659996 Sep 19 14:44:57.103753 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 789/1584] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:44:51 2022] POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action => generated 0 bytes in 5669 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:44:57.111203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0c31757d-e245-4a3a-8809-d5a57b62f32c req-8349cd12-3d26-47c6-81c7-84fe2fb7deaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e03d5dc-b937-4876-a4ca-43dc55f3dc77", "name": "network-vif-deleted", "tag": "b2d523b2-6a3a-47a4-a07f-f8bb721d78de"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:57.138129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0c31757d-e245-4a3a-8809-d5a57b62f32c req-8349cd12-3d26-47c6-81c7-84fe2fb7deaa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:57.138643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0c31757d-e245-4a3a-8809-d5a57b62f32c req-8349cd12-3d26-47c6-81c7-84fe2fb7deaa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:57.139125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0c31757d-e245-4a3a-8809-d5a57b62f32c req-8349cd12-3d26-47c6-81c7-84fe2fb7deaa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:57.178653 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0c31757d-e245-4a3a-8809-d5a57b62f32c req-8349cd12-3d26-47c6-81c7-84fe2fb7deaa service nova] Creating event network-vif-deleted:b2d523b2-6a3a-47a4-a07f-f8bb721d78de for instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 on n-h2-858384-1 Sep 19 14:44:57.187219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0c31757d-e245-4a3a-8809-d5a57b62f32c req-8349cd12-3d26-47c6-81c7-84fe2fb7deaa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081595 Sep 19 14:44:57.187984 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 790/1585] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:57.196966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:57.197681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:57.212037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:57.212538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:57.212983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:57.213696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:57.214515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:57.215432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:57.619415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:57.623327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:57.638159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:57.642355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:44:57.645240 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ffdf0362-a3c9-4e02-bda5-146280e7cd1c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1280 microversion: 2.25 time: 0.454985 Sep 19 14:44:57.650889 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 791/1586] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:57 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1280 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:44:57.666384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-705abfc6-4299-464c-9286-a984bfdffdec req-de078c13-e08e-4ee1-921f-3927d0ecf753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b6370c-34cf-43ab-b117-37fa92d259b4", "tag": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:57.719064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-705abfc6-4299-464c-9286-a984bfdffdec req-de078c13-e08e-4ee1-921f-3927d0ecf753 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:57.719547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-705abfc6-4299-464c-9286-a984bfdffdec req-de078c13-e08e-4ee1-921f-3927d0ecf753 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:57.719976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-705abfc6-4299-464c-9286-a984bfdffdec req-de078c13-e08e-4ee1-921f-3927d0ecf753 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:57.767418 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-705abfc6-4299-464c-9286-a984bfdffdec req-de078c13-e08e-4ee1-921f-3927d0ecf753 service nova] Creating event network-changed:9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f for instance c4b6370c-34cf-43ab-b117-37fa92d259b4 on n-h1-858384-1 Sep 19 14:44:57.777408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-705abfc6-4299-464c-9286-a984bfdffdec req-de078c13-e08e-4ee1-921f-3927d0ecf753 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124976 Sep 19 14:44:57.779911 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 792/1587] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:57.797188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1205b35f-e018-410e-975d-880cfa1f1b3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29b60820>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:57.911689 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1205b35f-e018-410e-975d-880cfa1f1b3b tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.130212 Sep 19 14:44:57.917287 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 793/1588] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:44:57 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:57.930140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:57.934465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 4e03d5dc-b937-4876-a4ca-43dc55f3dc77] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:57.950151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:57.950992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:57.951595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:57.952523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:57.952987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:57.953418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:57.994364 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] HTTP exception thrown: Instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 could not be found. Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Request method failure captured: Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 HTTP/1.1 Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH6yp_DVBhq15SSWTj5FTgW_WVN8EjiNu5WCjMQ7xDKuQWJ4miw3FURKGmi_KcV_O6qaLNsfaUMxlJ3SlxT2C57qf2YP-M9CQS2v_d5SM--Iw54kAU05TqGd2pVTy9xubyrZckoZG9E83ZdavZ1ch9SwajxWK9uo_WISCOT10-NZL_A Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:44:57.997044 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_512934300eb6480bab9b4394114bbc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/512934300eb6480bab9b4394114bbc30"}]}] Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-LiveMigrationTest-1451098610 Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-LiveMigrationTest-1451098610-project Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a989536b40ed41ddaa1554bf40378758 Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-LiveMigrationTest-1451098610-project Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 could not be found. Sep 19 14:44:58.000295 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4e03d5dc-b937-4876-a4ca-43dc55f3dc77'} Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 could not be found. Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:58.001435 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 could not be found. Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 could not be found. Sep 19 14:44:58.004479 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:44:58.006355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Returning 404 to user: Instance 4e03d5dc-b937-4876-a4ca-43dc55f3dc77 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:58.009439 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aeb74c92-71f3-4dd0-8bb5-ff5556d6d593 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77" status: 404 len: 111 microversion: 2.1 time: 0.089904 Sep 19 14:44:58.010074 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 794/1589] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:44:57 2022] GET /compute/v2.1/servers/4e03d5dc-b937-4876-a4ca-43dc55f3dc77 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:44:58.018725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-13d444e8-cf74-4225-ad89-459252d86896 req-943077c5-ea91-4f47-8159-04b087e9754b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "name": "network-vif-plugged", "status": "completed", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:58.031141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13d444e8-cf74-4225-ad89-459252d86896 req-943077c5-ea91-4f47-8159-04b087e9754b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:58.031932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13d444e8-cf74-4225-ad89-459252d86896 req-943077c5-ea91-4f47-8159-04b087e9754b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:58.032545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13d444e8-cf74-4225-ad89-459252d86896 req-943077c5-ea91-4f47-8159-04b087e9754b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:58.047617 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-13d444e8-cf74-4225-ad89-459252d86896 req-943077c5-ea91-4f47-8159-04b087e9754b service nova] Creating event network-vif-plugged:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:44:58.056927 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-13d444e8-cf74-4225-ad89-459252d86896 req-943077c5-ea91-4f47-8159-04b087e9754b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045290 Sep 19 14:44:58.058190 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 795/1590] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:58.065285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-085a0539-a556-4f3a-b6be-12a506dd7ded tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'create', calling method: .version_select at 0x7fde29a24700>, body: {"pool": "639a7146-e83b-4789-be3c-bfe8c8684fb1"} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:58.613861 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a4ebd27-b661-4ba7-9e0b-4ff7276b40ee tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.893521 Sep 19 14:44:58.627243 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 796/1591] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:44:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:44:59.128564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4dc14a9c-6715-40b9-b356-6c2186ae931d"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:44:59.131936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:59.147034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:59.147725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:59.148300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:59.151631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:59.152441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:59.153102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:59.334568 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] HTTP exception thrown: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Request method failure captured: Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments/17c7aa81-4055-4970-9bae-79d9683f968c HTTP/1.1 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 74 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIATQI6jr-13aFw6msaprdTMpur4ZBg1yDq8U2nyShJs0oo1qk8_21nK2SXvnneil8XlNYPXVMDLWNqRuezkspZHC3GWYsvrVGz_2gK87TNNGWjoNqTw2ojckLziQc_xMEpCqU2lmLnUl9pB8PR-5pK9CiPHd7Y_Sh6Xddzgdzo63Q4 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a705c94f9f284434a631a4a4df236929 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesAdminNegativeTest-1378966426 Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:44:59.365038 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a705c94f9f284434a631a4a4df236929"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a705c94f9f284434a631a4a4df236929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a705c94f9f284434a631a4a4df236929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a705c94f9f284434a631a4a4df236929"}]}] Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesAdminNegativeTest-1378966426 Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a705c94f9f284434a631a4a4df236929 Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1378966426 Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesAdminNegativeTest-1378966426-project-admin Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 003d48cddcc0422188b5f5c1bd3e7ab5 Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesAdminNegativeTest-1378966426-project-admin Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: {"volumeAttachment": {"volumeId": "4dc14a9c-6715-40b9-b356-6c2186ae931d"}} Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:44:59.367573 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '52c1a3df-11b1-4178-b222-2f04d095f00e', 'id': '17c7aa81-4055-4970-9bae-79d9683f968c', 'body': {'volumeAttachment': {'volumeId': '4dc14a9c-6715-40b9-b356-6c2186ae931d'}}} Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:44:59.368707 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. (HTTP 404) (Request-ID: req-e0b44cb1-6e4a-4e27-a6b3-805e4daf8d71) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:44:59.370143 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:44:59.371631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. Sep 19 14:44:59.372926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:44:59.376914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Returning 400 to user: Volume 4dc14a9c-6715-40b9-b356-6c2186ae931d could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:44:59.377661 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-576d358a-0e6c-4dde-8aa4-e8999cc482dd tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] 10.222.0.81 "PUT /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments/17c7aa81-4055-4970-9bae-79d9683f968c" status: 400 len: 107 microversion: 2.1 time: 0.749381 Sep 19 14:44:59.379079 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 797/1592] 10.222.0.81 () {60 vars in 1433 bytes} [Mon Sep 19 14:44:58 2022] PUT /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments/17c7aa81-4055-4970-9bae-79d9683f968c => generated 107 bytes in 751 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:44:59.393387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39477042-825a-4009-b26a-8c04b161861c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '.version_select at 0x7fde29a9d0d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:59.466285 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39477042-825a-4009-b26a-8c04b161861c tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235644104" status: 202 len: 0 microversion: 2.1 time: 0.085882 Sep 19 14:44:59.467832 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 798/1593] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235644104 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:44:59.481789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:44:59.483698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:44:59.503299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:59.505681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:59.507021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:44:59.508604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:44:59.512780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:44:59.513719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:00.253913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:00.270058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:00.271822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:00.277656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e02d877-6aae-45c6-b2ad-f52628207255 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1280 microversion: 2.25 time: 0.807564 Sep 19 14:45:00.279264 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 799/1594] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:44:59 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1280 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:00.292040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-012729e5-5c78-4566-b0e4-f294d1014165 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a5f9d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:00.414595 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-012729e5-5c78-4566-b0e4-f294d1014165 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.125232 Sep 19 14:45:00.419686 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 800/1595] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:00 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:00.424982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-365778275", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "f05b3455-618c-4083-add0-0e4bab7610d4"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:00.596014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] validate_networks() for [('f05b3455-618c-4083-add0-0e4bab7610d4', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:45:01.909455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-085a0539-a556-4f3a-b6be-12a506dd7ded tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.849771 Sep 19 14:45:01.911398 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 796/1596] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:44:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:01.919540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:01.920717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:01.937610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:01.938392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:01.939536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:01.940920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:01.941854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:01.942467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.167931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lazy-loading 'services' on Instance uuid 52c1a3df-11b1-4178-b222-2f04d095f00e {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:02.198128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:45:02.199983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:45:02.201913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:45:02.202590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:45:02.203319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:45:02.224867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.225565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.226159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.227788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.228553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.229889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.257180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Getting quotas for project b1afbbefb33447b2871b1c40b2bc6cc5. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:45:02.311434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Getting quotas for user ee0cfca622a34b55828b768b57f8697a and project b1afbbefb33447b2871b1c40b2bc6cc5. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:45:02.341039 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8863d109-3820-49f3-ad68-f99059d2148f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "DELETE /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments/17c7aa81-4055-4970-9bae-79d9683f968c" status: 202 len: 0 microversion: 2.1 time: 0.427499 Sep 19 14:45:02.342204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:45:02.342478 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 797/1597] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 14:45:01 2022] DELETE /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments/17c7aa81-4055-4970-9bae-79d9683f968c => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:45:02.354617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:45:02.357556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:02.358595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:02.372916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.374723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.377346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.383433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.384643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.387823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.505568 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96f3b12f-8e37-45e2-bfef-94415ab98000 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.077878 Sep 19 14:45:02.508484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 801/1598] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:45:02.539449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffd82ad0-2bed-411e-ad1f-d3c05046a2c8 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde2a5b7670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:02.661843 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffd82ad0-2bed-411e-ad1f-d3c05046a2c8 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.136859 Sep 19 14:45:02.663021 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 802/1599] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:02 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:02.678298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'action', calling method: .version_select at 0x7fde2c6219d0>, body: {"addFloatingIp": {"address": "172.25.9.86"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:02.687229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:02.710381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.714317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.715246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.718390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.719007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.722314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.800442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:02.813370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:02.814853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:02.816009 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-022f3a1b-d7dc-4d7f-8edd-efd5bd1b8fe4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1280 microversion: 2.25 time: 0.472043 Sep 19 14:45:02.822591 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 798/1600] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:02 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1280 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:02.839927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:02.840727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:02.849395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.850128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.850885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.852428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:02.853136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:02.853737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:02.910570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:45:02.932138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:02.932553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquired lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:03.120362 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e653c3eb-3f09-4e89-bf2b-5f94ed11b852 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 204 len: 0 microversion: 2.1 time: 0.296124 Sep 19 14:45:03.126386 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 799/1601] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:45:02 2022] DELETE /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:03.142425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:03.158425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:03.171940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:03.175467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:03.176160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:03.177923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:03.180809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:03.181454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:03.282090 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f506753a-ac48-4965-b18f-06c604be5766 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154250 Sep 19 14:45:03.297760 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 800/1602] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:03 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:03.321618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e33afad6-33fa-4812-9e9b-fd6b7ca89b4b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:03.322356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e33afad6-33fa-4812-9e9b-fd6b7ca89b4b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:03.586411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e33afad6-33fa-4812-9e9b-fd6b7ca89b4b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:03.606601 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e33afad6-33fa-4812-9e9b-fd6b7ca89b4b tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1223 microversion: 2.1 time: 0.310159 Sep 19 14:45:03.612375 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 801/1603] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:03 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1223 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:03.628402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:03.629307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:03.673929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:03.677886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:03.682093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:03.684487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:03.686136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:03.687686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:04.249093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:04.249093 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c078eddc-3445-4c26-ab16-35c66c0e7563 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 200 len: 1485 microversion: 2.1 time: 0.615549 Sep 19 14:45:04.249093 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 802/1604] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:03 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 1485 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:04.249093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62672417-f85c-4a53-acec-f3408daf7339 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299eedc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:04.323740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62672417-f85c-4a53-acec-f3408daf7339 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.087680 Sep 19 14:45:04.324333 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 803/1605] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:04 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:04.349490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:04.353273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:04.376158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:04.376866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:04.378640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:04.379766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:04.380131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:04.380563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:05.165857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1.", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:45:05.166455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Releasing lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:05.167394 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.167394 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Request method failure captured: Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action HTTP/1.1 Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 45 Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIA-bedYiOoIeMviy8esJEqikmHwsBsKvSwzQtVOefg1HlzEpwK9SydAb9MdWuJNqffIbUx_81TOOjvC-v5yvqxQTYgp8zG1eJX68Vhu5FARKGpl8iJpwweFOrOLq9E-xJcSUt2doK-tk-NCsJPBjLra2-PdFVziOsGN7qz4ef12tFU Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:45:05.170491 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6af088fe0e6047ccaa484e35f24a69d6"}]}] Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ae47961de16a4a71a315100608f7efc3 Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: {"addFloatingIp": {"address": "172.25.9.86"}} Sep 19 14:45:05.172381 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c4b6370c-34cf-43ab-b117-37fa92d259b4', 'body': {'addFloatingIp': {'address': '172.25.9.86'}}} Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:45:05.173468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:45:05.175478 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.177278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.179185 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] Sep 19 14:45:05.182507 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:05.186226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Returning 400 to user: Cannot associate floating IP 172.25.9.86 (3261c726-55d7-4800-b971-71aa0c10319e) with port 9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 639a7146-e83b-4789-be3c-bfe8c8684fb1. Sep 19 14:45:05.186226 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-d164ab31-c2f7-4bda-afe2-6adf59f825d8'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:05.187956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-822dad84-f01c-4061-a3f7-47f2bbed16a3 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action" status: 400 len: 381 microversion: 2.1 time: 2.522210 Sep 19 14:45:05.189669 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 803/1606] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:02 2022] POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action => generated 381 bytes in 2524 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:45:05.218360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:05.227768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:05.228029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:05.234245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:05.237902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:05.238063 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e4657c2-9fa8-4261-a120-8e97de632dca tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1280 microversion: 2.25 time: 0.912343 Sep 19 14:45:05.240495 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 804/1607] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:04 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1280 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:05.256585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:05.261222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:05.266079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:05.266582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:05.267546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:05.275029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:05.276618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:05.280358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:05.305929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:05.310838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:05.311398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:05.312155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:05.323741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:05.324184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:05.370809 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-27295856-a97c-4b19-b5e3-2e7df86dbba4 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176968 Sep 19 14:45:05.377901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 804/1608] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:05 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:05.525610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2004626795", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:05.563062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:05.572899 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e42a0924-f381-4cf8-bee6-863e5f491518 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1283 microversion: 2.1 time: 0.325682 Sep 19 14:45:05.582614 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 805/1609] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:05 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1283 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:05.605690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1851e050-51d7-4218-90d5-77d37c6dd98d tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '.version_select at 0x7fde299f4700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:05.640597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] validate_networks() for [('fec2220e-6bd6-451c-a1a2-0b1e8da69831', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:45:07.734693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:45:07.735921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:45:07.736576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:45:07.737332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:45:07.738639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:45:07.767263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:07.768319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:07.768774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:07.769540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:07.770004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:07.770437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:07.817121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Getting quotas for project 336c00bdba004c87ad422bb2dde66117. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:45:07.832002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Getting quotas for user 763b0d6ea07d4a38b8fd44aa39e99a84 and project 336c00bdba004c87ad422bb2dde66117. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:45:07.870137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:45:07.872928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:45:08.031625 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df1e77a4-5400-488f-98d6-48ac5cbfbd33 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.649935 Sep 19 14:45:08.035059 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 805/1610] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:45:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:45:08.065082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:08.066164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: d2679ae8-f24f-4bb1-a771-0994a55bd65a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:08.087227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.088203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.088825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.093363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.094144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.094914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.131570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.135853 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] HTTP exception thrown: Instance d2679ae8-f24f-4bb1-a771-0994a55bd65a could not be found. Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Request method failure captured: Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a HTTP/1.1 Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6yp_DVBhq15SSWTj5FTgW_WVN8EjiNu5WCjMQ7xDKuQWJ4miw3FURKGmi_KcV_O6qaLNsfaUMxlJ3SlxT2C57qf2YP-M9CQS2v_d5SM--Iw54kAU05TqGd2pVTy9xubyrZckoZG9E83ZdavZ1ch9SwajxWK9uo_WISCOT10-NZL_A Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:45:08.139291 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_512934300eb6480bab9b4394114bbc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/512934300eb6480bab9b4394114bbc30"}]}] Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveMigrationTest-1451098610 Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveMigrationTest-1451098610-project Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a989536b40ed41ddaa1554bf40378758 Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveMigrationTest-1451098610-project Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance d2679ae8-f24f-4bb1-a771-0994a55bd65a could not be found. Sep 19 14:45:08.141206 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd2679ae8-f24f-4bb1-a771-0994a55bd65a'} Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2679ae8-f24f-4bb1-a771-0994a55bd65a could not be found. Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:08.142237 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2679ae8-f24f-4bb1-a771-0994a55bd65a could not be found. Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2679ae8-f24f-4bb1-a771-0994a55bd65a could not be found. Sep 19 14:45:08.143892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:08.149075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Returning 404 to user: Instance d2679ae8-f24f-4bb1-a771-0994a55bd65a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:08.152904 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-938073c0-e3cb-4bc1-a795-a076650916bd tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a" status: 404 len: 111 microversion: 2.1 time: 0.098994 Sep 19 14:45:08.154073 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 806/1611] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:08 2022] GET /compute/v2.1/servers/d2679ae8-f24f-4bb1-a771-0994a55bd65a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:45:08.168011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-778e8b8c-045c-4fb2-977d-ea0ee3fd17c9 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29aaa670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:08.287838 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-778e8b8c-045c-4fb2-977d-ea0ee3fd17c9 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.131885 Sep 19 14:45:08.288392 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 807/1612] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:08 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:08.310022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-56879efa-c333-4f1a-afaf-13700f13884f req-e1868c6e-aba9-4255-9ff1-f529d5b0a36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2679ae8-f24f-4bb1-a771-0994a55bd65a", "name": "network-vif-deleted", "tag": "0abb9a01-3482-473b-ac11-2d6a4f22ab12"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:08.399934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56879efa-c333-4f1a-afaf-13700f13884f req-e1868c6e-aba9-4255-9ff1-f529d5b0a36d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.400403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56879efa-c333-4f1a-afaf-13700f13884f req-e1868c6e-aba9-4255-9ff1-f529d5b0a36d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.400976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56879efa-c333-4f1a-afaf-13700f13884f req-e1868c6e-aba9-4255-9ff1-f529d5b0a36d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.462241 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-56879efa-c333-4f1a-afaf-13700f13884f req-e1868c6e-aba9-4255-9ff1-f529d5b0a36d service nova] Creating event network-vif-deleted:0abb9a01-3482-473b-ac11-2d6a4f22ab12 for instance d2679ae8-f24f-4bb1-a771-0994a55bd65a on n-h1-858384-1 Sep 19 14:45:08.480751 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-56879efa-c333-4f1a-afaf-13700f13884f req-e1868c6e-aba9-4255-9ff1-f529d5b0a36d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190358 Sep 19 14:45:08.481385 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 808/1613] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:08.499303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:08.499760 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1851e050-51d7-4218-90d5-77d37c6dd98d tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/3261c726-55d7-4800-b971-71aa0c10319e" status: 202 len: 0 microversion: 2.1 time: 2.906483 Sep 19 14:45:08.501776 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 806/1614] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:45:05 2022] DELETE /compute/v2.1/os-floating-ips/3261c726-55d7-4800-b971-71aa0c10319e => generated 0 bytes in 2918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:45:08.507215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:08.511392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:08.517509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:08.524174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.525365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.526021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.526993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.527637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.528245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.541544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.548114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.552499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.553965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.553965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.561287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.684866 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49624afb-d664-443a-9cd5-6c0f34795661 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181452 Sep 19 14:45:08.689652 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 807/1615] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:08 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:08.699231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b1f27ac7-8c2a-4196-955a-a3ae4a7fc2b3 req-b6689232-6062-4fee-97e6-30e1b3854d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cea384e-ffd7-4ffb-a325-149d8c5fbf62", "name": "network-vif-plugged", "status": "completed", "tag": "baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:08.722263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b1f27ac7-8c2a-4196-955a-a3ae4a7fc2b3 req-b6689232-6062-4fee-97e6-30e1b3854d6c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.727299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b1f27ac7-8c2a-4196-955a-a3ae4a7fc2b3 req-b6689232-6062-4fee-97e6-30e1b3854d6c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.728082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b1f27ac7-8c2a-4196-955a-a3ae4a7fc2b3 req-b6689232-6062-4fee-97e6-30e1b3854d6c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.771069 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b1f27ac7-8c2a-4196-955a-a3ae4a7fc2b3 req-b6689232-6062-4fee-97e6-30e1b3854d6c service nova] Creating event network-vif-plugged:baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd for instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 on n-h2-858384-1 Sep 19 14:45:08.816102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b1f27ac7-8c2a-4196-955a-a3ae4a7fc2b3 req-b6689232-6062-4fee-97e6-30e1b3854d6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124792 Sep 19 14:45:08.817899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 808/1616] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:08.883622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:08.891171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:08.919215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.923232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.924179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.925646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:08.928779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:08.931350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:08.994565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:09.012224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:09.019310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:09.024723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e2d4c17f-6541-48aa-ba1a-67c3f1beee22 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1280 microversion: 2.25 time: 0.542058 Sep 19 14:45:09.027862 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 809/1617] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:08 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1280 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:09.045710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-05963842-dfef-4243-8481-520686e65c73 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:09.046346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-05963842-dfef-4243-8481-520686e65c73 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:09.230733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-05963842-dfef-4243-8481-520686e65c73 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:09.248684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-05963842-dfef-4243-8481-520686e65c73 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1223 microversion: 2.1 time: 0.215466 Sep 19 14:45:09.252034 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 810/1618] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:09 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1223 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:09.264763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:09.270727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:09.302982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:09.305242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:09.308327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:09.311656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:09.313405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:09.319546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:09.428294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:45:09.508585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:09.529268 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-391ec399-60e3-4b59-8beb-1b8bb916ca86 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1323 microversion: 2.1 time: 0.679082 Sep 19 14:45:09.531126 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 809/1619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:08 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:09.536198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'action', calling method: .version_select at 0x7fde2c636790>, body: {"removeFloatingIp": {"address": "172.25.9.13"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:09.687402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55e1c5bf-48c1-4020-965f-10ca1a50c606 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "DELETE /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 204 len: 0 microversion: 2.1 time: 0.433747 Sep 19 14:45:09.688849 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 811/1620] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:45:09 2022] DELETE /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:09.694848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-734171f0-2dca-4533-acc8-5daaa0e51650 req-68c602f1-9281-4d98-9a17-6d27ef41ac9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3934e7f-da3c-4411-98ed-0e7bee2460c7", "tag": "013e9e03-d582-4be5-9797-9ff12cdb9ae2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:09.707138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.727284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-734171f0-2dca-4533-acc8-5daaa0e51650 req-68c602f1-9281-4d98-9a17-6d27ef41ac9c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:09.728045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-734171f0-2dca-4533-acc8-5daaa0e51650 req-68c602f1-9281-4d98-9a17-6d27ef41ac9c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:09.730454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-734171f0-2dca-4533-acc8-5daaa0e51650 req-68c602f1-9281-4d98-9a17-6d27ef41ac9c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:09.763698 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-734171f0-2dca-4533-acc8-5daaa0e51650 req-68c602f1-9281-4d98-9a17-6d27ef41ac9c service nova] Creating event network-changed:013e9e03-d582-4be5-9797-9ff12cdb9ae2 for instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 on n-h1-858384-1 Sep 19 14:45:09.773203 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-734171f0-2dca-4533-acc8-5daaa0e51650 req-68c602f1-9281-4d98-9a17-6d27ef41ac9c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082522 Sep 19 14:45:09.775795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 812/1621] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:09.786720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b97e88bf-1129-4684-8ef8-6e6047e3f552 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29b045e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:09.911431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b97e88bf-1129-4684-8ef8-6e6047e3f552 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.130311 Sep 19 14:45:09.912442 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 813/1622] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:09 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:09.937435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:09.938704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:09.952147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:09.957988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:09.959275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:09.960178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:09.967550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:09.968272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:10.019578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:10.030934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:10.031442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:10.035322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:10.042857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:10.044267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:10.051927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:10.911504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:10.925581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3ce7b30-98e9-4bf9-865e-de5a2d87513e tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1500 microversion: 2.1 time: 1.011856 Sep 19 14:45:10.926179 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 814/1623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:09 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1500 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:10.952043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:10.954418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:10.981017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:10.985603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:10.986895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:10.987844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:10.990258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:10.994999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:11.108150 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4d9eab5-74c2-4c1c-857d-dcb4b1f61126 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160097 Sep 19 14:45:11.108770 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 815/1624] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:10 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:11.122535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:11.129338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:11.150117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:11.150629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:11.153052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:11.154039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:11.164014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:11.164512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:11.207235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:11.208213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquired lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:12.821339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:12.832709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:12.837228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:12.838423 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5cec120f-7f9c-4c14-8d01-d47f38b58a26 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1280 microversion: 2.25 time: 1.724781 Sep 19 14:45:12.859860 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 816/1625] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:11 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1280 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:12.878587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:12.883216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:12.902068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:12.903237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:12.903829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:12.904841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:12.905504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:12.906785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.048145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:13.064700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3608703a-9075-49a1-8d1a-9bafdad780dc tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1281 microversion: 2.1 time: 0.202760 Sep 19 14:45:13.078826 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 817/1626] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:12 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:13.080120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:13.081337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:13.103882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:13.104688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:13.106310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.107359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:13.108207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:13.113791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.511383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:13.555850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6bece6ac-a9a6-4d19-97c1-07df5c71153a tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1323 microversion: 2.1 time: 0.487047 Sep 19 14:45:13.557193 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 818/1627] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:13 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1323 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:13.562151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d61421e2-4be9-4832-93b9-f755074d967d tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a47c10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:13.591980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:13.695937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d61421e2-4be9-4832-93b9-f755074d967d tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.137350 Sep 19 14:45:13.704384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 819/1628] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:13 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:13.709449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:13.710083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:13.734152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:13.735003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:13.735623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.736557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:13.737201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:13.737805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.872687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a989536b40ed41ddaa1554bf40378758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512934300eb6480bab9b4394114bbc30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:13.896537 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e5b837b-8d0c-4c52-a5dc-19bed32c0f65 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 200 len: 1296 microversion: 2.1 time: 0.190922 Sep 19 14:45:13.913194 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 820/1629] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:13 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 1296 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:13.921541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:13.925222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:13.936049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:13.936828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:13.937513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.938441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:13.939115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:13.939716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:13.990402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:45:14.021225 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-16f5325e-384a-42e7-a787-c6a7e165837c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106231 Sep 19 14:45:14.022598 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 821/1630] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:13 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:45:14.065344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47cfd6a6-6c11-4ea3-b915-399ea7a000a6"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:14.083800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:14.105541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:14.106366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:14.107018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:14.107942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:14.108812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:14.109522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:14.594332 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e587506-8bd0-4514-9caf-33bb3943fc57 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "POST /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.570180 Sep 19 14:45:14.595398 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 822/1631] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 14:45:14 2022] POST /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:14.612637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bb5acbb1-2cfc-4fbb-a649-f1a8fdee0938 req-dafd9dbd-af4e-4340-b252-ea5c5f5d4aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36015b1d-9daa-4b76-bb72-48bb7a834641", "name": "network-vif-deleted", "tag": "b7b08c8e-f338-40b2-9a9f-5815386907da"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:14.671986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb5acbb1-2cfc-4fbb-a649-f1a8fdee0938 req-dafd9dbd-af4e-4340-b252-ea5c5f5d4aa0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:14.675887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb5acbb1-2cfc-4fbb-a649-f1a8fdee0938 req-dafd9dbd-af4e-4340-b252-ea5c5f5d4aa0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:14.681048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb5acbb1-2cfc-4fbb-a649-f1a8fdee0938 req-dafd9dbd-af4e-4340-b252-ea5c5f5d4aa0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:14.734229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bb5acbb1-2cfc-4fbb-a649-f1a8fdee0938 req-dafd9dbd-af4e-4340-b252-ea5c5f5d4aa0 service nova] Creating event network-vif-deleted:b7b08c8e-f338-40b2-9a9f-5815386907da for instance 36015b1d-9daa-4b76-bb72-48bb7a834641 on n-h1-858384-1 Sep 19 14:45:14.761868 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bb5acbb1-2cfc-4fbb-a649-f1a8fdee0938 req-dafd9dbd-af4e-4340-b252-ea5c5f5d4aa0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164666 Sep 19 14:45:14.764394 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 823/1632] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:14.774467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:14.775186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:14.785192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:14.786050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:14.786818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:14.787796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:14.788620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:14.789890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:15.345863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:15.360800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:15.363493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:15.365367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-899397a9-b488-4182-825c-cf08ad52e9ee tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1475 microversion: 2.25 time: 0.599751 Sep 19 14:45:15.368408 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 824/1633] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:14 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1475 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:15.378286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:15.378952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:15.399930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:15.400655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:15.401287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:15.402391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:15.403058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:15.403657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:15.731049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Updating instance_info_cache with network_info: [{"id": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f", "address": "fa:16:3e:10:a6:7b", "network": {"id": "e9efff2d-14e3-46cc-8852-37758a7c9828", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1278010663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6af088fe0e6047ccaa484e35f24a69d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9aa5d7ff-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:45:15.752283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Releasing lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:15.755948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-662c06a1-8bd3-4fe2-8d3b-6422d2c2328e tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action" status: 202 len: 0 microversion: 2.1 time: 6.222083 Sep 19 14:45:15.760281 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 810/1634] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:09 2022] POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action => generated 0 bytes in 6228 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:45:15.765393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:15.781356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1839387126", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b8b5b1b5-4968-4be9-8320-4a3dc5b18d81"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:15.784699 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1aabfd60-38a0-4890-84ef-65c8585ccec1 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1323 microversion: 2.1 time: 0.415364 Sep 19 14:45:15.812086 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 825/1635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:15 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:15.824906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:15.827114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:15.839508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:15.846005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:15.846809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:15.847652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:15.848352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:15.849019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:15.876569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:15.958114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] validate_networks() for [('b8b5b1b5-4968-4be9-8320-4a3dc5b18d81', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:45:16.187407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:16.217360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-071fc7e1-6360-4d7e-abda-ea0fdff76f3c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1323 microversion: 2.1 time: 0.403969 Sep 19 14:45:16.218974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 826/1636] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:15 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:16.236898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2307fad-4c01-4755-a0fc-24fa7222bb3c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a0f160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:16.333783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2307fad-4c01-4755-a0fc-24fa7222bb3c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.113368 Sep 19 14:45:16.335126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 827/1637] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:16 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:16.340809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:16.343868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] [instance: 36015b1d-9daa-4b76-bb72-48bb7a834641] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:16.369952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:16.370724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:16.371124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:16.372462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:16.373340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:16.374068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:16.397652 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] HTTP exception thrown: Instance 36015b1d-9daa-4b76-bb72-48bb7a834641 could not be found. Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Request method failure captured: Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 HTTP/1.1 Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH6yp_DVBhq15SSWTj5FTgW_WVN8EjiNu5WCjMQ7xDKuQWJ4miw3FURKGmi_KcV_O6qaLNsfaUMxlJ3SlxT2C57qf2YP-M9CQS2v_d5SM--Iw54kAU05TqGd2pVTy9xubyrZckoZG9E83ZdavZ1ch9SwajxWK9uo_WISCOT10-NZL_A Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:45:16.399362 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_512934300eb6480bab9b4394114bbc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/512934300eb6480bab9b4394114bbc30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/512934300eb6480bab9b4394114bbc30"}]}] Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveMigrationTest-1451098610 Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 512934300eb6480bab9b4394114bbc30 Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveMigrationTest-1451098610 Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveMigrationTest-1451098610-project Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a989536b40ed41ddaa1554bf40378758 Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveMigrationTest-1451098610-project Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 36015b1d-9daa-4b76-bb72-48bb7a834641 could not be found. Sep 19 14:45:16.400945 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '36015b1d-9daa-4b76-bb72-48bb7a834641'} Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36015b1d-9daa-4b76-bb72-48bb7a834641 could not be found. Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:16.401802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36015b1d-9daa-4b76-bb72-48bb7a834641 could not be found. Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36015b1d-9daa-4b76-bb72-48bb7a834641 could not be found. Sep 19 14:45:16.403191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:16.404456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] Returning 404 to user: Instance 36015b1d-9daa-4b76-bb72-48bb7a834641 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:16.404456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-de0e9bc0-b1d1-4f4f-bf03-91af606c6590 tempest-LiveMigrationTest-1451098610 tempest-LiveMigrationTest-1451098610-project] 10.222.0.81 "GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641" status: 404 len: 111 microversion: 2.1 time: 0.064826 Sep 19 14:45:16.405576 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 828/1638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:16 2022] GET /compute/v2.1/servers/36015b1d-9daa-4b76-bb72-48bb7a834641 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:45:16.411873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e2bc15dc-7a60-4734-8294-ed65c2d9f2d8 req-63c42f2e-82de-4e7f-b6de-01bf439d190a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3934e7f-da3c-4411-98ed-0e7bee2460c7", "name": "network-vif-plugged", "status": "completed", "tag": "013e9e03-d582-4be5-9797-9ff12cdb9ae2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:16.422905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e2bc15dc-7a60-4734-8294-ed65c2d9f2d8 req-63c42f2e-82de-4e7f-b6de-01bf439d190a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:16.423453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e2bc15dc-7a60-4734-8294-ed65c2d9f2d8 req-63c42f2e-82de-4e7f-b6de-01bf439d190a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:16.423893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e2bc15dc-7a60-4734-8294-ed65c2d9f2d8 req-63c42f2e-82de-4e7f-b6de-01bf439d190a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:16.437421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e2bc15dc-7a60-4734-8294-ed65c2d9f2d8 req-63c42f2e-82de-4e7f-b6de-01bf439d190a service nova] Creating event network-vif-plugged:013e9e03-d582-4be5-9797-9ff12cdb9ae2 for instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 on n-h1-858384-1 Sep 19 14:45:16.444107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e2bc15dc-7a60-4734-8294-ed65c2d9f2d8 req-63c42f2e-82de-4e7f-b6de-01bf439d190a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 Sep 19 14:45:16.445658 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 829/1639] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:16.728103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:16.729107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:16.741060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:16.741598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:16.742056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:16.742790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:16.745157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:16.748516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.032899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:45:17.034412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:45:17.035401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:45:17.036159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:45:17.037478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:45:17.051452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.052879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.053547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.056499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.083621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.084964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.116375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:17.122483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Getting quotas for project c204b981d98b46c29a36a09c38266982. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:45:17.144175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Getting quotas for user c157ab3e33fe4f648c425f54f7347b39 and project c204b981d98b46c29a36a09c38266982. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:45:17.150371 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d348cb0c-fde3-4b7b-afbb-f6c2c7d8c847 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1967 microversion: 2.25 time: 0.703424 Sep 19 14:45:17.154872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 830/1640] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:16 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1967 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:17.162660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f822c4a-53bb-47ea-b2fd-04f52019e604 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '.version_select at 0x7fde299f5b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:17.193993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:45:17.197372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:45:17.324759 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a1b899c-de72-4c00-91c8-ab9072a2b3ff tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562006 Sep 19 14:45:17.331474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 811/1641] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:45:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:45:17.337756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7c03c1a3-b24e-44a0-8b1e-ad0ef6908fbb req-e099f060-a4bd-40a0-a36b-18927ec37143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:17.379080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c03c1a3-b24e-44a0-8b1e-ad0ef6908fbb req-e099f060-a4bd-40a0-a36b-18927ec37143 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.379589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c03c1a3-b24e-44a0-8b1e-ad0ef6908fbb req-e099f060-a4bd-40a0-a36b-18927ec37143 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.380041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c03c1a3-b24e-44a0-8b1e-ad0ef6908fbb req-e099f060-a4bd-40a0-a36b-18927ec37143 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.411372 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7c03c1a3-b24e-44a0-8b1e-ad0ef6908fbb req-e099f060-a4bd-40a0-a36b-18927ec37143 service nova] Creating event network-changed:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:45:17.417074 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7c03c1a3-b24e-44a0-8b1e-ad0ef6908fbb req-e099f060-a4bd-40a0-a36b-18927ec37143 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089951 Sep 19 14:45:17.422784 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 812/1642] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:17.431966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f37db75a-9aff-44e7-a5a3-ebce01cf846c req-8e9b66ce-c096-4bed-a3ec-86e03715c7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b6370c-34cf-43ab-b117-37fa92d259b4", "tag": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:17.454418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f37db75a-9aff-44e7-a5a3-ebce01cf846c req-8e9b66ce-c096-4bed-a3ec-86e03715c7f5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.455219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f37db75a-9aff-44e7-a5a3-ebce01cf846c req-8e9b66ce-c096-4bed-a3ec-86e03715c7f5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.455828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f37db75a-9aff-44e7-a5a3-ebce01cf846c req-8e9b66ce-c096-4bed-a3ec-86e03715c7f5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.471014 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f37db75a-9aff-44e7-a5a3-ebce01cf846c req-8e9b66ce-c096-4bed-a3ec-86e03715c7f5 service nova] Creating event network-changed:9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f for instance c4b6370c-34cf-43ab-b117-37fa92d259b4 on n-h1-858384-1 Sep 19 14:45:17.481353 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f37db75a-9aff-44e7-a5a3-ebce01cf846c req-8e9b66ce-c096-4bed-a3ec-86e03715c7f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056317 Sep 19 14:45:17.481969 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 813/1643] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:17.490789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:17.493173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:17.507528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.508290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.508987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.509951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.510640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.511327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.794737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:17.905955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:17.920886 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09cca960-7e3e-47e0-9099-45b57b386518 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1323 microversion: 2.1 time: 0.436004 Sep 19 14:45:17.922408 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 814/1644] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:17 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:17.941418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:17.943826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:17.972946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.973468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.973914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.974641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:17.978726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:17.979227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:17.983743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.334384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:18.368288 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c4c9440-6a9c-41f4-afd7-fd2bd4ba7827 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1967 microversion: 2.25 time: 0.443534 Sep 19 14:45:18.371803 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 815/1645] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:17 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1967 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:18.383034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:18.386580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:18.399157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:18.399383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:18.411351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:18.412165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:18.412869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:18.413551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:18.653461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:18.661708 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9e0b35ef-290f-418e-bcd8-39e73e062bb5 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1323 microversion: 2.1 time: 0.288771 Sep 19 14:45:18.662299 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 816/1646] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:18 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:18.677478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:18.677478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:18.705458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:18.705990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:18.706440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:18.710498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:18.711589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:18.712085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:18.851782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:18.866361 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f9945cf-6fba-4d41-9c2a-1a69231b918e tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1270 microversion: 2.1 time: 0.194943 Sep 19 14:45:18.872008 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 817/1647] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:18 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:18.876815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e6d53345-ba1e-4fec-8144-fbbd0c260bf4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29af5310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:18.985463 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e6d53345-ba1e-4fec-8144-fbbd0c260bf4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.112242 Sep 19 14:45:18.991483 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 818/1648] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:18 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:19.012010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:19.017904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.031490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.034667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.036376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.037193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.038000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.072549 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12b4623e-77a5-47e0-bb61-8bc358b83cb6 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076260 Sep 19 14:45:19.073801 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 819/1649] 10.222.0.81 () {60 vars in 1217 bytes} [Mon Sep 19 14:45:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:19.081362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:19.082448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:19.092164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.092950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.093625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.094809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.095587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.096250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.242013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:19.284661 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f822c4a-53bb-47ea-b2fd-04f52019e604 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/20231707-08ae-43ad-a748-67e138e6b15d" status: 202 len: 0 microversion: 2.1 time: 2.128125 Sep 19 14:45:19.285259 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 831/1650] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:45:17 2022] DELETE /compute/v2.1/os-floating-ips/20231707-08ae-43ad-a748-67e138e6b15d => generated 0 bytes in 2130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:45:19.293524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-1", "block_migration": "auto"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:19.304101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:19.350818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.353790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.354529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.355801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.356441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.357038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.405930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'flavor' on Instance uuid 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:19.426876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Going to try to live migrate instance to n-h1-858384-1 {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 14:45:19.530211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:19.550733 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-586a03fc-31c1-4a15-a902-48a214caf289 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1323 microversion: 2.1 time: 0.473606 Sep 19 14:45:19.565007 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 820/1651] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:19 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:19.592616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4557932-e573-4d32-81d4-984dfe942209 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4557932-e573-4d32-81d4-984dfe942209 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Request method failure captured: Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action HTTP/1.1 Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 34 Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIA-bedYiOoIeMviy8esJEqikmHwsBsKvSwzQtVOefg1HlzEpwK9SydAb9MdWuJNqffIbUx_81TOOjvC-v5yvqxQTYgp8zG1eJX68Vhu5FARKGpl8iJpwweFOrOLq9E-xJcSUt2doK-tk-NCsJPBjLra2-PdFVziOsGN7qz4ef12tFU Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:45:19.605756 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6af088fe0e6047ccaa484e35f24a69d6"}]}] Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ae47961de16a4a71a315100608f7efc3 Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: {"addFloatingIp": {"address": ""}} Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:45:19.607455 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c4b6370c-34cf-43ab-b117-37fa92d259b4', 'body': {'addFloatingIp': {'address': ''}}} Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi '' Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:19.608382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:45:19.609965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:45:19.611649 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 19 14:45:19.611649 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.612755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4557932-e573-4d32-81d4-984dfe942209 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:19.615501 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4557932-e573-4d32-81d4-984dfe942209 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action" status: 400 len: 142 microversion: 2.1 time: 0.044887 Sep 19 14:45:19.621953 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 821/1652] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:19 2022] POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action => generated 142 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:45:19.628489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:19.636395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:19.654785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.655271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.655707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.656411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.656864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.657434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:19.738302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:19.739018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquired lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:19.965239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Releasing lock "refresh_cache-c4b6370c-34cf-43ab-b117-37fa92d259b4" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:19.965721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] HTTP exception thrown: floating IP not found Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Request method failure captured: Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action HTTP/1.1 Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 41 Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIA-bedYiOoIeMviy8esJEqikmHwsBsKvSwzQtVOefg1HlzEpwK9SydAb9MdWuJNqffIbUx_81TOOjvC-v5yvqxQTYgp8zG1eJX68Vhu5FARKGpl8iJpwweFOrOLq9E-xJcSUt2doK-tk-NCsJPBjLra2-PdFVziOsGN7qz4ef12tFU Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:45:19.967958 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6af088fe0e6047ccaa484e35f24a69d6"}]}] Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ae47961de16a4a71a315100608f7efc3 Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:45:19.969976 n-d-858384-1 devstack@n-api.service[128731]: exception: floating IP not found Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c4b6370c-34cf-43ab-b117-37fa92d259b4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:19.971525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 19 14:45:19.973510 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:19.975272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Returning 404 to user: floating IP not found {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:19.975272 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-80ae0cb3-3363-4229-a1fb-c1399b05d42f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action" status: 404 len: 67 microversion: 2.1 time: 0.346072 Sep 19 14:45:19.979346 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 822/1653] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:19 2022] POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action => generated 67 bytes in 356 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:45:19.985901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:19.987264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:19.997769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:19.998700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:19.999474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:20.000526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:20.001017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:20.001535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:20.341864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:20.350972 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23951c07-668f-44be-bb75-02f3917d6cac tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 200 len: 1519 microversion: 2.1 time: 0.370137 Sep 19 14:45:20.352637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 823/1654] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:19 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 1519 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:20.358496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:20.359141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:20.365729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:20.366227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:20.369228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:20.370037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:20.370686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:20.371986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:20.550150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:20.560203 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c18e240a-94bd-4a1c-9bc5-05d9eb659a60 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1276 microversion: 2.1 time: 0.206098 Sep 19 14:45:20.560802 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 824/1655] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:20 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:20.565515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1bee9280-a72c-4150-85b8-e85dd867e525 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:20.628083 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1bee9280-a72c-4150-85b8-e85dd867e525 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1bee9280-a72c-4150-85b8-e85dd867e525 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Request method failure captured: Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action HTTP/1.1 Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 44 Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIA-bedYiOoIeMviy8esJEqikmHwsBsKvSwzQtVOefg1HlzEpwK9SydAb9MdWuJNqffIbUx_81TOOjvC-v5yvqxQTYgp8zG1eJX68Vhu5FARKGpl8iJpwweFOrOLq9E-xJcSUt2doK-tk-NCsJPBjLra2-PdFVziOsGN7qz4ef12tFU Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:45:20.630647 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6af088fe0e6047ccaa484e35f24a69d6"}]}] Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ae47961de16a4a71a315100608f7efc3 Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:45:20.633282 n-d-858384-1 devstack@n-api.service[128731]: exception: Floating IP not found for address 0.0.0.0. Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c4b6370c-34cf-43ab-b117-37fa92d259b4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:20.634192 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 19 14:45:20.635665 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:20.637526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1bee9280-a72c-4150-85b8-e85dd867e525 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:20.637526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1bee9280-a72c-4150-85b8-e85dd867e525 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action" status: 404 len: 88 microversion: 2.1 time: 0.070703 Sep 19 14:45:20.640601 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 825/1656] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:20 2022] POST /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4/action => generated 88 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:45:20.646339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a06dc542-a338-4d15-8cf0-a19a9dac9a65 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29ae3af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:20.727979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a06dc542-a338-4d15-8cf0-a19a9dac9a65 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1422 microversion: 2.1 time: 0.086142 Sep 19 14:45:20.737948 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 826/1657] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:20 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:20.746985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.213"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:20.749554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:20.756975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:20.758717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:20.759420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:20.760315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:20.760948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:20.761559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:20.829878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:20.830293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquired lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:23.121134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:45:23.487875 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ef54c36-97da-424b-bb4b-c882eff1dba4 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62/action" status: 202 len: 0 microversion: 2.25 time: 4.198021 Sep 19 14:45:23.493995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 832/1658] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:45:19 2022] POST /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62/action => generated 0 bytes in 4204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:23.503356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:23.511096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:23.539784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:23.555533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:23.563510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:23.565161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:23.569290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:23.571799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:24.380070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:24.404936 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0ca85c3-5843-45b2-92e8-4be9bc1ef0c5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1323 microversion: 2.1 time: 0.909535 Sep 19 14:45:24.406493 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 833/1659] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:23 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1323 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:24.419900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:24.423383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:24.439191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:24.441894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:24.442691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:24.444042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:24.446635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:24.448549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:24.519038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:45:24.621983 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-868e0ed3-b31e-4612-9e51-7a56e2064e87 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 204 len: 0 microversion: 2.1 time: 0.213489 Sep 19 14:45:24.623154 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 834/1660] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:45:24 2022] DELETE /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:24.631214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:24.633024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:24.641945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:24.642961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:24.644438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:24.645516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:24.646407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:24.647041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.160257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:25.174941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e66254e-82de-45a9-944f-e51ab384707b tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1318 microversion: 2.1 time: 0.547980 Sep 19 14:45:25.192059 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 835/1661] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:24 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:25.199004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9190aeb-b41c-4d6e-b04c-054e3f390cd2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a0f790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:25.262782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Updating instance_info_cache with network_info: [{"id": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a", "address": "fa:16:3e:b0:03:46", "network": {"id": "f05b3455-618c-4083-add0-0e4bab7610d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2016119408-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b1afbbefb33447b2871b1c40b2bc6cc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap36aaba0a-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:45:25.267089 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9190aeb-b41c-4d6e-b04c-054e3f390cd2 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1431 microversion: 2.1 time: 0.073372 Sep 19 14:45:25.269108 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 836/1662] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:25 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1431 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:25.275097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-efbb4786-6017-447d-bbdd-861d66f817f3 req-bacae7b1-324f-4dde-b8c4-bafe650c27a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "name": "network-vif-plugged", "status": "completed", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:25.292230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Releasing lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:25.293307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b4d939fa-bb8f-4cae-a584-72128843610c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action" status: 202 len: 0 microversion: 2.1 time: 4.554272 Sep 19 14:45:25.294353 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 827/1663] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:20 2022] POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action => generated 0 bytes in 4556 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:45:25.294957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-efbb4786-6017-447d-bbdd-861d66f817f3 req-bacae7b1-324f-4dde-b8c4-bafe650c27a8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:25.296428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-efbb4786-6017-447d-bbdd-861d66f817f3 req-bacae7b1-324f-4dde-b8c4-bafe650c27a8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:25.297436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-efbb4786-6017-447d-bbdd-861d66f817f3 req-bacae7b1-324f-4dde-b8c4-bafe650c27a8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.300184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e5363642-c816-448c-88c0-74b4877c6454 req-3e321820-e306-437d-acbc-6b8a500134ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:25.315891 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-efbb4786-6017-447d-bbdd-861d66f817f3 req-bacae7b1-324f-4dde-b8c4-bafe650c27a8 service nova] Creating event network-vif-plugged:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:45:25.323050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:25.325801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e5363642-c816-448c-88c0-74b4877c6454 req-3e321820-e306-437d-acbc-6b8a500134ac service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:25.326913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-efbb4786-6017-447d-bbdd-861d66f817f3 req-bacae7b1-324f-4dde-b8c4-bafe650c27a8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055692 Sep 19 14:45:25.327996 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 837/1664] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:25.328370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e5363642-c816-448c-88c0-74b4877c6454 req-3e321820-e306-437d-acbc-6b8a500134ac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:25.328904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e5363642-c816-448c-88c0-74b4877c6454 req-3e321820-e306-437d-acbc-6b8a500134ac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.337277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:25.345742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:25.351019 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e5363642-c816-448c-88c0-74b4877c6454 req-3e321820-e306-437d-acbc-6b8a500134ac service nova] Creating event network-changed:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:45:25.357923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:25.358648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:25.361116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.362643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:25.363466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:25.364413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.370501 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e5363642-c816-448c-88c0-74b4877c6454 req-3e321820-e306-437d-acbc-6b8a500134ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074103 Sep 19 14:45:25.373905 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 828/1665] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:25.382958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:25.387777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:25.402393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:25.403754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:25.405057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.406391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:25.407175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:25.407970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:25.917169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:25.926530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-da12a8cc-2638-4b90-a269-d1d723336a94 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1542 microversion: 2.1 time: 0.548574 Sep 19 14:45:25.943972 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 829/1666] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:25 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1542 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:25.943972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2bf299dc-4421-47f6-ba53-3cf9f59b6e99 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a881f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:25.975557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:25.983477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:25.985171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:25.986614 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9cfe7d9f-a4cb-4c3f-8def-4dd0bc120a94 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.656852 Sep 19 14:45:25.988097 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 838/1667] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:25 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:25.995370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.213"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:25.997136 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2bf299dc-4421-47f6-ba53-3cf9f59b6e99 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 200 len: 1431 microversion: 2.1 time: 0.063242 Sep 19 14:45:26.007671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:26.009346 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 830/1668] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:25 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 1431 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:26.016563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.016938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:26.017174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.017834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.018764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.019501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.019946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.032506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:26.043448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.044352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.044863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.045822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.046264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.046790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.051421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "refresh_cache-f3934e7f-da3c-4411-98ed-0e7bee2460c7" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:26.052097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquired lock "refresh_cache-f3934e7f-da3c-4411-98ed-0e7bee2460c7" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:26.438577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:26.448880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68b106ae-a681-44a9-9c47-f36246950739 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1323 microversion: 2.1 time: 0.437780 Sep 19 14:45:26.449802 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 831/1669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:26 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:26.458556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a83b00fc-7f5d-4ea8-9bab-a0a8b9891781 req-26658a8c-6863-4b9b-a696-2920dba18678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319128d5-7c79-4e00-9a01-58b049a919f1", "tag": "c6753a4a-5e9d-4507-8a4a-453084cae3f7"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:26.470083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a83b00fc-7f5d-4ea8-9bab-a0a8b9891781 req-26658a8c-6863-4b9b-a696-2920dba18678 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.471158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a83b00fc-7f5d-4ea8-9bab-a0a8b9891781 req-26658a8c-6863-4b9b-a696-2920dba18678 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.471325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a83b00fc-7f5d-4ea8-9bab-a0a8b9891781 req-26658a8c-6863-4b9b-a696-2920dba18678 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.484595 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a83b00fc-7f5d-4ea8-9bab-a0a8b9891781 req-26658a8c-6863-4b9b-a696-2920dba18678 service nova] Creating event network-changed:c6753a4a-5e9d-4507-8a4a-453084cae3f7 for instance 319128d5-7c79-4e00-9a01-58b049a919f1 on n-h2-858384-1 Sep 19 14:45:26.490911 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a83b00fc-7f5d-4ea8-9bab-a0a8b9891781 req-26658a8c-6863-4b9b-a696-2920dba18678 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Sep 19 14:45:26.492826 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 832/1670] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:26.499522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:26.500661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:26.509222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.509503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.509948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.510662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.511494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.512306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.848673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:26.868163 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b211ed03-1dfd-46e2-9b5f-25e81a2076e5 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1467 microversion: 2.1 time: 0.373670 Sep 19 14:45:26.869782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 833/1671] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:26 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:26.875759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:26.876705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:26.884311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.885078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.885864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:26.887636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:26.888262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:26.888872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:27.174670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:27.372000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:27.382347 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c4061882-8934-4eed-b225-ef3116198338 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1318 microversion: 2.1 time: 0.511215 Sep 19 14:45:27.385495 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 834/1672] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:26 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:27.393480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad3abf93-bd47-4079-b7c9-87b73c2482ca tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a24160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:27.473968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad3abf93-bd47-4079-b7c9-87b73c2482ca tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/65e17483-129b-4a3b-97d8-49cd96ae0799" status: 200 len: 784 microversion: 2.1 time: 0.087048 Sep 19 14:45:27.487387 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 835/1673] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:27 2022] GET /compute/v2.1/images/65e17483-129b-4a3b-97d8-49cd96ae0799 => generated 784 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:27.507009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:27.516657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:27.550953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:27.551876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:27.552495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:27.553550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:27.555225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:27.556210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:27.619446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:27.620182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:27.620800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:27.621439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lazy-loading 'fault' on Instance uuid c4b6370c-34cf-43ab-b117-37fa92d259b4 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:28.488922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae47961de16a4a71a315100608f7efc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af088fe0e6047ccaa484e35f24a69d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:28.497955 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b4ac2c20-7eb5-4771-bbcb-92d156d94805 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 200 len: 1321 microversion: 2.1 time: 1.007653 Sep 19 14:45:28.499631 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 836/1674] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:27 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 1321 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:28.504707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:28.505408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:28.514661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:28.516340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:28.517063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:28.518145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:28.518872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:28.519572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:29.004407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:29.019755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:29.024717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:29.027873 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7efe5501-896a-47cd-a037-eecb78013d6b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.526950 Sep 19 14:45:29.028496 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 837/1675] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:28 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:29.043327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:29.044377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:29.054126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:29.056008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:29.056746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:29.057186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:29.058141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:29.059005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:29.061094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:29.101337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:29.518200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:29.561266 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3f1bce12-d69e-4e23-9ee1-fc37e945ed94 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1518 microversion: 2.1 time: 0.526835 Sep 19 14:45:29.566200 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 838/1676] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:29 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1518 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:29.593151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e34f1ecc-cd97-4a87-a921-f43776974c05 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:29.657999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e34f1ecc-cd97-4a87-a921-f43776974c05 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.081767 Sep 19 14:45:29.672475 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 839/1677] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:45:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:29.723162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:29.729324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:29.757995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:29.760867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:29.762052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:29.766684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:29.770164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:29.773477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:30.362811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:30.390579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-75d6e9f1-356b-40dc-805e-6f86615bce1f tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1318 microversion: 2.1 time: 0.713441 Sep 19 14:45:30.403629 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 840/1678] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:29 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:30.415093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1059f47a-de09-4fc4-8bf3-6a61905dfdf5 req-9b922333-4286-4f39-9022-e123605e80c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b6370c-34cf-43ab-b117-37fa92d259b4", "name": "network-vif-deleted", "tag": "9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:30.440984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1059f47a-de09-4fc4-8bf3-6a61905dfdf5 req-9b922333-4286-4f39-9022-e123605e80c6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:30.442330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1059f47a-de09-4fc4-8bf3-6a61905dfdf5 req-9b922333-4286-4f39-9022-e123605e80c6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:30.443693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1059f47a-de09-4fc4-8bf3-6a61905dfdf5 req-9b922333-4286-4f39-9022-e123605e80c6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:30.460633 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1059f47a-de09-4fc4-8bf3-6a61905dfdf5 req-9b922333-4286-4f39-9022-e123605e80c6 service nova] Creating event network-vif-deleted:9aa5d7ff-8999-4a6a-bcd1-97dd2b54aa6f for instance c4b6370c-34cf-43ab-b117-37fa92d259b4 on n-h1-858384-1 Sep 19 14:45:30.468470 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1059f47a-de09-4fc4-8bf3-6a61905dfdf5 req-9b922333-4286-4f39-9022-e123605e80c6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070472 Sep 19 14:45:30.469736 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 841/1679] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:30.476814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:30.477851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] [instance: c4b6370c-34cf-43ab-b117-37fa92d259b4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:30.486889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:30.488280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:30.489253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:30.490199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:30.490896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:30.492049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:30.509117 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] HTTP exception thrown: Instance c4b6370c-34cf-43ab-b117-37fa92d259b4 could not be found. Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Request method failure captured: Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 HTTP/1.1 Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIA-bedYiOoIeMviy8esJEqikmHwsBsKvSwzQtVOefg1HlzEpwK9SydAb9MdWuJNqffIbUx_81TOOjvC-v5yvqxQTYgp8zG1eJX68Vhu5FARKGpl8iJpwweFOrOLq9E-xJcSUt2doK-tk-NCsJPBjLra2-PdFVziOsGN7qz4ef12tFU Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:45:30.514148 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6af088fe0e6047ccaa484e35f24a69d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6af088fe0e6047ccaa484e35f24a69d6"}]}] Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6af088fe0e6047ccaa484e35f24a69d6 Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ae47961de16a4a71a315100608f7efc3 Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:45:30.516286 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance c4b6370c-34cf-43ab-b117-37fa92d259b4 could not be found. Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c4b6370c-34cf-43ab-b117-37fa92d259b4'} Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b6370c-34cf-43ab-b117-37fa92d259b4 could not be found. Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:30.517307 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b6370c-34cf-43ab-b117-37fa92d259b4 could not be found. Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b6370c-34cf-43ab-b117-37fa92d259b4 could not be found. Sep 19 14:45:30.519661 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:30.523934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] Returning 404 to user: Instance c4b6370c-34cf-43ab-b117-37fa92d259b4 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:30.525151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-196afd51-c2c5-4e0d-81b5-0a4d80eea28f tempest-FloatingIPsAssociationNegativeTestJSON-2088223180 tempest-FloatingIPsAssociationNegativeTestJSON-2088223180-project] 10.222.0.81 "GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4" status: 404 len: 111 microversion: 2.1 time: 0.053934 Sep 19 14:45:30.526254 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 842/1680] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:30 2022] GET /compute/v2.1/servers/c4b6370c-34cf-43ab-b117-37fa92d259b4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:45:30.533551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:30.537028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:30.544948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:30.545722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:30.546528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:30.547511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:30.548170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:30.548791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:30.649551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lazy-loading 'flavor' on Instance uuid bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:30.926188 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.network.neutron [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] re-assign floating IP 172.25.9.213 from instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 Sep 19 14:45:30.929683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-226b3d0f-d942-4d39-865d-b8e957b72b3a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action" status: 200 len: 32 microversion: 2.1 time: 0.401206 Sep 19 14:45:30.930705 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 843/1681] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:30 2022] POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:45:30.945752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fde5ddc-3e63-4129-a0b3-3082d04ec951 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299cf550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:31.066594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Building network info cache for instance {{(pid=128730) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:45:32.493672 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8fde5ddc-3e63-4129-a0b3-3082d04ec951 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "DELETE /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 204 len: 0 microversion: 2.1 time: 1.561305 Sep 19 14:45:32.494472 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 844/1682] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:30 2022] DELETE /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 0 bytes in 1563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:32.499723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:32.502966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:32.538970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:32.539498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:32.540175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:32.541154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:32.547223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:32.547715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:32.633509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b973b715-1392-43de-ae75-b3b0850458f7 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137667 Sep 19 14:45:32.638915 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 845/1683] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:32 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:32.648861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:32.654195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:32.671728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:32.672311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:32.672833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:32.673626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:32.674169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:32.674690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:33.155480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:33.171193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:33.176835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:33.180546 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-55cbebe3-b4c3-4b90-b071-55ea861d1d0c tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.538383 Sep 19 14:45:33.187401 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 846/1684] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:32 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:33.193048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b4adc578-4466-4fb6-ac72-a9371eef5369 req-bb3eed7e-955d-4933-887b-4e0c042b1da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319128d5-7c79-4e00-9a01-58b049a919f1", "name": "network-vif-plugged", "status": "completed", "tag": "c6753a4a-5e9d-4507-8a4a-453084cae3f7"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:33.219583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b4adc578-4466-4fb6-ac72-a9371eef5369 req-bb3eed7e-955d-4933-887b-4e0c042b1da8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:33.220357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b4adc578-4466-4fb6-ac72-a9371eef5369 req-bb3eed7e-955d-4933-887b-4e0c042b1da8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:33.221128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b4adc578-4466-4fb6-ac72-a9371eef5369 req-bb3eed7e-955d-4933-887b-4e0c042b1da8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:33.250904 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b4adc578-4466-4fb6-ac72-a9371eef5369 req-bb3eed7e-955d-4933-887b-4e0c042b1da8 service nova] Creating event network-vif-plugged:c6753a4a-5e9d-4507-8a4a-453084cae3f7 for instance 319128d5-7c79-4e00-9a01-58b049a919f1 on n-h2-858384-1 Sep 19 14:45:33.260544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Updating instance_info_cache with network_info: [{"id": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a", "address": "fa:16:3e:b0:03:46", "network": {"id": "f05b3455-618c-4083-add0-0e4bab7610d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2016119408-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b1afbbefb33447b2871b1c40b2bc6cc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap36aaba0a-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128730) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:45:33.302393 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b4adc578-4466-4fb6-ac72-a9371eef5369 req-bb3eed7e-955d-4933-887b-4e0c042b1da8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094611 Sep 19 14:45:33.305035 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 847/1685] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:33.312625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7da584ca-d1b6-4e84-820d-8b579c566cb1 req-3e6c602d-a418-4503-8f7d-17de9e40c039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:33.313998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Building network info cache for instance {{(pid=128730) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:45:33.350888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7da584ca-d1b6-4e84-820d-8b579c566cb1 req-3e6c602d-a418-4503-8f7d-17de9e40c039 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:33.352255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7da584ca-d1b6-4e84-820d-8b579c566cb1 req-3e6c602d-a418-4503-8f7d-17de9e40c039 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:33.352931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7da584ca-d1b6-4e84-820d-8b579c566cb1 req-3e6c602d-a418-4503-8f7d-17de9e40c039 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:33.369881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7da584ca-d1b6-4e84-820d-8b579c566cb1 req-3e6c602d-a418-4503-8f7d-17de9e40c039 service nova] Creating event network-changed:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:45:33.377581 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7da584ca-d1b6-4e84-820d-8b579c566cb1 req-3e6c602d-a418-4503-8f7d-17de9e40c039 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069529 Sep 19 14:45:33.378821 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 848/1686] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:33.398425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:33.399675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:33.424009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:33.424977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:33.428113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:33.436040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:33.437207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:33.437903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:34.430133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:34.459294 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d544bc28-2f42-4253-939a-6394d34d87fe tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 1.078351 Sep 19 14:45:34.467645 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 849/1687] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:33 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:34.485420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:34.486610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:34.504057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:34.504878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:34.518963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:34.520665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:34.525329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:34.532323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:35.295155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:35.330413 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f15b581-7c39-4b0f-9abb-48ca6da5c69d tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1318 microversion: 2.1 time: 0.861089 Sep 19 14:45:35.331214 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 850/1688] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:34 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:35.353373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7687e51-d3d0-4f04-9bc6-fad7a17be8e3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde2997ba60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:35.397444 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e7687e51-d3d0-4f04-9bc6-fad7a17be8e3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] HTTP exception thrown: Image not found. Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7687e51-d3d0-4f04-9bc6-fad7a17be8e3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Request method failure captured: Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d HTTP/1.1 Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIBB37m5yB0dDmCl44J2G26UKADGcMIu3fq7ZZ3ZRWMzj2uUHI88RXrvx7gcZmJmfglz8jJKaMAcuqYNaaEik8QqH_VS40aQXwDhB_6gEOHPVa3vlMJp59zBO52VvLLE09Udf9GDpOjh-pzdXgnDMM8xrXV7yUvJ0cgJJvqpS2woq_k Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 77c95dfb9f2743c9a07677bb17deabb0 Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:45:35.460720 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/77c95dfb9f2743c9a07677bb17deabb0"}]}] Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 77c95dfb9f2743c9a07677bb17deabb0 Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesOneServerTestJSON-1199590929-project Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c4260762e3f74323bac74a519aeff94f Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesOneServerTestJSON-1199590929-project Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '3197baf5-f6cb-451f-9fbb-966cd615564d'} Sep 19 14:45:35.464963 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:45:35.467840 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3197baf5-f6cb-451f-9fbb-966cd615564d Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:45:35.470916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3197baf5-f6cb-451f-9fbb-966cd615564d could not be found. Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:45:35.479161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7687e51-d3d0-4f04-9bc6-fad7a17be8e3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:35.482456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e7687e51-d3d0-4f04-9bc6-fad7a17be8e3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 404 len: 62 microversion: 2.1 time: 0.131504 Sep 19 14:45:35.494947 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 851/1689] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:35 2022] GET /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 62 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:45:35.501115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:35.501900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:35.511279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:35.512149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:35.512724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:35.513881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:35.514479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:35.515196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:35.739123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lazy-loading 'services' on Instance uuid 4ae3f971-6de7-44e5-a5c3-65900357963c {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:45:35.938543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4a27e6d8-e626-4b9c-b99a-6f134c37c86b tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments/47cfd6a6-6c11-4ea3-b915-399ea7a000a6" status: 202 len: 0 microversion: 2.1 time: 0.459887 Sep 19 14:45:35.940148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 852/1690] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 14:45:35 2022] DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments/47cfd6a6-6c11-4ea3-b915-399ea7a000a6 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:45:35.948820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:35.949584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:35.958037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:35.958599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:35.959792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:35.971508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:35.972699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:35.973558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:36.007930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:36.478039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:36.503702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:36.516881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:36.520604 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3f4553a9-a49a-4da8-81fa-145481980350 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.578679 Sep 19 14:45:36.521784 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 853/1691] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:35 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:36.548003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e9bd211f-cf46-494f-9733-ce15957bcf9b req-f625793f-8d2c-43ec-a626-58029b1ef6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:36.563558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Updating instance_info_cache with network_info: [{"id": "013e9e03-d582-4be5-9797-9ff12cdb9ae2", "address": "fa:16:3e:a7:16:a5", "network": {"id": "f05b3455-618c-4083-add0-0e4bab7610d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2016119408-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b1afbbefb33447b2871b1c40b2bc6cc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap013e9e03-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128730) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:45:36.585019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Releasing lock "refresh_cache-f3934e7f-da3c-4411-98ed-0e7bee2460c7" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:36.586422 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3406056a-4877-4225-819e-87e67c652246 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7/action" status: 202 len: 0 microversion: 2.1 time: 10.596215 Sep 19 14:45:36.592977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9bd211f-cf46-494f-9733-ce15957bcf9b req-f625793f-8d2c-43ec-a626-58029b1ef6c7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:36.593758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9bd211f-cf46-494f-9733-ce15957bcf9b req-f625793f-8d2c-43ec-a626-58029b1ef6c7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:36.595426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 839/1692] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:25 2022] POST /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7/action => generated 0 bytes in 10606 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:45:36.598839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9bd211f-cf46-494f-9733-ce15957bcf9b req-f625793f-8d2c-43ec-a626-58029b1ef6c7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:36.612076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c4c6cf59-af50-4b25-8555-e9391b003d89 req-20a8e555-1e96-4ff8-928d-60f53afd274b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3934e7f-da3c-4411-98ed-0e7bee2460c7", "tag": "013e9e03-d582-4be5-9797-9ff12cdb9ae2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:36.639866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4c6cf59-af50-4b25-8555-e9391b003d89 req-20a8e555-1e96-4ff8-928d-60f53afd274b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:36.640183 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e9bd211f-cf46-494f-9733-ce15957bcf9b req-f625793f-8d2c-43ec-a626-58029b1ef6c7 service nova] Creating event network-vif-unplugged:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:45:36.640991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4c6cf59-af50-4b25-8555-e9391b003d89 req-20a8e555-1e96-4ff8-928d-60f53afd274b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:36.641656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4c6cf59-af50-4b25-8555-e9391b003d89 req-20a8e555-1e96-4ff8-928d-60f53afd274b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:36.653908 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e9bd211f-cf46-494f-9733-ce15957bcf9b req-f625793f-8d2c-43ec-a626-58029b1ef6c7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129895 Sep 19 14:45:36.661018 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 854/1693] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:36.661917 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c4c6cf59-af50-4b25-8555-e9391b003d89 req-20a8e555-1e96-4ff8-928d-60f53afd274b service nova] Creating event network-changed:013e9e03-d582-4be5-9797-9ff12cdb9ae2 for instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 on n-h1-858384-1 Sep 19 14:45:36.674157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-161751600"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:36.680573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:36.681118 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c4c6cf59-af50-4b25-8555-e9391b003d89 req-20a8e555-1e96-4ff8-928d-60f53afd274b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078505 Sep 19 14:45:36.694602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:36.695882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:36.696931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:36.699337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:36.699550 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 840/1694] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:36.700576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:36.701476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:36.709849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:36.713420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:36.727624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:36.728089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:36.728997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:36.729302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:36.730953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:36.732383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:37.311830 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64ece5d4-62da-40eb-81a8-31b2823c3dbc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "POST /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe/action" status: 202 len: 0 microversion: 2.1 time: 0.640935 Sep 19 14:45:37.339479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 855/1695] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:36 2022] POST /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:45:37.358479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:37.385370 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b206dfa1-af40-4b6a-9b5b-c0e08b60c906 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 0.683073 Sep 19 14:45:37.390683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:37.392250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:37.408035 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 841/1696] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:36 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:37.421670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:37.421670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:37.421670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:37.423902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:37.424736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:37.425293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:37.434774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'action', calling method: .version_select at 0x7fde2c621820>, body: {"removeFloatingIp": {"address": "172.25.9.213"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:37.866101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:37.889670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:37.893903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:37.895722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:37.901988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:37.904031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:37.905625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:38.007817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.034493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:38.082396 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6fcf5398-a123-4269-b3ec-ab232e240d75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1508 microversion: 2.1 time: 0.732183 Sep 19 14:45:38.083823 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 856/1697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:37 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:38.103058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-203a1b77-bd09-4c31-b595-2d5fd3d91ded tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299eeb80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:38.200190 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-203a1b77-bd09-4c31-b595-2d5fd3d91ded tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.113447 Sep 19 14:45:38.200855 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 857/1698] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:38 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:38.224812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:38.225875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:38.234950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:38.235825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:38.236601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:38.237633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:38.238373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:38.239232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:38.357338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:39.007668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] HTTP exception thrown: Floating IP 172.25.9.213 is not associated with instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3. Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Request method failure captured: Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action HTTP/1.1 Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 49 Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBHXyXR6XpDSQarWy0ffyYPx_EhvgNY0w1vLNSwrE-IwClSjK_QosY8izMVrqon-rQJACoYgZ61X9EAyV9QGsv8scTh1nwRWG7E0-vmn61dT8ugXTl84CkCStG5UlHEPcrEQn0-NEugPoPUkIrwq9R066SjeOi7e76i2KUvseeEBsI Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:45:39.013122 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b1afbbefb33447b2871b1c40b2bc6cc5"}]}] Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ee0cfca622a34b55828b768b57f8697a Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: {"removeFloatingIp": {"address": "172.25.9.213"}} Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:45:39.019815 n-d-858384-1 devstack@n-api.service[128730]: exception: Floating IP 172.25.9.213 is not associated with instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3. Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3', 'body': {'removeFloatingIp': {'address': '172.25.9.213'}}} Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.213 is not associated with instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3. Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:39.023175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:39.026448 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:39.026448 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:39.026448 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:39.026448 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:39.026448 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.213 is not associated with instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3. Sep 19 14:45:39.026448 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:39.043586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Returning 409 to user: Floating IP 172.25.9.213 is not associated with instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:39.059626 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3c8e7da-5903-4808-8659-facbb92eccc7 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action" status: 409 len: 146 microversion: 2.1 time: 1.635117 Sep 19 14:45:39.061410 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 842/1699] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:37 2022] POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action => generated 146 bytes in 1652 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:45:39.070337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:39.075491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:39.087678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:39.105232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:39.106813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:39.109346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:39.111190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:39.113821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:39.117600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:39.118648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:39.120727 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2b2a050-d5d1-4e09-a4d5-d87be1b9d14f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.902138 Sep 19 14:45:39.122018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:39.139055 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 858/1700] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:38 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:39.148064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.213"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:39.679606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:39.714230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:39.716583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:39.721655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:39.727550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:39.739590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:39.742501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:39.798368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:39.833956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4687a07-63fc-483c-9865-a1639041e261 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 0.768619 Sep 19 14:45:39.837982 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 843/1701] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:39 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:39.875065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c9f68ac-3a2c-4d51-8098-4899652a6db3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299c9f70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:40.046512 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c9f68ac-3a2c-4d51-8098-4899652a6db3 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.204664 Sep 19 14:45:40.067270 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 844/1702] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:39 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:40.184206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:40.185462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:40.225273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:40.228653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:40.229583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:40.231165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:40.246765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:40.248062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:40.877786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:40.936023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:40.956887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:40.959990 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d407f092-68a2-492c-9aed-549e06f2df1b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.790448 Sep 19 14:45:40.961257 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 845/1703] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:40 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:40.967842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "refresh_cache-f3934e7f-da3c-4411-98ed-0e7bee2460c7" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:40.968824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquired lock "refresh_cache-f3934e7f-da3c-4411-98ed-0e7bee2460c7" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:41.015756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:41.016916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:41.041995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:41.048074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:41.050540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:41.052284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:41.053514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:41.055068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:41.530637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:41.574866 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-de2e1192-2c8e-4e0a-abc1-b8515e516e37 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 0.600787 Sep 19 14:45:41.591465 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 846/1704] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:40 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:41.626625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94bb2e59-0f42-4ab4-88b1-6b5129e29bc6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a5faf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:41.700178 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94bb2e59-0f42-4ab4-88b1-6b5129e29bc6 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.106357 Sep 19 14:45:41.701759 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 847/1705] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:41 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:42.007386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:42.008462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:42.047350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:42.050099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:42.055176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:42.057148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:42.061279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:42.062413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:42.933686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:42.953003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:42.958902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:42.964409 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae771f4a-482e-41f6-920b-a119aa6f4bcf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.964664 Sep 19 14:45:42.972748 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 848/1706] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:41 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:45:42.983714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3eeb0d91-ea19-4653-a525-439a461c769e"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:42.986511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:42.998143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:42.999038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:42.999933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:43.001805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:43.002837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:43.003637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:43.086006 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] HTTP exception thrown: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Request method failure captured: Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1/os-volume_attachments/e30aa2c0-89a7-45ad-bac4-717be9b00d77 HTTP/1.1 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 74 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIATQI6jr-13aFw6msaprdTMpur4ZBg1yDq8U2nyShJs0oo1qk8_21nK2SXvnneil8XlNYPXVMDLWNqRuezkspZHC3GWYsvrVGz_2gK87TNNGWjoNqTw2ojckLziQc_xMEpCqU2lmLnUl9pB8PR-5pK9CiPHd7Y_Sh6Xddzgdzo63Q4 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a705c94f9f284434a631a4a4df236929 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesAdminNegativeTest-1378966426 Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 14:45:43.089976 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a705c94f9f284434a631a4a4df236929"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a705c94f9f284434a631a4a4df236929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a705c94f9f284434a631a4a4df236929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a705c94f9f284434a631a4a4df236929"}]}] Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesAdminNegativeTest-1378966426 Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a705c94f9f284434a631a4a4df236929 Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1378966426 Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesAdminNegativeTest-1378966426-project-admin Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 003d48cddcc0422188b5f5c1bd3e7ab5 Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesAdminNegativeTest-1378966426-project-admin Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: {"volumeAttachment": {"volumeId": "3eeb0d91-ea19-4653-a525-439a461c769e"}} Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:45:43.091891 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '319128d5-7c79-4e00-9a01-58b049a919f1', 'id': 'e30aa2c0-89a7-45ad-bac4-717be9b00d77', 'body': {'volumeAttachment': {'volumeId': '3eeb0d91-ea19-4653-a525-439a461c769e'}}} Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:45:43.093402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. (HTTP 404) (Request-ID: req-59496233-a4c6-41b4-9c1a-2a87fdef31f7) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:45:43.094772 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:43.096149 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. Sep 19 14:45:43.097471 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:43.103074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] Returning 404 to user: Volume e30aa2c0-89a7-45ad-bac4-717be9b00d77 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:43.103074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43e2d3d2-3163-478d-a6a9-9b927508e197 tempest-VolumesAdminNegativeTest-1378966426 tempest-VolumesAdminNegativeTest-1378966426-project-admin] 10.222.0.81 "PUT /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1/os-volume_attachments/e30aa2c0-89a7-45ad-bac4-717be9b00d77" status: 404 len: 109 microversion: 2.1 time: 0.128700 Sep 19 14:45:43.109166 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 849/1707] 10.222.0.81 () {60 vars in 1433 bytes} [Mon Sep 19 14:45:42 2022] PUT /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1/os-volume_attachments/e30aa2c0-89a7-45ad-bac4-717be9b00d77 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:45:43.121320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:43.136935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:43.173144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:43.174430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:43.175358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:43.178852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:43.181784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:43.183581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:44.028111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:45:44.432540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:44.446420 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a55a009f-8084-4303-a7e8-965749f4cc51 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 1.338006 Sep 19 14:45:44.455221 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 850/1708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:43 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:44.468466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21748629-0364-4a80-bcfd-f0b78b4cf35f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299c0550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:44.574614 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21748629-0364-4a80-bcfd-f0b78b4cf35f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.117933 Sep 19 14:45:44.593526 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 851/1709] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:44 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:44.607626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0e85ee06-10e5-4d32-bd1d-837143f07f76 req-e8aa7a16-731c-4951-99ba-53fb8533a026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "name": "network-vif-plugged", "status": "completed", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:44.644384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0e85ee06-10e5-4d32-bd1d-837143f07f76 req-e8aa7a16-731c-4951-99ba-53fb8533a026 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:44.644872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0e85ee06-10e5-4d32-bd1d-837143f07f76 req-e8aa7a16-731c-4951-99ba-53fb8533a026 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:44.645301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0e85ee06-10e5-4d32-bd1d-837143f07f76 req-e8aa7a16-731c-4951-99ba-53fb8533a026 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:44.695286 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0e85ee06-10e5-4d32-bd1d-837143f07f76 req-e8aa7a16-731c-4951-99ba-53fb8533a026 service nova] Creating event network-vif-plugged:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:45:44.712814 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0e85ee06-10e5-4d32-bd1d-837143f07f76 req-e8aa7a16-731c-4951-99ba-53fb8533a026 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117690 Sep 19 14:45:44.723721 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 852/1710] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:44.745283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:44.751993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:44.769295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:44.775744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:44.783591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:44.792583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:44.800118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:44.801237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:45.685284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:45.704384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:45.705881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:45.707112 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dbfd6ff1-745d-400c-aaa2-8160b10af9e2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.977190 Sep 19 14:45:45.720272 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 853/1711] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:44 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:45.724618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-674764a8-d565-467d-a346-d8eefebe0e48 req-227d24f4-bb75-47da-b46f-42d7f9fc0d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3934e7f-da3c-4411-98ed-0e7bee2460c7", "tag": "013e9e03-d582-4be5-9797-9ff12cdb9ae2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:45.753420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-674764a8-d565-467d-a346-d8eefebe0e48 req-227d24f4-bb75-47da-b46f-42d7f9fc0d46 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:45.753908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-674764a8-d565-467d-a346-d8eefebe0e48 req-227d24f4-bb75-47da-b46f-42d7f9fc0d46 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:45.759441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-674764a8-d565-467d-a346-d8eefebe0e48 req-227d24f4-bb75-47da-b46f-42d7f9fc0d46 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:45.797927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-674764a8-d565-467d-a346-d8eefebe0e48 req-227d24f4-bb75-47da-b46f-42d7f9fc0d46 service nova] Creating event network-changed:013e9e03-d582-4be5-9797-9ff12cdb9ae2 for instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 on n-h1-858384-1 Sep 19 14:45:45.812555 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-674764a8-d565-467d-a346-d8eefebe0e48 req-227d24f4-bb75-47da-b46f-42d7f9fc0d46 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091620 Sep 19 14:45:45.818075 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 854/1712] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:45.829783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b0c1135b-598e-46d7-bb08-48f51f3bafc8 req-3b919d5b-6c6f-4144-8113-e5dc3b50ea25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cea384e-ffd7-4ffb-a325-149d8c5fbf62", "name": "network-vif-unplugged", "status": "completed", "tag": "baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:45.858397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b0c1135b-598e-46d7-bb08-48f51f3bafc8 req-3b919d5b-6c6f-4144-8113-e5dc3b50ea25 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:45.859205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b0c1135b-598e-46d7-bb08-48f51f3bafc8 req-3b919d5b-6c6f-4144-8113-e5dc3b50ea25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:45.859803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b0c1135b-598e-46d7-bb08-48f51f3bafc8 req-3b919d5b-6c6f-4144-8113-e5dc3b50ea25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:45.888591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b0c1135b-598e-46d7-bb08-48f51f3bafc8 req-3b919d5b-6c6f-4144-8113-e5dc3b50ea25 service nova] Creating event network-vif-unplugged:baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd for instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 on n-h2-858384-1 Sep 19 14:45:45.895171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b0c1135b-598e-46d7-bb08-48f51f3bafc8 req-3b919d5b-6c6f-4144-8113-e5dc3b50ea25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075050 Sep 19 14:45:45.896503 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 855/1713] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:45.919975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:45.921073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:45.933954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:45.938158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:45.938973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:45.939914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:45.945525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:45.947987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:46.295747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:46.313724 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7573cb2a-2940-4c4b-9e93-c1f132bb0ae4 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 0.415723 Sep 19 14:45:46.316581 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 856/1714] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:45 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:46.332818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe117ece-ba9c-4f95-97c6-82ce74459b62 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a0ff70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:46.506049 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe117ece-ba9c-4f95-97c6-82ce74459b62 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.184317 Sep 19 14:45:46.512824 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 857/1715] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:46 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:46.749672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:46.750644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:46.769705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Updating instance_info_cache with network_info: [{"id": "013e9e03-d582-4be5-9797-9ff12cdb9ae2", "address": "fa:16:3e:a7:16:a5", "network": {"id": "f05b3455-618c-4083-add0-0e4bab7610d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2016119408-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b1afbbefb33447b2871b1c40b2bc6cc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap013e9e03-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:45:46.808151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Releasing lock "refresh_cache-f3934e7f-da3c-4411-98ed-0e7bee2460c7" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:46.810098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-019d5b94-6613-4407-8629-c5ef92aa6e63 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7/action" status: 202 len: 0 microversion: 2.1 time: 7.668988 Sep 19 14:45:46.811393 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 859/1716] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:39 2022] POST /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7/action => generated 0 bytes in 7671 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:45:46.832286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:46.835211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:46.837637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:46.841608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:46.843816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:46.846221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:46.847856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:46.851401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:46.855659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:46.857422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:46.860331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:46.862023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:46.863800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:46.865800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:46.995168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:45:47.251619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c994447-17c6-4723-bd45-42b79e245637 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 204 len: 0 microversion: 2.1 time: 0.433958 Sep 19 14:45:47.254464 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 860/1717] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:45:46 2022] DELETE /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:47.454090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:47.467554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:47.469425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:47.471036 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad87bb8a-e3e1-4fe2-ba10-4b9671ded3da tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.727746 Sep 19 14:45:47.489682 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 858/1718] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:46 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:47.515959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.213"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:47.520112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:47.531030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:47.532286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:47.533170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:47.534405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:47.535207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:47.535853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:47.600987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:45:47.602617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquired lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:45:47.896543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-742862557", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:48.032157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:45:50.124540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:45:50.125238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:45:50.125427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:45:50.126045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:45:50.126630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:45:50.146810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:50.147938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:50.149667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:50.151803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:50.152705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:50.156278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:50.183697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:45:50.191226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for user e2149c78b4d04c10b02d521a5635b29f and project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:45:50.207258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:45:50.211031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:45:50.274401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3313d0cc-2e60-4215-b41a-d4a6b535cae0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.017332 Sep 19 14:45:50.275883 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 861/1719] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:45:50.281077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:50.281946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:50.290444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:50.292212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:50.293341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:50.294844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:50.295667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:50.296821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:51.037787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:51.063610 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c327eaf-ce4c-470f-8870-b5512cebfcda tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 0.781588 Sep 19 14:45:51.067233 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 862/1720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:50 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:51.083026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b94c77c-6789-494f-acaf-39d7107a6d23 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a725e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:51.276530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b94c77c-6789-494f-acaf-39d7107a6d23 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.207759 Sep 19 14:45:51.283153 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 863/1721] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:51 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:51.304719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6f398be6-9921-4db3-8a53-e756351b31cd req-7d68d87a-40a7-4bef-bd81-fe85e57d48fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cea384e-ffd7-4ffb-a325-149d8c5fbf62", "tag": "baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:51.352491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6f398be6-9921-4db3-8a53-e756351b31cd req-7d68d87a-40a7-4bef-bd81-fe85e57d48fa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:51.367622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6f398be6-9921-4db3-8a53-e756351b31cd req-7d68d87a-40a7-4bef-bd81-fe85e57d48fa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:51.383724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6f398be6-9921-4db3-8a53-e756351b31cd req-7d68d87a-40a7-4bef-bd81-fe85e57d48fa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:51.442946 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6f398be6-9921-4db3-8a53-e756351b31cd req-7d68d87a-40a7-4bef-bd81-fe85e57d48fa service nova] Creating event network-changed:baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd for instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 on n-h2-858384-1 Sep 19 14:45:51.477257 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6f398be6-9921-4db3-8a53-e756351b31cd req-7d68d87a-40a7-4bef-bd81-fe85e57d48fa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192698 Sep 19 14:45:51.490279 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 864/1722] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:51.505034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:51.532235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:51.575117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:51.575932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:51.576850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:51.585239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:51.586224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:51.587029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:52.574050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Building network info cache for instance {{(pid=128730) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:45:52.856746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:52.880857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:52.882490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:52.883755 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-caa7a8fa-dd16-4efe-ad8c-ab7ecadb8874 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 1.391684 Sep 19 14:45:52.909845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 865/1723] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:51 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:52.937270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:52.956660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:52.979594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:52.980280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:52.980777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:52.981753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:52.983572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:52.991183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:53.252234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:53.273534 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97ffe192-09a8-4f2f-9e2c-7c94f0a43e1a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1264 microversion: 2.1 time: 0.362456 Sep 19 14:45:53.274845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 866/1724] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:52 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1264 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:53.280033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:53.288150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:53.304707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:53.305665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:53.307513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:53.310410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:53.313773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:53.314603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:53.422548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:45:53.639144 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f5454b2-b148-4c1c-b162-fbbe2b1285d7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "DELETE /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 204 len: 0 microversion: 2.1 time: 0.362516 Sep 19 14:45:53.644443 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 867/1725] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:45:53 2022] DELETE /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:53.662681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:53.671100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:53.692277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:53.692652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:53.695309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:53.696646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:53.698464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:53.700445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:53.828543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23422abe-5ef2-401b-bde9-61af636a9b8e tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.177072 Sep 19 14:45:53.835680 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 868/1726] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:53 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments => generated 25 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:45:53.853207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:53.857639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:53.877057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:53.881179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:53.882381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:53.883854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:53.892097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:53.894838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:54.883950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:54.947786 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-25cf1e88-88ca-4e97-9a06-30e541904028 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 1.111393 Sep 19 14:45:54.948399 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 869/1727] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:53 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:54.961091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f7bf529-507c-46d5-9308-6e0f36b37b54 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299ca550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:55.080214 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f7bf529-507c-46d5-9308-6e0f36b37b54 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.130696 Sep 19 14:45:55.080824 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 870/1728] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:54 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:55.094248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cd782174-bd56-4fb2-8d9d-59243e6b9392 req-92064b2d-b713-42b9-b35a-c2355b53e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:55.107266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:55.110261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd782174-bd56-4fb2-8d9d-59243e6b9392 req-92064b2d-b713-42b9-b35a-c2355b53e0e4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:55.110738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd782174-bd56-4fb2-8d9d-59243e6b9392 req-92064b2d-b713-42b9-b35a-c2355b53e0e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:55.111821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd782174-bd56-4fb2-8d9d-59243e6b9392 req-92064b2d-b713-42b9-b35a-c2355b53e0e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:55.159968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cd782174-bd56-4fb2-8d9d-59243e6b9392 req-92064b2d-b713-42b9-b35a-c2355b53e0e4 service nova] Creating event network-changed:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:45:55.159968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cd782174-bd56-4fb2-8d9d-59243e6b9392 req-92064b2d-b713-42b9-b35a-c2355b53e0e4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039938 Sep 19 14:45:55.159968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 871/1729] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:55.159968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:55.159968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:55.161547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:55.161547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:55.161547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:55.161547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:55.166089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:55.166089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:55.792090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:55.809666 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6375cabc-56ee-494c-888b-0589158f4ed5 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 200 len: 1514 microversion: 2.1 time: 0.674061 Sep 19 14:45:55.823866 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 872/1730] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:55 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 1514 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:55.832626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6f7a968a-7af3-49a8-a181-fde589c25be5 req-d10bdad0-6b22-44b1-aa3c-7749b95391a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3934e7f-da3c-4411-98ed-0e7bee2460c7", "name": "network-vif-deleted", "tag": "013e9e03-d582-4be5-9797-9ff12cdb9ae2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:55.874818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6f7a968a-7af3-49a8-a181-fde589c25be5 req-d10bdad0-6b22-44b1-aa3c-7749b95391a5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:55.875479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6f7a968a-7af3-49a8-a181-fde589c25be5 req-d10bdad0-6b22-44b1-aa3c-7749b95391a5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:55.876031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6f7a968a-7af3-49a8-a181-fde589c25be5 req-d10bdad0-6b22-44b1-aa3c-7749b95391a5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:55.912033 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6f7a968a-7af3-49a8-a181-fde589c25be5 req-d10bdad0-6b22-44b1-aa3c-7749b95391a5 service nova] Creating event network-vif-deleted:013e9e03-d582-4be5-9797-9ff12cdb9ae2 for instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 on n-h1-858384-1 Sep 19 14:45:55.930173 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6f7a968a-7af3-49a8-a181-fde589c25be5 req-d10bdad0-6b22-44b1-aa3c-7749b95391a5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115911 Sep 19 14:45:55.931456 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 873/1731] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:55.943367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:55.951800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:55.967050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:55.971035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:55.971646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:55.972544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:55.975931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:55.979948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:56.441000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Updating instance_info_cache with network_info: [{"id": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a", "address": "fa:16:3e:b0:03:46", "network": {"id": "f05b3455-618c-4083-add0-0e4bab7610d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2016119408-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b1afbbefb33447b2871b1c40b2bc6cc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap36aaba0a-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128730) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:45:56.483149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Releasing lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:45:56.487627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ee25a283-087c-4b57-8ca2-82e0805ed650 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action" status: 202 len: 0 microversion: 2.1 time: 8.985716 Sep 19 14:45:56.495344 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 859/1732] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:47 2022] POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action => generated 0 bytes in 9004 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:45:56.507756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:56.512889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:56.533058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:56.534465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:56.535183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:56.536597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:56.537756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:56.538449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:56.592191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d9234a64-29e0-4dce-8b22-4c9c1b924178 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093999 Sep 19 14:45:56.596136 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 860/1733] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:45:56 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:45:56.602107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:56.603331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:56.622697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:56.625117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:56.626327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:56.627565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:56.628247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:56.634845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:56.876026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:56.899138 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8510ed1-c071-46be-9359-7c1f15e28c79 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1270 microversion: 2.1 time: 0.301282 Sep 19 14:45:56.899871 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 861/1734] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:56 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:56.905451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:56.906468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:56.923680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:56.928682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:56.929304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:56.930180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:56.931399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:56.934682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:57.077025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:57.107486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:57.112184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:57.118984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff2c9aef-7108-4033-a83b-3c1ab7c02691 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 1.184517 Sep 19 14:45:57.142877 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 874/1735] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:55 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:57.163615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ce62a2c-fa73-4dc2-b07a-02da1b44ebc9 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299f4700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:57.295802 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ce62a2c-fa73-4dc2-b07a-02da1b44ebc9 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.143797 Sep 19 14:45:57.299936 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 875/1736] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:57 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:57.330340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-05bd2701-80b4-490d-af36-7bc429f0e40f tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '.version_select at 0x7fde299513a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:58.303426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:58.346263 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09767f9b-b6d8-48db-b130-e4bd449d06ad tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 1.444478 Sep 19 14:45:58.347776 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 862/1737] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:56 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:58.364165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:58.370296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:58.429526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:58.447895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:58.448539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:58.449447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:58.456700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:58.457318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:58.559520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:45:58.677488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:58.775491 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef467c13-db78-402f-8e58-ef58344f84d8 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 204 len: 0 microversion: 2.1 time: 0.424097 Sep 19 14:45:58.783953 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 863/1738] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:45:58 2022] DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:45:58.806168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:58.807562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 319128d5-7c79-4e00-9a01-58b049a919f1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:58.823795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:58.826484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:58.827659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:58.829609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:58.836641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:58.838005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:58.891765 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] HTTP exception thrown: Instance 319128d5-7c79-4e00-9a01-58b049a919f1 could not be found. Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Request method failure captured: Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 HTTP/1.1 Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH_qkeuhVV7XWoF_ecrY43vw13cIh2anGwI9-klNqwW3_DDeHYwwgdwqoeHiGuEuafvEdHZizaOaGrc5wLsF0aglcdu6WEkKBjniMLAcKOHFJEPw5Ak_3aRqAtbWggMzxDq0aY0lKLosLoGoSJBfabZS1CPmx1qHoQpNT3KcXdxUPJM Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: c204b981d98b46c29a36a09c38266982 Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesAdminNegativeTest-470174445 Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:45:58.893913 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c204b981d98b46c29a36a09c38266982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c204b981d98b46c29a36a09c38266982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c204b981d98b46c29a36a09c38266982"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c204b981d98b46c29a36a09c38266982"}]}] Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesAdminNegativeTest-470174445 Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: c204b981d98b46c29a36a09c38266982 Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-470174445 Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesAdminNegativeTest-470174445-project Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c157ab3e33fe4f648c425f54f7347b39 Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesAdminNegativeTest-470174445-project Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 319128d5-7c79-4e00-9a01-58b049a919f1 could not be found. Sep 19 14:45:58.896493 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '319128d5-7c79-4e00-9a01-58b049a919f1'} Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319128d5-7c79-4e00-9a01-58b049a919f1 could not be found. Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:45:58.897650 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319128d5-7c79-4e00-9a01-58b049a919f1 could not be found. Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319128d5-7c79-4e00-9a01-58b049a919f1 could not be found. Sep 19 14:45:58.899698 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:45:58.902806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Returning 404 to user: Instance 319128d5-7c79-4e00-9a01-58b049a919f1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:45:58.904042 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-60d62cd2-6a00-465c-8f47-bddbadfee43c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1" status: 404 len: 111 microversion: 2.1 time: 0.118284 Sep 19 14:45:58.907174 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 864/1739] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:58 2022] GET /compute/v2.1/servers/319128d5-7c79-4e00-9a01-58b049a919f1 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:45:58.932460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:58.933304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:58.950169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:58.950691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:58.951143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:58.959746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:58.960347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:58.960797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:58.964747 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-05bd2701-80b4-490d-af36-7bc429f0e40f tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/2f8f25a7-726c-4226-bb98-b466a168fc1a" status: 200 len: 184 microversion: 2.1 time: 1.663067 Sep 19 14:45:58.967737 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 876/1740] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:45:57 2022] GET /compute/v2.1/os-floating-ips/2f8f25a7-726c-4226-bb98-b466a168fc1a => generated 184 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:58.978302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d791c941-06d4-4391-b576-c922849fa9cd req-9c3054a4-80f3-4128-a626-a4c6c694b1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319128d5-7c79-4e00-9a01-58b049a919f1", "name": "network-vif-deleted", "tag": "c6753a4a-5e9d-4507-8a4a-453084cae3f7"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:59.009133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d791c941-06d4-4391-b576-c922849fa9cd req-9c3054a4-80f3-4128-a626-a4c6c694b1ea service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:59.010949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d791c941-06d4-4391-b576-c922849fa9cd req-9c3054a4-80f3-4128-a626-a4c6c694b1ea service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:59.012115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d791c941-06d4-4391-b576-c922849fa9cd req-9c3054a4-80f3-4128-a626-a4c6c694b1ea service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:59.063053 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d791c941-06d4-4391-b576-c922849fa9cd req-9c3054a4-80f3-4128-a626-a4c6c694b1ea service nova] Creating event network-vif-deleted:c6753a4a-5e9d-4507-8a4a-453084cae3f7 for instance 319128d5-7c79-4e00-9a01-58b049a919f1 on n-h2-858384-1 Sep 19 14:45:59.073294 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d791c941-06d4-4391-b576-c922849fa9cd req-9c3054a4-80f3-4128-a626-a4c6c694b1ea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103585 Sep 19 14:45:59.074641 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 877/1741] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:59.083360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:59.084623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:59.094450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:59.095060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:59.095535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:59.096555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:59.097241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:59.097904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:59.139736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:59.545583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:59.561950 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-414268cc-18b7-4270-8707-0f5434ce65d7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1312 microversion: 2.1 time: 0.653461 Sep 19 14:45:59.563348 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 865/1742] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:58 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1312 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:59.574817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61b10efe-7b32-41dc-9dfa-7e11a2f034dd tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299f5940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:59.687493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:59.689211 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61b10efe-7b32-41dc-9dfa-7e11a2f034dd tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.124480 Sep 19 14:45:59.690475 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 866/1743] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:45:59 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:59.707776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:59.712294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:59.712883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:45:59.714990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:45:59.719157 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb7707fd-5984-4c62-ac0b-ca9d37b37a30 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.640813 Sep 19 14:45:59.720912 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 878/1744] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:45:59 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:59.734842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.213"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:59.782136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:59.790261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:59.791545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:45:59.793136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:45:59.794252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:45:59.795333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:00.150091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:00.158714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:00.159575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:00.160239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:00.161712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:00.163675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:00.165200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:00.174899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:00.190982 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-808456f8-3ce9-4d97-aabc-333e4d3ad2d5 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1680 microversion: 2.1 time: 0.499087 Sep 19 14:46:00.191472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:00.199574 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 867/1745] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:45:59 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1680 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:00.217853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:00.218605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:00.242965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:00.261376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:00.271033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:00.273766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:00.281131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:00.281908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:00.284681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:02.030086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:02.049975 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0bdd14e5-082f-4b2f-a043-e64f8675256b tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 1.848629 Sep 19 14:46:02.050598 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 868/1746] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:00 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:02.069847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:02.070632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:02.079093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:02.079763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:02.080368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:02.081254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:02.081753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:02.082540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:02.334994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:46:02.336005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquired lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:46:03.996193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:04.009168 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e2fd0e53-6875-4da1-8497-dcc8d7043c31 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1312 microversion: 2.1 time: 1.952584 Sep 19 14:46:04.015706 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 869/1747] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:02 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1312 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:04.038441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a56419f-d287-462f-8534-1e68707dd6c4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29928c10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:04.169048 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a56419f-d287-462f-8534-1e68707dd6c4 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.151701 Sep 19 14:46:04.169656 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 870/1748] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:04 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:04.203404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:04.204615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:04.272874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:04.274479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:04.278245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:04.279591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:04.287340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:04.287857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:04.922390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:04.940955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:04.943112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:04.945122 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b0fae32-d830-4e14-8ce1-38759b30e8a8 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1485 microversion: 2.25 time: 0.774434 Sep 19 14:46:04.949851 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 871/1749] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:04 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1485 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:04.960882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:04.961859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:04.976935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:04.977718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:04.981907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:04.983745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:04.984795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:04.985497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:05.704902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:05.720783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5470cafa-78cc-4e57-ae79-6f8876e77518 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1680 microversion: 2.1 time: 0.769398 Sep 19 14:46:05.723492 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 872/1750] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:04 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1680 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:05.750466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-184cf3d2-acab-4488-b32c-21975e884d2a req-e9307bc1-8649-4901-bc73-e142ce6332cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:05.774056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-184cf3d2-acab-4488-b32c-21975e884d2a req-e9307bc1-8649-4901-bc73-e142ce6332cc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:05.775303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-184cf3d2-acab-4488-b32c-21975e884d2a req-e9307bc1-8649-4901-bc73-e142ce6332cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:05.776200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-184cf3d2-acab-4488-b32c-21975e884d2a req-e9307bc1-8649-4901-bc73-e142ce6332cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:05.796986 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-184cf3d2-acab-4488-b32c-21975e884d2a req-e9307bc1-8649-4901-bc73-e142ce6332cc service nova] Creating event network-changed:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h1-858384-1 Sep 19 14:46:05.806295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-184cf3d2-acab-4488-b32c-21975e884d2a req-e9307bc1-8649-4901-bc73-e142ce6332cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078178 Sep 19 14:46:05.812547 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 873/1751] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:05.820687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:05.822415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:05.833204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:05.868790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:05.869482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:05.870233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:05.880845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:05.881581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:06.408653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:46:06.614791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:06.636335 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-18e8602c-0d45-4dbd-a119-859832cd686f tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1524 microversion: 2.1 time: 0.820995 Sep 19 14:46:06.639510 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 874/1752] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:05 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1524 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:07.208987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83464f97-fd71-4d80-83ff-3cca0619725d tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Calling method '.version_select at 0x7fde29935a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:07.585521 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83464f97-fd71-4d80-83ff-3cca0619725d tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.944801 Sep 19 14:46:07.586026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 875/1753] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:46:06 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:46:07.591163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-076b7d1a-56ce-47be-808e-4884f1d871a6 req-1155e594-e211-4b61-b086-e0967a720a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae3f971-6de7-44e5-a5c3-65900357963c", "name": "network-vif-unplugged", "status": "completed", "tag": "42658f3f-48bf-4f7f-b156-2821c8e0c313"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:07.603360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:07.612631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-076b7d1a-56ce-47be-808e-4884f1d871a6 req-1155e594-e211-4b61-b086-e0967a720a64 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:07.614544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-076b7d1a-56ce-47be-808e-4884f1d871a6 req-1155e594-e211-4b61-b086-e0967a720a64 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:07.615212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-076b7d1a-56ce-47be-808e-4884f1d871a6 req-1155e594-e211-4b61-b086-e0967a720a64 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:07.648417 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-076b7d1a-56ce-47be-808e-4884f1d871a6 req-1155e594-e211-4b61-b086-e0967a720a64 service nova] Creating event network-vif-unplugged:42658f3f-48bf-4f7f-b156-2821c8e0c313 for instance 4ae3f971-6de7-44e5-a5c3-65900357963c on n-h2-858384-1 Sep 19 14:46:07.671849 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-076b7d1a-56ce-47be-808e-4884f1d871a6 req-1155e594-e211-4b61-b086-e0967a720a64 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075201 Sep 19 14:46:07.672535 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 876/1754] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:07.683016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:07.683735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:07.706506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:07.707158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:07.707610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:07.708338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:07.711470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:07.711963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:09.271186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:09.283301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0559ae38-b119-49d1-9eb3-9128bf849125 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1312 microversion: 2.1 time: 1.609481 Sep 19 14:46:09.301734 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 877/1755] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:07 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1312 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:09.327695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c7ad2dcf-8ca1-4765-85a5-0e323012cffa tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29a0fc10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:09.419117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c7ad2dcf-8ca1-4765-85a5-0e323012cffa tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.096030 Sep 19 14:46:09.429696 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 878/1756] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:09 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:09.443909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:09.444891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:09.461342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:09.462189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:09.463503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:09.464267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:09.464739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:09.465174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:09.796074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:09.809795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:09.811296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:09.812486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a9a8aa8f-e797-4d88-bcf8-8e467f0a94a6 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1475 microversion: 2.25 time: 0.381494 Sep 19 14:46:09.813051 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 879/1757] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:09 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1475 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:09.849905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:09.850419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:09.871663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:09.872198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:09.872635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:09.873367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:09.873812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:09.875314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:09.889840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Updating instance_info_cache with network_info: [{"id": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a", "address": "fa:16:3e:b0:03:46", "network": {"id": "f05b3455-618c-4083-add0-0e4bab7610d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2016119408-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b1afbbefb33447b2871b1c40b2bc6cc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap36aaba0a-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:46:09.918906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Releasing lock "refresh_cache-e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:46:09.920500 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1e609a5-821e-437d-9170-a0c94eaf17e9 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action" status: 202 len: 0 microversion: 2.1 time: 10.195376 Sep 19 14:46:09.925018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:09.926533 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 879/1758] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:45:59 2022] POST /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3/action => generated 0 bytes in 10204 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:46:09.936396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-32ad952c-7801-4660-9198-edfb822c1949 req-5ebee85e-0f25-42f0-bc15-7143bad994aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:09.979551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32ad952c-7801-4660-9198-edfb822c1949 req-5ebee85e-0f25-42f0-bc15-7143bad994aa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:09.980172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32ad952c-7801-4660-9198-edfb822c1949 req-5ebee85e-0f25-42f0-bc15-7143bad994aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:09.980632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32ad952c-7801-4660-9198-edfb822c1949 req-5ebee85e-0f25-42f0-bc15-7143bad994aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.018083 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-32ad952c-7801-4660-9198-edfb822c1949 req-5ebee85e-0f25-42f0-bc15-7143bad994aa service nova] Creating event network-changed:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:46:10.029883 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-32ad952c-7801-4660-9198-edfb822c1949 req-5ebee85e-0f25-42f0-bc15-7143bad994aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098488 Sep 19 14:46:10.030920 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 880/1759] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:10.044587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.045742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:10.060728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.061232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.061678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.067516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.068027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.068704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.132938 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a151f35-7750-4f0f-87aa-1229f926cfe7 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "DELETE /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 204 len: 0 microversion: 2.1 time: 0.292269 Sep 19 14:46:10.135093 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 880/1760] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:46:09 2022] DELETE /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:46:10.161571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06cfda25-19eb-4ecb-9e00-4ee023653d50 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Action: 'create', calling method: .version_select at 0x7fde29dcf430>, body: {"pool": "non_exist_pool"} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:10.169344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.169846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.170299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.170742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lazy-loading 'fault' on Instance uuid 4ae3f971-6de7-44e5-a5c3-65900357963c {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:46:10.273862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a279d9a3d84ddea38f52728f8775dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e642fd9f7b364b87ad1dd7a23c5e787c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:10.275001 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-06cfda25-19eb-4ecb-9e00-4ee023653d50 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] HTTP exception thrown: Floating IP pool not found. Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06cfda25-19eb-4ecb-9e00-4ee023653d50 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Request method failure captured: Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 26 Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKICshBQAwLCLXbm7bgo2YLDpws0cpGq34qnIpXjRfvVeFR3SU8uVskgfmkJNybadrcbVVp_zyR8QbFTTVrjIXbjDWwvce02cYNfg00kDE8ksOQA4btPSY6BU8p62b4EsWk8kaTVtSXi29l1CVSCgwL4VW-R-gRs_ZVbb9-Q-fgLVn2c Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7dad3ccfdbf446f9b5e8a7fcd07e0c54 Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-280846104 Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:10.277126 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}] Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-280846104 Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7dad3ccfdbf446f9b5e8a7fcd07e0c54 Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-280846104 Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FloatingIPsNegativeTestJSON-280846104-project Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: d17a8e122f834a099646486ae1bcfc27 Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-280846104-project Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: {"pool": "non_exist_pool"} Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: exception: Floating IP pool not found. Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 19 14:46:10.279018 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:10.280178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06cfda25-19eb-4ecb-9e00-4ee023653d50 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Returning 404 to user: Floating IP pool not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:10.281674 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06cfda25-19eb-4ecb-9e00-4ee023653d50 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.140847 Sep 19 14:46:10.282738 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 881/1761] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:46:10 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:46:10.289922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.290681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:10.292266 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-38ea4423-2eaf-4b5a-9cb0-56ae9f49d21d tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 200 len: 1331 microversion: 2.1 time: 0.259832 Sep 19 14:46:10.293430 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 881/1762] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 1331 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:10.298594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-69b89346-a0e1-4900-aa6b-f20c6d91618d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '.version_select at 0x7fde299518b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.303561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69b89346-a0e1-4900-aa6b-f20c6d91618d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.304381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69b89346-a0e1-4900-aa6b-f20c6d91618d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.305091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69b89346-a0e1-4900-aa6b-f20c6d91618d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.317781 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-69b89346-a0e1-4900-aa6b-f20c6d91618d tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.022204 Sep 19 14:46:10.319110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 882/1763] 10.222.0.81 () {60 vars in 1184 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:10.323930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.324803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:10.331907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.333076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.333786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.334836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.335573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.336284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.352870 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] HTTP exception thrown: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:10.353142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.353576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.354037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.354825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Request method failure captured: Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 HTTP/1.1 Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIBHXyXR6XpDSQarWy0ffyYPx_EhvgNY0w1vLNSwrE-IwClSjK_QosY8izMVrqon-rQJACoYgZ61X9EAyV9QGsv8scTh1nwRWG7E0-vmn61dT8ugXTl84CkCStG5UlHEPcrEQn0-NEugPoPUkIrwq9R066SjeOi7e76i2KUvseeEBsI Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:46:10.355956 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b1afbbefb33447b2871b1c40b2bc6cc5"}]}] Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ee0cfca622a34b55828b768b57f8697a Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:10.357498 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'f3934e7f-da3c-4411-98ed-0e7bee2460c7'} Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:10.358352 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:10.360404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.361805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.366133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Returning 404 to user: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:10.366960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.367595 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1f432227-39a1-40d4-ac44-6aeae7ad0121 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 404 len: 111 microversion: 2.1 time: 0.047050 Sep 19 14:46:10.368728 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 883/1764] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:46:10 2022] DELETE /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:10.374188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.375223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:10.382437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.383349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.384056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.384997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.385701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.386360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.781715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:10.795895 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d3a5bf1-cd61-4652-8b0a-475a66fcfa2d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1504 microversion: 2.1 time: 0.512971 Sep 19 14:46:10.798846 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 882/1765] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:10.814292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67ecea43-763f-4991-a552-f732243e9609 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Calling method '.version_select at 0x7fde29935d30>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.928699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-67ecea43-763f-4991-a552-f732243e9609 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 could not be found", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:46:10.929446 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-67ecea43-763f-4991-a552-f732243e9609 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] HTTP exception thrown: Floating IP not found for ID 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67ecea43-763f-4991-a552-f732243e9609 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Request method failure captured: Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-floating-ips/9a17db7b-b0d4-45ca-880d-8d6b62e76f31 HTTP/1.1 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKICshBQAwLCLXbm7bgo2YLDpws0cpGq34qnIpXjRfvVeFR3SU8uVskgfmkJNybadrcbVVp_zyR8QbFTTVrjIXbjDWwvce02cYNfg00kDE8ksOQA4btPSY6BU8p62b4EsWk8kaTVtSXi29l1CVSCgwL4VW-R-gRs_ZVbb9-Q-fgLVn2c Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7dad3ccfdbf446f9b5e8a7fcd07e0c54 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-280846104 Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:10.931764 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7dad3ccfdbf446f9b5e8a7fcd07e0c54"}]}] Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-280846104 Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7dad3ccfdbf446f9b5e8a7fcd07e0c54 Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-280846104 Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FloatingIPsNegativeTestJSON-280846104-project Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: d17a8e122f834a099646486ae1bcfc27 Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-280846104-project Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: exception: Floating IP not found for ID 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9a17db7b-b0d4-45ca-880d-8d6b62e76f31'} Sep 19 14:46:10.933643 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:46:10.934812 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 could not be found Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e15cfc90-bdd4-450a-b8cd-9f9f0d0fe40f'] Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9a17db7b-b0d4-45ca-880d-8d6b62e76f31. Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.936483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:10.939481 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:10.951398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 Sep 19 14:46:10.951398 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.951398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67ecea43-763f-4991-a552-f732243e9609 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] Returning 404 to user: Floating IP not found for ID 9a17db7b-b0d4-45ca-880d-8d6b62e76f31 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:10.951398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67ecea43-763f-4991-a552-f732243e9609 tempest-FloatingIPsNegativeTestJSON-280846104 tempest-FloatingIPsNegativeTestJSON-280846104-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/9a17db7b-b0d4-45ca-880d-8d6b62e76f31" status: 404 len: 111 microversion: 2.1 time: 0.142170 Sep 19 14:46:10.953930 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 883/1766] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:46:10 2022] DELETE /compute/v2.1/os-floating-ips/9a17db7b-b0d4-45ca-880d-8d6b62e76f31 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:10.961945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.963092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:10.975872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.976853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.977640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:10.979484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:10.980296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:10.980992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:11.193636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:11.204032 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97968cef-e3aa-4be4-b043-609248cc715a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1683 microversion: 2.1 time: 0.833915 Sep 19 14:46:11.209809 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 884/1767] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1683 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:11.214613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:11.220223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:11.237066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:11.238369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:11.240618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:11.248780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:11.250855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:11.251507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:11.546656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:11.558390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9fee64e6-aa0b-423f-a5b0-26024dbc58ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1312 microversion: 2.1 time: 0.602588 Sep 19 14:46:11.575397 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 884/1768] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:11.580657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:11.582191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: f3934e7f-da3c-4411-98ed-0e7bee2460c7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:11.597599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:11.604316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:11.604888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:11.605935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:11.606486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:11.607008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:11.635697 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] HTTP exception thrown: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Request method failure captured: Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 HTTP/1.1 Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBHXyXR6XpDSQarWy0ffyYPx_EhvgNY0w1vLNSwrE-IwClSjK_QosY8izMVrqon-rQJACoYgZ61X9EAyV9QGsv8scTh1nwRWG7E0-vmn61dT8ugXTl84CkCStG5UlHEPcrEQn0-NEugPoPUkIrwq9R066SjeOi7e76i2KUvseeEBsI Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:11.646532 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b1afbbefb33447b2871b1c40b2bc6cc5"}]}] Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ee0cfca622a34b55828b768b57f8697a Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:11.648101 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'f3934e7f-da3c-4411-98ed-0e7bee2460c7'} Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:11.648948 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. Sep 19 14:46:11.650359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:11.651648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Returning 404 to user: Instance f3934e7f-da3c-4411-98ed-0e7bee2460c7 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:11.651648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b703836-9213-4a41-8a88-47e1950f0fd1 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7" status: 404 len: 111 microversion: 2.1 time: 0.071189 Sep 19 14:46:11.651816 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 885/1769] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:11 2022] GET /compute/v2.1/servers/f3934e7f-da3c-4411-98ed-0e7bee2460c7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:11.665906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e941f29d-f22d-4344-b012-0565f84f3f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29928820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:11.746772 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e941f29d-f22d-4344-b012-0565f84f3f1f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.093231 Sep 19 14:46:11.747653 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 886/1770] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:11 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:11.758455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1c05854-a632-4f26-afd3-b602c9f46935 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'create', calling method: .version_select at 0x7fde2994e8b0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1599570106", "description": "tempest-description-1352568292"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:12.121392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] Lazy-loading 'services' on Instance uuid 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:46:12.155850 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-43d1a230-915f-4f51-a8a7-6697e1aff725 tempest-LiveAutoBlockMigrationV225Test-1066216379 tempest-LiveAutoBlockMigrationV225Test-1066216379-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1967 microversion: 2.25 time: 0.944600 Sep 19 14:46:12.156806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 885/1771] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:11 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1967 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:12.167902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:12.169403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:12.206794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:12.208197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:12.210479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:12.211472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:12.214904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:12.218922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:12.261962 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] HTTP exception thrown: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Request method failure captured: Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c HTTP/1.1 Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH_gyADoABGCJ24oeVoGNKhGcgLONVXwLUqZ9fT0LABkhG791efYx8GLYg6gW823ov7jXjGEP82AV4oiNzlVKYh8SAX7qdB4FK4YVLNiRE7ksi9xFHZo-glHS-bJV06hHvWIXJF896OqTUhsarInK9yYvoU0etPtQj9t7UVsy0XxfNU Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e642fd9f7b364b87ad1dd7a23c5e787c Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:46:12.263986 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e642fd9f7b364b87ad1dd7a23c5e787c"}]}] Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e642fd9f7b364b87ad1dd7a23c5e787c Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachSCSIVolumeTestJSON-1870470587-project Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c0a279d9a3d84ddea38f52728f8775dd Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1870470587-project Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:12.265546 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4ae3f971-6de7-44e5-a5c3-65900357963c'} Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:12.266501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:12.267934 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.271757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Returning 404 to user: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:12.272893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d71a4f13-a6fd-4592-bc8e-0a02f0f0b542 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 404 len: 111 microversion: 2.1 time: 0.115076 Sep 19 14:46:12.273695 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 886/1772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:12 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:12.278431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6c53d703-ea36-4d94-a62e-b82c345794ef req-02972e62-04bb-45d3-bb38-7ab244607d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "name": "network-vif-plugged", "status": "completed", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:12.292067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6c53d703-ea36-4d94-a62e-b82c345794ef req-02972e62-04bb-45d3-bb38-7ab244607d72 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:12.292936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6c53d703-ea36-4d94-a62e-b82c345794ef req-02972e62-04bb-45d3-bb38-7ab244607d72 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:12.293590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6c53d703-ea36-4d94-a62e-b82c345794ef req-02972e62-04bb-45d3-bb38-7ab244607d72 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:12.313563 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6c53d703-ea36-4d94-a62e-b82c345794ef req-02972e62-04bb-45d3-bb38-7ab244607d72 service nova] Creating event network-vif-plugged:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h1-858384-1 Sep 19 14:46:12.324199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6c53d703-ea36-4d94-a62e-b82c345794ef req-02972e62-04bb-45d3-bb38-7ab244607d72 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048992 Sep 19 14:46:12.325576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 887/1773] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:12.331110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5dcf3718-6534-4b88-b0ab-8a8173387b9c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '.version_select at 0x7fde299cfe50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:13.165099 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1c05854-a632-4f26-afd3-b602c9f46935 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.414252 Sep 19 14:46:13.166282 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 887/1774] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:46:11 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:13.183237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9a8a33bd-2468-4a88-aba8-62b9ec54d754 req-3c90c1ec-b71f-4bd0-91ff-ec52b9a1af10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae3f971-6de7-44e5-a5c3-65900357963c", "name": "network-vif-deleted", "tag": "42658f3f-48bf-4f7f-b156-2821c8e0c313"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:13.221282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9a8a33bd-2468-4a88-aba8-62b9ec54d754 req-3c90c1ec-b71f-4bd0-91ff-ec52b9a1af10 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.223659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9a8a33bd-2468-4a88-aba8-62b9ec54d754 req-3c90c1ec-b71f-4bd0-91ff-ec52b9a1af10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.227204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9a8a33bd-2468-4a88-aba8-62b9ec54d754 req-3c90c1ec-b71f-4bd0-91ff-ec52b9a1af10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:13.256003 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9a8a33bd-2468-4a88-aba8-62b9ec54d754 req-3c90c1ec-b71f-4bd0-91ff-ec52b9a1af10 service nova] Creating event network-vif-deleted:42658f3f-48bf-4f7f-b156-2821c8e0c313 for instance 4ae3f971-6de7-44e5-a5c3-65900357963c on n-h2-858384-1 Sep 19 14:46:13.273220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9a8a33bd-2468-4a88-aba8-62b9ec54d754 req-3c90c1ec-b71f-4bd0-91ff-ec52b9a1af10 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105987 Sep 19 14:46:13.281654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 888/1775] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:13.295396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:13.296461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:13.336410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.338785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.340636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:13.341632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.343202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.344169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:13.418429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:13.428779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:13.663949 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-628ee8f6-71b7-4810-acd8-2348a8716125 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 204 len: 0 microversion: 2.25 time: 0.379735 Sep 19 14:46:13.668100 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 889/1776] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:46:13 2022] DELETE /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:46:13.670636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:13.671462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:13.678671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.679265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.680330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:13.681368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.682125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.683078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:13.831088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:13.855822 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae141b21-9e7f-4d5c-9a43-770a7719ed75 tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1615 microversion: 2.1 time: 0.187553 Sep 19 14:46:13.867396 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 890/1777] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:13 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1615 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:13.881088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92e57371-a94b-4f60-ad99-54f85b666a55 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '.version_select at 0x7fde2a81b550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:13.943413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-92e57371-a94b-4f60-ad99-54f85b666a55 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194224372" status: 202 len: 0 microversion: 2.1 time: 0.074596 Sep 19 14:46:13.944599 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 891/1778] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194224372 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:13.954188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:13.955457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:13.976276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.977170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.977857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:13.978927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:13.981084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:13.981792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:14.541254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:14.553763 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-571b1de1-d7ec-481a-aab7-2c230e793a2e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1312 microversion: 2.1 time: 0.607772 Sep 19 14:46:14.561045 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 892/1779] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:13 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1312 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:14.575390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6159bd0-2c2e-42ce-85c4-5a5e1e99bb9a tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde29ab59d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:14.674287 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6159bd0-2c2e-42ce-85c4-5a5e1e99bb9a tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1428 microversion: 2.1 time: 0.113951 Sep 19 14:46:14.683218 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 893/1780] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:14 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:14.689464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1599570106"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:14.690026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:14.704410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:14.708319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:14.708836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:14.709600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:14.710080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:14.710512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:15.189321 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.network.security_group_api [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Adding security group 1d840d4e-ae8c-4e83-9923-ae62cbe11b32 to port 68799562-64e9-400b-82a1-3c05bde1a7e1 Sep 19 14:46:16.392650 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5dcf3718-6534-4b88-b0ab-8a8173387b9c tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/2f8f25a7-726c-4226-bb98-b466a168fc1a" status: 202 len: 0 microversion: 2.1 time: 4.065577 Sep 19 14:46:16.397383 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 888/1781] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:46:12 2022] DELETE /compute/v2.1/os-floating-ips/2f8f25a7-726c-4226-bb98-b466a168fc1a => generated 0 bytes in 4068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:16.410633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:16.411668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:16.446978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.447746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.448221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.455910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.457985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.462387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.619678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:16.639329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:16.648163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:16.649411 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-befb2d00-4c60-4fe6-bea6-539f8f4204ec tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1265 microversion: 2.25 time: 0.253709 Sep 19 14:46:16.650558 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 889/1782] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:16 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:16.673017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:16.683833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:16.692401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.693173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.693823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.698730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.700138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.700749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.747355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.748103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.748872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.749498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lazy-loading 'fault' on Instance uuid 52c1a3df-11b1-4178-b222-2f04d095f00e {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:46:16.818525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c157ab3e33fe4f648c425f54f7347b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c204b981d98b46c29a36a09c38266982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:16.827079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64317d80-2d7d-4975-9c42-debde8dbaa1a tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 200 len: 1331 microversion: 2.1 time: 0.164169 Sep 19 14:46:16.847930 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 890/1783] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:16 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 1331 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:16.853823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:16.854940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:16.873696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.884055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.886424 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70e4c1f9-4fce-4325-8805-d93727f7f5e5 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action" status: 202 len: 0 microversion: 2.1 time: 2.204878 Sep 19 14:46:16.887256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.887636 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 894/1784] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:46:14 2022] POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action => generated 0 bytes in 2211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:16.891927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:16.895240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77efd11d-1ba1-41bf-99e5-c35d9f619c2c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde298f0af0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:16.898668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:16.899376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:16.994878 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-77efd11d-1ba1-41bf-99e5-c35d9f619c2c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1437 microversion: 2.1 time: 0.105868 Sep 19 14:46:16.995642 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 895/1785] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:16 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:17.010726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-92a20cba-eebc-45fc-926e-05d1365efc13 req-fb3565b9-aa35-46f8-8f2f-bd7712c22a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cea384e-ffd7-4ffb-a325-149d8c5fbf62", "name": "network-vif-deleted", "tag": "baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:17.067817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-92a20cba-eebc-45fc-926e-05d1365efc13 req-fb3565b9-aa35-46f8-8f2f-bd7712c22a5d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.068905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-92a20cba-eebc-45fc-926e-05d1365efc13 req-fb3565b9-aa35-46f8-8f2f-bd7712c22a5d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.070285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-92a20cba-eebc-45fc-926e-05d1365efc13 req-fb3565b9-aa35-46f8-8f2f-bd7712c22a5d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.101448 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-92a20cba-eebc-45fc-926e-05d1365efc13 req-fb3565b9-aa35-46f8-8f2f-bd7712c22a5d service nova] Creating event network-vif-deleted:baf76a3e-a5ba-4af6-b0ff-9170e8f7d6fd for instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 on n-h1-858384-1 Sep 19 14:46:17.107810 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-92a20cba-eebc-45fc-926e-05d1365efc13 req-fb3565b9-aa35-46f8-8f2f-bd7712c22a5d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109089 Sep 19 14:46:17.109018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 896/1786] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:17.116407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0fe8287a-b1dd-4085-bba8-7c1d5493e430 req-97336ebe-18c7-4b43-ad2a-c00068d97056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c1a3df-11b1-4178-b222-2f04d095f00e", "name": "network-vif-deleted", "tag": "af9b7cd6-f390-4f70-b449-36b69fd19f29"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:17.133678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0fe8287a-b1dd-4085-bba8-7c1d5493e430 req-97336ebe-18c7-4b43-ad2a-c00068d97056 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.134562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0fe8287a-b1dd-4085-bba8-7c1d5493e430 req-97336ebe-18c7-4b43-ad2a-c00068d97056 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.135258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0fe8287a-b1dd-4085-bba8-7c1d5493e430 req-97336ebe-18c7-4b43-ad2a-c00068d97056 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.149971 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0fe8287a-b1dd-4085-bba8-7c1d5493e430 req-97336ebe-18c7-4b43-ad2a-c00068d97056 service nova] Creating event network-vif-deleted:af9b7cd6-f390-4f70-b449-36b69fd19f29 for instance 52c1a3df-11b1-4178-b222-2f04d095f00e on n-h1-858384-1 Sep 19 14:46:17.155975 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0fe8287a-b1dd-4085-bba8-7c1d5493e430 req-97336ebe-18c7-4b43-ad2a-c00068d97056 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045417 Sep 19 14:46:17.157162 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 897/1787] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:17.163563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:17.164447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:17.172089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.172920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.173544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.174418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.176009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.177617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.213939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:17.240352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:17.255320 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b05f60e-eefd-43ca-bb6a-e8198d8e267f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1462 microversion: 2.1 time: 0.399791 Sep 19 14:46:17.259066 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 891/1788] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:16 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1462 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:17.273196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1599570106"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:17.274503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:17.301194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.303601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.304313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.305791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.314562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.318678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.491069 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c2fc1d93-f483-4a48-9eda-275cff718cf0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 204 len: 0 microversion: 2.1 time: 0.332070 Sep 19 14:46:17.492297 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 898/1789] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:46:17 2022] DELETE /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:46:17.507082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8dc2465b-17d0-40f0-8697-9f6fc630a77f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde299c04c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:17.616751 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8dc2465b-17d0-40f0-8697-9f6fc630a77f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 200 len: 1437 microversion: 2.1 time: 0.122580 Sep 19 14:46:17.626070 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 899/1790] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:17 2022] GET /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:17.642960 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Removing security group 1d840d4e-ae8c-4e83-9923-ae62cbe11b32 from port 68799562-64e9-400b-82a1-3c05bde1a7e1 Sep 19 14:46:17.856735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:17.857477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:17.868563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.869053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.869486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:17.870194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:17.870659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:17.883671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.296869 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3bdbb3e-911e-4d65-a96e-aa66c60759ae tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action" status: 202 len: 0 microversion: 2.1 time: 1.036644 Sep 19 14:46:18.297474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 892/1791] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:46:17 2022] POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:18.307420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:18.308039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:18.324223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.324720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.325156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.325868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.326319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.326764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.623011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0cfca622a34b55828b768b57f8697a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1afbbefb33447b2871b1c40b2bc6cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:18.637658 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3a7f6ae2-4c70-4ccc-abba-dd55ade691e0 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 200 len: 1526 microversion: 2.1 time: 0.337021 Sep 19 14:46:18.639254 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 893/1792] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:18 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 1526 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:18.646295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:18.647728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:18.656394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.658630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.668392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.670244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.671156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.673600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.729866 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1717993d-28c7-4d74-a172-652b167a6669 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1613 microversion: 2.1 time: 1.102250 Sep 19 14:46:18.737757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 900/1793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:17 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1613 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:18.743432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:18.758918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:18.771384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.778994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.779771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.783695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.784775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.785206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.919100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:18.928845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:18.930518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:18.932162 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b316381-a8e1-4620-9209-93ec771a9bd2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1265 microversion: 2.25 time: 0.192657 Sep 19 14:46:18.947545 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 901/1794] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:18 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:18.957964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:18.958900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [instance: 52c1a3df-11b1-4178-b222-2f04d095f00e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:18.967197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.968022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.968622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.969647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:18.970314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:18.970945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:18.988707 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] HTTP exception thrown: Instance 52c1a3df-11b1-4178-b222-2f04d095f00e could not be found. Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Request method failure captured: Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e HTTP/1.1 Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH_qkeuhVV7XWoF_ecrY43vw13cIh2anGwI9-klNqwW3_DDeHYwwgdwqoeHiGuEuafvEdHZizaOaGrc5wLsF0aglcdu6WEkKBjniMLAcKOHFJEPw5Ak_3aRqAtbWggMzxDq0aY0lKLosLoGoSJBfabZS1CPmx1qHoQpNT3KcXdxUPJM Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: c204b981d98b46c29a36a09c38266982 Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesAdminNegativeTest-470174445 Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:18.990723 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c204b981d98b46c29a36a09c38266982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c204b981d98b46c29a36a09c38266982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c204b981d98b46c29a36a09c38266982"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c204b981d98b46c29a36a09c38266982"}]}] Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesAdminNegativeTest-470174445 Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: c204b981d98b46c29a36a09c38266982 Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-470174445 Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesAdminNegativeTest-470174445-project Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c157ab3e33fe4f648c425f54f7347b39 Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesAdminNegativeTest-470174445-project Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 52c1a3df-11b1-4178-b222-2f04d095f00e could not be found. Sep 19 14:46:18.992575 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '52c1a3df-11b1-4178-b222-2f04d095f00e'} Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c1a3df-11b1-4178-b222-2f04d095f00e could not be found. Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:18.993613 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c1a3df-11b1-4178-b222-2f04d095f00e could not be found. Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c1a3df-11b1-4178-b222-2f04d095f00e could not be found. Sep 19 14:46:18.995381 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:18.997664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Returning 404 to user: Instance 52c1a3df-11b1-4178-b222-2f04d095f00e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:18.998874 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb106c16-4fd3-4e60-b12b-f93d678564ec tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e" status: 404 len: 111 microversion: 2.1 time: 0.050362 Sep 19 14:46:19.000983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 902/1795] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:18 2022] GET /compute/v2.1/servers/52c1a3df-11b1-4178-b222-2f04d095f00e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:19.006937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:19.007780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-24f71a4c-3832-43e7-92f1-21ec396f110d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'create', calling method: .version_select at 0x7fde298f0c10>, body: {"pool": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:19.016013 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14b324c7-d4c7-4b3d-8007-c296536f996e tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1467 microversion: 2.1 time: 0.375411 Sep 19 14:46:19.016525 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 894/1796] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:18 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:19.029340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:19.029928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:19.041482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:19.042277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:19.042928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:19.043805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:19.044426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:19.045462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:19.132911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0f0f6300ffa94b38a82d3884d7c8dfdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ed4a6962574d4ebe6a3a15963fd3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:19.133458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] flavor_id is None. Assuming migration. {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 19 14:46:19.134131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 14:46:19.611210 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0351b6f2-b2c4-44d8-894c-ecfabdd47a81 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f/action" status: 202 len: 0 microversion: 2.1 time: 0.586149 Sep 19 14:46:19.612883 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 895/1797] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:46:19 2022] POST /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:19.619015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0096aaf5-0187-45ac-a007-8db3ce5af36c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] Calling method '.version_select at 0x7fde2996e790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:19.624239 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0096aaf5-0187-45ac-a007-8db3ce5af36c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [51a2263b-92d3-4718-ac86-2e1e88a872e0] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 14:46:20.635128 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [None req-0096aaf5-0187-45ac-a007-8db3ce5af36c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] [51a2263b-92d3-4718-ac86-2e1e88a872e0] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 45836. Sep 19 14:46:20.664018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0096aaf5-0187-45ac-a007-8db3ce5af36c tempest-VolumesAdminNegativeTest-470174445 tempest-VolumesAdminNegativeTest-470174445-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130472108" status: 202 len: 0 microversion: 2.1 time: 1.049533 Sep 19 14:46:20.667956 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 896/1798] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 14:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130472108 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:20.671948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdd9b234-daf8-4a1f-97ca-f13a3ebea5c9 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde298f4310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:20.982684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-24f71a4c-3832-43e7-92f1-21ec396f110d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.974164 Sep 19 14:46:20.984296 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 903/1799] 10.222.0.81 () {60 vars in 1170 bytes} [Mon Sep 19 14:46:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:21.008626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}, {"name": "network-changed", "server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:21.059747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.060376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.060995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.081934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] Creating event network-changed:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:46:21.083019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] Creating event network-changed:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:46:21.095561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b2a7399b-eaf3-4a9d-9a10-3fee89ff1ebd req-fea8c90c-3045-43bf-9043-d4ed549f5c42 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.108213 Sep 19 14:46:21.097538 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 904/1800] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:21.226416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-24cda278-2000-410e-b2e0-ad726a21406d tempest-ListImagesTestJSON-1873285954 tempest-ListImagesTestJSON-1873285954-project] Calling method '.version_select at 0x7fde298a5a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:21.342221 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-24cda278-2000-410e-b2e0-ad726a21406d tempest-ListImagesTestJSON-1873285954 tempest-ListImagesTestJSON-1873285954-project] 10.222.0.81 "GET /compute/v2.1/images/65e17483-129b-4a3b-97d8-49cd96ae0799" status: 200 len: 784 microversion: 2.1 time: 0.240594 Sep 19 14:46:21.343295 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 905/1801] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:46:21 2022] GET /compute/v2.1/images/65e17483-129b-4a3b-97d8-49cd96ae0799 => generated 784 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:21.349479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:21.350227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:21.362866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.363766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.364474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.365428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.366166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.367185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.755219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdd9b234-daf8-4a1f-97ca-f13a3ebea5c9 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "DELETE /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27" status: 204 len: 0 microversion: 2.1 time: 1.088256 Sep 19 14:46:21.759676 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 897/1802] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:20 2022] DELETE /compute/v2.1/images/b63d1db8-b323-4bd7-b598-f36e9fdc0c27 => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:46:21.765825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:21.766779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] [instance: e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:21.774022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.775031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.775737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.776692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.777402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.778054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.781361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:21.796080 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9458f6e-2dcd-41f9-ab9f-9376b41ae156 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1471 microversion: 2.1 time: 0.449798 Sep 19 14:46:21.796684 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 906/1803] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:21 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:21.812214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:21.813661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] HTTP exception thrown: Instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 could not be found. Sep 19 14:46:21.814555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Request method failure captured: Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 HTTP/1.1 Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIBHXyXR6XpDSQarWy0ffyYPx_EhvgNY0w1vLNSwrE-IwClSjK_QosY8izMVrqon-rQJACoYgZ61X9EAyV9QGsv8scTh1nwRWG7E0-vmn61dT8ugXTl84CkCStG5UlHEPcrEQn0-NEugPoPUkIrwq9R066SjeOi7e76i2KUvseeEBsI Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:46:21.818081 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b1afbbefb33447b2871b1c40b2bc6cc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b1afbbefb33447b2871b1c40b2bc6cc5"}]}] Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b1afbbefb33447b2871b1c40b2bc6cc5 Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-884621281 Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ee0cfca622a34b55828b768b57f8697a Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-884621281-project Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 could not be found. Sep 19 14:46:21.819913 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3'} Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 could not be found. Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:21.820789 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 could not be found. Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 could not be found. Sep 19 14:46:21.822208 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:21.824833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:21.826371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] Returning 404 to user: Instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:21.827598 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9c1624e-c388-4523-896c-0329e1f91cb8 tempest-FloatingIPsAssociationTestJSON-884621281 tempest-FloatingIPsAssociationTestJSON-884621281-project] 10.222.0.81 "GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3" status: 404 len: 111 microversion: 2.1 time: 0.066165 Sep 19 14:46:21.828707 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 898/1804] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:21 2022] GET /compute/v2.1/servers/e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:21.828850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.829253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.829755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.830461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.831367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.832404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.839265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ce05727f-d64b-411b-ae63-1169bc5d013b req-5b64a525-1bcf-45e5-8ccd-e82ef9e400d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:21.864656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ce05727f-d64b-411b-ae63-1169bc5d013b req-5b64a525-1bcf-45e5-8ccd-e82ef9e400d9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.865155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ce05727f-d64b-411b-ae63-1169bc5d013b req-5b64a525-1bcf-45e5-8ccd-e82ef9e400d9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.865600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ce05727f-d64b-411b-ae63-1169bc5d013b req-5b64a525-1bcf-45e5-8ccd-e82ef9e400d9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.905737 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ce05727f-d64b-411b-ae63-1169bc5d013b req-5b64a525-1bcf-45e5-8ccd-e82ef9e400d9 service nova] Creating event network-vif-unplugged:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:46:21.920183 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ce05727f-d64b-411b-ae63-1169bc5d013b req-5b64a525-1bcf-45e5-8ccd-e82ef9e400d9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089277 Sep 19 14:46:21.926774 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 899/1805] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:21.933515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.177"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:21.937259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:21.945002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.945815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.946595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:21.947535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:21.948255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:21.948947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:22.005973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "refresh_cache-bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:46:22.006286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquired lock "refresh_cache-bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:46:22.060547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:22.081338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:22.087644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:22.088862 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4bf52784-5e1a-4799-87ce-7fef96925e6d tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1265 microversion: 2.25 time: 0.289286 Sep 19 14:46:22.093594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 907/1806] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:21 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:22.104799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e921f42-a5aa-4336-a89f-03611224e465 tempest-ListImagesTestJSON-1873285954 tempest-ListImagesTestJSON-1873285954-project] Calling method '.version_select at 0x7fde298a5700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:22.269815 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7e921f42-a5aa-4336-a89f-03611224e465 tempest-ListImagesTestJSON-1873285954 tempest-ListImagesTestJSON-1873285954-project] 10.222.0.81 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.174430 Sep 19 14:46:22.274901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 908/1807] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Sep 19 14:46:22 2022] GET /compute/v2.1/images => generated 445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:22.280320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1cba29f-db97-4501-b7d1-c4eb8113dc2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '.version_select at 0x7fde298aedc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:22.369678 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c1cba29f-db97-4501-b7d1-c4eb8113dc2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] HTTP exception thrown: Image not found. Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1cba29f-db97-4501-b7d1-c4eb8113dc2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Request method failure captured: Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d HTTP/1.1 Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBB37m5yB0dDmCl44J2G26UKADGcMIu3fq7ZZ3ZRWMzj2uUHI88RXrvx7gcZmJmfglz8jJKaMAcuqYNaaEik8QqH_VS40aQXwDhB_6gEOHPVa3vlMJp59zBO52VvLLE09Udf9GDpOjh-pzdXgnDMM8xrXV7yUvJ0cgJJvqpS2woq_k Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 77c95dfb9f2743c9a07677bb17deabb0 Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:22.373635 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/77c95dfb9f2743c9a07677bb17deabb0"}]}] Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 77c95dfb9f2743c9a07677bb17deabb0 Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerTestJSON-1199590929-project Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c4260762e3f74323bac74a519aeff94f Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerTestJSON-1199590929-project Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '3197baf5-f6cb-451f-9fbb-966cd615564d'} Sep 19 14:46:22.375686 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3197baf5-f6cb-451f-9fbb-966cd615564d to delete Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:22.376829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3197baf5-f6cb-451f-9fbb-966cd615564d could not be found. Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:22.380137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1cba29f-db97-4501-b7d1-c4eb8113dc2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:22.382300 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1cba29f-db97-4501-b7d1-c4eb8113dc2f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "DELETE /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d" status: 404 len: 62 microversion: 2.1 time: 0.098602 Sep 19 14:46:22.387102 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 909/1808] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:22 2022] DELETE /compute/v2.1/images/3197baf5-f6cb-451f-9fbb-966cd615564d => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:46:22.400588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b61c869-9894-4124-ade3-0daa747e261f tempest-ListImagesTestJSON-1873285954 tempest-ListImagesTestJSON-1873285954-project] Calling method '.version_select at 0x7fde298aeb80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:22.490413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b61c869-9894-4124-ade3-0daa747e261f tempest-ListImagesTestJSON-1873285954 tempest-ListImagesTestJSON-1873285954-project] 10.222.0.81 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.107651 Sep 19 14:46:22.491359 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 910/1809] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:46:22 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:22.496534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:22.497266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:22.505069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:22.505817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:22.506994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:22.508271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:22.508901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:22.509513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:22.566882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:22.679794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a37107cd-8274-4002-a96a-8e72463d0c4f tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "DELETE /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 204 len: 0 microversion: 2.1 time: 0.186751 Sep 19 14:46:22.683723 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 911/1810] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:46:22 2022] DELETE /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:46:22.707606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:22.709080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:22.717313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:22.718419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:22.719311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:22.720208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:22.720828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:22.722541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:23.585963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:23.603724 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-393bf569-fd53-4b74-81ce-482a336aac19 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1473 microversion: 2.1 time: 0.918299 Sep 19 14:46:23.608467 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 912/1811] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:22 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1473 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:23.615074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:23.615625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:23.633561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:23.634647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:23.635197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:23.635992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:23.636544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:23.637043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:23.691216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:24.081660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:24.098668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1031764b-8225-4a9e-afdf-211cc414a2fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1471 microversion: 2.1 time: 0.487993 Sep 19 14:46:24.101285 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 913/1812] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:23 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1471 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:24.113044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:24.114061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:24.124278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:24.125960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:24.126604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:24.128277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:24.129102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:24.130070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:24.254727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:24.266677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:24.272776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:24.280337 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f76644c2-d416-4c62-a4ec-6ec52d0660d4 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 200 len: 1265 microversion: 2.25 time: 0.177257 Sep 19 14:46:24.281316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 914/1813] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:24 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:24.299870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-15f56d71-91a0-4d97-b171-d3c56d9fbe99 req-c5f89f3c-2d60-407e-ace8-baf2a75a52e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3", "name": "network-vif-deleted", "tag": "36aaba0a-b3d4-43a6-9c89-2b21e360d54a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:24.316212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-15f56d71-91a0-4d97-b171-d3c56d9fbe99 req-c5f89f3c-2d60-407e-ace8-baf2a75a52e9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:24.317015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-15f56d71-91a0-4d97-b171-d3c56d9fbe99 req-c5f89f3c-2d60-407e-ace8-baf2a75a52e9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:24.322084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-15f56d71-91a0-4d97-b171-d3c56d9fbe99 req-c5f89f3c-2d60-407e-ace8-baf2a75a52e9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:24.345117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-15f56d71-91a0-4d97-b171-d3c56d9fbe99 req-c5f89f3c-2d60-407e-ace8-baf2a75a52e9 service nova] Creating event network-vif-deleted:36aaba0a-b3d4-43a6-9c89-2b21e360d54a for instance e5c42e97-e1d4-4afd-b6f1-98015b9ac5c3 on n-h2-858384-1 Sep 19 14:46:24.363952 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-15f56d71-91a0-4d97-b171-d3c56d9fbe99 req-c5f89f3c-2d60-407e-ace8-baf2a75a52e9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081030 Sep 19 14:46:24.365172 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 915/1814] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:24.629645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:24.631533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:24.642605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:24.644115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:24.644988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:24.646007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:24.646716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:24.647375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:24.930410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:46:25.471304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:25.481420 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc8b4051-3696-4cc8-ab91-1db31ad7b27c tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1473 microversion: 2.1 time: 0.857837 Sep 19 14:46:25.502851 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 916/1815] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:24 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1473 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:25.502851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:25.502851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:25.516135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:25.518512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:25.520397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:25.521339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:25.523388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:25.523942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:25.960112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:25.980166 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-585e4715-93fb-4ef3-8c56-4bb082c8f96c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1471 microversion: 2.1 time: 0.490333 Sep 19 14:46:25.985820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 917/1816] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:25 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1471 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:26.001047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:26.004331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 6cea384e-ffd7-4ffb-a325-149d8c5fbf62] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:26.021057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:26.021602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:26.022059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:26.022831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:26.023302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:26.026001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:26.062019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] HTTP exception thrown: Instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 could not be found. Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Request method failure captured: Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 HTTP/1.1 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7nL560JA3IfmG-oi0wwmcrr7mNQLowZtXZfUWymymfRFqexE2qnazRP-3asnJEs23hDCt7DxfSIXAdAodbw7AjKPVsD5TrfMGeGkSaGSPzjq6v4QNMxrhswOJYopzYtwi-rFvYIKviVr1c0mqev145jhv8vkc4j8lY92M34fPzUdc Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.25 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:26.063762 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a64d6b46c4541198f372d1f74417498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a64d6b46c4541198f372d1f74417498"}]}] Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 79d78edfe25746049a02a43130f1df11 Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 could not be found. Sep 19 14:46:26.066329 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6cea384e-ffd7-4ffb-a325-149d8c5fbf62'} Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 could not be found. Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:26.067483 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 could not be found. Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 could not be found. Sep 19 14:46:26.069321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:26.070964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Returning 404 to user: Instance 6cea384e-ffd7-4ffb-a325-149d8c5fbf62 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:26.071820 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00e970d7-f914-4c62-8961-21d9d029064f tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62" status: 404 len: 111 microversion: 2.25 time: 0.083862 Sep 19 14:46:26.074107 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 918/1817] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:25 2022] GET /compute/v2.1/servers/6cea384e-ffd7-4ffb-a325-149d8c5fbf62 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:46:26.414625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-dc1a33fe-dc37-42f3-9d47-64a4ec4a5eb6 req-bf36e31e-c9ef-48a4-a131-0314683330bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:26.434731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-dc1a33fe-dc37-42f3-9d47-64a4ec4a5eb6 req-bf36e31e-c9ef-48a4-a131-0314683330bd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:26.435273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-dc1a33fe-dc37-42f3-9d47-64a4ec4a5eb6 req-bf36e31e-c9ef-48a4-a131-0314683330bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:26.435763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-dc1a33fe-dc37-42f3-9d47-64a4ec4a5eb6 req-bf36e31e-c9ef-48a4-a131-0314683330bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:26.461205 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-dc1a33fe-dc37-42f3-9d47-64a4ec4a5eb6 req-bf36e31e-c9ef-48a4-a131-0314683330bd service nova] Creating event network-changed:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:46:26.479727 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-dc1a33fe-dc37-42f3-9d47-64a4ec4a5eb6 req-bf36e31e-c9ef-48a4-a131-0314683330bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061239 Sep 19 14:46:26.483630 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 919/1818] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:46:26.521396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:26.522246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:26.538889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:26.539671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:26.540323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:26.541229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:26.541929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:26.544473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:26.909167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Updating instance_info_cache with network_info: [{"id": "68799562-64e9-400b-82a1-3c05bde1a7e1", "address": "fa:16:3e:91:57:f6", "network": {"id": "fec2220e-6bd6-451c-a1a2-0b1e8da69831", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-522016048-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "336c00bdba004c87ad422bb2dde66117", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap68799562-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:46:26.918624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Releasing lock "refresh_cache-bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:46:26.920497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4959cbf8-0f5d-4f02-bf7c-1de92b07237e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action" status: 202 len: 0 microversion: 2.1 time: 4.991991 Sep 19 14:46:26.937652 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 900/1819] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:46:21 2022] POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action => generated 0 bytes in 5010 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:46:26.944879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.177"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:27.209744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:27.232630 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54e6214a-9355-4f86-b1c4-04d6792f36d7 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1473 microversion: 2.1 time: 0.717042 Sep 19 14:46:27.234786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 920/1820] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:26 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1473 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:27.258612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:27.259582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:27.271965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:27.273572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:27.274032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:27.274781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:27.275263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:27.275696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:27.620553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:27.626400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:27.628206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:27.628747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:27.629179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:27.629916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:27.633359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:27.634061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:27.823208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:27.835192 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-388863ca-8cf8-4925-95d2-1d9c625cc676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1471 microversion: 2.1 time: 0.584818 Sep 19 14:46:27.838647 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 921/1821] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:27 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1471 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:28.161294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "refresh_cache-bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:46:28.161769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquired lock "refresh_cache-bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:46:28.265829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:28.267108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:28.318554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.321046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.323022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.323989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.327832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.328451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.547271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4260762e3f74323bac74a519aeff94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c95dfb9f2743c9a07677bb17deabb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:28.557322 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d61d2a6-8067-4b6e-8bcd-f773f85fed55 tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 200 len: 1431 microversion: 2.1 time: 0.297208 Sep 19 14:46:28.558135 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 922/1822] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:28 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 1431 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:28.576315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:28.584558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:28.614542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.615273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.615937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.616866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.617512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.618130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.672233 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] HTTP exception thrown: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Request method failure captured: Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c HTTP/1.1 Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH_gyADoABGCJ24oeVoGNKhGcgLONVXwLUqZ9fT0LABkhG791efYx8GLYg6gW823ov7jXjGEP82AV4oiNzlVKYh8SAX7qdB4FK4YVLNiRE7ksi9xFHZo-glHS-bJV06hHvWIXJF896OqTUhsarInK9yYvoU0etPtQj9t7UVsy0XxfNU Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e642fd9f7b364b87ad1dd7a23c5e787c Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:28.674016 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e642fd9f7b364b87ad1dd7a23c5e787c"}]}] Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e642fd9f7b364b87ad1dd7a23c5e787c Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachSCSIVolumeTestJSON-1870470587-project Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c0a279d9a3d84ddea38f52728f8775dd Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1870470587-project Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.676014 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4ae3f971-6de7-44e5-a5c3-65900357963c'} Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:28.677169 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.678581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.682987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Returning 404 to user: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:28.684061 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0822d2b7-9e38-4392-ba5a-9f6664011d97 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 404 len: 111 microversion: 2.1 time: 0.125106 Sep 19 14:46:28.684667 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 923/1823] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:46:28 2022] DELETE /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:28.695068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:28.695700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] [instance: 4ae3f971-6de7-44e5-a5c3-65900357963c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:28.724371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.724893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.725348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.726107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.726582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.727065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.794550 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] HTTP exception thrown: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Request method failure captured: Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c HTTP/1.1 Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH_gyADoABGCJ24oeVoGNKhGcgLONVXwLUqZ9fT0LABkhG791efYx8GLYg6gW823ov7jXjGEP82AV4oiNzlVKYh8SAX7qdB4FK4YVLNiRE7ksi9xFHZo-glHS-bJV06hHvWIXJF896OqTUhsarInK9yYvoU0etPtQj9t7UVsy0XxfNU Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e642fd9f7b364b87ad1dd7a23c5e787c Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:28.796221 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e642fd9f7b364b87ad1dd7a23c5e787c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e642fd9f7b364b87ad1dd7a23c5e787c"}]}] Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e642fd9f7b364b87ad1dd7a23c5e787c Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1870470587 Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachSCSIVolumeTestJSON-1870470587-project Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c0a279d9a3d84ddea38f52728f8775dd Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1870470587-project Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.797811 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4ae3f971-6de7-44e5-a5c3-65900357963c'} Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:28.799877 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. Sep 19 14:46:28.801417 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:28.804252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] Returning 404 to user: Instance 4ae3f971-6de7-44e5-a5c3-65900357963c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:28.804252 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3cb69497-8290-48e2-a656-bc2a84e11a38 tempest-AttachSCSIVolumeTestJSON-1870470587 tempest-AttachSCSIVolumeTestJSON-1870470587-project] 10.222.0.81 "GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c" status: 404 len: 111 microversion: 2.1 time: 0.108905 Sep 19 14:46:28.804252 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 924/1824] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:28 2022] GET /compute/v2.1/servers/4ae3f971-6de7-44e5-a5c3-65900357963c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:46:28.860987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:28.862507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:28.879325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.883503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.884324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:28.885283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:28.889528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:28.890303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:30.852629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:30.861410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-52608abe-6d39-4e4f-b048-184bc008ba72 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 2.004168 Sep 19 14:46:30.862637 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 925/1825] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:28 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:30.876220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-438e2328-b930-47c4-9568-2273ff2d1f62 req-9007704a-0eca-4b5a-9d86-2d712de531aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cb98fa-2ced-4a43-8a85-c1f42983aafe", "name": "network-vif-deleted", "tag": "7a7b3124-1d5e-47ac-838b-f308c7da7a90"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:30.899000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:30.904906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-438e2328-b930-47c4-9568-2273ff2d1f62 req-9007704a-0eca-4b5a-9d86-2d712de531aa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:30.905778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-438e2328-b930-47c4-9568-2273ff2d1f62 req-9007704a-0eca-4b5a-9d86-2d712de531aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:30.909285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-438e2328-b930-47c4-9568-2273ff2d1f62 req-9007704a-0eca-4b5a-9d86-2d712de531aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:30.933848 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-438e2328-b930-47c4-9568-2273ff2d1f62 req-9007704a-0eca-4b5a-9d86-2d712de531aa service nova] Creating event network-vif-deleted:7a7b3124-1d5e-47ac-838b-f308c7da7a90 for instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe on n-h1-858384-1 Sep 19 14:46:30.952508 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-438e2328-b930-47c4-9568-2273ff2d1f62 req-9007704a-0eca-4b5a-9d86-2d712de531aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088349 Sep 19 14:46:30.961532 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 926/1826] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:30.967259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:30.968316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] [instance: 10cb98fa-2ced-4a43-8a85-c1f42983aafe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:30.984460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:30.985333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:30.986019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:30.987205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:30.987901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:30.988589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:31.010652 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] HTTP exception thrown: Instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe could not be found. Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Request method failure captured: Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe HTTP/1.1 Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIBB37m5yB0dDmCl44J2G26UKADGcMIu3fq7ZZ3ZRWMzj2uUHI88RXrvx7gcZmJmfglz8jJKaMAcuqYNaaEik8QqH_VS40aQXwDhB_6gEOHPVa3vlMJp59zBO52VvLLE09Udf9GDpOjh-pzdXgnDMM8xrXV7yUvJ0cgJJvqpS2woq_k Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 77c95dfb9f2743c9a07677bb17deabb0 Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:31.012908 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/77c95dfb9f2743c9a07677bb17deabb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/77c95dfb9f2743c9a07677bb17deabb0"}]}] Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 77c95dfb9f2743c9a07677bb17deabb0 Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1199590929 Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerTestJSON-1199590929-project Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c4260762e3f74323bac74a519aeff94f Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerTestJSON-1199590929-project Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe could not be found. Sep 19 14:46:31.014528 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '10cb98fa-2ced-4a43-8a85-c1f42983aafe'} Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe could not be found. Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:31.015521 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe could not be found. Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe could not be found. Sep 19 14:46:31.016958 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:31.022017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] Returning 404 to user: Instance 10cb98fa-2ced-4a43-8a85-c1f42983aafe could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:31.023293 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-80ab026a-60b9-4a9e-a76f-73cce7aef6dc tempest-ImagesOneServerTestJSON-1199590929 tempest-ImagesOneServerTestJSON-1199590929-project] 10.222.0.81 "GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe" status: 404 len: 111 microversion: 2.1 time: 0.060090 Sep 19 14:46:31.024125 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 927/1827] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:30 2022] GET /compute/v2.1/servers/10cb98fa-2ced-4a43-8a85-c1f42983aafe => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:31.889495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:31.891602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:31.925357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:31.928943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:31.931010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:31.934005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:31.939756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:31.940635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:32.269197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Building network info cache for instance {{(pid=128731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 19 14:46:33.326846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:33.340249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d0ad626e-7e2d-4b59-b96d-9711c8978f0d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 1.454899 Sep 19 14:46:33.352344 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 928/1828] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:31 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:33.363385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7535fa02-ac01-4267-b91a-b9bb8aa347fb req-676f1985-8a7c-49c0-bb8b-a47ce3e36406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:33.394570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7535fa02-ac01-4267-b91a-b9bb8aa347fb req-676f1985-8a7c-49c0-bb8b-a47ce3e36406 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:33.396692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7535fa02-ac01-4267-b91a-b9bb8aa347fb req-676f1985-8a7c-49c0-bb8b-a47ce3e36406 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:33.397386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7535fa02-ac01-4267-b91a-b9bb8aa347fb req-676f1985-8a7c-49c0-bb8b-a47ce3e36406 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:33.426062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7535fa02-ac01-4267-b91a-b9bb8aa347fb req-676f1985-8a7c-49c0-bb8b-a47ce3e36406 service nova] Creating event network-changed:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:46:33.432758 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7535fa02-ac01-4267-b91a-b9bb8aa347fb req-676f1985-8a7c-49c0-bb8b-a47ce3e36406 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078237 Sep 19 14:46:33.434952 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 929/1829] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:34.195287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:34.196712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:34.240951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:34.241768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:34.242243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:34.247810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:34.248399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:34.248860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:34.347491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:34.596240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5f5395f1-f0c3-481d-9b60-ac4985d0800e tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "DELETE /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 204 len: 0 microversion: 2.25 time: 0.403421 Sep 19 14:46:34.599373 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 930/1830] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:46:34 2022] DELETE /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 14:46:34.619036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:34.622391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:34.683807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:34.685245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:34.693932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:34.709674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:34.712534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:34.715364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:36.527001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:36.556721 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-decf8502-0e58-4864-8a11-caeb5985c261 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 1.950794 Sep 19 14:46:36.573026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 931/1831] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:34 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:36.589000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:36.590684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:36.605249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:36.606672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:36.607388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:36.608414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:36.610010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:36.619484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:36.995783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Updating instance_info_cache with network_info: [{"id": "68799562-64e9-400b-82a1-3c05bde1a7e1", "address": "fa:16:3e:91:57:f6", "network": {"id": "fec2220e-6bd6-451c-a1a2-0b1e8da69831", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-522016048-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "336c00bdba004c87ad422bb2dde66117", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap68799562-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:46:37.023962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Releasing lock "refresh_cache-bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" {{(pid=128731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:46:37.032920 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbb8bf14-f688-4aba-b2f0-9ada30867c1d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action" status: 202 len: 0 microversion: 2.1 time: 10.088915 Sep 19 14:46:37.040397 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 901/1832] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:46:26 2022] POST /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06/action => generated 0 bytes in 10102 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 19 14:46:37.048378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba7a3b12-0db8-4bd6-976c-93d30efd824d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '.version_select at 0x7fde29903430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:37.406365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:37.429960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:37.433708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:37.436877 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1ac5bd3-e3b0-4824-aab8-05dc1adf19a2 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1731 microversion: 2.25 time: 0.861829 Sep 19 14:46:37.438705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 932/1833] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:36 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1731 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:37.593773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:37.594615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:37.604098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:37.604991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:37.605757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:37.606538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:37.607027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:37.607627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:37.687892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:38.274109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:38.281286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:38.284128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-564c88db-9224-4a1e-ba56-d8272dc7e1af tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 0.695011 Sep 19 14:46:38.292106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 933/1834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:37 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:38.489707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:38.491968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:38.524322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:38.525471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:38.526348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:38.527958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:38.529468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:38.533326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:38.709412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:38.720780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:38.722671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:38.724360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-782ba9c0-1277-4486-bb37-9b02f8172c9b tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1664 microversion: 2.25 time: 0.262054 Sep 19 14:46:38.739553 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 934/1835] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:38 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1664 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:39.322173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:39.323028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:39.331286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:39.332227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:39.332967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:39.333952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:39.334691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:39.335398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:39.684662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:39.696991 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e278cde-1d51-4627-9147-0cd99e16e286 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 0.383319 Sep 19 14:46:39.701980 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 935/1836] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:39 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:39.719098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6695ed8e-b78d-46bf-b273-0a5e5e9975ae req-f90f6847-b3c3-4b76-929a-e294f99044b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fba3b9-9528-42c7-a666-cbd5f158103d", "name": "network-vif-deleted", "tag": "7c91d2c7-d1d4-4305-b4a1-488ce3e7e978"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:39.739823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6695ed8e-b78d-46bf-b273-0a5e5e9975ae req-f90f6847-b3c3-4b76-929a-e294f99044b9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:39.741161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6695ed8e-b78d-46bf-b273-0a5e5e9975ae req-f90f6847-b3c3-4b76-929a-e294f99044b9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:39.741843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6695ed8e-b78d-46bf-b273-0a5e5e9975ae req-f90f6847-b3c3-4b76-929a-e294f99044b9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:39.769097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6695ed8e-b78d-46bf-b273-0a5e5e9975ae req-f90f6847-b3c3-4b76-929a-e294f99044b9 service nova] Creating event network-vif-deleted:7c91d2c7-d1d4-4305-b4a1-488ce3e7e978 for instance 94fba3b9-9528-42c7-a666-cbd5f158103d on n-h2-858384-1 Sep 19 14:46:39.775774 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6695ed8e-b78d-46bf-b273-0a5e5e9975ae req-f90f6847-b3c3-4b76-929a-e294f99044b9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071607 Sep 19 14:46:39.777160 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 936/1837] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:39.785337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:39.786453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:39.802656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:39.803712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:39.804700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:39.805903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:39.806871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:39.821632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:40.808653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:40.819880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:40.828200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:40.832173 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-05d54b72-608c-49df-9c63-77a2483f77a3 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 200 len: 1371 microversion: 2.25 time: 1.053511 Sep 19 14:46:40.847768 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 937/1838] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:39 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 1371 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:40.866258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:40.875163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:40.882805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:40.883264 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba7a3b12-0db8-4bd6-976c-93d30efd824d tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/6ae7e857-90d6-437e-9e76-d9b68c7c89d9" status: 202 len: 0 microversion: 2.1 time: 3.839667 Sep 19 14:46:40.887686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:40.888001 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 902/1839] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:46:37 2022] DELETE /compute/v2.1/os-floating-ips/6ae7e857-90d6-437e-9e76-d9b68c7c89d9 => generated 0 bytes in 3847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:40.888227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:40.888817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:40.889553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:40.893625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:40.900054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9434ad6e-7a35-4adc-9242-5862b8a7f82e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '.version_select at 0x7fde298a8c10>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:41.300178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:41.319407 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d0510b31-e7d0-47c8-a855-65e4fa0ba4ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 0.457542 Sep 19 14:46:41.320420 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 938/1840] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:40 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:41.609182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9434ad6e-7a35-4adc-9242-5862b8a7f82e tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/1d840d4e-ae8c-4e83-9923-ae62cbe11b32" status: 202 len: 0 microversion: 2.1 time: 0.714461 Sep 19 14:46:41.610061 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 903/1841] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:46:40 2022] DELETE /compute/v2.1/os-security-groups/1d840d4e-ae8c-4e83-9923-ae62cbe11b32 => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:46:41.619900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:41.620909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:41.636584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:41.637955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:41.639569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:41.640700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:41.642830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:41.644980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:41.708949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:41.848673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3facac66-b252-4535-980f-fe061ecab602 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 204 len: 0 microversion: 2.1 time: 0.232914 Sep 19 14:46:41.849374 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 939/1842] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:46:41 2022] DELETE /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:46:41.860049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:41.863470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:41.878337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:41.886452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:41.887170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:41.887384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 94fba3b9-9528-42c7-a666-cbd5f158103d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:41.891594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:41.896874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:41.900492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:41.901049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:41.910260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:41.914980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:41.915617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:41.916384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:41.923292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:41.926673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:41.977967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] HTTP exception thrown: Instance 94fba3b9-9528-42c7-a666-cbd5f158103d could not be found. Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Request method failure captured: Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d HTTP/1.1 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKH7nL560JA3IfmG-oi0wwmcrr7mNQLowZtXZfUWymymfRFqexE2qnazRP-3asnJEs23hDCt7DxfSIXAdAodbw7AjKPVsD5TrfMGeGkSaGSPzjq6v4QNMxrhswOJYopzYtwi-rFvYIKviVr1c0mqev145jhv8vkc4j8lY92M34fPzUdc Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.25 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:46:41.991557 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a64d6b46c4541198f372d1f74417498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a64d6b46c4541198f372d1f74417498"}]}] Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 79d78edfe25746049a02a43130f1df11 Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 94fba3b9-9528-42c7-a666-cbd5f158103d could not be found. Sep 19 14:46:41.993672 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '94fba3b9-9528-42c7-a666-cbd5f158103d'} Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94fba3b9-9528-42c7-a666-cbd5f158103d could not be found. Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:41.994788 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94fba3b9-9528-42c7-a666-cbd5f158103d could not be found. Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94fba3b9-9528-42c7-a666-cbd5f158103d could not be found. Sep 19 14:46:41.996734 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:46:41.999750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Returning 404 to user: Instance 94fba3b9-9528-42c7-a666-cbd5f158103d could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:42.001416 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25194744-d8ec-42b4-908b-087316f23345 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d" status: 404 len: 111 microversion: 2.25 time: 0.135562 Sep 19 14:46:42.007060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 940/1843] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:41 2022] GET /compute/v2.1/servers/94fba3b9-9528-42c7-a666-cbd5f158103d => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:46:42.016487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25e62825-25d1-4f92-9654-3980ba4cae08 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '.version_select at 0x7fde29985820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:42.053928 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25e62825-25d1-4f92-9654-3980ba4cae08 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182171430" status: 204 len: 0 microversion: 2.25 time: 0.041355 Sep 19 14:46:42.057856 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 941/1844] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 14:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182171430 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:46:42.350497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:42.353646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:42.354920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:42.369709 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71a9cf7e-6904-40aa-9140-d9a83a359402 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1510 microversion: 2.1 time: 0.515242 Sep 19 14:46:42.374769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:42.378571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 904/1845] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:41 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:42.379678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:42.380381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:42.384250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:42.385072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:42.387245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:43.015504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:43.035172 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-92e334f9-ab0a-45b9-9022-6d15d2a0365b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 0.688668 Sep 19 14:46:43.059371 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 942/1846] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:42 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:43.422662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:43.449917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:43.469523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:43.471471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:43.472861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:43.473961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:43.474726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:43.476513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:44.082635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:44.110768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:44.137778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:44.149276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:44.151310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:44.155125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:44.156414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:44.159387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:44.592702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:44.609150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f6c8669-ef0c-4a9f-8b5e-4f4e69eb779a tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1510 microversion: 2.1 time: 1.203679 Sep 19 14:46:44.611404 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 905/1847] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:43 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1510 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:44.622572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:44.624492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:44.635287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:44.636409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:44.637286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:44.638457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:44.639645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:44.640415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:44.683830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:44.727987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:44.739935 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-860f3bcb-f7f7-431f-a5f0-46f799aaf305 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 0.679836 Sep 19 14:46:44.744976 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 943/1848] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:44 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:44.832888 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dfcef3b8-d73c-403a-9a99-94cf81a6c884 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 204 len: 0 microversion: 2.25 time: 0.219130 Sep 19 14:46:44.834157 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 906/1849] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:46:44 2022] DELETE /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:46:44.842318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:44.842992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:44.855585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:44.858086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:44.859384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:44.861884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:44.863000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:44.863878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:45.112074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:45.134060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:45.137846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:45.144814 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82f7d504-6df6-4f1c-9dcd-cc27ed5b03a7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1548 microversion: 2.25 time: 0.306518 Sep 19 14:46:45.173599 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 944/1850] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:44 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1548 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:45.644623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:45.646879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:45.659684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:45.660717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:45.661533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:45.662485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:45.663435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:45.664161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:45.780462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:45.781435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:45.790575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:45.791386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:45.792069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:45.792989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:45.793643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:45.794425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:46.214040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:46.243806 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2223e85-f27d-4b42-aacc-138f7d66f257 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1510 microversion: 2.1 time: 0.607163 Sep 19 14:46:46.263009 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 907/1851] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:45 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1510 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:46.274126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:46.275148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:46.283835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:46.284806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:46.285707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:46.286668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:46.287405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:46.288138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:46.307764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:46.331093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc2765b4-2875-4742-91aa-3f9bbe2e88bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1476 microversion: 2.1 time: 0.553813 Sep 19 14:46:46.333930 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 945/1852] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:45 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:46.536648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:46.553642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:46.560721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:46.567579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8feebf5f-7a9d-4630-9728-4c8c32daaf92 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 200 len: 1506 microversion: 2.25 time: 0.299621 Sep 19 14:46:46.572043 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 908/1853] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:46 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:46.588302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3c8008ab-8f60-4fcb-838d-ed586f461fc8 req-e83ac1c9-9fa5-420e-9352-fadb0c6c4718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee743740-af6b-4413-85fc-0b23e4e3bb36", "name": "network-vif-deleted", "tag": "bedfe11b-122c-4ed5-93b4-13b7e2892b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:46.621510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3c8008ab-8f60-4fcb-838d-ed586f461fc8 req-e83ac1c9-9fa5-420e-9352-fadb0c6c4718 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:46.623403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3c8008ab-8f60-4fcb-838d-ed586f461fc8 req-e83ac1c9-9fa5-420e-9352-fadb0c6c4718 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:46.627574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3c8008ab-8f60-4fcb-838d-ed586f461fc8 req-e83ac1c9-9fa5-420e-9352-fadb0c6c4718 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:46.655234 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3c8008ab-8f60-4fcb-838d-ed586f461fc8 req-e83ac1c9-9fa5-420e-9352-fadb0c6c4718 service nova] Creating event network-vif-deleted:bedfe11b-122c-4ed5-93b4-13b7e2892b3a for instance ee743740-af6b-4413-85fc-0b23e4e3bb36 on n-h2-858384-1 Sep 19 14:46:46.667977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3c8008ab-8f60-4fcb-838d-ed586f461fc8 req-e83ac1c9-9fa5-420e-9352-fadb0c6c4718 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086975 Sep 19 14:46:46.670136 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 946/1854] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:47.273756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:47.281536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:47.300032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.301143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.302940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.303958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.304634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.305413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.372308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:47.373679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:47.386324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.388857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.389689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.390369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.391017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.393734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lazy-loading 'fault' on Instance uuid bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:46:47.394641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.395589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.396226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.398030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.663728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763b0d6ea07d4a38b8fd44aa39e99a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336c00bdba004c87ad422bb2dde66117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:47.679108 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f1295b8-da8a-4b6c-8345-f9b5b882b1e9 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 200 len: 1313 microversion: 2.1 time: 0.408600 Sep 19 14:46:47.680130 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 909/1855] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:47 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:47.705325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:47.706390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: ee743740-af6b-4413-85fc-0b23e4e3bb36] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:47.718185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.724287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.725116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.726117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.734364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.735604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.767810 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] HTTP exception thrown: Instance ee743740-af6b-4413-85fc-0b23e4e3bb36 could not be found. Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Request method failure captured: Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 HTTP/1.1 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7nL560JA3IfmG-oi0wwmcrr7mNQLowZtXZfUWymymfRFqexE2qnazRP-3asnJEs23hDCt7DxfSIXAdAodbw7AjKPVsD5TrfMGeGkSaGSPzjq6v4QNMxrhswOJYopzYtwi-rFvYIKviVr1c0mqev145jhv8vkc4j8lY92M34fPzUdc Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.25 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:46:47.776462 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a64d6b46c4541198f372d1f74417498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a64d6b46c4541198f372d1f74417498"}]}] Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 79d78edfe25746049a02a43130f1df11 Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ee743740-af6b-4413-85fc-0b23e4e3bb36 could not be found. Sep 19 14:46:47.778163 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ee743740-af6b-4413-85fc-0b23e4e3bb36'} Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee743740-af6b-4413-85fc-0b23e4e3bb36 could not be found. Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:47.779209 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee743740-af6b-4413-85fc-0b23e4e3bb36 could not be found. Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee743740-af6b-4413-85fc-0b23e4e3bb36 could not be found. Sep 19 14:46:47.780660 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:47.784884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Returning 404 to user: Instance ee743740-af6b-4413-85fc-0b23e4e3bb36 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:47.786041 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a5d13149-ab4e-43a8-a814-ecc66949badf tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36" status: 404 len: 111 microversion: 2.25 time: 0.102254 Sep 19 14:46:47.786887 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 910/1856] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:47 2022] GET /compute/v2.1/servers/ee743740-af6b-4413-85fc-0b23e4e3bb36 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:46:47.799045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:47.799859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:47.817962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.821016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.823105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.824015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:47.824511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:47.825055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:47.873040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:46:47.909905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:47.919648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f8fffad0-5915-4a8a-bb27-ad9c722e2631 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1475 microversion: 2.1 time: 0.557013 Sep 19 14:46:47.937185 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 947/1857] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:47 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1475 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:47.991738 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b057169-72bf-4b68-af2f-b8c1530aecd7 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 204 len: 0 microversion: 2.25 time: 0.199827 Sep 19 14:46:47.995614 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 911/1858] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:46:47 2022] DELETE /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:46:48.002016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:48.002733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:48.019987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:48.021466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:48.022142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:48.023377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:48.024067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:48.024705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:48.333278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:48.347946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:48.349964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:48.354626 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d65be60-0106-4bac-a3a7-936cf9fdc927 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1564 microversion: 2.25 time: 0.356735 Sep 19 14:46:48.357217 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 948/1859] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:47 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1564 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:46:48.715236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:48.715958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] [instance: bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:48.730596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:48.731115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:48.736319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:48.738197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:48.739320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:48.767956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:48.807449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] HTTP exception thrown: Instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 could not be found. Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Request method failure captured: Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 HTTP/1.1 Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIBwZoWfSlkmjzuL0g3_bZRoHwHnluSJbpudDusptnx9hCDgAr3OF_8abiZDku7eFZ55mngwWtAUnoku0mE_zXuW5ZKVZOm05rdlITd4m-gxcAg1Ew8wl8ycGkEzOu9Ft_nuY40ciBy6sGB8MjtFAHBQJ9OpA9TCGAM8rv_vbrrcIFw Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 336c00bdba004c87ad422bb2dde66117 Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1129627425 Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:46:48.809350 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_336c00bdba004c87ad422bb2dde66117"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/336c00bdba004c87ad422bb2dde66117"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/336c00bdba004c87ad422bb2dde66117"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/336c00bdba004c87ad422bb2dde66117"}]}] Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1129627425 Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 336c00bdba004c87ad422bb2dde66117 Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1129627425 Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerRescueTestJSONUnderV235-1129627425-project Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 763b0d6ea07d4a38b8fd44aa39e99a84 Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1129627425-project Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 could not be found. Sep 19 14:46:48.811265 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06'} Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 could not be found. Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:48.812389 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 could not be found. Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 could not be found. Sep 19 14:46:48.814962 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:48.817157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] Returning 404 to user: Instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:48.819840 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3640e916-9db2-439f-bc4f-c08ab6077896 tempest-ServerRescueTestJSONUnderV235-1129627425 tempest-ServerRescueTestJSONUnderV235-1129627425-project] 10.222.0.81 "GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06" status: 404 len: 111 microversion: 2.1 time: 0.116995 Sep 19 14:46:48.823276 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 912/1860] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:48 2022] GET /compute/v2.1/servers/bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:46:48.945524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:48.946315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:48.959372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:48.960885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:48.962969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:48.964384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:48.966495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:48.968094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:49.018505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06", "name": "network-vif-deleted", "tag": "68799562-64e9-400b-82a1-3c05bde1a7e1"}, {"server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "name": "network-vif-unplugged", "status": "completed", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:49.047262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:49.048285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:49.048777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:49.111942 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Creating event network-vif-deleted:68799562-64e9-400b-82a1-3c05bde1a7e1 for instance bf232b8c-d6f9-482c-aa9d-d5b0ec0edd06 on n-h1-858384-1 Sep 19 14:46:49.123162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Creating event network-vif-unplugged:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h2-858384-1 Sep 19 14:46:49.145734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:46:49.191536 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-668afc75-4637-4dae-b32c-3b1dbfd6189b req-6b316de7-a619-41bf-9b50-55ec28e7eba7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.181495 Sep 19 14:46:49.195518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 913/1861] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:46:49.397214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:49.398158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:49.414485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:49.415273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:49.415909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:49.417377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:49.431617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:49.432190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:49.630010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:49.634990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:49.651317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:49.656068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d78edfe25746049a02a43130f1df11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64d6b46c4541198f372d1f74417498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:49.660469 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cd661510-fdf6-4ec6-a8c9-c5070db8be78 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 200 len: 1347 microversion: 2.25 time: 0.277974 Sep 19 14:46:49.663163 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 914/1862] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:49 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 1347 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:49.862700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:49.877598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bde48a8f-c4b2-4816-af7c-c1ed90c22a1d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1475 microversion: 2.1 time: 0.935386 Sep 19 14:46:49.888164 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 949/1863] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:48 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1475 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:50.691071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:50.691687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] [instance: 09f71947-2bb8-4578-85f9-29c818e8d88a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:50.700867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:50.701375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:50.701849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:50.702511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:50.702999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:50.703713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:50.720782 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] HTTP exception thrown: Instance 09f71947-2bb8-4578-85f9-29c818e8d88a could not be found. Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Request method failure captured: Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a HTTP/1.1 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKH7nL560JA3IfmG-oi0wwmcrr7mNQLowZtXZfUWymymfRFqexE2qnazRP-3asnJEs23hDCt7DxfSIXAdAodbw7AjKPVsD5TrfMGeGkSaGSPzjq6v4QNMxrhswOJYopzYtwi-rFvYIKviVr1c0mqev145jhv8vkc4j8lY92M34fPzUdc Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.25 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:46:50.722969 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a64d6b46c4541198f372d1f74417498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a64d6b46c4541198f372d1f74417498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a64d6b46c4541198f372d1f74417498"}]}] Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6a64d6b46c4541198f372d1f74417498 Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-529271648 Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 79d78edfe25746049a02a43130f1df11 Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-529271648-project Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 09f71947-2bb8-4578-85f9-29c818e8d88a could not be found. Sep 19 14:46:50.724727 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '09f71947-2bb8-4578-85f9-29c818e8d88a'} Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f71947-2bb8-4578-85f9-29c818e8d88a could not be found. Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:50.725616 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f71947-2bb8-4578-85f9-29c818e8d88a could not be found. Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f71947-2bb8-4578-85f9-29c818e8d88a could not be found. Sep 19 14:46:50.727075 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:46:50.730254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] Returning 404 to user: Instance 09f71947-2bb8-4578-85f9-29c818e8d88a could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:50.731297 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-026fcee7-28ad-4825-8f52-efd8dd77b200 tempest-LiveAutoBlockMigrationV225Test-529271648 tempest-LiveAutoBlockMigrationV225Test-529271648-project] 10.222.0.81 "GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a" status: 404 len: 111 microversion: 2.25 time: 0.044935 Sep 19 14:46:50.731973 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 915/1864] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:46:50 2022] GET /compute/v2.1/servers/09f71947-2bb8-4578-85f9-29c818e8d88a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:46:50.905684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:50.906330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:50.926906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:50.927852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:50.928547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:50.929544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:50.930261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:50.930972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:51.279426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}, {"server_uuid": "09f71947-2bb8-4578-85f9-29c818e8d88a", "name": "network-vif-deleted", "tag": "f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:51.298739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:51.301227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:51.304198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:51.331997 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Creating event network-changed:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h2-858384-1 Sep 19 14:46:51.332924 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Creating event network-vif-deleted:f7423d69-7e2d-48fe-97f7-0f1c8f5c4d74 for instance 09f71947-2bb8-4578-85f9-29c818e8d88a on n-h2-858384-1 Sep 19 14:46:51.340141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:46:51.355683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e4644ba6-c5ed-4b7b-985f-e92113207a8d req-215b3cac-2738-408e-a8ef-e72fd3acac99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080520 Sep 19 14:46:51.356908 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 916/1865] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:51.517216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:51.534968 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b02d192f-76f4-45c1-8091-ae0f41743de2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1473 microversion: 2.1 time: 0.630410 Sep 19 14:46:51.537543 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 950/1866] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:50 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1473 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:52.579448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:52.581159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:52.591439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:52.592627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:52.593590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:52.595214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:52.596188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:52.596799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:53.094834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:53.103698 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79db6da7-eab8-442e-8d85-a796076031bc tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1470 microversion: 2.1 time: 0.545668 Sep 19 14:46:53.112150 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 917/1867] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:52 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:53.138184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:53.138910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:53.151308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:53.158038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:53.162613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:53.163927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:53.164816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:53.165541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:53.245217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:53.353074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa6dbdb4-43af-40f9-9357-86cf6b7eea4c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f/action" status: 204 len: 0 microversion: 2.1 time: 0.218086 Sep 19 14:46:53.357156 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 951/1868] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:46:53 2022] POST /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:46:53.366187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:53.366368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:53.397475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:53.402033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:53.402499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:53.414062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:53.414571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:53.415045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:53.458545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8baa76b4-7335-464a-bf90-4539760e62d6 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde2e2ae820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-308052317", "description": "tempest-description-1253785671"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:54.509025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:54.536080 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62d6fc21-7b5f-4562-b342-b867be0ba491 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1470 microversion: 2.1 time: 1.177534 Sep 19 14:46:54.537488 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 952/1869] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:53 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1470 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:54.869608 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8baa76b4-7335-464a-bf90-4539760e62d6 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.692575 Sep 19 14:46:54.874047 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 918/1870] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:46:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:46:54.898897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-40b9c7eb-9f0b-4fd5-be7e-cc2d13805d0b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde298635e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1281729427", "description": "tempest-description-434651269"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:55.006840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "name": "network-vif-plugged", "status": "completed", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:55.028312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:55.029109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:55.029787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:55.046382 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] Creating event network-vif-plugged:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h2-858384-1 Sep 19 14:46:55.055187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:46:55.071388 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-065347ea-ce97-435e-bf51-fe44bff86117 req-e17e0f63-debf-4bbc-ae19-2125b3c0ce44 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068242 Sep 19 14:46:55.072812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 919/1871] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:55.569141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:55.570036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:55.582307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:55.583159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:55.584105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:55.585656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:55.586417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:55.588460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:56.233662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-40b9c7eb-9f0b-4fd5-be7e-cc2d13805d0b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.349770 Sep 19 14:46:56.239843 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 953/1872] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:46:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:56.353724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1755498193", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "ab8155bb-1643-4a4f-b80c-2fe8e1d41d93"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:56.461760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] validate_networks() for [('ab8155bb-1643-4a4f-b80c-2fe8e1d41d93', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:46:56.653059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:56.706897 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e87dd7c4-45bf-463e-add2-86b813d9371b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1470 microversion: 2.1 time: 1.143352 Sep 19 14:46:56.707598 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 920/1873] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:55 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1470 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:57.731661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:57.733410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:57.745809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:57.747624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:57.751792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:57.753199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:57.754213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:57.755251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:58.768898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:46:58.769436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:46:58.769815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:46:58.770232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:46:58.770652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:46:58.799435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:58.799961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:58.800876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:58.801994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:46:58.802956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:46:58.803623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:46:58.865106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Getting quotas for project 24fe599a0fd746e6861a30dc82e1e060. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:46:58.882630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Getting quotas for user 3b698695cf7f467da5b0d5273c3795a5 and project 24fe599a0fd746e6861a30dc82e1e060. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:46:58.920506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:46:58.935494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:46:59.058677 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a592a9c-5a6b-420f-9e02-2fb3da51d398 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.702645 Sep 19 14:46:59.066226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 954/1874] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:46:59.087930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-365629b6-a047-45f5-822b-3f46a42b5a24 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:59.088562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-365629b6-a047-45f5-822b-3f46a42b5a24 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:46:59.173839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:59.196986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f1e55503-42ba-4b62-8291-4144fb106085 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1470 microversion: 2.1 time: 1.468192 Sep 19 14:46:59.199345 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 921/1875] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:57 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1470 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:46:59.291928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-365629b6-a047-45f5-822b-3f46a42b5a24 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:46:59.301867 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-365629b6-a047-45f5-822b-3f46a42b5a24 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1216 microversion: 2.1 time: 0.230463 Sep 19 14:46:59.326876 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 955/1876] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:46:59 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1216 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:47:00.229095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:00.229766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:00.246513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:00.251470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:00.255475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:00.256909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:00.257556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:00.258165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:00.349884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:00.350522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:00.364292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:00.364802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:00.367868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:00.369574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:00.371361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:00.372520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:00.785566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:00.794805 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aaf74af1-aa3c-426c-add6-26f2f91ada64 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1220 microversion: 2.1 time: 0.455411 Sep 19 14:47:00.798865 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 956/1877] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:00 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1220 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:47:01.008359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:01.043644 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aacac3b2-730a-47e6-b0e0-f7b0f4b6c886 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1462 microversion: 2.1 time: 0.817461 Sep 19 14:47:01.047510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 922/1878] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:00 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1462 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:01.076074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:01.076704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:01.092838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:01.093900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:01.094508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:01.095099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:01.095562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:01.095991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:02.133071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1441126035", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "f9e16d8c-98c4-40ea-9b7b-262bffe3641c"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:02.263875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] validate_networks() for [('f9e16d8c-98c4-40ea-9b7b-262bffe3641c', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:02.752159 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e9eca5e-d860-45e1-9fed-19dc324090a0 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1613 microversion: 2.1 time: 1.679347 Sep 19 14:47:02.754913 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 957/1879] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:01 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1613 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:02.766132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:02.768056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:02.778648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:02.782716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:02.784097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:02.785269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:02.788081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:02.789389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:02.790508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:03.088573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:03.102378 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e445ffc3-4f24-4ba6-ad64-8c5a270c74e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1274 microversion: 2.1 time: 0.345339 Sep 19 14:47:03.103386 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 958/1880] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:02 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:03.117093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4cd9d001-3248-4d85-a89d-d5d28a4d050b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '.version_select at 0x7fde2a81bd30>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:03.120907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd9d001-3248-4d85-a89d-d5d28a4d050b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:03.121395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd9d001-3248-4d85-a89d-d5d28a4d050b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:03.121986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4cd9d001-3248-4d85-a89d-d5d28a4d050b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:03.143882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4cd9d001-3248-4d85-a89d-d5d28a4d050b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.035121 Sep 19 14:47:03.146167 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 959/1881] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:47:03 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:03.402317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-242110872", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:03.465175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:06.439133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:06.440588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:06.441312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:06.442128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:06.442849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:06.462977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:06.466662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:06.474263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:06.481064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:06.483016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:06.485727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:06.565226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for project 70b97b22e77c48d59731205c993e5789. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:06.578214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for user e40c5acb3fa44fe2b0aa0696e3dcf8c2 and project 70b97b22e77c48d59731205c993e5789. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:06.616584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:47:06.620141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:47:06.801082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b0d9d97a-c33d-4495-a090-12b5fa044a68 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.209460 Sep 19 14:47:06.808994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 923/1882] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 5218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:47:06.837157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:06.842032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:06.889972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:06.908819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:06.909380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:06.910226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:06.910834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:06.912540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:07.150405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:07.151048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:07.151411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:07.151820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:07.152235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:07.177699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:07.179102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:07.180191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:07.186305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:07.187776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:07.189121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:07.227146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:07.237093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for user e2149c78b4d04c10b02d521a5635b29f and project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:07.255104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:47:07.258076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:47:07.282847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:07.293638 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a674a375-d2f6-48b3-946c-36be868a794a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1274 microversion: 2.1 time: 0.480900 Sep 19 14:47:07.307357 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 924/1883] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:06 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1274 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:07.399112 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ade192a2-d73f-4dbb-b671-4efea0947956 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.008815 Sep 19 14:47:07.404746 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 960/1884] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:47:07.843417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-826372995", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "779ee5e7-92ae-45cf-806b-a3db91dc090f"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:07.862687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:07.882680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3894380e-6fd5-474b-bf35-0cb9e0ed9749 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:07.922578 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3894380e-6fd5-474b-bf35-0cb9e0ed9749 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.501456 Sep 19 14:47:07.935547 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 961/1885] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:07.941546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:07.942556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:07.956379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] validate_networks() for [('779ee5e7-92ae-45cf-806b-a3db91dc090f', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:07.957575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:07.959561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:07.960325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:07.962217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:07.963115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:07.963810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:08.460889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:08.472396 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dec3df68-8ead-4a57-ba3d-4f622ba7b060 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1229 microversion: 2.1 time: 0.535343 Sep 19 14:47:08.480747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 962/1886] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:07 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1229 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:08.909159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9acd0f28-a587-48be-a388-dc03c0060cf3 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Action: 'create', calling method: .version_select at 0x7fde29830d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1236754339", "metadata": {"Type": "work"}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9acd0f28-a587-48be-a388-dc03c0060cf3 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Request method failure captured: Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 122 Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDr68w8C_doolup3MHq6eNwA69fA3XuQwmZjc-IP_mH8n-OmzTkTuD7nOC_6K4FSA2PF6adcySZHiVDAWCIXkf-MrO6nmoGSeCLRcZ5gxQQ1wgcazIYWDL0bFQrdoIPJ89iA-fhh8aNkNUy-lRjQ9ZxKEDlNdRnmNQDf6zyuc6aJIU Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:08.915579 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0c6501d49cac40a793102374f083315a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0c6501d49cac40a793102374f083315a"}]}] Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 01e647db9d84480f99ca7199d52a648a Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1236754339", "metadata": {"Type": "work"}}} Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:47:08.916598 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1236754339', 'metadata': {'Type': 'work'}}}} Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:08.917264 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:47:08.918235 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:47:08.919202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 14:47:08.919202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:08.923857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9acd0f28-a587-48be-a388-dc03c0060cf3 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:08.927791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9acd0f28-a587-48be-a388-dc03c0060cf3 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.445694 Sep 19 14:47:08.928988 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 963/1887] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 14:47:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 447 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:47:08.942314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:08.943369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:08.962488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:08.965204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:08.965960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:08.970874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:08.972253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:08.973067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:09.455102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:09.455645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:09.455995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:09.456397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:09.456988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:09.474137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:09.479307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:09.480001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:09.482447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:09.488713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:09.489737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:09.555400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:09.571734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for user b469a10b494b4876896c5300aa676b46 and project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:09.601051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:47:09.603558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:47:09.700363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a0993c55-8c1f-42c6-bb8d-595abd733f3c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.401323 Sep 19 14:47:09.704368 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 925/1888] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:47:09.720865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4c3884c-e7d6-4bb3-8454-1a627e9326fd tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:09.758882 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4c3884c-e7d6-4bb3-8454-1a627e9326fd tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.052970 Sep 19 14:47:09.759485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 926/1889] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:47:09 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:09.769369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:09.769369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:09.788171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:09.791061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:09.792398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:09.794872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:09.799199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:09.799847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:09.958671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:09.987836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04622de8-a403-4a58-acd0-c994521211a3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1216 microversion: 2.1 time: 1.057498 Sep 19 14:47:09.988765 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 964/1890] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:08 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1216 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:10.007610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393249e5-3b42-4abf-801c-4855d8a40afb tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Action: 'create', calling method: .version_select at 0x7fde29816040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1034480065", "metadata": {"Type": "work"}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393249e5-3b42-4abf-801c-4855d8a40afb tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Request method failure captured: Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 120 Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDr68w8C_doolup3MHq6eNwA69fA3XuQwmZjc-IP_mH8n-OmzTkTuD7nOC_6K4FSA2PF6adcySZHiVDAWCIXkf-MrO6nmoGSeCLRcZ5gxQQ1wgcazIYWDL0bFQrdoIPJ89iA-fhh8aNkNUy-lRjQ9ZxKEDlNdRnmNQDf6zyuc6aJIU Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:10.011711 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0c6501d49cac40a793102374f083315a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0c6501d49cac40a793102374f083315a"}]}] Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 01e647db9d84480f99ca7199d52a648a Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1034480065", "metadata": {"Type": "work"}}} Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:47:10.012743 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1034480065', 'metadata': {'Type': 'work'}}}} Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi '0' Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:10.013348 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:47:10.014619 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:47:10.015519 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 14:47:10.015519 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.019732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393249e5-3b42-4abf-801c-4855d8a40afb tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:10.032471 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-393249e5-3b42-4abf-801c-4855d8a40afb tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.042506 Sep 19 14:47:10.033327 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 965/1891] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 14:47:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:47:10.049312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:10.059469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:10.080760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:10.081609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:10.082273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:10.083331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:10.083981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:10.084615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:10.477001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:10.491890 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e911e8e4-0f0f-476e-a0bb-105a117b52d4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1283 microversion: 2.1 time: 0.455916 Sep 19 14:47:10.494498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 966/1892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:10 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1283 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:10.519807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd2220e8-9dde-494f-8981-4ce748bbed23 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:10.520802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd2220e8-9dde-494f-8981-4ce748bbed23 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:10.868091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd2220e8-9dde-494f-8981-4ce748bbed23 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:10.877698 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd2220e8-9dde-494f-8981-4ce748bbed23 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1207 microversion: 2.1 time: 0.381771 Sep 19 14:47:10.896803 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 967/1893] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:10 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1207 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:10.903157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-032e7c5f-5f72-45f8-8be7-1b46858ccefb tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:10.916228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-032e7c5f-5f72-45f8-8be7-1b46858ccefb tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017890 Sep 19 14:47:10.916989 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 968/1894] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:10.934657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bdd2780c-1603-4975-8f59-73449d02f51c tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Action: 'create', calling method: .version_select at 0x7fde29a9d790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-227516735", "metadata": {"Type": "work"}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bdd2780c-1603-4975-8f59-73449d02f51c tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Request method failure captured: Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 118 Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDr68w8C_doolup3MHq6eNwA69fA3XuQwmZjc-IP_mH8n-OmzTkTuD7nOC_6K4FSA2PF6adcySZHiVDAWCIXkf-MrO6nmoGSeCLRcZ5gxQQ1wgcazIYWDL0bFQrdoIPJ89iA-fhh8aNkNUy-lRjQ9ZxKEDlNdRnmNQDf6zyuc6aJIU Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:10.941921 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0c6501d49cac40a793102374f083315a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0c6501d49cac40a793102374f083315a"}]}] Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 01e647db9d84480f99ca7199d52a648a Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-227516735", "metadata": {"Type": "work"}}} Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:47:10.943581 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-227516735', 'metadata': {'Type': 'work'}}}} Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi '' Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:10.944498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:47:10.945769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:47:10.947010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 14:47:10.947010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:10.948030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bdd2780c-1603-4975-8f59-73449d02f51c tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:10.952668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bdd2780c-1603-4975-8f59-73449d02f51c tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021503 Sep 19 14:47:10.953981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 969/1895] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 14:47:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:47:10.970533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dcb7d206-66ee-46de-b027-f2da5a5b78d6 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:10.990236 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dcb7d206-66ee-46de-b027-f2da5a5b78d6 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035132 Sep 19 14:47:10.990857 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 970/1896] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:11.003757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd3f5f52-c24d-4f62-ad66-754fc27ae83b tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Calling method '.version_select at 0x7fde29a0f430>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.099870 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-bd3f5f52-c24d-4f62-ad66-754fc27ae83b tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] HTTP exception thrown: Volume tempest-invalid-1335260981 could not be found. Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd3f5f52-c24d-4f62-ad66-754fc27ae83b tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Request method failure captured: Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1335260981 HTTP/1.1 Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDr68w8C_doolup3MHq6eNwA69fA3XuQwmZjc-IP_mH8n-OmzTkTuD7nOC_6K4FSA2PF6adcySZHiVDAWCIXkf-MrO6nmoGSeCLRcZ5gxQQ1wgcazIYWDL0bFQrdoIPJ89iA-fhh8aNkNUy-lRjQ9ZxKEDlNdRnmNQDf6zyuc6aJIU Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:11.102085 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0c6501d49cac40a793102374f083315a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0c6501d49cac40a793102374f083315a"}]}] Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 01e647db9d84480f99ca7199d52a648a Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume tempest-invalid-1335260981 could not be found. Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'tempest-invalid-1335260981'} Sep 19 14:47:11.103974 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1335260981 could not be found. (HTTP 404) (Request-ID: req-2929de7a-c81b-447c-937e-9475ffd7aea7) Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.105065 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:47:11.106196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1335260981 could not be found. Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:47:11.108946 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1335260981 could not be found. Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1335260981 could not be found. Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd3f5f52-c24d-4f62-ad66-754fc27ae83b tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Returning 404 to user: Volume tempest-invalid-1335260981 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd3f5f52-c24d-4f62-ad66-754fc27ae83b tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1335260981" status: 404 len: 99 microversion: 2.1 time: 0.107187 Sep 19 14:47:11.111363 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 971/1897] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 14:47:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1335260981 => generated 99 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:47:11.118279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d27db9e1-e5e3-4fef-8e58-d0bf32ac5a2f tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.166770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:11.187380 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-831fbed5-4fb9-4a43-9fe9-61ab89adfe85 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 1.424567 Sep 19 14:47:11.192697 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d27db9e1-e5e3-4fef-8e58-d0bf32ac5a2f tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.087119 Sep 19 14:47:11.193289 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 972/1898] 10.222.0.81 () {58 vars in 1165 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:11.203653 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 927/1899] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:09 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:11.216166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.216791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:11.223514 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c685084c-c4fe-489c-ad6a-78f9c09e1410 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015166 Sep 19 14:47:11.230443 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 928/1900] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 14:47:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 14:47:11.237005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68fa2ae7-60b8-442f-a753-d81a93cb61da tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.245033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:11.245707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:11.246313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:11.247217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:11.247820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:11.249323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:11.253080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68fa2ae7-60b8-442f-a753-d81a93cb61da tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021370 Sep 19 14:47:11.253754 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 929/1901] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:11.269943 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f7f40638-862e-4654-a62a-0b838c61fe60 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014918 Sep 19 14:47:11.276274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 930/1902] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 14:47:11.283324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a8a08d0-6c58-4b47-91d2-432a9939aa0c tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.324933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a8a08d0-6c58-4b47-91d2-432a9939aa0c tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.047057 Sep 19 14:47:11.325545 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 931/1903] 10.222.0.81 () {58 vars in 1169 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:11.347113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2412c8be-5248-480e-8363-9beaeb108489 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Calling method '.version_select at 0x7fde29982550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.419008 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-2412c8be-5248-480e-8363-9beaeb108489 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] HTTP exception thrown: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2412c8be-5248-480e-8363-9beaeb108489 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Request method failure captured: Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-volumes/4433f563-21aa-46de-b37f-458090e5b731 HTTP/1.1 Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDr68w8C_doolup3MHq6eNwA69fA3XuQwmZjc-IP_mH8n-OmzTkTuD7nOC_6K4FSA2PF6adcySZHiVDAWCIXkf-MrO6nmoGSeCLRcZ5gxQQ1wgcazIYWDL0bFQrdoIPJ89iA-fhh8aNkNUy-lRjQ9ZxKEDlNdRnmNQDf6zyuc6aJIU Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:11.424932 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0c6501d49cac40a793102374f083315a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0c6501d49cac40a793102374f083315a"}]}] Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 01e647db9d84480f99ca7199d52a648a Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: exception: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4433f563-21aa-46de-b37f-458090e5b731'} Sep 19 14:47:11.426565 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. (HTTP 404) (Request-ID: req-b1dc778a-5d09-4b09-8dd2-1b820687c60e) Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.427560 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:47:11.428713 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 14:47:11.429860 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. Sep 19 14:47:11.431391 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.434306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2412c8be-5248-480e-8363-9beaeb108489 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Returning 404 to user: Volume 4433f563-21aa-46de-b37f-458090e5b731 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:11.437719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2412c8be-5248-480e-8363-9beaeb108489 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/4433f563-21aa-46de-b37f-458090e5b731" status: 404 len: 109 microversion: 2.1 time: 0.109684 Sep 19 14:47:11.447082 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 932/1904] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 14:47:11 2022] DELETE /compute/v2.1/os-volumes/4433f563-21aa-46de-b37f-458090e5b731 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:11.474564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89f8f90f-4942-4f4b-a750-51bb6ac4587d tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.510182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89f8f90f-4942-4f4b-a750-51bb6ac4587d tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.061696 Sep 19 14:47:11.521462 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 933/1905] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:11.535696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d7d755a-3ad2-4787-bde8-4b770a2731a4 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Calling method '.version_select at 0x7fde29982ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.602023 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-7d7d755a-3ad2-4787-bde8-4b770a2731a4 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] HTTP exception thrown: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d7d755a-3ad2-4787-bde8-4b770a2731a4 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Request method failure captured: Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-volumes/01bdd3d5-2858-42dd-8bce-077dd5aac125 HTTP/1.1 Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDr68w8C_doolup3MHq6eNwA69fA3XuQwmZjc-IP_mH8n-OmzTkTuD7nOC_6K4FSA2PF6adcySZHiVDAWCIXkf-MrO6nmoGSeCLRcZ5gxQQ1wgcazIYWDL0bFQrdoIPJ89iA-fhh8aNkNUy-lRjQ9ZxKEDlNdRnmNQDf6zyuc6aJIU Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:11.604901 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0c6501d49cac40a793102374f083315a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0c6501d49cac40a793102374f083315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0c6501d49cac40a793102374f083315a"}]}] Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0c6501d49cac40a793102374f083315a Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesNegativeTest-1966699738 Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 01e647db9d84480f99ca7199d52a648a Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesNegativeTest-1966699738-project Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: exception: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '01bdd3d5-2858-42dd-8bce-077dd5aac125'} Sep 19 14:47:11.606123 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. (HTTP 404) (Request-ID: req-13bbd617-3247-45e3-b129-64901bc7e6f6) Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.606933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:47:11.608635 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 14:47:11.610454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d7d755a-3ad2-4787-bde8-4b770a2731a4 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] Returning 404 to user: Volume 01bdd3d5-2858-42dd-8bce-077dd5aac125 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d7d755a-3ad2-4787-bde8-4b770a2731a4 tempest-VolumesNegativeTest-1966699738 tempest-VolumesNegativeTest-1966699738-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/01bdd3d5-2858-42dd-8bce-077dd5aac125" status: 404 len: 109 microversion: 2.1 time: 0.085408 Sep 19 14:47:11.611674 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 934/1906] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/os-volumes/01bdd3d5-2858-42dd-8bce-077dd5aac125 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:11.615200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.625983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:11.661103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:11.661891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:11.663300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:11.667251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:11.667878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:11.669109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:11.755403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:11.766883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9afda58-ccec-4a5c-9d2b-146097209585 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1270 microversion: 2.1 time: 0.572009 Sep 19 14:47:11.768204 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 973/1907] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1270 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:11.773952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-139bf4b6-205b-452f-aae0-edb3032f1bf8 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.784086 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-139bf4b6-205b-452f-aae0-edb3032f1bf8 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014587 Sep 19 14:47:11.785230 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 974/1908] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:11.809325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f63fd7aa-fc1f-449f-99ab-85af6102c97f tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.913386 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f63fd7aa-fc1f-449f-99ab-85af6102c97f tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.115544 Sep 19 14:47:11.919026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 975/1909] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:11.938254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:11.943404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:11.963729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:11.969769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:11.971228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:11.973023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:11.974100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:11.975128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:12.522416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:12.532281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c672304e-9974-4fac-beef-0bff25e6c586 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1259 microversion: 2.1 time: 0.614340 Sep 19 14:47:12.534478 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 976/1910] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1259 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:12.540791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b62fcc8f-21d8-40d4-b06f-6c3e55b622fa tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:12.550551 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b62fcc8f-21d8-40d4-b06f-6c3e55b622fa tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014628 Sep 19 14:47:12.551430 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 977/1911] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:12.557978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:12.559201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:12.566822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:12.567315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:12.567939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:12.568912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:12.569399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:12.569845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:12.744532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:12.762253 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a82ff70-8196-461e-aa57-6aad7b1bdb3a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1325 microversion: 2.1 time: 1.151329 Sep 19 14:47:12.763485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 935/1912] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:11 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1325 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:12.779577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48b16a1f-5996-477f-8665-585f9ecb00dc tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:12.825435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48b16a1f-5996-477f-8665-585f9ecb00dc tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.059659 Sep 19 14:47:12.826589 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 936/1913] 10.222.0.81 () {58 vars in 1144 bytes} [Mon Sep 19 14:47:12 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:12.832428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:12.833666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:12.841368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:12.842004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:12.843578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:12.844413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:12.845112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:12.845790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:13.122270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:13.134561 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b2317e0-825b-4e3d-9b88-18f2370251c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1270 microversion: 2.1 time: 0.306561 Sep 19 14:47:13.146771 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 937/1914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:12 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1270 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:13.146771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5037c40-f786-42e7-a55b-12ed10e211d6 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.156553 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5037c40-f786-42e7-a55b-12ed10e211d6 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015852 Sep 19 14:47:13.158869 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 938/1915] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:13.164139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a6ea0ff9-3a6a-4d38-90e6-14e02c567010 req-ea5127af-e564-4a51-9c09-846125bfb31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6453a51-ab3a-4f6d-9103-a5fa529cb918", "tag": "e67ffa41-a969-4001-bf3a-9466ac3b9254"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:13.184339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a6ea0ff9-3a6a-4d38-90e6-14e02c567010 req-ea5127af-e564-4a51-9c09-846125bfb31f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:13.185404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a6ea0ff9-3a6a-4d38-90e6-14e02c567010 req-ea5127af-e564-4a51-9c09-846125bfb31f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:13.186104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a6ea0ff9-3a6a-4d38-90e6-14e02c567010 req-ea5127af-e564-4a51-9c09-846125bfb31f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:13.208474 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a6ea0ff9-3a6a-4d38-90e6-14e02c567010 req-ea5127af-e564-4a51-9c09-846125bfb31f service nova] Creating event network-changed:e67ffa41-a969-4001-bf3a-9466ac3b9254 for instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 on n-h1-858384-1 Sep 19 14:47:13.216875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a6ea0ff9-3a6a-4d38-90e6-14e02c567010 req-ea5127af-e564-4a51-9c09-846125bfb31f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057699 Sep 19 14:47:13.220305 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 939/1916] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:13.236412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2e9fb8f-6596-477b-a086-e83f4ba0264c tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.260923 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2e9fb8f-6596-477b-a086-e83f4ba0264c tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.038378 Sep 19 14:47:13.263288 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 940/1917] 10.222.0.81 () {58 vars in 1148 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:13.278897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fdc7243-03a3-4b88-bbce-76be8bc8290e tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.301705 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8fdc7243-03a3-4b88-bbce-76be8bc8290e tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.027973 Sep 19 14:47:13.303499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 941/1918] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:13.321855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bc08d66b-3cab-49d9-80e0-040c27cfdb34 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.335538 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bc08d66b-3cab-49d9-80e0-040c27cfdb34 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020998 Sep 19 14:47:13.337694 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 942/1919] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:13.351578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10ea15eb-997e-43ff-a637-96d272bf7462 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.423097 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-10ea15eb-997e-43ff-a637-96d272bf7462 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.076700 Sep 19 14:47:13.424306 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 943/1920] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:13.443340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa9a59f2-e384-4231-b17b-390bf3e10bf4 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.468963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa9a59f2-e384-4231-b17b-390bf3e10bf4 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033337 Sep 19 14:47:13.470325 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 944/1921] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:13.489974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-292cdc93-61a5-4bdb-9f12-27c529754e26 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.498212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-292cdc93-61a5-4bdb-9f12-27c529754e26 tempest-FlavorsV2TestJSON-882026819 tempest-FlavorsV2TestJSON-882026819-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012033 Sep 19 14:47:13.499977 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 945/1922] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:13.557957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.559603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:13.583473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:13.584678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:13.587630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:13.588355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:13.590120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:13.590604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:13.593114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:13.606730 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa204e04-95b1-4e2d-84f7-d27b3a8b58cc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 1.051366 Sep 19 14:47:13.609160 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 978/1923] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:12 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:13.809335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:13.819451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:13.840592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:13.849223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b15df12e-27e3-4cbd-a9f1-90ddd67092d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1265 microversion: 2.1 time: 0.296849 Sep 19 14:47:13.864218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:13.866790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:13.867745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:13.868509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:13.869274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 946/1924] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:47:13.875263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:13.875712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:14.166774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:14.167411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:14.182348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:14.182860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:14.183304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:14.184410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:14.184874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:14.185299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:14.455842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:14.481568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8148e49-cbfb-4be6-a7ea-3ad36cb95038 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1270 microversion: 2.1 time: 0.318756 Sep 19 14:47:14.482794 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 947/1925] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:14 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:14.568367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:14.584882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2cc650cc-8bb2-4d76-a684-83ff593ddbb1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1325 microversion: 2.1 time: 0.794353 Sep 19 14:47:14.586050 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 979/1926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:13 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1325 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:14.631951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:14.632909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:14.650589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:14.651121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:14.651576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:14.652286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:14.652782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:14.653178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:14.878768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:14.880143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:14.887749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:14.888441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:14.889070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:14.891807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:14.892475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:14.893049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:15.107439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:15.142096 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c38d45d-a86f-4ded-bc6b-92bae3edd5ab tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1265 microversion: 2.1 time: 0.267652 Sep 19 14:47:15.147532 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 980/1927] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:14 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:15.241569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:15.278974 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e9ffb37e-6f81-47a0-9ba6-2ad8e78468bd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 0.650363 Sep 19 14:47:15.282110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 948/1928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:14 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:15.301794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-29c5b2b1-ea40-42ea-a2f9-02f930dcce35 req-061ba44f-e16a-40e1-9a6b-1136acfd0b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4c7295-0ba8-4615-8a31-23ebcebe3c1b", "tag": "d9147a69-ab3a-48ac-ad66-eac5cde7a687"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:15.359866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-29c5b2b1-ea40-42ea-a2f9-02f930dcce35 req-061ba44f-e16a-40e1-9a6b-1136acfd0b87 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:15.363224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-29c5b2b1-ea40-42ea-a2f9-02f930dcce35 req-061ba44f-e16a-40e1-9a6b-1136acfd0b87 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:15.366404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-29c5b2b1-ea40-42ea-a2f9-02f930dcce35 req-061ba44f-e16a-40e1-9a6b-1136acfd0b87 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:15.426663 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-29c5b2b1-ea40-42ea-a2f9-02f930dcce35 req-061ba44f-e16a-40e1-9a6b-1136acfd0b87 service nova] Creating event network-changed:d9147a69-ab3a-48ac-ad66-eac5cde7a687 for instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b on n-h2-858384-1 Sep 19 14:47:15.433131 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-29c5b2b1-ea40-42ea-a2f9-02f930dcce35 req-061ba44f-e16a-40e1-9a6b-1136acfd0b87 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152679 Sep 19 14:47:15.434797 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 981/1929] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:15.513453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:15.523479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:15.573404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:15.579119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:15.583046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:15.587544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:15.592783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:15.596417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:15.611663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:15.612755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:15.644939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:15.646307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:15.647540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:15.649302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:15.653586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:15.654712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:17.008235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:17.022004 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0975e28-5770-4482-84a9-a7015019a175 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1325 microversion: 2.1 time: 1.416382 Sep 19 14:47:17.038951 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 982/1930] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:15 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1325 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:17.063844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:17.064987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:17.088170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:17.089579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:17.091433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:17.093669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:17.095869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:17.099103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:17.213359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:17.595624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:17.606416 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ec6f50c-3f30-4041-884d-51ca46cce479 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 2.101923 Sep 19 14:47:17.626007 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 949/1931] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:15 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:17.643361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:17.644794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:17.659315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:17.660417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:17.661493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:17.663380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:17.664994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:17.666081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:18.115389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:18.120226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:18.137454 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9ea093e-a013-436f-a090-dcbae642c0c4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 1.093815 Sep 19 14:47:18.138556 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 983/1932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:17 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:18.147768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:18.148646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:18.162394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:18.163144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:18.168702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:18.169829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:18.171265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:18.171897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:18.267081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:18.299615 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4c9efa6-8e9a-4737-80f5-19f610ece53d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 0.669965 Sep 19 14:47:18.300495 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 950/1933] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:17 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:18.751050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0d0f1cb7-fb9e-4011-aa75-dd8b2b19efef tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:18.760163 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0d0f1cb7-fb9e-4011-aa75-dd8b2b19efef tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.292549 Sep 19 14:47:18.760739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:18.761489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 951/1934] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:47:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:18.767213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:18.767991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:18.798575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c31c57e-ea4d-4bbe-a13c-d3bf8803edc6 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1325 microversion: 2.1 time: 0.657797 Sep 19 14:47:18.812922 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 984/1935] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:18 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1325 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:19.085253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:19.085768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:19.087003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:19.088277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:19.088780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:19.089223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:19.169160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:19.169786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:19.184510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:19.185277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:19.186916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:19.189402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:19.193636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:19.195298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:19.525260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:19.593025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:19.628680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:19.637114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:19.648977 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e58a4340-b33f-450e-974e-8ccb51465dc4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.886001 Sep 19 14:47:19.649782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 952/1936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:18 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:19.679187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:19.682992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:19.699667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:19.700064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:19.702842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:19.703593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:19.704075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:19.704504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:19.914398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:19.970449 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d53b39f-52ef-477b-bcd2-ef2c3f75e9bc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 0.809230 Sep 19 14:47:19.975436 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 985/1937] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:19 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:19.996483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:19.999160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:20.010976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:20.011483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:20.011931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:20.012681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:20.013143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:20.013578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:20.543380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:20.554209 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc1f3968-3356-471c-8403-5a81588f274a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 0.884136 Sep 19 14:47:20.561586 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 953/1938] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:19 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:20.561586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46aae11d-74c2-4237-8a3d-f1041a9c23ed tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-491632747", "imageRef": "4e8a1e32-1fb5-4bb9-b11e-f21a69dc09e0", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:20.742193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-46aae11d-74c2-4237-8a3d-f1041a9c23ed tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:20.875921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=16 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:20.889971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:20.898146 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2a71666-7621-449e-ae12-59dc1cfb69e7 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1325 microversion: 2.1 time: 0.921204 Sep 19 14:47:20.911172 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 986/1939] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:19 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1325 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:20.916241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-46818581-4137-4b8b-98f4-80f0944b596e req-bd8dc826-0d2b-409a-b930-56d044e7dbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66966956-5029-45de-857c-13bcc6f6cc3f", "tag": "adbf3bd5-48b6-4b80-8902-6ec5d598fda3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:20.934866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-46818581-4137-4b8b-98f4-80f0944b596e req-bd8dc826-0d2b-409a-b930-56d044e7dbb9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:20.935357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-46818581-4137-4b8b-98f4-80f0944b596e req-bd8dc826-0d2b-409a-b930-56d044e7dbb9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:20.936342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-46818581-4137-4b8b-98f4-80f0944b596e req-bd8dc826-0d2b-409a-b930-56d044e7dbb9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:20.964558 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-46818581-4137-4b8b-98f4-80f0944b596e req-bd8dc826-0d2b-409a-b930-56d044e7dbb9 service nova] Creating event network-changed:adbf3bd5-48b6-4b80-8902-6ec5d598fda3 for instance 66966956-5029-45de-857c-13bcc6f6cc3f on n-h1-858384-1 Sep 19 14:47:20.997364 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-46818581-4137-4b8b-98f4-80f0944b596e req-bd8dc826-0d2b-409a-b930-56d044e7dbb9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083573 Sep 19 14:47:21.007084 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 987/1940] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:21.024346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.032027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:21.044382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:21.045513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:21.046254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:21.048534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:21.049546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:21.051656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:21.538053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:21.554552 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-470c512d-bdc0-4558-bdc7-8cbf6275607e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.545556 Sep 19 14:47:21.555381 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 988/1941] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:21.570940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.571404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:21.585406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:21.586499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:21.587290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:21.588519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:21.589430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:21.591118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:21.931415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-46aae11d-74c2-4237-8a3d-f1041a9c23ed tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46aae11d-74c2-4237-8a3d-f1041a9c23ed tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] Request method failure captured: Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 142 Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKID2CZ6eUhYSR5E3D9isDG22dJ4lO7_U-rQe8vGhQDh7rUvqpdhQnmiFKgiUr0GFMBkn2068SE24OrJx5O3qxhLX5q-78__cMuO9tUYdGBz0xhp32P9oCwGWVmFSGJmeTgaYeZPgrIOCyv5EDUR9B9p_2H2QBmdSrlsMg1HSPWxJ1rA Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 02ca818201364f7391246c4f227c150f Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FlavorsV2NegativeTest-1638909425 Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:21.933309 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_02ca818201364f7391246c4f227c150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/02ca818201364f7391246c4f227c150f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/02ca818201364f7391246c4f227c150f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/02ca818201364f7391246c4f227c150f"}]}] Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FlavorsV2NegativeTest-1638909425 Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 02ca818201364f7391246c4f227c150f Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1638909425 Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FlavorsV2NegativeTest-1638909425-project Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 1c41907b386547cd82ba87cfee901acc Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FlavorsV2NegativeTest-1638909425-project Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-491632747", "imageRef": "4e8a1e32-1fb5-4bb9-b11e-f21a69dc09e0", "flavorRef": "452"}} Sep 19 14:47:21.934650 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: exception: Flavor's memory is too small for requested image. Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-491632747', 'imageRef': '4e8a1e32-1fb5-4bb9-b11e-f21a69dc09e0', 'flavorRef': '452'}}} Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:21.936458 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:21.937720 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46aae11d-74c2-4237-8a3d-f1041a9c23ed tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:21.939129 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46aae11d-74c2-4237-8a3d-f1041a9c23ed tempest-FlavorsV2NegativeTest-1638909425 tempest-FlavorsV2NegativeTest-1638909425-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.372193 Sep 19 14:47:21.941119 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 954/1942] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:20 2022] POST /compute/v2.1/servers => generated 93 bytes in 1378 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:21.948091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-588194e5-079a-4a76-a836-477f85834ca0 req-8f55b02d-39e7-4e4c-8aa7-0d764b9ba9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6453a51-ab3a-4f6d-9103-a5fa529cb918", "name": "network-vif-plugged", "status": "completed", "tag": "e67ffa41-a969-4001-bf3a-9466ac3b9254"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:21.978741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-588194e5-079a-4a76-a836-477f85834ca0 req-8f55b02d-39e7-4e4c-8aa7-0d764b9ba9cd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:21.979318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-588194e5-079a-4a76-a836-477f85834ca0 req-8f55b02d-39e7-4e4c-8aa7-0d764b9ba9cd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:21.979708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-588194e5-079a-4a76-a836-477f85834ca0 req-8f55b02d-39e7-4e4c-8aa7-0d764b9ba9cd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:22.002803 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-588194e5-079a-4a76-a836-477f85834ca0 req-8f55b02d-39e7-4e4c-8aa7-0d764b9ba9cd service nova] Creating event network-vif-plugged:e67ffa41-a969-4001-bf3a-9466ac3b9254 for instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 on n-h1-858384-1 Sep 19 14:47:22.017262 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-588194e5-079a-4a76-a836-477f85834ca0 req-8f55b02d-39e7-4e4c-8aa7-0d764b9ba9cd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075770 Sep 19 14:47:22.021081 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 955/1943] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:22.037291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:22.039456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:22.055846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:22.059325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:22.059844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:22.061241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:22.066610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:22.067263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:23.130732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:23.148902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e2c30e76-21a9-4d05-80cd-eeae6004ff48 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 1.592086 Sep 19 14:47:23.161115 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 989/1944] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:23.187452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:23.195751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:23.229738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:23.235079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:23.236703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:23.242853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:23.243358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:23.243800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:23.847291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:23.858716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c81d083e-7468-4650-92d5-69c59ebaa869 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 1.836139 Sep 19 14:47:23.861044 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 956/1945] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:22 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:23.869897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:23.872890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:23.886510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:23.890594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:23.891204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:23.894448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:23.895036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:23.896465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:23.909369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:23.918400 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-350e1431-f6f0-4a20-98c3-33a04c4a0e58 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1325 microversion: 2.1 time: 0.756212 Sep 19 14:47:23.936219 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 990/1946] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:23 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:23.952289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5227362b-be25-4427-abfa-1a4cae2b3683 req-4dceeb28-81c8-4799-8629-21bab3f3ff97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5b0455-403e-47af-a5a7-63e230f449fa", "tag": "8ef5482f-8e3a-45be-9cf2-8e69f078595f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:23.980365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5227362b-be25-4427-abfa-1a4cae2b3683 req-4dceeb28-81c8-4799-8629-21bab3f3ff97 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:23.981038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5227362b-be25-4427-abfa-1a4cae2b3683 req-4dceeb28-81c8-4799-8629-21bab3f3ff97 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:23.983624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5227362b-be25-4427-abfa-1a4cae2b3683 req-4dceeb28-81c8-4799-8629-21bab3f3ff97 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:24.587826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:24.603464 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8a96f934-e375-4dc0-b5c3-8b8a6ffdb36b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.739986 Sep 19 14:47:24.608480 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 957/1947] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:23 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:24.628977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5227362b-be25-4427-abfa-1a4cae2b3683 req-4dceeb28-81c8-4799-8629-21bab3f3ff97 service nova] Creating event network-changed:8ef5482f-8e3a-45be-9cf2-8e69f078595f for instance be5b0455-403e-47af-a5a7-63e230f449fa on n-h2-858384-1 Sep 19 14:47:24.633313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a30d7a53-bf65-4f4b-b70f-710b89edfad6 req-7b0c0df6-18d4-4d1f-a5e2-e345c0b99431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4c7295-0ba8-4615-8a31-23ebcebe3c1b", "name": "network-vif-plugged", "status": "completed", "tag": "d9147a69-ab3a-48ac-ad66-eac5cde7a687"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:24.636674 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5227362b-be25-4427-abfa-1a4cae2b3683 req-4dceeb28-81c8-4799-8629-21bab3f3ff97 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.695470 Sep 19 14:47:24.638041 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 991/1948] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:24.646943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:24.648074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:24.658055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:24.658729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:24.660179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:24.661354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:24.661968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:24.662796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:24.673861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a30d7a53-bf65-4f4b-b70f-710b89edfad6 req-7b0c0df6-18d4-4d1f-a5e2-e345c0b99431 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:24.678823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a30d7a53-bf65-4f4b-b70f-710b89edfad6 req-7b0c0df6-18d4-4d1f-a5e2-e345c0b99431 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:24.679941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a30d7a53-bf65-4f4b-b70f-710b89edfad6 req-7b0c0df6-18d4-4d1f-a5e2-e345c0b99431 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:24.721280 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a30d7a53-bf65-4f4b-b70f-710b89edfad6 req-7b0c0df6-18d4-4d1f-a5e2-e345c0b99431 service nova] Creating event network-vif-plugged:d9147a69-ab3a-48ac-ad66-eac5cde7a687 for instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b on n-h2-858384-1 Sep 19 14:47:24.744712 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a30d7a53-bf65-4f4b-b70f-710b89edfad6 req-7b0c0df6-18d4-4d1f-a5e2-e345c0b99431 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123933 Sep 19 14:47:24.745844 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 958/1949] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:24.891198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:24.891920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:24.902795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:24.903545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:24.904761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:24.908848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:24.909696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:24.910222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:25.132545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:25.146132 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35554650-9dc6-4f09-8620-91fba48d8dde tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 0.505671 Sep 19 14:47:25.147864 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 992/1950] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:24 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:25.152495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:25.153105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:25.176999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:25.177501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:25.177942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:25.178727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:25.183469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:25.183794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:25.262080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:25.278691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dee2ae00-3df6-4b59-82d4-65e072857364 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 0.391771 Sep 19 14:47:25.299949 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 959/1951] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:24 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:47:25.634287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:25.635586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:25.650423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:25.653183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:25.655550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:25.658158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:25.658805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:25.659255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:25.941766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:25.959760 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba66b877-5909-45d3-9ffe-fb00bde801e2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.810735 Sep 19 14:47:25.964062 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 993/1952] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:25 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:25.984931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:25.985632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:26.016601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:26.018111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:26.019329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:26.021366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:26.025883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:26.027447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:26.774418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:26.789085 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57c1eea1-bb84-4c2e-9bdd-ca41b9fa1a04 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 1.159341 Sep 19 14:47:26.789680 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 960/1953] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:25 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:26.801045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:26.801553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:26.821781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:26.822290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:26.822734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:26.825275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:26.826636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:26.828163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:26.835555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:26.852990 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b315d50-0e18-4c53-a16c-2f23e8b2c6bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.872507 Sep 19 14:47:26.856499 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 994/1954] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:25 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:47:26.877668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:26.881290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:26.913135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:26.913840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:26.914584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:26.918348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:26.919041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:26.920374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:27.363782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:27.377291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e618106-2789-43b3-af66-f7118e23c53c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 0.583581 Sep 19 14:47:27.378368 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 961/1955] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:26 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:27.387622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:27.407256 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f656c63-7aa1-4dc2-9fb8-4f584fab0f34 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1316 microversion: 2.1 time: 0.548702 Sep 19 14:47:27.415341 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 995/1956] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:26 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:27.437547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-debfb23a-90aa-46fc-9502-5818593af259 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-839087164", "metadata": {"": ""}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-debfb23a-90aa-46fc-9502-5818593af259 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action HTTP/1.1 Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 106 Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:27.445984 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-839087164", "metadata": {"": ""}}} Sep 19 14:47:27.447560 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-839087164', 'metadata': {'': ''}}}} Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'': ''} Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:27.448359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.449510 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-debfb23a-90aa-46fc-9502-5818593af259 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:27.450529 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-debfb23a-90aa-46fc-9502-5818593af259 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action" status: 400 len: 170 microversion: 2.1 time: 0.029433 Sep 19 14:47:27.465619 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 996/1957] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Sep 19 14:47:27 2022] POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action => generated 170 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:47:27.475130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:27.492183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:27.514005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:27.516867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:27.519340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:27.521131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:27.521615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:27.522051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:27.953553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:27.955507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45f0558f-6dce-4b12-848f-b6716ed673d6 tempest-FloatingIPDetailsNegativeTestJSON-33378454 tempest-FloatingIPDetailsNegativeTestJSON-33378454-project] Calling method '.version_select at 0x7fde2999a940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:27.976296 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-203804cf-132d-461b-b91d-6848c6bd7c79 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.509390 Sep 19 14:47:27.977499 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 997/1958] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:27 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:27.984483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:27.985347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:28.000491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.002190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.002907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.007040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.012819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.013330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.043806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-45f0558f-6dce-4b12-848f-b6716ed673d6 tempest-FloatingIPDetailsNegativeTestJSON-33378454 tempest-FloatingIPDetailsNegativeTestJSON-33378454-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fa9b9e53-f73d-46e6-be63-cfe34ba372f5 could not be found", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:47:28.046383 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-45f0558f-6dce-4b12-848f-b6716ed673d6 tempest-FloatingIPDetailsNegativeTestJSON-33378454 tempest-FloatingIPDetailsNegativeTestJSON-33378454-project] HTTP exception thrown: Floating IP not found for ID fa9b9e53-f73d-46e6-be63-cfe34ba372f5 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45f0558f-6dce-4b12-848f-b6716ed673d6 tempest-FloatingIPDetailsNegativeTestJSON-33378454 tempest-FloatingIPDetailsNegativeTestJSON-33378454-project] Request method failure captured: Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-floating-ips/fa9b9e53-f73d-46e6-be63-cfe34ba372f5 HTTP/1.1 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKID-gyhHGLZhzlEZgJrwPPbLfHv4DXOuzwOwY4IQZLHN8SOi1ZSNlP1CHPMm7qMtnnvAX6q7HqOzqEcIS8WyR0fSpXLjb5ila-Yb2KQGUr_Bukf5LIsYSeLkJ0m1XZxWxTuRnKPBq2hFWFIG-bFAzs9h0FG_ebP-mWkOYO08VivkwqA Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e2edf8faa98d4faab17aaa1d477e0ff7 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-33378454 Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:28.050039 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e2edf8faa98d4faab17aaa1d477e0ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e2edf8faa98d4faab17aaa1d477e0ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e2edf8faa98d4faab17aaa1d477e0ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e2edf8faa98d4faab17aaa1d477e0ff7"}]}] Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-33378454 Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e2edf8faa98d4faab17aaa1d477e0ff7 Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-33378454 Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-33378454-project Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: eb33ae0a941c45b9865266989cef07f7 Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-33378454-project Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: exception: Floating IP not found for ID fa9b9e53-f73d-46e6-be63-cfe34ba372f5 Sep 19 14:47:28.051218 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'fa9b9e53-f73d-46e6-be63-cfe34ba372f5'} Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:28.051928 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fa9b9e53-f73d-46e6-be63-cfe34ba372f5 could not be found Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11af34eb-2164-438d-98f6-44614fd87175'] Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fa9b9e53-f73d-46e6-be63-cfe34ba372f5. Sep 19 14:47:28.052917 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fa9b9e53-f73d-46e6-be63-cfe34ba372f5 Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:28.053916 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:28.055764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:28.055764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fa9b9e53-f73d-46e6-be63-cfe34ba372f5 Sep 19 14:47:28.055764 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.057412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45f0558f-6dce-4b12-848f-b6716ed673d6 tempest-FloatingIPDetailsNegativeTestJSON-33378454 tempest-FloatingIPDetailsNegativeTestJSON-33378454-project] Returning 404 to user: Floating IP not found for ID fa9b9e53-f73d-46e6-be63-cfe34ba372f5 {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:28.058293 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45f0558f-6dce-4b12-848f-b6716ed673d6 tempest-FloatingIPDetailsNegativeTestJSON-33378454 tempest-FloatingIPDetailsNegativeTestJSON-33378454-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/fa9b9e53-f73d-46e6-be63-cfe34ba372f5" status: 404 len: 111 microversion: 2.1 time: 0.678735 Sep 19 14:47:28.058877 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 962/1959] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:47:27 2022] GET /compute/v2.1/os-floating-ips/fa9b9e53-f73d-46e6-be63-cfe34ba372f5 => generated 111 bytes in 680 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:28.068574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:28.069205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:28.089405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.089921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.092276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.094419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.095015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.095483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.384732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:28.397218 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38cad836-ccc7-4554-9a96-a214c4b06a54 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.418236 Sep 19 14:47:28.399705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 998/1960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:27 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:28.417764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:28.420373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:28.427635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:28.442914 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9d50be4d-a7b6-432d-8c07-1aa62292307a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.382798 Sep 19 14:47:28.444044 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 963/1961] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:28 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:28.448310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.449262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.449850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.452622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.453299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.455004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.456381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:28.458781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:28.471320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.472307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.473041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.474213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.475840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.481011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.872635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:28.886917 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b0655b0-d50d-44bd-a861-61b1a8597113 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1503 microversion: 2.1 time: 0.437278 Sep 19 14:47:28.888673 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 964/1962] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:28 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1503 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:28.896890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:28.898286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0052020-2577-4e6c-9d09-6c0c7fdabec5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1026625669", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0052020-2577-4e6c-9d09-6c0c7fdabec5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action HTTP/1.1 Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 619 Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:28.904012 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:28.905897 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:47:28.906533 n-d-858384-1 devstack@n-api.service[128731]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1026625669", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 19 14:47:28.906533 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:47:28.906533 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1026625669', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 19 14:47:28.906792 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:28.907567 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.908579 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:28.909373 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:28.909373 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:28.909373 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:47:28.909373 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:47:28.909373 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:47:28.909373 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:28.909766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0052020-2577-4e6c-9d09-6c0c7fdabec5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:28.909766 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0052020-2577-4e6c-9d09-6c0c7fdabec5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action" status: 400 len: 938 microversion: 2.1 time: 0.012089 Sep 19 14:47:28.911001 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 965/1963] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Sep 19 14:47:28 2022] POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action => generated 938 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:47:28.914574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4566f781-80d9-4078-b6b0-952381b10d7b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 0.512919 Sep 19 14:47:28.916918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:28.917761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:28.919936 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 999/1964] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:28 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:28.927380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.928089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.928679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.929535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.930144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.930904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.935768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-308052317"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:28.936475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:28.948280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.952186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.953161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:28.957221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:28.957944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:28.958901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:29.359670 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.network.security_group_api [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Adding security group fc551dfd-d442-4606-a5de-46c592fe43b9 to port d9147a69-ab3a-48ac-ad66-eac5cde7a687 Sep 19 14:47:29.479170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:29.498028 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c42b8f1-faf4-424b-8bb0-e9f832b0b7a5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.582584 Sep 19 14:47:29.522852 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 966/1965] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:28 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:29.533929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:29.535946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:29.552325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:29.553409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:29.555584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:29.556564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:29.558554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:29.561265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:30.246842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:30.266686 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28e3b158-10fd-4416-92c0-bca5f04517c4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.741083 Sep 19 14:47:30.269232 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 967/1966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:29 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:30.284142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3dc312f8-7fde-4f07-b894-967f02719467 req-b93a0ed8-a544-476c-8fbc-878f607eda5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5b0455-403e-47af-a5a7-63e230f449fa", "name": "network-vif-plugged", "status": "completed", "tag": "8ef5482f-8e3a-45be-9cf2-8e69f078595f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:30.313954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3dc312f8-7fde-4f07-b894-967f02719467 req-b93a0ed8-a544-476c-8fbc-878f607eda5e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:30.314455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3dc312f8-7fde-4f07-b894-967f02719467 req-b93a0ed8-a544-476c-8fbc-878f607eda5e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:30.314932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3dc312f8-7fde-4f07-b894-967f02719467 req-b93a0ed8-a544-476c-8fbc-878f607eda5e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:30.340875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3dc312f8-7fde-4f07-b894-967f02719467 req-b93a0ed8-a544-476c-8fbc-878f607eda5e service nova] Creating event network-vif-plugged:8ef5482f-8e3a-45be-9cf2-8e69f078595f for instance be5b0455-403e-47af-a5a7-63e230f449fa on n-h2-858384-1 Sep 19 14:47:30.360912 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3dc312f8-7fde-4f07-b894-967f02719467 req-b93a0ed8-a544-476c-8fbc-878f607eda5e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087579 Sep 19 14:47:30.361583 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 968/1967] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:30.372104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:30.373345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:30.391927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf4c7a86-c3f7-4905-a127-acace984bda0 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b/action" status: 202 len: 0 microversion: 2.1 time: 1.468310 Sep 19 14:47:30.392525 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1000/1968] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:28 2022] POST /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b/action => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:30.402830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:30.403454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:30.405948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:30.413606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:30.414385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:30.417538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:30.418269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:30.419029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:30.439976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:30.455035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:30.457081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:30.459181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:30.467201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:30.471376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:31.096876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:31.107045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:31.119621 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b29e17d-1640-4aa0-addd-67c1b6233ee8 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.755576 Sep 19 14:47:31.120847 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 969/1969] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:30 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:31.131137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1281729427"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:31.131818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:31.142222 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8177bae5-4a1f-4dfd-a96a-678c8c787747 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1307 microversion: 2.1 time: 0.741678 Sep 19 14:47:31.142222 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1001/1970] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:30 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1307 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:31.145009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:31.145799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:31.146483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:31.147560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:31.148145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:31.148657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:31.157640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e6ad6e5f-8f1b-4d30-8eb9-9420f16a1d73 req-4e312580-06db-45d3-a1f6-846a395eda17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4c7295-0ba8-4615-8a31-23ebcebe3c1b", "tag": "d9147a69-ab3a-48ac-ad66-eac5cde7a687"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:31.174940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e6ad6e5f-8f1b-4d30-8eb9-9420f16a1d73 req-4e312580-06db-45d3-a1f6-846a395eda17 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:31.175624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e6ad6e5f-8f1b-4d30-8eb9-9420f16a1d73 req-4e312580-06db-45d3-a1f6-846a395eda17 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:31.176278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e6ad6e5f-8f1b-4d30-8eb9-9420f16a1d73 req-4e312580-06db-45d3-a1f6-846a395eda17 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:31.200598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e6ad6e5f-8f1b-4d30-8eb9-9420f16a1d73 req-4e312580-06db-45d3-a1f6-846a395eda17 service nova] Creating event network-changed:d9147a69-ab3a-48ac-ad66-eac5cde7a687 for instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b on n-h2-858384-1 Sep 19 14:47:31.216149 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e6ad6e5f-8f1b-4d30-8eb9-9420f16a1d73 req-4e312580-06db-45d3-a1f6-846a395eda17 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072919 Sep 19 14:47:31.217683 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1002/1971] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:31.225972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e83756d-7494-47bc-b6f2-bb09ffe96473 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e83756d-7494-47bc-b6f2-bb09ffe96473 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action HTTP/1.1 Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 285 Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:31.232878 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:47:31.234113 n-d-858384-1 devstack@n-api.service[128730]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:47:31.234803 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:47:31.235352 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:47:31.241082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:47:31.241792 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 14:47:31.241792 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:31.241792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e83756d-7494-47bc-b6f2-bb09ffe96473 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:31.241792 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e83756d-7494-47bc-b6f2-bb09ffe96473 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action" status: 400 len: 619 microversion: 2.1 time: 0.015573 Sep 19 14:47:31.242046 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1003/1972] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Sep 19 14:47:31 2022] POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:47:31.251522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b141fe8-1538-4dba-a345-a330e80debb4 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde297d0670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:31.332568 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b141fe8-1538-4dba-a345-a330e80debb4 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/3a8ce2cf-5e48-4c69-a1ff-ee4eb21a221b" status: 200 len: 661 microversion: 2.1 time: 0.095627 Sep 19 14:47:31.335244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1004/1973] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:31 2022] GET /compute/v2.1/images/3a8ce2cf-5e48-4c69-a1ff-ee4eb21a221b => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:31.350812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:31.353879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:31.377432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:31.378639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:31.380227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:31.381044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:31.381535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:31.381981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:31.884843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Adding security group cc4a8b4b-fd14-4050-a25d-32c582b6650d to port d9147a69-ab3a-48ac-ad66-eac5cde7a687 Sep 19 14:47:32.147136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:32.161802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:32.176037 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b19f7a23-b439-4234-9994-f62e48f5a100 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.839525 Sep 19 14:47:32.176644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1005/1974] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:31 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:32.181658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:32.186634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:32.202765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:32.203611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:32.204314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:32.205431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:32.206904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:32.207546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:32.573766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:32.585989 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8cef1542-af9a-49bc-9a89-748ddf78bda5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.407947 Sep 19 14:47:32.589683 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1006/1975] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:32 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:32.605221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ced47f75-24b5-4aa4-b237-0e8173f2fd67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29928ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:32.691359 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ced47f75-24b5-4aa4-b237-0e8173f2fd67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/3a8ce2cf-5e48-4c69-a1ff-ee4eb21a221b" status: 200 len: 661 microversion: 2.1 time: 0.103368 Sep 19 14:47:32.692040 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1007/1976] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:32 2022] GET /compute/v2.1/images/3a8ce2cf-5e48-4c69-a1ff-ee4eb21a221b => generated 661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:32.987616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70e35f13-2896-40eb-bc69-08f77ec1b81f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b/action" status: 202 len: 0 microversion: 2.1 time: 1.863608 Sep 19 14:47:32.989367 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 970/1977] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:31 2022] POST /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b/action => generated 0 bytes in 1868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:33.001337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:33.002518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:33.036359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.038494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.040540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.043123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Action: 'update', calling method: .version_select at 0x7fde2980b8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:33.051951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.052473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.052927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.441465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:33.461740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f1f0955a-2267-4556-babd-50a4c014bab0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1488 microversion: 2.1 time: 0.468598 Sep 19 14:47:33.483723 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 971/1978] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:32 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1488 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:33.490140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:33.491094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:33.499330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.500134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.500790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.502979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.503783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.504415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.516638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:33.524360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.525465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.526248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.527782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.528601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.529258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.617505 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-71b2ad42-20b3-4383-95f2-9bc5ad3ba48e tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812" status: 200 len: 240 microversion: 2.36 time: 0.914434 Sep 19 14:47:33.618972 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1008/1979] 10.222.0.81 () {62 vars in 1303 bytes} [Mon Sep 19 14:47:32 2022] PUT /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812 => generated 240 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:33.625096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-cd24f05b-dab3-427e-8341-971f40c42e2f req-805743c3-b105-41cd-9703-7f0610e29afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66966956-5029-45de-857c-13bcc6f6cc3f", "name": "network-vif-plugged", "status": "completed", "tag": "adbf3bd5-48b6-4b80-8902-6ec5d598fda3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:33.637393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cd24f05b-dab3-427e-8341-971f40c42e2f req-805743c3-b105-41cd-9703-7f0610e29afc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.638829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cd24f05b-dab3-427e-8341-971f40c42e2f req-805743c3-b105-41cd-9703-7f0610e29afc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.639609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cd24f05b-dab3-427e-8341-971f40c42e2f req-805743c3-b105-41cd-9703-7f0610e29afc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.653091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-cd24f05b-dab3-427e-8341-971f40c42e2f req-805743c3-b105-41cd-9703-7f0610e29afc service nova] Creating event network-vif-plugged:adbf3bd5-48b6-4b80-8902-6ec5d598fda3 for instance 66966956-5029-45de-857c-13bcc6f6cc3f on n-h1-858384-1 Sep 19 14:47:33.660615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-cd24f05b-dab3-427e-8341-971f40c42e2f req-805743c3-b105-41cd-9703-7f0610e29afc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040081 Sep 19 14:47:33.661860 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1009/1980] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:33.671518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:33.672485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:33.680813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.681647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.682296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.683354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:33.684070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:33.684884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:33.908694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:33.928351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-55397fa5-346c-4b12-ab1f-3877af239912 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.443079 Sep 19 14:47:33.932486 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 972/1981] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:33 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:33.940402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-852c110e-54e1-42fe-a7ec-1cbc4e426be7 req-4b9db34e-1824-4793-875a-fe2badad7d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4c7295-0ba8-4615-8a31-23ebcebe3c1b", "tag": "d9147a69-ab3a-48ac-ad66-eac5cde7a687"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:33.988399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:34.000702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-852c110e-54e1-42fe-a7ec-1cbc4e426be7 req-4b9db34e-1824-4793-875a-fe2badad7d17 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.001208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-852c110e-54e1-42fe-a7ec-1cbc4e426be7 req-4b9db34e-1824-4793-875a-fe2badad7d17 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.001657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-852c110e-54e1-42fe-a7ec-1cbc4e426be7 req-4b9db34e-1824-4793-875a-fe2badad7d17 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:34.034566 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-852c110e-54e1-42fe-a7ec-1cbc4e426be7 req-4b9db34e-1824-4793-875a-fe2badad7d17 service nova] Creating event network-changed:d9147a69-ab3a-48ac-ad66-eac5cde7a687 for instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b on n-h2-858384-1 Sep 19 14:47:34.040195 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-852c110e-54e1-42fe-a7ec-1cbc4e426be7 req-4b9db34e-1824-4793-875a-fe2badad7d17 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105958 Sep 19 14:47:34.040803 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 973/1982] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:34.062473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:34.063392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:34.074164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.074959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.076127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:34.078402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.080759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.081353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:34.196408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:34.243998 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb98af39-3e8f-4f66-84f0-63cbef2eefdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa/action" status: 202 len: 0 microversion: 2.1 time: 0.193805 Sep 19 14:47:34.244767 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 974/1983] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:34 2022] POST /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:34.259054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:34.260261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:34.278357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.279378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.282596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:34.290650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.291454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.292074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:34.366259 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ea3295a-4014-404e-ae1a-7cd299b1c766 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.702778 Sep 19 14:47:34.367506 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1010/1984] 10.222.0.81 () {58 vars in 1293 bytes} [Mon Sep 19 14:47:33 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b/os-security-groups => generated 1157 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:34.374105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Calling method '.version_select at 0x7fde29928c10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:34.929988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:34.944106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88335379-3866-4a43-afcc-f4817e40606c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1312 microversion: 2.1 time: 0.697055 Sep 19 14:47:34.945532 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 975/1985] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:34 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1312 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:34.953101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-369757074"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:34.956160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:34.963799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.964309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.964752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:34.965691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:34.966954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:34.967550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.025597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.026049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.026456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.027438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.028084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.029140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.053998 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b1d1f397-00da-4d29-bbc1-a213994404c4 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812/detail" status: 200 len: 672 microversion: 2.36 time: 0.684703 Sep 19 14:47:35.054641 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1011/1986] 10.222.0.81 () {60 vars in 1304 bytes} [Mon Sep 19 14:47:34 2022] GET /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812/detail => generated 672 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:35.060196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:35.061063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:35.087438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.087934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.088376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.089095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.089546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.089971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.341660 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c7a5fb45-a7c4-4869-b644-563e2584c95b tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action" status: 202 len: 0 microversion: 2.1 time: 0.394011 Sep 19 14:47:35.344195 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 976/1987] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:34 2022] POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:47:35.362774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-86ca978d-befa-4943-bd32-24b8d0bd58df tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde299cae50>, body: {"security_group": {"name": " tempest-securitygroup -232797626 ", "description": "tempest-description-353947231"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:35.490041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:35.502228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8afeb6d1-8a22-4022-b772-4d3ff20d844d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 200 len: 1473 microversion: 2.1 time: 0.446156 Sep 19 14:47:35.503484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1012/1988] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:35 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 1473 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:35.509001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32de6f24-9d37-4864-b5ae-e9187b8e3a4f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde298f0ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:35.592568 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32de6f24-9d37-4864-b5ae-e9187b8e3a4f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/3c9cb6de-a5bc-4a2e-bba7-4a680a6af71a" status: 200 len: 661 microversion: 2.1 time: 0.084423 Sep 19 14:47:35.594003 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1013/1989] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:35 2022] GET /compute/v2.1/images/3c9cb6de-a5bc-4a2e-bba7-4a680a6af71a => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:35.601420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-404777637"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:35.605050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:35.612524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.613328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.613969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.615178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.615743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.616684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.670280 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Cannot 'createImage' instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 while it is in task_state image_snapshot Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action HTTP/1.1 Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 84 Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:35.672473 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-404777637"}} Sep 19 14:47:35.673877 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'createImage' instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 while it is in task_state image_snapshot Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-404777637'}}} Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:35.674897 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 while it is in task_state image_snapshot Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 while it is in task_state image_snapshot Sep 19 14:47:35.676041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:35.677001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 409 to user: Cannot 'createImage' instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 while it is in task_state image_snapshot {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:35.677001 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1eff43f-7aa1-4853-beee-1f6da04eef21 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action" status: 409 len: 159 microversion: 2.1 time: 0.080580 Sep 19 14:47:35.677450 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1014/1990] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:35 2022] POST /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918/action => generated 159 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:47:35.686663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Action: 'update', calling method: .version_select at 0x7fde297d04c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:35.773029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-86ca978d-befa-4943-bd32-24b8d0bd58df tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.427175 Sep 19 14:47:35.773633 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 977/1991] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:47:35 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:35.778431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-580154103"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:35.781140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:35.798372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.798912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.799628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:35.800351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:35.800809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:35.807175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.070799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-126dffe6-4369-4b5e-8c24-fd7ad013c1d9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa/action" status: 202 len: 0 microversion: 2.1 time: 0.295661 Sep 19 14:47:36.079174 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 978/1992] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:35 2022] POST /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:47:36.086316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-108c6911-5b01-450f-8a9f-22729761382f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29a24ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.136080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.140513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.140976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.141871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.142258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.142679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.158070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-108c6911-5b01-450f-8a9f-22729761382f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/3c9cb6de-a5bc-4a2e-bba7-4a680a6af71a" status: 200 len: 661 microversion: 2.1 time: 0.077278 Sep 19 14:47:36.158661 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 979/1993] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:36 2022] GET /compute/v2.1/images/3c9cb6de-a5bc-4a2e-bba7-4a680a6af71a => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:36.166707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c68c6a20-fb5c-43c2-816c-3c70d72fe3eb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '.version_select at 0x7fde2e2745e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.187986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.188886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.189708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.191208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.191856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.192523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.326390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-566e3d35-b0ac-4b90-a40d-8b7b151faa97 tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812?user_id=7a5dbfc2db944779b9875fc047c2ef56" status: 200 len: 240 microversion: 2.36 time: 0.644475 Sep 19 14:47:36.328323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1015/1994] 10.222.0.81 () {62 vars in 1384 bytes} [Mon Sep 19 14:47:35 2022] PUT /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812?user_id=7a5dbfc2db944779b9875fc047c2ef56 => generated 240 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:36.350347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d354e660-f680-4f87-9d21-e6502bde1028 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29778a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.463322 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d354e660-f680-4f87-9d21-e6502bde1028 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e" status: 200 len: 222 microversion: 2.1 time: 0.133564 Sep 19 14:47:36.467301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1016/1995] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:47:36 2022] GET /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e => generated 222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:36.473453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.474363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:36.479418 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c68c6a20-fb5c-43c2-816c-3c70d72fe3eb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/images/35cf57fa-78f7-4b8d-a147-7c6aa1624d51" status: 204 len: 0 microversion: 2.1 time: 0.319476 Sep 19 14:47:36.480287 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 980/1996] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:36 2022] DELETE /compute/v2.1/images/35cf57fa-78f7-4b8d-a147-7c6aa1624d51 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:47:36.485964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad04d753-1619-4255-9889-653cce33a0e9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2e2ae9d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.516168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.516677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.517181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.517938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.520266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.520778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.583720 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad04d753-1619-4255-9889-653cce33a0e9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.099140 Sep 19 14:47:36.592586 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 981/1997] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:36 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:36.597951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27826d6b-52a0-49b4-b362-1ee1bca9e10c tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] Calling method '.version_select at 0x7fde2e274820>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.735189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:36.745630 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfa2accc-5c94-4a4a-bbd3-980bcaf7ad53 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1461 microversion: 2.1 time: 0.276755 Sep 19 14:47:36.747439 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1017/1998] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:36 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1461 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:36.766976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-71c4e593-6d85-4664-b5a9-23203591f082 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29d1d280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.975689 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27826d6b-52a0-49b4-b362-1ee1bca9e10c tempest-QuotasAdminTestV236-1189783876 tempest-QuotasAdminTestV236-1189783876-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812?user_id=7a5dbfc2db944779b9875fc047c2ef56" status: 200 len: 282 microversion: 2.36 time: 0.381789 Sep 19 14:47:36.976682 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 982/1999] 10.222.0.81 () {60 vars in 1364 bytes} [Mon Sep 19 14:47:36 2022] GET /compute/v2.1/os-quota-sets/7425e4d062554b7d8cee048119910812?user_id=7a5dbfc2db944779b9875fc047c2ef56 => generated 282 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:36.985003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:36.985967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:36.994007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.995568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:36.995885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:36.997282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:36.999224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:37.000052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:37.042737 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-71c4e593-6d85-4664-b5a9-23203591f082 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e" status: 202 len: 0 microversion: 2.1 time: 0.293486 Sep 19 14:47:37.045271 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1018/2000] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:47:36 2022] DELETE /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:37.064979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:37.072528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:37.087538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:37.089482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:37.092090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:37.093689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:37.094944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:37.096012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:37.269015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:37.276705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 14:47:37.284939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:37.286066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:37.286848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:37.287703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:37.288304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:37.309974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:37.324809 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32fb4e52-a249-49e6-b268-c3999c814058 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1539 microversion: 2.1 time: 0.344239 Sep 19 14:47:37.360690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 983/2001] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:36 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:37.374588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde298a4700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:37.427769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:47:37.428381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group c651e703-c090-4f5f-8455-6fc643ad715e not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:47:37.428920 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.428920 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e HTTP/1.1 Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:37.431416 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] Sep 19 14:47:37.433610 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c651e703-c090-4f5f-8455-6fc643ad715e'} Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:37.436397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:47:37.439704 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.442880 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-06dc55c7-a4d4-4aed-8929-1b73f2c1ae31'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d923fe7-9f06-4fc5-a3bb-d5ad758472e2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e" status: 404 len: 194 microversion: 2.1 time: 0.067178 Sep 19 14:47:37.447151 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 984/2002] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:47:37 2022] GET /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:37.450938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df908587-3d4e-48a3-a70f-5f7e8e39f9e6 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde2e274430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-177994620", "description": "tempest-description-1929015317"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:37.511085 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8101b757-4542-4317-8b4a-7d6c615b540b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f/action" status: 202 len: 0 microversion: 2.1 time: 0.461615 Sep 19 14:47:37.517795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1019/2003] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:47:37 2022] POST /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:37.531143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:37.532870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:37.546471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:37.548308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:37.549621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:37.551327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:37.552550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:37.553741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:37.753236 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df908587-3d4e-48a3-a70f-5f7e8e39f9e6 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.310544 Sep 19 14:47:37.754455 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 985/2004] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:47:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:37.764110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-040d6ca8-4d17-444b-8ef2-4db5007e6f14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2e274c10>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:37.819989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:37.842216 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d32774dd-2f8f-4992-9535-5a3e3e73777d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1470 microversion: 2.1 time: 0.319949 Sep 19 14:47:37.843194 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1020/2005] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:37 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:37.857023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d58ab74-9499-4bf5-b47d-a9e230072abd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde29834940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1837717578", "description": "tempest-description-359680219"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:37.862333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-040d6ca8-4d17-444b-8ef2-4db5007e6f14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.105064 Sep 19 14:47:37.862970 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 986/2006] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:37 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:38.097651 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d58ab74-9499-4bf5-b47d-a9e230072abd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.252346 Sep 19 14:47:38.098411 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1021/2007] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:47:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:38.121439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2229d7f6-80e7-4504-8a7d-5eab4476bb9a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde2999a5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1396708153", "description": "tempest-description-102887939"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:38.373932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:38.374817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:38.394885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:38.395679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:38.396388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:38.399802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:38.400561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:38.401761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:38.784844 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2229d7f6-80e7-4504-8a7d-5eab4476bb9a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.676073 Sep 19 14:47:38.786861 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 987/2008] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:47:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:38.801175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0ed2f45-2655-4c16-94be-dc73676467ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29896430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:38.866473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:38.879091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1fa7046e-b3d9-41bd-b1ab-9a59e1fa7ee1 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1534 microversion: 2.1 time: 0.512206 Sep 19 14:47:38.883102 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1022/2009] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:38 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1534 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:38.890122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:38.891038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:38.919354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:38.920167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:38.922669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:38.925087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:38.926377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:38.928231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:39.541619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:39.548694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0ed2f45-2655-4c16-94be-dc73676467ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.752673 Sep 19 14:47:39.550097 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 988/2010] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:47:38 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:39.555028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ad2d815-de07-43a7-99bb-abf3af10d374 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde298a40d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:39.604261 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9fcc3b6c-a314-4a9f-b26d-3001421b0467 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1470 microversion: 2.1 time: 0.719788 Sep 19 14:47:39.612518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1023/2011] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:38 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1470 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:39.639788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcaee8eb-cb8e-412a-a83d-6fda3c01ae86 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29928280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:39.750473 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ad2d815-de07-43a7-99bb-abf3af10d374 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.198910 Sep 19 14:47:39.751027 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 989/2012] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:39 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:39.767472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f24e590-fd44-4eec-bfcc-d4200cda4eae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2e2ae4c0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:39.869254 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f24e590-fd44-4eec-bfcc-d4200cda4eae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/108ecb0e-69ba-46fd-a389-b9fbb00d39ec" status: 200 len: 661 microversion: 2.1 time: 0.116759 Sep 19 14:47:39.893534 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 990/2013] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:39 2022] GET /compute/v2.1/images/108ecb0e-69ba-46fd-a389-b9fbb00d39ec => generated 661 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:39.913355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9e365dd7-fa34-47b2-9b9a-319f7eff6f99 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2e172b80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:40.062641 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9e365dd7-fa34-47b2-9b9a-319f7eff6f99 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/108ecb0e-69ba-46fd-a389-b9fbb00d39ec" status: 200 len: 661 microversion: 2.1 time: 0.161663 Sep 19 14:47:40.074812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 991/2014] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:39 2022] GET /compute/v2.1/images/108ecb0e-69ba-46fd-a389-b9fbb00d39ec => generated 661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:40.080637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:40.081737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:40.096912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:40.102161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:40.103036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:40.104390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:40.108336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:40.109211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:40.570105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcaee8eb-cb8e-412a-a83d-6fda3c01ae86 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58" status: 202 len: 0 microversion: 2.1 time: 0.954262 Sep 19 14:47:40.571002 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1024/2015] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:47:39 2022] DELETE /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58 => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:40.577987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-487386029", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:40.722874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:40.764418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:40.781982 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8f9e5db0-ec49-42e8-b5da-d3d2c18bf2e4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1521 microversion: 2.1 time: 0.716565 Sep 19 14:47:40.786437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 992/2016] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:40 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1521 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:40.841771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde298969d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:41.032581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:47:41.038514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group ea5c963d-33ff-4f0a-a745-23140ed38d58 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:47:41.039924 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.039924 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58 HTTP/1.1 Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:41.047223 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] Sep 19 14:47:41.049859 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ea5c963d-33ff-4f0a-a745-23140ed38d58'} Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:41.051531 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:47:41.053516 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.061615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:47:41.066778 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-eb1d7c1c-ffff-4cba-982b-8ebcb7b3101e'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:41.102289 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7727d588-4aa9-48f5-9eb9-f5ea8987f85d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58" status: 404 len: 194 microversion: 2.1 time: 0.314172 Sep 19 14:47:41.118587 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 993/2017] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:47:40 2022] GET /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58 => generated 194 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:41.186390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:41.188360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:41.217778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:41.220129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:41.225005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:41.227978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:41.230472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:41.233026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:41.420964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:41.421379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:41.422051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:41.422620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:41.423843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:41.475267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:41.476609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:41.481924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:41.487148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:41.494384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:41.503006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:41.602234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Getting quotas for project 748bd95ac454426f80b5937ff3080dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:41.619356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Getting quotas for user 2ca604f0c3a1493b9dd60905bbce3291 and project 748bd95ac454426f80b5937ff3080dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:41.663330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:47:41.669736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:47:41.819665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:41.836735 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-399ea46c-218f-4fbb-8e4b-7e1d78521afb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262944 Sep 19 14:47:41.839530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1025/2018] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:47:41.841951 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e674b35c-5b7e-43e1-a76f-af28ee793fa3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1470 microversion: 2.1 time: 0.716961 Sep 19 14:47:41.845457 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 994/2019] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:41 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1470 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:41.858093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ecbc551f-1d04-4d72-b06a-3e6120c0a2c2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde298e7d30>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:41.863912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:41.865310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:41.906496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:41.909020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:41.925953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:41.931937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:41.934698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:41.937133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:42.048572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:47:42.064690 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ecbc551f-1d04-4d72-b06a-3e6120c0a2c2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.223140 Sep 19 14:47:42.066464 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1026/2020] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:41 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:42.106789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a9aded5b-53b8-4074-b1a6-07ad4730e09f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29935940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:42.553828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4a1758f1-c3dc-4aa1-9a42-3a5f3c6d6076 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 204 len: 0 microversion: 2.1 time: 0.706698 Sep 19 14:47:42.555395 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 995/2021] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:47:41 2022] DELETE /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:47:42.569218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e24c5d4c-2bd2-4651-a20b-f0d7116913e0 req-05dcd761-b69c-4fd4-a6a2-ba455b2071d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5b0455-403e-47af-a5a7-63e230f449fa", "name": "network-vif-plugged", "status": "completed", "tag": "8ef5482f-8e3a-45be-9cf2-8e69f078595f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:42.597869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e24c5d4c-2bd2-4651-a20b-f0d7116913e0 req-05dcd761-b69c-4fd4-a6a2-ba455b2071d5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:42.600240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e24c5d4c-2bd2-4651-a20b-f0d7116913e0 req-05dcd761-b69c-4fd4-a6a2-ba455b2071d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:42.604441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e24c5d4c-2bd2-4651-a20b-f0d7116913e0 req-05dcd761-b69c-4fd4-a6a2-ba455b2071d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:42.635130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e24c5d4c-2bd2-4651-a20b-f0d7116913e0 req-05dcd761-b69c-4fd4-a6a2-ba455b2071d5 service nova] Creating event network-vif-plugged:8ef5482f-8e3a-45be-9cf2-8e69f078595f for instance be5b0455-403e-47af-a5a7-63e230f449fa on n-h2-858384-1 Sep 19 14:47:42.649700 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e24c5d4c-2bd2-4651-a20b-f0d7116913e0 req-05dcd761-b69c-4fd4-a6a2-ba455b2071d5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092146 Sep 19 14:47:42.653287 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 996/2022] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:42.669124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1515117112", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:42.875521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:44.773243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:44.774379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:44.774379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:44.774725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:44.775358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:44.800972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:44.802063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:44.802733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:44.803526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:44.804064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:44.804728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:44.831323 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a9aded5b-53b8-4074-b1a6-07ad4730e09f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21" status: 202 len: 0 microversion: 2.1 time: 2.752996 Sep 19 14:47:44.832413 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1027/2023] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:47:42 2022] DELETE /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 => generated 0 bytes in 2764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:44.838198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:44.843603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:44.872943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:44.885534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:44.886371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:44.895963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:44.896972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:44.898195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:44.916104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Getting quotas for project 748bd95ac454426f80b5937ff3080dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:44.961721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Getting quotas for user 2ca604f0c3a1493b9dd60905bbce3291 and project 748bd95ac454426f80b5937ff3080dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:45.057452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:47:45.088573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:47:45.379338 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3289ec4f-d665-459d-b24b-594f1a0c4377 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.719536 Sep 19 14:47:45.386538 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 997/2024] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:47:45.411686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:45.412321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:45.438512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:45.440070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:45.442297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:45.446091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:45.450215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:45.452189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:46.542294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:46.569185 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd457698-b1b5-47c2-849a-aa64a3602d46 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 200 len: 1527 microversion: 2.1 time: 1.734422 Sep 19 14:47:46.588284 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1028/2025] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:44 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 1527 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:46.613969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9505283-6bec-4fa9-b21d-aa287e169fc3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29a47b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:46.709291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:46.733651 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3535b971-92ca-42ee-97ea-288315cc3076 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1470 microversion: 2.1 time: 1.343493 Sep 19 14:47:46.737267 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 998/2026] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:45 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1470 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:46.773812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ed315e23-94bf-4ecf-a61b-82937c3a9a72 req-5a20dfd0-a331-48b7-9fe5-4c55fba6f3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6453a51-ab3a-4f6d-9103-a5fa529cb918", "name": "network-vif-plugged", "status": "completed", "tag": "e67ffa41-a969-4001-bf3a-9466ac3b9254"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:46.804231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed315e23-94bf-4ecf-a61b-82937c3a9a72 req-5a20dfd0-a331-48b7-9fe5-4c55fba6f3fe service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:46.805277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed315e23-94bf-4ecf-a61b-82937c3a9a72 req-5a20dfd0-a331-48b7-9fe5-4c55fba6f3fe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:46.806320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed315e23-94bf-4ecf-a61b-82937c3a9a72 req-5a20dfd0-a331-48b7-9fe5-4c55fba6f3fe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:46.847149 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ed315e23-94bf-4ecf-a61b-82937c3a9a72 req-5a20dfd0-a331-48b7-9fe5-4c55fba6f3fe service nova] Creating event network-vif-plugged:e67ffa41-a969-4001-bf3a-9466ac3b9254 for instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 on n-h1-858384-1 Sep 19 14:47:46.879750 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ed315e23-94bf-4ecf-a61b-82937c3a9a72 req-5a20dfd0-a331-48b7-9fe5-4c55fba6f3fe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125532 Sep 19 14:47:46.883573 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 999/2027] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:46.903976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29b3ec10>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:46.965839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:47:46.967330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:47:46.969042 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.969042 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 HTTP/1.1 Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:46.977882 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] Sep 19 14:47:46.980463 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c76cf3a4-937c-46f7-a0fc-e13c19bc7d21'} Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:46.982879 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:47:46.985024 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.990501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] Sep 19 14:47:46.994419 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:46.997287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:47:46.997287 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-6cd57153-7817-471f-8a32-321bde1bc70c'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:46.999584 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae0b79ab-a723-4f4c-92b3-00463ec0b5c1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21" status: 404 len: 194 microversion: 2.1 time: 0.108862 Sep 19 14:47:47.001274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1000/2028] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:47:46 2022] GET /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:47.024031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:47.027434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:47.058793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:47.063938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:47.066925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:47.070263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:47.073082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:47.074716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:47.467093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:47.516659 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8a34dd17-13bc-4a91-865a-ceb6f1b7818b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1222 microversion: 2.1 time: 0.508130 Sep 19 14:47:47.538957 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1001/2029] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:47 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1222 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:47.579248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f7ea0d9-2c48-4bf4-b029-3a0eaca8baaf tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29af5550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:48.558222 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f7ea0d9-2c48-4bf4-b029-3a0eaca8baaf tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4" status: 202 len: 0 microversion: 2.1 time: 1.015263 Sep 19 14:47:48.559472 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1002/2030] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:47:47 2022] DELETE /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4 => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:47:48.797546 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d9505283-6bec-4fa9-b21d-aa287e169fc3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 2.201535 Sep 19 14:47:48.810545 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1029/2031] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:46 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:48.818820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:48.823662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:48.838587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:48.839369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:48.844929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:48.846583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:48.847606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:48.848237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:48.883846 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 HTTP/1.1 Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:47:48.886424 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:47:48.887971 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918'} Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:48.888917 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:47:48.890646 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:47:48.894027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:48.895169 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-07f37c0a-edcb-4282-91bc-bc89285294a4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 404 len: 111 microversion: 2.1 time: 0.083348 Sep 19 14:47:48.896262 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1030/2032] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:48 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:48.901323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:48.904144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:48.911449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:48.912341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:48.913020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:48.914412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:48.915877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:48.916584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:49.171547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ce9b56e0-f65e-4ac8-8031-d030e70275bb req-ee2f6418-5332-4cfa-b3a2-2ae4e91b1dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6453a51-ab3a-4f6d-9103-a5fa529cb918", "name": "network-vif-deleted", "tag": "e67ffa41-a969-4001-bf3a-9466ac3b9254"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:49.207444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ce9b56e0-f65e-4ac8-8031-d030e70275bb req-ee2f6418-5332-4cfa-b3a2-2ae4e91b1dfa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:49.211056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ce9b56e0-f65e-4ac8-8031-d030e70275bb req-ee2f6418-5332-4cfa-b3a2-2ae4e91b1dfa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:49.216195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ce9b56e0-f65e-4ac8-8031-d030e70275bb req-ee2f6418-5332-4cfa-b3a2-2ae4e91b1dfa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:49.253782 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ce9b56e0-f65e-4ac8-8031-d030e70275bb req-ee2f6418-5332-4cfa-b3a2-2ae4e91b1dfa service nova] Creating event network-vif-deleted:e67ffa41-a969-4001-bf3a-9466ac3b9254 for instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 on n-h1-858384-1 Sep 19 14:47:49.273400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ce9b56e0-f65e-4ac8-8031-d030e70275bb req-ee2f6418-5332-4cfa-b3a2-2ae4e91b1dfa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.710844 Sep 19 14:47:49.279171 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1003/2033] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:49.303524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:49.304905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:49.325265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:49.326215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:49.328772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:49.329869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:49.331633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:49.332310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:49.618948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:49.637570 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a04edab3-9678-467e-91a0-c3666a55c9f6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1276 microversion: 2.1 time: 0.351701 Sep 19 14:47:49.651485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1004/2034] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:49 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1276 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:49.663108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2996e160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:49.772771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:49.781721 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa7fd7c7-db47-45bf-8352-303e2715166a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1475 microversion: 2.1 time: 0.884102 Sep 19 14:47:49.803305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1031/2035] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:48 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1475 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:49.831502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55c37449-32f0-4cd5-a2df-a563ba58c81c tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29a478b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:49.859782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:47:49.860618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group 0e684488-d8e1-484a-a321-d6424bfa29a4 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:47:49.861416 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.861416 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4 HTTP/1.1 Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:47:49.863643 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] Sep 19 14:47:49.864815 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '0e684488-d8e1-484a-a321-d6424bfa29a4'} Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:49.865536 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:47:49.866540 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.867517 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] Sep 19 14:47:49.868573 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:47:49.879235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:47:49.879235 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-72a57bf8-4367-434a-8fac-19bada57d958'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:47:49.880403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3012d7f-fbfd-4358-8193-f9b12dddb1ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4" status: 404 len: 194 microversion: 2.1 time: 0.226958 Sep 19 14:47:49.883765 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1005/2036] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:47:49 2022] GET /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4 => generated 194 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:47:49.893217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-158f1730-76b1-4779-951b-dda93271f0b5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'create', calling method: .version_select at 0x7fde2e237af0>, body: {"keypair": {"name": "tempest-keypair-528320486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC6xWWzm7aPmC5n1IFb3Ln9Ee1zqPYVL90sFf5UbqLcO+5qOPqrBJWNtNi6NuUYhXuBEdoDkGOePj9OYEOiGiq9UvU9hOxovqI7VtJIjmYra+oSNn/yFzOmB/u1jcah1w=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:49.913237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-158f1730-76b1-4779-951b-dda93271f0b5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for project 70b97b22e77c48d59731205c993e5789. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:49.920015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-158f1730-76b1-4779-951b-dda93271f0b5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for user e40c5acb3fa44fe2b0aa0696e3dcf8c2 and project 70b97b22e77c48d59731205c993e5789. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:49.957351 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55c37449-32f0-4cd5-a2df-a563ba58c81c tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748" status: 200 len: 637 microversion: 2.1 time: 0.151230 Sep 19 14:47:49.958902 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1032/2037] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:49 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748 => generated 637 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:49.960312 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-158f1730-76b1-4779-951b-dda93271f0b5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075138 Sep 19 14:47:49.967933 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1006/2038] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:47:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:49.976744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ed56a34-8583-410c-b010-9ee6afa3dedd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29896550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:49.978304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-748f050e-3172-4c86-a7f3-a91ac3948242 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29a24310>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:50.167485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-748f050e-3172-4c86-a7f3-a91ac3948242 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.206896 Sep 19 14:47:50.176012 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1033/2039] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:49 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:50.208115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-faaa388d-c2f2-4370-811a-e0408d8da143 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde29a47430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:50.960365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-faaa388d-c2f2-4370-811a-e0408d8da143 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:50.998405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-faaa388d-c2f2-4370-811a-e0408d8da143 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:51.131255 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ed56a34-8583-410c-b010-9ee6afa3dedd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.168856 Sep 19 14:47:51.140037 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1007/2040] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:47:49 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:51.145314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:51.146175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:51.158358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:51.186667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:51.190619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:51.194960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:51.196231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:51.198160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:51.289597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:51.558579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=11 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:52.215992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:52.227981 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17827ed4-eb30-4e25-9996-b38103519a82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1318 microversion: 2.1 time: 1.086430 Sep 19 14:47:52.232693 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1008/2041] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:51 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:52.258913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:52.264233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:52.291357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:52.296687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:52.300421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:52.303457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:52.311817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:52.313768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:52.839415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:52.858327 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2e64f7c-4719-4fca-9ead-1be411c248fb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1475 microversion: 2.1 time: 0.620116 Sep 19 14:47:52.859384 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1009/2042] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:52 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1475 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:52.865367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-830cf088-763e-4b55-a1fb-822b1fce00e8 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde2996e790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1055238722", "description": "tempest-description-165282476"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:53.193149 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-faaa388d-c2f2-4370-811a-e0408d8da143 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 3.014572 Sep 19 14:47:53.194193 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1034/2043] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:47:50 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 3017 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:47:53.211536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da36b46c-4333-48cf-a6cc-ecf4ccfd002c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29a240d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:53.847402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da36b46c-4333-48cf-a6cc-ecf4ccfd002c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.651774 Sep 19 14:47:53.857083 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1035/2044] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:53 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:53.862147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-de01cc3b-7feb-43f7-a5cd-bbbec0dabf3f req-0a5bb64d-0d23-4370-95fa-89351d3c4259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:53.883152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-de01cc3b-7feb-43f7-a5cd-bbbec0dabf3f req-0a5bb64d-0d23-4370-95fa-89351d3c4259 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:53.884925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-de01cc3b-7feb-43f7-a5cd-bbbec0dabf3f req-0a5bb64d-0d23-4370-95fa-89351d3c4259 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:53.885533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-de01cc3b-7feb-43f7-a5cd-bbbec0dabf3f req-0a5bb64d-0d23-4370-95fa-89351d3c4259 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:53.906787 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-de01cc3b-7feb-43f7-a5cd-bbbec0dabf3f req-0a5bb64d-0d23-4370-95fa-89351d3c4259 service nova] Creating event network-changed:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:47:53.912951 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-de01cc3b-7feb-43f7-a5cd-bbbec0dabf3f req-0a5bb64d-0d23-4370-95fa-89351d3c4259 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054421 Sep 19 14:47:53.913801 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1036/2045] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:53.920910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1dfb01ee-945d-4de0-a75e-17f5ce940ba6 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde299c9820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:54.295487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1dfb01ee-945d-4de0-a75e-17f5ce940ba6 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "DELETE /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.380152 Sep 19 14:47:54.299929 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1037/2046] 10.222.0.81 () {58 vars in 1296 bytes} [Mon Sep 19 14:47:53 2022] DELETE /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata/os_version => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:47:54.305353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:54.306116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:54.334961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:54.335482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:54.335928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:54.341413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:54.343580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:54.345521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:54.717414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-830cf088-763e-4b55-a1fb-822b1fce00e8 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.856464 Sep 19 14:47:54.718593 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1010/2047] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:47:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:54.724025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:54.725736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:54.741782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:54.746175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:54.748274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:54.749195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:54.751422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:54.752026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:54.874713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:55.360192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:55.369709 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e763a09-f96b-4b6b-9e83-1ad091aeb231 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1318 microversion: 2.1 time: 1.068578 Sep 19 14:47:55.374206 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1038/2048] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:54 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1318 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:55.391131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec6c7489-183b-447a-b5d1-728fdc173296 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29a24280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:55.451736 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec6c7489-183b-447a-b5d1-728fdc173296 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 37 microversion: 2.1 time: 0.076204 Sep 19 14:47:55.452629 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1039/2049] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:47:55 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 37 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:47:55.461633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-753dce77-b701-4a8f-9dad-fdeb77601347 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde299984c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1871039860", "description": "tempest-description-622403283"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:55.607573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:55.621497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7dfdce03-aecf-4282-b93e-b969f69a4078 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1475 microversion: 2.1 time: 0.900944 Sep 19 14:47:55.623204 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1011/2050] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:54 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1475 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:55.640588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13e0d25c-cfe5-425b-b9ca-86ea63d25c0d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2e2ae700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:55.730947 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13e0d25c-cfe5-425b-b9ca-86ea63d25c0d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.105428 Sep 19 14:47:55.732899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1012/2051] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:55 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:55.751526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-82020799", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:55.860149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] validate_networks() for [('f9e16d8c-98c4-40ea-9b7b-262bffe3641c', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:47:56.943084 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-753dce77-b701-4a8f-9dad-fdeb77601347 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.489161 Sep 19 14:47:56.944261 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1040/2052] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:47:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:56.950584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e7bd3d9-b482-432b-88ee-e196cb0ca67e tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde2980ba60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:47:57.530151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:57.549914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6e7bd3d9-b482-432b-88ee-e196cb0ca67e tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:57.564478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6e7bd3d9-b482-432b-88ee-e196cb0ca67e tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:58.496113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:47:58.497198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:47:58.498603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:47:58.499541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:47:58.500847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:47:58.550253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:58.550776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:58.551229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:58.551985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:58.552444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:58.552884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:58.625257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for project 70b97b22e77c48d59731205c993e5789. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:47:58.634193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for user e40c5acb3fa44fe2b0aa0696e3dcf8c2 and project 70b97b22e77c48d59731205c993e5789. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:47:58.674238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:47:58.677126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:47:58.754204 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8f11fc11-8a49-430e-adbd-71d90d0ea405 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.019391 Sep 19 14:47:58.762923 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1013/2053] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:47:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:47:58.769654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:58.770856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:58.780943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:58.781960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:58.782946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:58.786507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:58.787875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:58.788659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:58.965492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:58.995739 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbd8333c-77de-4b13-8781-353d26bbf76d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1318 microversion: 2.1 time: 0.229677 Sep 19 14:47:59.011100 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1014/2054] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:58 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:59.011100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:59.011100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:47:59.019307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:59.019820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:59.022802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:59.023731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:47:59.024098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:47:59.024526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:47:59.337083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:47:59.351592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e55bff31-2267-466e-939a-06d40f01277e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1475 microversion: 2.1 time: 0.352492 Sep 19 14:47:59.366888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1015/2055] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:47:58 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:59.366888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a343d82c-9f1b-4cea-addb-2f03da4144c9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2e172940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:00.206590 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a343d82c-9f1b-4cea-addb-2f03da4144c9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.851824 Sep 19 14:48:00.209703 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1016/2056] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:47:59 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:00.219153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e5ad8e40-3252-4d75-981d-a379ba8677d5 req-0a10e30d-bfc0-4fcf-abbc-b1ef0b6dc9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56bc4e2-626f-4f58-b751-104d2332d667", "tag": "3b76a253-3ccb-40fd-b477-5d121bf281f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:00.259226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e5ad8e40-3252-4d75-981d-a379ba8677d5 req-0a10e30d-bfc0-4fcf-abbc-b1ef0b6dc9b5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:00.259729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e5ad8e40-3252-4d75-981d-a379ba8677d5 req-0a10e30d-bfc0-4fcf-abbc-b1ef0b6dc9b5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:00.260189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e5ad8e40-3252-4d75-981d-a379ba8677d5 req-0a10e30d-bfc0-4fcf-abbc-b1ef0b6dc9b5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:00.341184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e5ad8e40-3252-4d75-981d-a379ba8677d5 req-0a10e30d-bfc0-4fcf-abbc-b1ef0b6dc9b5 service nova] Creating event network-changed:3b76a253-3ccb-40fd-b477-5d121bf281f4 for instance b56bc4e2-626f-4f58-b751-104d2332d667 on n-h2-858384-1 Sep 19 14:48:00.352128 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e5ad8e40-3252-4d75-981d-a379ba8677d5 req-0a10e30d-bfc0-4fcf-abbc-b1ef0b6dc9b5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141051 Sep 19 14:48:00.353042 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1017/2057] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:00.382849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-56361174", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "ab8155bb-1643-4a4f-b80c-2fe8e1d41d93"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:01.578934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e7bd3d9-b482-432b-88ee-e196cb0ca67e tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 4.633400 Sep 19 14:48:01.581275 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1041/2058] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:47:56 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 4636 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:01.891951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] validate_networks() for [('ab8155bb-1643-4a4f-b80c-2fe8e1d41d93', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:48:02.037223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d4a62c3-12c3-4cd5-956d-67c463ab7986 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Action: 'create', calling method: .version_select at 0x7fde29935310>, body: {"keypair": {"name": "tempest-keypair-2134908873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNlvPwXBu7PlI4c+x402A4ZtiSrv/n0O/MWGdjOf2eybU5FX6Gi9j0PSjEPXU5ILIVKY7CPeTYAoUnqPMytNvTGVKLK8zmktgX9TGuG+jC3btrSCo8kTyZT8emTDw4UnQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:02.084567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=37 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:02.088433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-1d4a62c3-12c3-4cd5-956d-67c463ab7986 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Getting quotas for project 50aabb0c0ff64ece9d49a90817f9c171. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:02.106370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-1d4a62c3-12c3-4cd5-956d-67c463ab7986 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Getting quotas for user 7662235a95b945d3a417c78cb457ce05 and project 50aabb0c0ff64ece9d49a90817f9c171. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:02.179812 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d4a62c3-12c3-4cd5-956d-67c463ab7986 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.597123 Sep 19 14:48:02.180587 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1042/2059] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:48:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:02.195366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:02.200402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:02.227040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:02.227860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:02.228467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:02.230025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:02.230887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:02.231502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:02.236382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:02.418924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:02.459959 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-046237ce-bef4-4968-9d8d-ae655ce5dd2f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1281 microversion: 2.1 time: 0.277527 Sep 19 14:48:02.468037 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1043/2060] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:02 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:02.494948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e2641a0b-17a3-4422-aec5-0704d9f802aa req-eeb41840-6d1b-4836-a060-5f62c866ede3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "name": "network-vif-plugged", "status": "completed", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:02.532769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e2641a0b-17a3-4422-aec5-0704d9f802aa req-eeb41840-6d1b-4836-a060-5f62c866ede3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:02.535459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e2641a0b-17a3-4422-aec5-0704d9f802aa req-eeb41840-6d1b-4836-a060-5f62c866ede3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:02.538560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e2641a0b-17a3-4422-aec5-0704d9f802aa req-eeb41840-6d1b-4836-a060-5f62c866ede3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:02.582161 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e2641a0b-17a3-4422-aec5-0704d9f802aa req-eeb41840-6d1b-4836-a060-5f62c866ede3 service nova] Creating event network-vif-plugged:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:48:02.595794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e2641a0b-17a3-4422-aec5-0704d9f802aa req-eeb41840-6d1b-4836-a060-5f62c866ede3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126135 Sep 19 14:48:02.596418 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1044/2061] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:02.613407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:02.614127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:02.643662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:02.644179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:02.644758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:02.645520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:02.645994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:02.653489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:03.302181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:03.313201 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6259205c-0ae8-4a34-8467-a66ebf508cdb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1318 microversion: 2.1 time: 0.711389 Sep 19 14:48:03.326793 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1045/2062] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:02 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:03.346177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:03.346835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:03.366023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:03.366530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:03.367011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:03.367747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:03.368209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:03.378384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:03.989428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:48:03.989976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:48:03.990433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:48:03.991546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:48:03.992220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:48:04.008835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:04.044232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:04.066320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-af1c0be0-5cb3-465e-9779-460d45b96f07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1475 microversion: 2.1 time: 0.746072 Sep 19 14:48:04.066320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1046/2063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:03 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1475 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:04.066628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=21 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:04.068297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:04.071350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:04.072036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:04.075221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:04.076001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:04.076461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:04.081235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03fbc110-b1e4-49d7-a71e-ae4bbe349fb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29778ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:04.125196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Getting quotas for project 24fe599a0fd746e6861a30dc82e1e060. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:04.139301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Getting quotas for user 3b698695cf7f467da5b0d5273c3795a5 and project 24fe599a0fd746e6861a30dc82e1e060. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:04.190690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:48:04.205206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:48:04.258391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03fbc110-b1e4-49d7-a71e-ae4bbe349fb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.192702 Sep 19 14:48:04.258977 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1047/2064] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:04 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:04.272427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3334352-dc10-4400-8d4d-2528b0835ea7 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29998790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:04.290501 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-946110de-7e73-46ec-800b-d857e60f3213 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.932656 Sep 19 14:48:04.291772 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1018/2065] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:48:04.297760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:04.299272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:04.312339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:04.313094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:04.314208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:04.317407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:04.319120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:04.320131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:04.560488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3334352-dc10-4400-8d4d-2528b0835ea7 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.299666 Sep 19 14:48:04.567222 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1048/2066] 10.222.0.81 () {58 vars in 1290 bytes} [Mon Sep 19 14:48:04 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata/os_distro => generated 33 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:04.575683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74274626-f69e-4337-8496-d30652916b14 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:04.576320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74274626-f69e-4337-8496-d30652916b14 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:04.968353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-74274626-f69e-4337-8496-d30652916b14 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:04.986360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74274626-f69e-4337-8496-d30652916b14 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1214 microversion: 2.1 time: 0.417918 Sep 19 14:48:04.990830 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1049/2067] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:04 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1214 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:05.001734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:05.010221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:05.014878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13128288-e5e4-4329-b896-1e819af4d0bc tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1323 microversion: 2.1 time: 0.721171 Sep 19 14:48:05.015885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:05.018825 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1019/2068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:04 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:05.037233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb3f5bd3-6e39-4584-9815-d2eadd248778 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde29a88af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:05.044272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:05.060138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:05.067446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:05.075156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:05.076261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:05.077240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:05.287369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-fb3f5bd3-6e39-4584-9815-d2eadd248778 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:05.301408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-fb3f5bd3-6e39-4584-9815-d2eadd248778 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:05.845212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:05.865186 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14b14406-a7ad-406c-abab-ea6f48b73139 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1318 microversion: 2.1 time: 0.872676 Sep 19 14:48:05.871182 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1050/2069] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:04 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:05.888124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:05.891658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:05.913542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:05.916415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:05.918261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:05.923000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:05.929006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:05.929993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:06.380868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:06.391829 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3fddc541-f78d-4e7f-a942-5d4ad7289116 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1474 microversion: 2.1 time: 0.518895 Sep 19 14:48:06.398362 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1051/2070] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:05 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1474 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:06.407309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8c72a799-e733-408c-a322-4d4aaa9c3b6b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2980b9d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:06.711250 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8c72a799-e733-408c-a322-4d4aaa9c3b6b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1413 microversion: 2.1 time: 0.311950 Sep 19 14:48:06.727610 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1052/2071] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:06 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1413 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:06.963744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-99aec9e5-a102-4c63-9ea7-4e81c1d6e0de req-06159891-adaf-4c92-9f9f-0f7c2482100a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56bc4e2-626f-4f58-b751-104d2332d667", "name": "network-vif-plugged", "status": "completed", "tag": "3b76a253-3ccb-40fd-b477-5d121bf281f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:06.976013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-99aec9e5-a102-4c63-9ea7-4e81c1d6e0de req-06159891-adaf-4c92-9f9f-0f7c2482100a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:06.976762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-99aec9e5-a102-4c63-9ea7-4e81c1d6e0de req-06159891-adaf-4c92-9f9f-0f7c2482100a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:06.977435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-99aec9e5-a102-4c63-9ea7-4e81c1d6e0de req-06159891-adaf-4c92-9f9f-0f7c2482100a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.016165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-99aec9e5-a102-4c63-9ea7-4e81c1d6e0de req-06159891-adaf-4c92-9f9f-0f7c2482100a service nova] Creating event network-vif-plugged:3b76a253-3ccb-40fd-b477-5d121bf281f4 for instance b56bc4e2-626f-4f58-b751-104d2332d667 on n-h2-858384-1 Sep 19 14:48:07.035797 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-99aec9e5-a102-4c63-9ea7-4e81c1d6e0de req-06159891-adaf-4c92-9f9f-0f7c2482100a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303773 Sep 19 14:48:07.037691 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1053/2072] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:07.053356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:07.055648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:07.093603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.096094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.096791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.098567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.100267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.111266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.155300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb3f5bd3-6e39-4584-9815-d2eadd248778 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 2.135101 Sep 19 14:48:07.156162 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1020/2073] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:48:05 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:07.164846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:07.165699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:07.197463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.199693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.201670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.216747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.220676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.221659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.259528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:07.278317 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2caf4e55-1d3b-48e9-9f15-985bf334b502 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1266 microversion: 2.1 time: 0.238438 Sep 19 14:48:07.296786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1054/2074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:07 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:07.399842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-cabc6956-aad0-4601-a3ab-826b28868087 req-b2061ec0-2a7a-4612-bb48-af7f2aebc501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b82c3fe-870b-49e7-970d-cd4220021ea9", "tag": "36a03116-2353-4c78-94eb-a9f4f179a8e4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:07.443068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cabc6956-aad0-4601-a3ab-826b28868087 req-b2061ec0-2a7a-4612-bb48-af7f2aebc501 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.443617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cabc6956-aad0-4601-a3ab-826b28868087 req-b2061ec0-2a7a-4612-bb48-af7f2aebc501 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.446530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cabc6956-aad0-4601-a3ab-826b28868087 req-b2061ec0-2a7a-4612-bb48-af7f2aebc501 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.467279 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-cabc6956-aad0-4601-a3ab-826b28868087 req-b2061ec0-2a7a-4612-bb48-af7f2aebc501 service nova] Creating event network-changed:36a03116-2353-4c78-94eb-a9f4f179a8e4 for instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 on n-h1-858384-1 Sep 19 14:48:07.476814 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-cabc6956-aad0-4601-a3ab-826b28868087 req-b2061ec0-2a7a-4612-bb48-af7f2aebc501 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178329 Sep 19 14:48:07.477859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1055/2075] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:07.485839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:07.486572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:07.497535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.498048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.498700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.499625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.501639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.502325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.806736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:07.824859 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa066a4f-4b87-4eaf-ba59-5b2ae89b04d3 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1323 microversion: 2.1 time: 0.666895 Sep 19 14:48:07.846173 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1021/2076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:07 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:07.850445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf671f72-108a-4ecd-a13a-fa8e789bead8 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29a889d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:07.905085 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf671f72-108a-4ecd-a13a-fa8e789bead8 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069138 Sep 19 14:48:07.905598 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1022/2077] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:48:07 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:07.916346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:07.917674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:07.934305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.935510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.936494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:07.938074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:07.939117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:07.940399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:08.497831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:08.537578 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d4bb415b-4446-4aa6-8ae6-25611065fe67 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1318 microversion: 2.1 time: 1.058237 Sep 19 14:48:08.538182 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1056/2078] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:07 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:08.559945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f045502-6a03-4353-974e-fbd62e330cc9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde299c9940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:08.634532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f045502-6a03-4353-974e-fbd62e330cc9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1422 microversion: 2.1 time: 0.090987 Sep 19 14:48:08.635991 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1057/2079] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:08 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:08.641151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d6ee1de-ff92-4272-8282-f842c6038f8d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde2994e820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:08.710634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-3d6ee1de-ff92-4272-8282-f842c6038f8d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:08.719295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-3d6ee1de-ff92-4272-8282-f842c6038f8d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:08.780542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:08.802844 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7ca52fd-54ea-412a-bc71-2f969a59a46e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1474 microversion: 2.1 time: 0.894364 Sep 19 14:48:08.805110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1023/2080] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:07 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1474 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:08.825435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:08.831946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:08.874343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:08.883575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:08.883941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:08.884746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:08.885827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:08.886186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:09.077999 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d6ee1de-ff92-4272-8282-f842c6038f8d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 0.440571 Sep 19 14:48:09.078617 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1058/2081] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:48:08 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:09.083647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3cf51189-7e1c-4832-a9d6-049e2ffc34bd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde299988b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:09.083952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:09.097716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3821ad2b-11ce-4b45-b326-76a349b16baa tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1272 microversion: 2.1 time: 0.284470 Sep 19 14:48:09.098850 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1024/2082] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:08 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:09.116051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:09.116692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:09.123830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:09.127528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:09.128205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:09.129161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:09.129797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:09.130400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:09.196228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3cf51189-7e1c-4832-a9d6-049e2ffc34bd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 200 len: 1422 microversion: 2.1 time: 0.116382 Sep 19 14:48:09.202337 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1059/2083] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:09 2022] GET /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:09.219831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7768cbf5-1502-4c18-94de-c7e3fe1b8af7 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde2994e310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:09.329147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7768cbf5-1502-4c18-94de-c7e3fe1b8af7 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:09.344183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7768cbf5-1502-4c18-94de-c7e3fe1b8af7 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:09.753930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:09.769659 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bd2264c-73c0-4ec8-bbfd-63f595dfb225 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1323 microversion: 2.1 time: 0.667857 Sep 19 14:48:09.771518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1025/2084] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:09 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1323 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:09.781608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e34df491-2259-468d-8220-34c437b68eee tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29b3eb80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:09.926232 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7768cbf5-1502-4c18-94de-c7e3fe1b8af7 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 64 microversion: 2.1 time: 0.720990 Sep 19 14:48:09.927379 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1060/2085] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:48:09 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 64 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:09.938942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66966956-5029-45de-857c-13bcc6f6cc3f", "name": "network-vif-unplugged", "status": "completed", "tag": "adbf3bd5-48b6-4b80-8902-6ec5d598fda3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:09.963044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:09.964452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:09.964993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:09.983073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] Creating event network-vif-unplugged:adbf3bd5-48b6-4b80-8902-6ec5d598fda3 for instance 66966956-5029-45de-857c-13bcc6f6cc3f on n-h1-858384-1 Sep 19 14:48:09.992297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] Instance 66966956-5029-45de-857c-13bcc6f6cc3f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:48:10.001327 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-24d87d54-965d-4f30-9e08-f245eccaeeab req-5eb1ebcf-ea4b-4db8-a1b6-7e40fd5a97cf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071110 Sep 19 14:48:10.001516 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1061/2086] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:10.009728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:10.011172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:10.019415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:10.020946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:10.021611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:10.022709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:10.023393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:10.024076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:10.585707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:10.602855 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e09cfa62-2470-4cad-9f95-cfe6687be9c6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1468 microversion: 2.1 time: 0.599295 Sep 19 14:48:10.620783 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1062/2087] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:10 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1468 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:10.632368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:10.632860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:10.663433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:10.663802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:10.664301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:10.664969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:10.669338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:10.670022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:10.950024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e34df491-2259-468d-8220-34c437b68eee tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 204 len: 0 microversion: 2.1 time: 1.177133 Sep 19 14:48:10.950826 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1026/2088] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:09 2022] DELETE /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:10.957115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f7712137-b917-43a0-b99c-c998858944ce tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29982670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:11.040759 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f7712137-b917-43a0-b99c-c998858944ce tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 64 microversion: 2.1 time: 0.088430 Sep 19 14:48:11.043117 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1027/2089] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:48:10 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 64 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:11.052130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:11.056790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:11.077077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.077944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.078628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.079600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.080291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.080930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.363079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:11.374833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e30d4b5-3b27-444b-a990-2f85db4032db tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1472 microversion: 2.1 time: 0.752868 Sep 19 14:48:11.377332 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1063/2090] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:10 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1472 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:11.383405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:11.389803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:11.404987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.407299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.408016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.408973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.409669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.410311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.454217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:11.467777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-364aa8c5-0b90-4ec5-8da5-c6a85dbe4320 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 0.422274 Sep 19 14:48:11.468604 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1028/2091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:11 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:11.478380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:11.479955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:11.487459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.488399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.489081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.490042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.490736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.491463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.911248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:11.920371 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5f56fd99-0afd-47d7-ba8a-c275a2071dae tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1467 microversion: 2.1 time: 0.541176 Sep 19 14:48:11.921105 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1064/2092] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:11 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1467 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:11.947442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:11.950492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:11.962022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:11.969432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.970956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.971345 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e6389aa9-9ec9-45a9-ab93-34b981d0c88e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1323 microversion: 2.1 time: 0.500897 Sep 19 14:48:11.971965 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1029/2093] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:11 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:11.972539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:11.974193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:11.975686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:11.977115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.001659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11eae5a3-9237-4dc8-b009-0404572d678d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde29951c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:12.064833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:48:12.138864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-11eae5a3-9237-4dc8-b009-0404572d678d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:12.151941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-11eae5a3-9237-4dc8-b009-0404572d678d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:12.247935 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2507fe1-71c3-45c0-80c7-3a607cd43ed2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 204 len: 0 microversion: 2.1 time: 0.324790 Sep 19 14:48:12.251956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1065/2094] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:48:11 2022] DELETE /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:12.284184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-131387398"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:12.288555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:12.296640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.298861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.299509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.300706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.301394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.302050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.674789 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11eae5a3-9237-4dc8-b009-0404572d678d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 0.681685 Sep 19 14:48:12.675761 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1030/2095] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:48:11 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:12.691130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-07078e5c-d2d2-44c9-bbba-9bb83de00187 req-ccf4cd4a-5ca0-4ede-9bb6-d454ede8c395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ed66d1-7d8a-4250-bac4-614eb9870aad", "tag": "b65542cf-cdee-4c3d-9d66-7d1bd9fa4335"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:12.711591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-07078e5c-d2d2-44c9-bbba-9bb83de00187 req-ccf4cd4a-5ca0-4ede-9bb6-d454ede8c395 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.712476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-07078e5c-d2d2-44c9-bbba-9bb83de00187 req-ccf4cd4a-5ca0-4ede-9bb6-d454ede8c395 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.713300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-07078e5c-d2d2-44c9-bbba-9bb83de00187 req-ccf4cd4a-5ca0-4ede-9bb6-d454ede8c395 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.740675 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-07078e5c-d2d2-44c9-bbba-9bb83de00187 req-ccf4cd4a-5ca0-4ede-9bb6-d454ede8c395 service nova] Creating event network-changed:b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 for instance 07ed66d1-7d8a-4250-bac4-614eb9870aad on n-h2-858384-1 Sep 19 14:48:12.754592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-07078e5c-d2d2-44c9-bbba-9bb83de00187 req-ccf4cd4a-5ca0-4ede-9bb6-d454ede8c395 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076549 Sep 19 14:48:12.755212 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1031/2096] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:12.766109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:12.766930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:12.789863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.790363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.790828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.792333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.792853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.793288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.879545 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94953bc9-f190-41fb-bdb1-e2019112ea9f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "POST /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265/action" status: 202 len: 0 microversion: 2.1 time: 0.625471 Sep 19 14:48:12.880839 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1066/2097] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:12 2022] POST /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:48:12.893344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:12.899615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:12.919170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.920178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.920984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.923983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:12.924808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:12.925413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:12.966009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:13.091328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:13.105472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e637ba37-b56c-40b1-af69-a20c01c981ec tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1469 microversion: 2.1 time: 0.345441 Sep 19 14:48:13.125047 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1032/2098] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:12 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:13.130843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1855654991", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "779ee5e7-92ae-45cf-806b-a3db91dc090f"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:13.201359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] validate_networks() for [('779ee5e7-92ae-45cf-806b-a3db91dc090f', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:48:13.432654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:13.450417 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df423be7-44fa-4a02-aa3a-73ae70ceeced tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 0.568163 Sep 19 14:48:13.452222 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1067/2099] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:12 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:13.459343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7c4e120-2eb9-4cf7-b290-587657c5e09d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update', calling method: .version_select at 0x7fde299359d0>, body: {"meta": {"os_version": "alt"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:13.569688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a7c4e120-2eb9-4cf7-b290-587657c5e09d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:13.585000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a7c4e120-2eb9-4cf7-b290-587657c5e09d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:13.983848 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7c4e120-2eb9-4cf7-b290-587657c5e09d tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.529562 Sep 19 14:48:13.990401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1068/2100] 10.222.0.81 () {60 vars in 1313 bytes} [Mon Sep 19 14:48:13 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata/os_version => generated 31 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:13.999367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a9fcdf6-0ccc-4330-ab2f-76bb1b0ab773 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29998790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:14.068026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a9fcdf6-0ccc-4330-ab2f-76bb1b0ab773 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1452 microversion: 2.1 time: 0.075769 Sep 19 14:48:14.068981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1069/2101] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:13 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:14.080631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:14.081258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:14.103588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.105359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:14.106031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.107240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.108408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.109233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.109828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.283870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:48:14.283870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:48:14.283870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:48:14.284143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:48:14.284639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:48:14.296694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.297469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.298492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.299863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.300914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.301630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.335388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:14.350011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for user b469a10b494b4876896c5300aa676b46 and project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:14.372233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:48:14.375505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:48:14.457936 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bcac8cc5-f52a-4894-a671-5108bb17aee2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331277 Sep 19 14:48:14.458603 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1033/2102] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:48:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:48:14.476571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b27404aa-4280-489d-993a-197536f15b8d req-55a2aa12-3f9a-4ffb-a70f-f7291613c957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5b0455-403e-47af-a5a7-63e230f449fa", "name": "network-vif-unplugged", "status": "completed", "tag": "8ef5482f-8e3a-45be-9cf2-8e69f078595f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:14.480840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b27404aa-4280-489d-993a-197536f15b8d req-55a2aa12-3f9a-4ffb-a70f-f7291613c957 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.481339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b27404aa-4280-489d-993a-197536f15b8d req-55a2aa12-3f9a-4ffb-a70f-f7291613c957 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.481777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b27404aa-4280-489d-993a-197536f15b8d req-55a2aa12-3f9a-4ffb-a70f-f7291613c957 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.496372 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b27404aa-4280-489d-993a-197536f15b8d req-55a2aa12-3f9a-4ffb-a70f-f7291613c957 service nova] Creating event network-vif-unplugged:8ef5482f-8e3a-45be-9cf2-8e69f078595f for instance be5b0455-403e-47af-a5a7-63e230f449fa on n-h2-858384-1 Sep 19 14:48:14.503049 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b27404aa-4280-489d-993a-197536f15b8d req-55a2aa12-3f9a-4ffb-a70f-f7291613c957 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036596 Sep 19 14:48:14.504608 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1034/2103] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:14.511743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:14.512213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:14.519178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.519972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.520418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.521362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.521837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.522337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.568889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:14.590322 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-89941f42-93b1-4979-b249-78c9bca1bec4 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1323 microversion: 2.1 time: 0.516352 Sep 19 14:48:14.593259 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1070/2104] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:14 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:14.607293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f13976b3-b732-471f-9fc6-ec888d98a4af tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29935a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:14.642805 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3c3fb9e-5210-40f4-b840-c9e6dad9b52a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f/action" status: 204 len: 0 microversion: 2.1 time: 0.136306 Sep 19 14:48:14.646845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1035/2105] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:14 2022] POST /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f/action => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:14.666573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de559c20-eeee-4c44-95d3-e3588b9501c0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:14.669481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de559c20-eeee-4c44-95d3-e3588b9501c0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:14.739272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f13976b3-b732-471f-9fc6-ec888d98a4af tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 58 microversion: 2.1 time: 0.144080 Sep 19 14:48:14.751454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1071/2106] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:48:14 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 58 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:14.757143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:14.758105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:14.766795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.767434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.768421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.769494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.769970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.770408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.810778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de559c20-eeee-4c44-95d3-e3588b9501c0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:14.831163 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de559c20-eeee-4c44-95d3-e3588b9501c0 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1208 microversion: 2.1 time: 0.180398 Sep 19 14:48:14.833755 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1036/2107] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:14 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1208 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:14.855228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:14.858677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:14.881381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.882594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.883533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.884574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:14.885205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:14.885695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:14.889264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:16.005858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:16.030899 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09c00112-ad40-4c93-8e6f-57489d6e62e3 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 1.277919 Sep 19 14:48:16.031822 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1072/2108] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:14 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:16.036744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ad3e25e-7804-4dde-831c-d8d6e26bda66 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'update_all', calling method: .version_select at 0x7fde2994e310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:16.048400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:16.060545 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83aa3a73-dcbe-4511-9a70-99caab39d5a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1469 microversion: 2.1 time: 1.218684 Sep 19 14:48:16.061072 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1037/2109] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:14 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1469 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:16.069991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f58744f-cad5-4c74-8b4d-e843cd3344f4 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2e172940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:16.430948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f58744f-cad5-4c74-8b4d-e843cd3344f4 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1452 microversion: 2.1 time: 0.364429 Sep 19 14:48:16.444769 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1038/2110] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:16 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1452 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:16.474331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:16.477537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:16.481977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-1ad3e25e-7804-4dde-831c-d8d6e26bda66 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:16.497645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:16.498569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:16.499745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:16.503289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:16.504084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:16.504697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:16.514932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-1ad3e25e-7804-4dde-831c-d8d6e26bda66 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:16.997337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:17.010773 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17b72064-ecfb-4c43-90fd-6b560b15ec7f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1323 microversion: 2.1 time: 0.552850 Sep 19 14:48:17.013433 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1039/2111] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:16 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:17.026012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:17.029764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:17.050431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.051036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.051387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.054359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.054873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.055315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.177270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:17.189494 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6be648b0-8713-4f27-a8a1-bff492c2d81b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1266 microversion: 2.1 time: 0.172911 Sep 19 14:48:17.189982 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1040/2112] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:17 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:17.199545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b82c3fe-870b-49e7-970d-cd4220021ea9", "name": "network-vif-plugged", "status": "completed", "tag": "36a03116-2353-4c78-94eb-a9f4f179a8e4"}, {"server_uuid": "66966956-5029-45de-857c-13bcc6f6cc3f", "name": "network-vif-plugged", "status": "completed", "tag": "adbf3bd5-48b6-4b80-8902-6ec5d598fda3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:17.247844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.248334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.248769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.292328 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Creating event network-vif-plugged:36a03116-2353-4c78-94eb-a9f4f179a8e4 for instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 on n-h1-858384-1 Sep 19 14:48:17.306509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Creating event network-vif-plugged:adbf3bd5-48b6-4b80-8902-6ec5d598fda3 for instance 66966956-5029-45de-857c-13bcc6f6cc3f on n-h1-858384-1 Sep 19 14:48:17.318877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] Instance 66966956-5029-45de-857c-13bcc6f6cc3f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:48:17.350598 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1af403cd-9f37-4368-ad5a-16e58ef4771e req-02694fa2-9ab0-49e7-aa24-90c4a0f3b260 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.159007 Sep 19 14:48:17.358160 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1041/2113] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:17.382256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3f7bd42d-9adc-445a-add5-58414f6e7d70 req-c32b4ba7-b404-4722-b649-6e3114c1ff95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5b0455-403e-47af-a5a7-63e230f449fa", "name": "network-vif-deleted", "tag": "8ef5482f-8e3a-45be-9cf2-8e69f078595f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:17.396683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3f7bd42d-9adc-445a-add5-58414f6e7d70 req-c32b4ba7-b404-4722-b649-6e3114c1ff95 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.397607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3f7bd42d-9adc-445a-add5-58414f6e7d70 req-c32b4ba7-b404-4722-b649-6e3114c1ff95 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.399416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3f7bd42d-9adc-445a-add5-58414f6e7d70 req-c32b4ba7-b404-4722-b649-6e3114c1ff95 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.421251 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3f7bd42d-9adc-445a-add5-58414f6e7d70 req-c32b4ba7-b404-4722-b649-6e3114c1ff95 service nova] Creating event network-vif-deleted:8ef5482f-8e3a-45be-9cf2-8e69f078595f for instance be5b0455-403e-47af-a5a7-63e230f449fa on n-h2-858384-1 Sep 19 14:48:17.428090 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3f7bd42d-9adc-445a-add5-58414f6e7d70 req-c32b4ba7-b404-4722-b649-6e3114c1ff95 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065429 Sep 19 14:48:17.430112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1042/2114] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:17.437919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:17.439947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:17.459196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.460635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.461480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.462604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.464323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.465072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.709068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:17.720045 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24f9cf81-546d-4eb9-addc-e847c5c8c93a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 0.288350 Sep 19 14:48:17.720641 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1043/2115] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:17 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:17.748800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:17.750092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:17.759388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.761399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.761833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:17.762796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:17.763436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:17.764723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:18.055615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:18.074195 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-efc15783-a1b4-4cba-8140-a5416945bf4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1469 microversion: 2.1 time: 0.331279 Sep 19 14:48:18.094776 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1044/2116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:17 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:18.094776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56ec59ee-491c-40ba-b89d-c8eb3ecc6dea tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a68e160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:24.317671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:24.829281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=21 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:26.010548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=17 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:26.548033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=21 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:26.570567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:27.758296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:28.062164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=35 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:29.738724 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56ec59ee-491c-40ba-b89d-c8eb3ecc6dea tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1452 microversion: 2.1 time: 11.659104 Sep 19 14:48:29.740264 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1045/2117] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:18 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1452 bytes in 11661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:29.755801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:29.756532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:29.771568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:29.772315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:29.772937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:29.774339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:29.782587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:29.785393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.095454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:30.105799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9bbec84d-1c21-41fa-a5d6-b6c25c25a6fb tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1519 microversion: 2.1 time: 0.364107 Sep 19 14:48:30.106684 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1046/2118] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:29 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:30.113013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:30.113714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:30.121314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.122452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.123091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.124139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.124754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.125333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.132279 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ad3e25e-7804-4dde-831c-d8d6e26bda66 tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 61 microversion: 2.1 time: 14.099347 Sep 19 14:48:30.133699 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1073/2119] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:48:16 2022] PUT /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 61 bytes in 14101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:30.143065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:30.143972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:30.155486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.157613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.158078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.159179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.159333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.159789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.484672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:30.494538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:30.495569 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-452e4bdb-9433-4a3b-a316-2f7d411b40dd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 0.358137 Sep 19 14:48:30.501914 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1074/2120] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:30 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:30.507527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:30.507722 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-003b3cee-d2db-45f2-a42f-872b87945eb5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1308 microversion: 2.1 time: 0.398679 Sep 19 14:48:30.511429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:30.513642 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1047/2121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:30 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:30.518731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.519234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d0d9a944-65f6-4f41-8744-ae6516acebe8 req-178f8b43-076e-40c1-99ba-96a55f49715e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "name": "network-vif-plugged", "status": "completed", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:30.522963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.523684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.525416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.526196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.526841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.533927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d0d9a944-65f6-4f41-8744-ae6516acebe8 req-178f8b43-076e-40c1-99ba-96a55f49715e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.534674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d0d9a944-65f6-4f41-8744-ae6516acebe8 req-178f8b43-076e-40c1-99ba-96a55f49715e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.535397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d0d9a944-65f6-4f41-8744-ae6516acebe8 req-178f8b43-076e-40c1-99ba-96a55f49715e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.562383 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d0d9a944-65f6-4f41-8744-ae6516acebe8 req-178f8b43-076e-40c1-99ba-96a55f49715e service nova] Creating event network-vif-plugged:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:48:30.585248 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d0d9a944-65f6-4f41-8744-ae6516acebe8 req-178f8b43-076e-40c1-99ba-96a55f49715e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069684 Sep 19 14:48:30.594973 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1048/2122] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:30.613010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2a7c629c-ea4c-4761-81ff-436ccb1272c8 req-126492ca-292b-455b-8acb-b9e60c2ae846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4625dcde-6307-4376-ad72-5ce73c514464", "tag": "cf56d438-3242-4fbe-bf8d-6222aca4b97c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:30.634069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2a7c629c-ea4c-4761-81ff-436ccb1272c8 req-126492ca-292b-455b-8acb-b9e60c2ae846 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:30.634836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2a7c629c-ea4c-4761-81ff-436ccb1272c8 req-126492ca-292b-455b-8acb-b9e60c2ae846 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:30.635827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2a7c629c-ea4c-4761-81ff-436ccb1272c8 req-126492ca-292b-455b-8acb-b9e60c2ae846 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:30.649619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2a7c629c-ea4c-4761-81ff-436ccb1272c8 req-126492ca-292b-455b-8acb-b9e60c2ae846 service nova] Creating event network-changed:cf56d438-3242-4fbe-bf8d-6222aca4b97c for instance 4625dcde-6307-4376-ad72-5ce73c514464 on n-h2-858384-1 Sep 19 14:48:30.656370 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2a7c629c-ea4c-4761-81ff-436ccb1272c8 req-126492ca-292b-455b-8acb-b9e60c2ae846 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058808 Sep 19 14:48:30.657261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1049/2123] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:30.664654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08b97bfb-b6fa-4ace-b4d5-f0900d94e09f tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Action: 'create', calling method: .version_select at 0x7fde29babc10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:30.754177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-08b97bfb-b6fa-4ace-b4d5-f0900d94e09f tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:30.772789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-08b97bfb-b6fa-4ace-b4d5-f0900d94e09f tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Getting quotas for user fb549483f5954c1483d13c2e2b0324b4 and project ac8345b3db294dd0bc33fbb6ac32d9b2. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:30.984563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:31.010648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c24bac04-41e5-4306-81f9-4d921d3ad016 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1461 microversion: 2.1 time: 0.507273 Sep 19 14:48:31.023767 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1075/2124] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:30 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1461 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:31.040749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:31.048610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:31.067158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:31.068109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:31.068849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:31.069844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:31.070550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:31.071243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:31.472320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:31.484486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-18537e70-e67f-41dc-b63b-e0bc99b0ef14 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1519 microversion: 2.1 time: 0.447802 Sep 19 14:48:31.485111 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1076/2125] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:31 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:31.491499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb26b0f0-1898-4e3e-8563-99d287d035af tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29aaab80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:31.699321 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08b97bfb-b6fa-4ace-b4d5-f0900d94e09f tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "POST /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 85 microversion: 2.1 time: 1.034666 Sep 19 14:48:31.700491 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1050/2126] 10.222.0.81 () {60 vars in 1281 bytes} [Mon Sep 19 14:48:30 2022] POST /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 85 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:31.715657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:31.716407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:31.739345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:31.739894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:31.740353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:31.741129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:31.741602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:31.742034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:31.753223 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb26b0f0-1898-4e3e-8563-99d287d035af tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1452 microversion: 2.1 time: 0.266808 Sep 19 14:48:31.753829 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1077/2127] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:31 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:31.775934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1098312306"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:31.780984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:31.794665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:31.795225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:31.796045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:31.797758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:31.799353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:31.800656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:32.133873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:32.147775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a664daa3-2a37-4248-8456-51daa8d21dc9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1461 microversion: 2.1 time: 0.445768 Sep 19 14:48:32.154633 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1051/2128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:31 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1461 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:32.162923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:32.164060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:32.178611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:32.180945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:32.181431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:32.182510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:32.183343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:32.194685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:32.369881 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-690949c0-ea32-4884-838a-c08a8b89eead tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.596447 Sep 19 14:48:32.388530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1078/2129] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:31 2022] POST /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:48:32.429484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:32.433386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:32.459598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:32.460494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:32.464364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:32.467888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:32.471142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:32.472185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:32.594820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:32.613790 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e6d48e8-4939-4fc6-b7d3-d8902f8cb050 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 0.457309 Sep 19 14:48:32.614507 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1052/2130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:32 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:32.632017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08242010-5cd7-483d-8078-4f99bc4f3c0a tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] Calling method '.version_select at 0x7fde29b3e430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:32.718486 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08242010-5cd7-483d-8078-4f99bc4f3c0a tempest-ImagesMetadataTestJSON-1649324793 tempest-ImagesMetadataTestJSON-1649324793-project] 10.222.0.81 "GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata" status: 200 len: 85 microversion: 2.1 time: 0.090594 Sep 19 14:48:32.719110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1053/2131] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:48:32 2022] GET /compute/v2.1/images/d865a1fb-9487-4a87-863c-71e288167748/metadata => generated 85 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:32.728257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44a1c7d1-1f70-4d93-93b9-4133f4a89ae6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'create', calling method: .version_select at 0x7fde29a24280>, body: {"keypair": {"name": "tempest-keypair-1525947213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+FMDGv1ja1vASBgNw8GBYQuhCZU4RU0yFnqMNhPLZDy4MaD+xi28DAlSq95p3eLpUMyui1yLKpBaEWj6hTiWbJai3uUIPAL6Qgwwru0iKbE6hkcJuDmhE+pUbqS9MQ4Q=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:32.792318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-44a1c7d1-1f70-4d93-93b9-4133f4a89ae6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:32.808363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-44a1c7d1-1f70-4d93-93b9-4133f4a89ae6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for user e2149c78b4d04c10b02d521a5635b29f and project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:32.885018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-44a1c7d1-1f70-4d93-93b9-4133f4a89ae6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162478 Sep 19 14:48:32.889418 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1054/2132] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:48:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:32.929700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ebb6f279-ef7f-424e-ba11-1ee259ce3304 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '.version_select at 0x7fde29982940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:32.996635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:33.011962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab51734f-384c-40a2-8479-1a42087c4c21 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1308 microversion: 2.1 time: 0.618853 Sep 19 14:48:33.026989 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1079/2133] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:32 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:33.041691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed66d1-7d8a-4250-bac4-614eb9870aad", "name": "network-vif-plugged", "status": "completed", "tag": "b65542cf-cdee-4c3d-9d66-7d1bd9fa4335"}, {"server_uuid": "4625dcde-6307-4376-ad72-5ce73c514464", "name": "network-vif-plugged", "status": "completed", "tag": "cf56d438-3242-4fbe-bf8d-6222aca4b97c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:33.080536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:33.084954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:33.085479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:33.104574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] Creating event network-vif-plugged:b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 for instance 07ed66d1-7d8a-4250-bac4-614eb9870aad on n-h2-858384-1 Sep 19 14:48:33.105784 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] Creating event network-vif-plugged:cf56d438-3242-4fbe-bf8d-6222aca4b97c for instance 4625dcde-6307-4376-ad72-5ce73c514464 on n-h2-858384-1 Sep 19 14:48:33.113849 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b550e83e-226a-4db0-a936-5529118e2160 req-800aa7d4-288d-43da-8188-e0ab9e9ed604 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093963 Sep 19 14:48:33.114572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1080/2134] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:33.120789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c741b8a-d2f0-4854-a93e-c9120a7ec8c0 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29a9b670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:34.268166 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ebb6f279-ef7f-424e-ba11-1ee259ce3304 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278" status: 204 len: 0 microversion: 2.1 time: 1.376561 Sep 19 14:48:34.270279 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1055/2135] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:32 2022] DELETE /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278 => generated 0 bytes in 1380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:34.276589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:34.287170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:34.306352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:34.311411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:34.313621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:34.327221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:34.328076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:34.328755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:34.354988 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c741b8a-d2f0-4854-a93e-c9120a7ec8c0 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1452 microversion: 2.1 time: 1.236776 Sep 19 14:48:34.356300 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1081/2136] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:33 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1452 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:34.362321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:34.363628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:34.375283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:34.376318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:34.377024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:34.378012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:34.379578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:34.389486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:35.001538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:35.015601 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad8e343b-dbfc-4fc9-8ad9-2bccebf7926a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1308 microversion: 2.1 time: 0.657918 Sep 19 14:48:35.017385 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1082/2137] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:34 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1308 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:35.024700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f74bcb7b-e176-4995-bc62-6b295cb40a57 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '.version_select at 0x7fde29a9be50>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:35.037469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:35.048929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-72e12b37-5c11-47a6-8b33-cc100e3eef5b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1314 microversion: 2.1 time: 0.777253 Sep 19 14:48:35.056420 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1056/2138] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:34 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:35.069350 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f74bcb7b-e176-4995-bc62-6b295cb40a57 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Image not found. Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f74bcb7b-e176-4995-bc62-6b295cb40a57 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278 HTTP/1.1 Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:48:35.090800 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '44ec693a-a7fb-49d1-9b89-bfd293c2f278'} Sep 19 14:48:35.092417 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:35.093351 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 44ec693a-a7fb-49d1-9b89-bfd293c2f278 Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:35.094882 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44ec693a-a7fb-49d1-9b89-bfd293c2f278 could not be found. Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:35.096421 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:35.097769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f74bcb7b-e176-4995-bc62-6b295cb40a57 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:35.098870 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f74bcb7b-e176-4995-bc62-6b295cb40a57 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278" status: 404 len: 62 microversion: 2.1 time: 0.073786 Sep 19 14:48:35.098870 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1083/2139] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:35 2022] GET /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:35.104864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:35.105601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:35.116583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:35.116865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:35.117128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:35.117851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:35.119637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:35.120739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:35.367858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:35.379859 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-943a3b90-71a0-4fc6-bdae-0dbbbb6018a2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1537 microversion: 2.1 time: 0.281096 Sep 19 14:48:35.381543 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1057/2140] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:35 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1537 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:35.390136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b5e9f78-15ef-46ea-be32-a2e4bc4b1132 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29a9d790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:35.473230 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b5e9f78-15ef-46ea-be32-a2e4bc4b1132 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1461 microversion: 2.1 time: 0.094839 Sep 19 14:48:35.474005 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1084/2141] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:35 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:35.491756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24153293-ef38-44ae-b04a-f6c90c01af0c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29ae48b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:35.549227 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24153293-ef38-44ae-b04a-f6c90c01af0c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 200 len: 1461 microversion: 2.1 time: 0.061230 Sep 19 14:48:35.550035 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1058/2142] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:35 2022] GET /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 1461 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:35.586221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:35.587969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:35.597153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:35.597764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:35.598288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:35.599250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:35.600676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:35.601209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:35.875772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:35.889007 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-caf61d3a-6719-4a4a-8c93-399d0cfa3bd6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1467 microversion: 2.1 time: 0.326184 Sep 19 14:48:35.890530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1085/2143] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:35 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:35.916103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2063841014"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:35.918537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:35.936676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:35.937190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:35.937639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:35.938377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:35.938883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:35.939310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:36.045973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:36.046884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:36.056187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:36.057591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:36.058264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:36.067768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:36.068752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:36.069403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:36.382544 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9009497d-7e24-4c4b-b018-4074aa7aaa4c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "POST /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667/action" status: 202 len: 0 microversion: 2.1 time: 0.470711 Sep 19 14:48:36.384651 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1059/2144] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:35 2022] POST /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:48:36.420820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:36.421538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:36.453382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:36.454841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:36.454841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:36.457251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:36.457733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:36.458166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:36.763361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:36.779850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab2f751b-3e8c-4e36-a085-24837c4c8161 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1488 microversion: 2.1 time: 0.739547 Sep 19 14:48:36.780469 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1086/2145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:36 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1488 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:36.785702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abce4581-b2fd-4ead-9eed-8ae90d75a8f0 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29a9d5e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:36.910794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abce4581-b2fd-4ead-9eed-8ae90d75a8f0 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.128971 Sep 19 14:48:36.911398 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1087/2146] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:36 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:36.920350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:36.922062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:36.941814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:36.942480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:36.942983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:36.944618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:36.945195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:36.945641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:37.037630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:37.049051 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d77932f-057e-4b6b-991e-116bea765a2a tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1502 microversion: 2.1 time: 0.662848 Sep 19 14:48:37.062888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1060/2147] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:36 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:37.062888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c60cf499-2737-40b0-a933-ef5f8b77ec9f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:37.080289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c60cf499-2737-40b0-a933-ef5f8b77ec9f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:37.080810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c60cf499-2737-40b0-a933-ef5f8b77ec9f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:37.081265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c60cf499-2737-40b0-a933-ef5f8b77ec9f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:37.249160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c60cf499-2737-40b0-a933-ef5f8b77ec9f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Going to try to stop instance {{(pid=128731) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:48:37.332769 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c60cf499-2737-40b0-a933-ef5f8b77ec9f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464/action" status: 202 len: 0 microversion: 2.1 time: 0.276293 Sep 19 14:48:37.346841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1061/2148] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:37 2022] POST /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:48:37.375905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1055238722"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:37.378329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:37.402377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:37.405095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:37.405572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:37.406338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:37.410813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:37.413434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:37.642433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:37.660336 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51063243-863b-477c-942a-4a2f0346d963 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1519 microversion: 2.1 time: 0.742292 Sep 19 14:48:37.684996 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1088/2149] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:36 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1519 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:37.698147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3615b902-1f8c-45b1-93ec-93cb17d7447b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '.version_select at 0x7fde29a9dee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:37.707392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3615b902-1f8c-45b1-93ec-93cb17d7447b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:37.708641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3615b902-1f8c-45b1-93ec-93cb17d7447b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:37.709662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3615b902-1f8c-45b1-93ec-93cb17d7447b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:37.727640 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3615b902-1f8c-45b1-93ec-93cb17d7447b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.035581 Sep 19 14:48:37.729242 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1089/2150] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 14:48:37 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:37.744140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:37.747641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:37.764791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:37.765777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Adding security group 1cd9f039-f796-4a33-9611-2830032e0656 to port b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 Sep 19 14:48:37.767125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:37.768387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:37.769986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:37.772224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:37.773926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:38.187025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:38.237962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c07f3d8-d28b-47ff-ba0a-1b767c796bff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.502328 Sep 19 14:48:38.241141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1090/2151] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:37 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:38.460703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0cf36b98-7128-4739-acea-4b9bb979f397 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Calling method '.version_select at 0x7fde29aaa4c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:38.496902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0cf36b98-7128-4739-acea-4b9bb979f397 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] HTTP exception thrown: Image not found. Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0cf36b98-7128-4739-acea-4b9bb979f397 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Request method failure captured: Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/images/5943c9e9-31ba-47ed-a85e-922e7fffcc35/metadata/os_distro HTTP/1.1 Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIFFIGIMSd6IxFPI8T3QpeTqlEFR4dJzExl_93tKuTJTeK8MrHqIQqX3IkuJHHacy3VINkD_XeTyaz3vgH3XmuzMQAl0Pa1H-YqDvIWQR33oL4Xseq90bNMwW6G89-ODtMuo4z04jcPLCwlgqgTYNe_5AJ1cJ-HrvM49jatvcAm3OMw Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:48:38.506518 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7683ed137b1a4ca387023f05814a933d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7683ed137b1a4ca387023f05814a933d"}]}] Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 791bc7ecdbaf4753946c7e96542b517f Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'image_id': '5943c9e9-31ba-47ed-a85e-922e7fffcc35', 'id': 'os_distro'} Sep 19 14:48:38.507936 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:38.509559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5943c9e9-31ba-47ed-a85e-922e7fffcc35 Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:38.510857 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5943c9e9-31ba-47ed-a85e-922e7fffcc35 could not be found. Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:38.511947 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.512957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0cf36b98-7128-4739-acea-4b9bb979f397 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:38.514242 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0cf36b98-7128-4739-acea-4b9bb979f397 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] 10.222.0.81 "DELETE /compute/v2.1/images/5943c9e9-31ba-47ed-a85e-922e7fffcc35/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.265808 Sep 19 14:48:38.516295 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1091/2152] 10.222.0.81 () {58 vars in 1293 bytes} [Mon Sep 19 14:48:38 2022] DELETE /compute/v2.1/images/5943c9e9-31ba-47ed-a85e-922e7fffcc35/metadata/os_distro => generated 62 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:38.527277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:38.533239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:38.545001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:38.545640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:38.546305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:38.547136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:38.547885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:38.548327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:38.591435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:48:38.652824 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e2fc1eb-bad5-463b-b750-4735efcd1af2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad/action" status: 202 len: 0 microversion: 2.1 time: 1.304397 Sep 19 14:48:38.653886 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1062/2153] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:37 2022] POST /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad/action => generated 0 bytes in 1307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:48:38.673556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c56d6eef-ef01-4e06-b9a2-e9e02a2b9ff1 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:38.701295 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c56d6eef-ef01-4e06-b9a2-e9e02a2b9ff1 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045069 Sep 19 14:48:38.702898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1063/2154] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:48:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:38.721482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26175b17-13e6-47fb-a35c-1da300566b20 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29b9c160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:38.799676 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1dcd9787-667a-4cfa-86d1-c60dddecee08 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 204 len: 0 microversion: 2.1 time: 0.278110 Sep 19 14:48:38.801901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1092/2155] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:48:38 2022] DELETE /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:38.814206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1be7bf9-41c8-4f08-8403-14a66a9f553b tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Calling method '.version_select at 0x7fde29b13b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:38.858790 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d1be7bf9-41c8-4f08-8403-14a66a9f553b tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] HTTP exception thrown: Image not found. Sep 19 14:48:38.860640 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26175b17-13e6-47fb-a35c-1da300566b20 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.153267 Sep 19 14:48:38.861383 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1064/2156] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:38 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1be7bf9-41c8-4f08-8403-14a66a9f553b tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Request method failure captured: Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/images/7fa60421-3d24-4993-a369-683cf86a45bf/metadata/os_version HTTP/1.1 Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIFFIGIMSd6IxFPI8T3QpeTqlEFR4dJzExl_93tKuTJTeK8MrHqIQqX3IkuJHHacy3VINkD_XeTyaz3vgH3XmuzMQAl0Pa1H-YqDvIWQR33oL4Xseq90bNMwW6G89-ODtMuo4z04jcPLCwlgqgTYNe_5AJ1cJ-HrvM49jatvcAm3OMw Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:48:38.868404 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7683ed137b1a4ca387023f05814a933d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7683ed137b1a4ca387023f05814a933d"}]}] Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 791bc7ecdbaf4753946c7e96542b517f Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'image_id': '7fa60421-3d24-4993-a369-683cf86a45bf', 'id': 'os_version'} Sep 19 14:48:38.869881 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:38.870622 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7fa60421-3d24-4993-a369-683cf86a45bf Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:38.871652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7fa60421-3d24-4993-a369-683cf86a45bf could not be found. Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:38.872785 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:38.873817 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:38.878457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1be7bf9-41c8-4f08-8403-14a66a9f553b tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:38.879042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-227ae425-6301-4771-8fcd-519989b14f61 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29a244c0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:38.879210 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1be7bf9-41c8-4f08-8403-14a66a9f553b tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] 10.222.0.81 "GET /compute/v2.1/images/7fa60421-3d24-4993-a369-683cf86a45bf/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.073501 Sep 19 14:48:38.881106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1093/2157] 10.222.0.81 () {58 vars in 1293 bytes} [Mon Sep 19 14:48:38 2022] GET /compute/v2.1/images/7fa60421-3d24-4993-a369-683cf86a45bf/metadata/os_version => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:38.904320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1908e390-c0e8-420d-b20a-c3867e2ef207 req-ecb4adc4-4bfb-4afc-8757-cebba2464816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ed66d1-7d8a-4250-bac4-614eb9870aad", "tag": "b65542cf-cdee-4c3d-9d66-7d1bd9fa4335"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:38.942254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1908e390-c0e8-420d-b20a-c3867e2ef207 req-ecb4adc4-4bfb-4afc-8757-cebba2464816 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:38.943284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1908e390-c0e8-420d-b20a-c3867e2ef207 req-ecb4adc4-4bfb-4afc-8757-cebba2464816 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:38.944066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1908e390-c0e8-420d-b20a-c3867e2ef207 req-ecb4adc4-4bfb-4afc-8757-cebba2464816 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:38.967653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1908e390-c0e8-420d-b20a-c3867e2ef207 req-ecb4adc4-4bfb-4afc-8757-cebba2464816 service nova] Creating event network-changed:b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 for instance 07ed66d1-7d8a-4250-bac4-614eb9870aad on n-h2-858384-1 Sep 19 14:48:38.976897 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1908e390-c0e8-420d-b20a-c3867e2ef207 req-ecb4adc4-4bfb-4afc-8757-cebba2464816 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089935 Sep 19 14:48:38.980320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1094/2158] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:39.009771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c0e371d-2372-44e7-b179-b860ce618f2b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1311547393", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:39.072270 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c0e371d-2372-44e7-b179-b860ce618f2b tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.087352 Sep 19 14:48:39.073432 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1095/2159] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Sep 19 14:48:38 2022] POST /compute/v2.1/flavors => generated 499 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:39.086878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:39.088210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:39.093544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-227ae425-6301-4771-8fcd-519989b14f61 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use.", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:48:39.094256 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-227ae425-6301-4771-8fcd-519989b14f61 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.094256 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-227ae425-6301-4771-8fcd-519989b14f61 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656 HTTP/1.1 Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:48:39.096894 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: exception: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] Sep 19 14:48:39.105432 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1cd9f039-f796-4a33-9611-2830032e0656'} Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:39.107388 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.111048 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.113473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-227ae425-6301-4771-8fcd-519989b14f61 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 400 to user: Security Group 1cd9f039-f796-4a33-9611-2830032e0656 in use. Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-64c9cec5-1b11-4b30-a846-2009716da926'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-227ae425-6301-4771-8fcd-519989b14f61 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656" status: 400 len: 185 microversion: 2.1 time: 0.235346 Sep 19 14:48:39.120813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1065/2160] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:48:38 2022] DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656 => generated 185 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:48:39.122897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:39.122897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:39.122897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:39.122897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:39.123741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:39.123741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:39.124351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d51b8143-c745-4111-acc9-b95086e80559 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Calling method '.version_select at 0x7fde29a7b670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:39.149602 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d51b8143-c745-4111-acc9-b95086e80559 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] HTTP exception thrown: Image not found. Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d51b8143-c745-4111-acc9-b95086e80559 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Request method failure captured: Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/images/efc73358-c09a-483e-9024-7816b8fb0f26/metadata HTTP/1.1 Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIFFIGIMSd6IxFPI8T3QpeTqlEFR4dJzExl_93tKuTJTeK8MrHqIQqX3IkuJHHacy3VINkD_XeTyaz3vgH3XmuzMQAl0Pa1H-YqDvIWQR33oL4Xseq90bNMwW6G89-ODtMuo4z04jcPLCwlgqgTYNe_5AJ1cJ-HrvM49jatvcAm3OMw Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:48:39.153979 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7683ed137b1a4ca387023f05814a933d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7683ed137b1a4ca387023f05814a933d"}]}] Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 791bc7ecdbaf4753946c7e96542b517f Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'image_id': 'efc73358-c09a-483e-9024-7816b8fb0f26'} Sep 19 14:48:39.155352 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:39.156073 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID efc73358-c09a-483e-9024-7816b8fb0f26 Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:39.157114 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image efc73358-c09a-483e-9024-7816b8fb0f26 could not be found. Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:39.158288 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:39.159408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.163379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d51b8143-c745-4111-acc9-b95086e80559 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:39.164467 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d51b8143-c745-4111-acc9-b95086e80559 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] 10.222.0.81 "GET /compute/v2.1/images/efc73358-c09a-483e-9024-7816b8fb0f26/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064451 Sep 19 14:48:39.166351 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1066/2161] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 14:48:39 2022] GET /compute/v2.1/images/efc73358-c09a-483e-9024-7816b8fb0f26/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:39.171687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-761425b3-1b47-43a6-bd64-82046033dd98 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:39.184532 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-761425b3-1b47-43a6-bd64-82046033dd98 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016785 Sep 19 14:48:39.208581 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1067/2162] 10.222.0.81 () {58 vars in 1182 bytes} [Mon Sep 19 14:48:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:48:39.223056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:39.229063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:39.253294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:39.256849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:39.257318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:39.259341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:39.261800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:39.263266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:39.453397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-54e50f09-4271-4d9e-bb46-e1e577d59a4d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad/action" status: 202 len: 0 microversion: 2.1 time: 0.235413 Sep 19 14:48:39.463353 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1068/2163] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:39 2022] POST /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:48:39.470252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-66165ab4-4e06-418d-919f-c06c5d922ad4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Action: 'update_all', calling method: .version_select at 0x7fde29b9cc10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:39.567142 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-66165ab4-4e06-418d-919f-c06c5d922ad4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] HTTP exception thrown: Image not found. Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-66165ab4-4e06-418d-919f-c06c5d922ad4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Request method failure captured: Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/images/a2b1c6b2-0667-4916-9682-75454a8b8d66/metadata HTTP/1.1 Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 57 Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIFFIGIMSd6IxFPI8T3QpeTqlEFR4dJzExl_93tKuTJTeK8MrHqIQqX3IkuJHHacy3VINkD_XeTyaz3vgH3XmuzMQAl0Pa1H-YqDvIWQR33oL4Xseq90bNMwW6G89-ODtMuo4z04jcPLCwlgqgTYNe_5AJ1cJ-HrvM49jatvcAm3OMw Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:48:39.569439 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7683ed137b1a4ca387023f05814a933d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7683ed137b1a4ca387023f05814a933d"}]}] Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 791bc7ecdbaf4753946c7e96542b517f Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:48:39.572372 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'image_id': 'a2b1c6b2-0667-4916-9682-75454a8b8d66', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:39.581772 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a2b1c6b2-0667-4916-9682-75454a8b8d66 Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:39.585563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2b1c6b2-0667-4916-9682-75454a8b8d66 could not be found. Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:39.592885 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:39.601230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:39.606875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-66165ab4-4e06-418d-919f-c06c5d922ad4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:39.606875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-66165ab4-4e06-418d-919f-c06c5d922ad4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] 10.222.0.81 "PUT /compute/v2.1/images/a2b1c6b2-0667-4916-9682-75454a8b8d66/metadata" status: 404 len: 62 microversion: 2.1 time: 0.105894 Sep 19 14:48:39.606875 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1069/2164] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:48:39 2022] PUT /compute/v2.1/images/a2b1c6b2-0667-4916-9682-75454a8b8d66/metadata => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:39.606875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:39.606875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:39.627276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:39.627794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:39.628252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:39.631958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:39.632906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:39.634399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:40.029825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:40.039426 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-18131005-f5c6-4bf1-8d41-402c45d571c7 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.465970 Sep 19 14:48:40.046873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:40.048486 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1070/2165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:39 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:40.064217 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0529047c-67fe-4003-8e27-b45ced7ded88 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1525 microversion: 2.1 time: 0.982835 Sep 19 14:48:40.067652 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1096/2166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:39 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1525 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:40.072196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:40.073115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:40.080469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:40.080899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1818156456", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "3a9eca60-a465-432c-a880-ce3f6daccf88"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:40.081413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:40.082040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:40.082989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:40.083638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:40.084256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:40.175263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:48:40.979151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:40.983347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:41.002230 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59fe84bb-0e97-4556-b6e0-7228a3cc39cd tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1573 microversion: 2.1 time: 0.935700 Sep 19 14:48:41.003096 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1071/2167] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:40 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1573 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:41.008501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68b675cf-4b9d-4ba6-975c-1fcdba047746 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Action: 'update', calling method: .version_select at 0x7fde29a7b8b0>, body: {"meta": {"os_distro": "alt"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:41.064223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-68b675cf-4b9d-4ba6-975c-1fcdba047746 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] HTTP exception thrown: Image not found. Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68b675cf-4b9d-4ba6-975c-1fcdba047746 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Request method failure captured: Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/images/eae3828c-f377-44e5-9a99-fbed3bbc2547/metadata/os_distro HTTP/1.1 Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 30 Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIFFIGIMSd6IxFPI8T3QpeTqlEFR4dJzExl_93tKuTJTeK8MrHqIQqX3IkuJHHacy3VINkD_XeTyaz3vgH3XmuzMQAl0Pa1H-YqDvIWQR33oL4Xseq90bNMwW6G89-ODtMuo4z04jcPLCwlgqgTYNe_5AJ1cJ-HrvM49jatvcAm3OMw Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:48:41.068003 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7683ed137b1a4ca387023f05814a933d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7683ed137b1a4ca387023f05814a933d"}]}] Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 791bc7ecdbaf4753946c7e96542b517f Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: {"meta": {"os_distro": "alt"}} Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:48:41.069499 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'image_id': 'eae3828c-f377-44e5-9a99-fbed3bbc2547', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:41.070324 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID eae3828c-f377-44e5-9a99-fbed3bbc2547 Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:41.073404 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eae3828c-f377-44e5-9a99-fbed3bbc2547 could not be found. Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:41.074692 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:41.075984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.079089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68b675cf-4b9d-4ba6-975c-1fcdba047746 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:41.081612 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68b675cf-4b9d-4ba6-975c-1fcdba047746 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] 10.222.0.81 "PUT /compute/v2.1/images/eae3828c-f377-44e5-9a99-fbed3bbc2547/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.076608 Sep 19 14:48:41.082678 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1072/2168] 10.222.0.81 () {60 vars in 1310 bytes} [Mon Sep 19 14:48:41 2022] PUT /compute/v2.1/images/eae3828c-f377-44e5-9a99-fbed3bbc2547/metadata/os_distro => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:41.089705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-eebe4ee6-2dfa-4fa9-b4ad-ffbe924f1973 req-ab02dc94-f788-4d0a-a466-44743c7e1862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "name": "network-vif-unplugged", "status": "completed", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:41.117357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-eebe4ee6-2dfa-4fa9-b4ad-ffbe924f1973 req-ab02dc94-f788-4d0a-a466-44743c7e1862 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.119012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-eebe4ee6-2dfa-4fa9-b4ad-ffbe924f1973 req-ab02dc94-f788-4d0a-a466-44743c7e1862 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.119769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-eebe4ee6-2dfa-4fa9-b4ad-ffbe924f1973 req-ab02dc94-f788-4d0a-a466-44743c7e1862 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.135927 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-eebe4ee6-2dfa-4fa9-b4ad-ffbe924f1973 req-ab02dc94-f788-4d0a-a466-44743c7e1862 service nova] Creating event network-vif-unplugged:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:48:41.142128 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-eebe4ee6-2dfa-4fa9-b4ad-ffbe924f1973 req-ab02dc94-f788-4d0a-a466-44743c7e1862 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058027 Sep 19 14:48:41.143123 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1073/2169] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:41.148714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d2e7abd-9c7d-4997-8011-73891c374db5 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde298a4430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:41.198244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:48:41.199482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:48:41.201127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:48:41.202251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:48:41.203128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:48:41.216507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.217064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d2e7abd-9c7d-4997-8011-73891c374db5 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.072702 Sep 19 14:48:41.217595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.217841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1074/2170] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:41 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:41.218500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.223154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:41.223790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:41.227732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.228746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.229381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.233969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.234491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.234962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.235683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.236219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.236665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.259272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:41.269858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for user e2149c78b4d04c10b02d521a5635b29f and project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:41.290442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:48:41.293871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:48:41.390136 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b226ecf2-e9cd-4e03-b6fc-b239cfb6c2ea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.320934 Sep 19 14:48:41.395429 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1097/2171] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:48:41.406254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:41.407334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:41.428593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.431595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.436776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.452953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:41.454764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:41.455392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:41.460570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:41.489179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:41.501631 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-baec2324-e907-4a76-8ac8-1aa25cfae764 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.282561 Sep 19 14:48:41.503801 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1075/2172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:41 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:41.522089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b85bd821-2033-4d5e-967a-b7926b56caa4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Action: 'create', calling method: .version_select at 0x7fde29ae5af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:41.576766 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b85bd821-2033-4d5e-967a-b7926b56caa4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] HTTP exception thrown: Image not found. Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b85bd821-2033-4d5e-967a-b7926b56caa4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Request method failure captured: Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/images/48f391de-5e7a-4b73-bda9-e85f98057531/metadata HTTP/1.1 Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 57 Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIFFIGIMSd6IxFPI8T3QpeTqlEFR4dJzExl_93tKuTJTeK8MrHqIQqX3IkuJHHacy3VINkD_XeTyaz3vgH3XmuzMQAl0Pa1H-YqDvIWQR33oL4Xseq90bNMwW6G89-ODtMuo4z04jcPLCwlgqgTYNe_5AJ1cJ-HrvM49jatvcAm3OMw Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:48:41.579720 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7683ed137b1a4ca387023f05814a933d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7683ed137b1a4ca387023f05814a933d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7683ed137b1a4ca387023f05814a933d"}]}] Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 7683ed137b1a4ca387023f05814a933d Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-559767302 Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 791bc7ecdbaf4753946c7e96542b517f Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-559767302-project Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:48:41.581538 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'image_id': '48f391de-5e7a-4b73-bda9-e85f98057531', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:41.582509 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48f391de-5e7a-4b73-bda9-e85f98057531 Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:48:41.583757 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48f391de-5e7a-4b73-bda9-e85f98057531 could not be found. Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:41.585204 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:48:41.587664 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:41.590143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b85bd821-2033-4d5e-967a-b7926b56caa4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:41.590143 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b85bd821-2033-4d5e-967a-b7926b56caa4 tempest-ImagesMetadataNegativeTestJSON-559767302 tempest-ImagesMetadataNegativeTestJSON-559767302-project] 10.222.0.81 "POST /compute/v2.1/images/48f391de-5e7a-4b73-bda9-e85f98057531/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080557 Sep 19 14:48:41.596908 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1076/2173] 10.222.0.81 () {60 vars in 1281 bytes} [Mon Sep 19 14:48:41 2022] POST /compute/v2.1/images/48f391de-5e7a-4b73-bda9-e85f98057531/metadata => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:48:41.612088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbbfb8b3-6044-41c3-b806-9d5e0081bfdb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:41.612736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbbfb8b3-6044-41c3-b806-9d5e0081bfdb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:41.753718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbbfb8b3-6044-41c3-b806-9d5e0081bfdb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:41.764768 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbbfb8b3-6044-41c3-b806-9d5e0081bfdb tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1279 microversion: 2.1 time: 0.165503 Sep 19 14:48:41.770367 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1077/2174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:41 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:41.790536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1122256739", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f337a3a1-e6fb-48f4-97c8-4a8bfaebba33"}], "security_groups": [{"name": "tempest-securitygroup--1234804079"}], "key_name": "tempest-keypair-2134908873", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "354ab56a-9140-4d7e-a2f2-66de89166363", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:41.819867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:41.877708 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e85bc27f-074f-4b44-8133-5cff60166926 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 200 len: 1525 microversion: 2.1 time: 0.480665 Sep 19 14:48:41.898353 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1098/2175] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:41 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 1525 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:42.043497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:42.044839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:42.061237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:42.065291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:42.070359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:42.073503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:42.077117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:42.084818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:42.169070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] validate_networks() for [('f337a3a1-e6fb-48f4-97c8-4a8bfaebba33', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:48:42.944160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:42.959221 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82bb352d-20cb-4857-9d2c-73e3d19f657d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1573 microversion: 2.1 time: 0.924115 Sep 19 14:48:42.962132 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1099/2176] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:42 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1573 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:42.977884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2b58e53-1e0e-4cd5-9f03-8de982c98962 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29aa04c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:43.168093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2b58e53-1e0e-4cd5-9f03-8de982c98962 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.199230 Sep 19 14:48:43.188962 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1100/2177] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:42 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:43.200924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:43.202632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:43.222184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:43.229930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:43.230916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:43.232030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:43.232760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:43.233565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.071342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:44.107275 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eacc404d-955a-4d32-8ec1-6820111e019e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.909114 Sep 19 14:48:44.140408 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1101/2178] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:43 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:44.155305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-93279fce-f010-40de-8e36-75668cbb74ee req-1c91c9da-eeb5-40c4-9d91-21ff3c6764fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b82c3fe-870b-49e7-970d-cd4220021ea9", "name": "network-vif-deleted", "tag": "36a03116-2353-4c78-94eb-a9f4f179a8e4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:44.179538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93279fce-f010-40de-8e36-75668cbb74ee req-1c91c9da-eeb5-40c4-9d91-21ff3c6764fc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.181642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93279fce-f010-40de-8e36-75668cbb74ee req-1c91c9da-eeb5-40c4-9d91-21ff3c6764fc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.182582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-93279fce-f010-40de-8e36-75668cbb74ee req-1c91c9da-eeb5-40c4-9d91-21ff3c6764fc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.212391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-93279fce-f010-40de-8e36-75668cbb74ee req-1c91c9da-eeb5-40c4-9d91-21ff3c6764fc service nova] Creating event network-vif-deleted:36a03116-2353-4c78-94eb-a9f4f179a8e4 for instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 on n-h1-858384-1 Sep 19 14:48:44.221416 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-93279fce-f010-40de-8e36-75668cbb74ee req-1c91c9da-eeb5-40c4-9d91-21ff3c6764fc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078897 Sep 19 14:48:44.223810 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1102/2179] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:44.236946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:44.238619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:44.271559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.272114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.272737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.273522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.274192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.276139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.309195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Getting quotas for project 50aabb0c0ff64ece9d49a90817f9c171. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:44.326320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Getting quotas for user 7662235a95b945d3a417c78cb457ce05 and project 50aabb0c0ff64ece9d49a90817f9c171. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:44.355946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:48:44.356807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:48:44.358015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:48:44.359044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:48:44.359778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:48:44.397567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.398532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.400208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.401740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.402561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.403356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.457307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Getting quotas for project 50aabb0c0ff64ece9d49a90817f9c171. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:44.470861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Getting quotas for user 7662235a95b945d3a417c78cb457ce05 and project 50aabb0c0ff64ece9d49a90817f9c171. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:44.592368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:44.604177 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6896e3e3-bdb1-42c3-a35c-69895839f544 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1331 microversion: 2.1 time: 0.377550 Sep 19 14:48:44.605307 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1103/2180] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:44 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1331 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:44.612373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:44.613230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:44.625539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.640847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.642125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.643438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.644300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.645071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.667338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 HTTP/1.1 Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:48:44.670080 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:48:44.672724 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '0b82c3fe-870b-49e7-970d-cd4220021ea9'} Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:44.674048 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:48:44.676212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:48:44.678148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:44.678148 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dad556e5-9350-47c4-b30e-2375291f6e2a tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 404 len: 111 microversion: 2.1 time: 0.065223 Sep 19 14:48:44.678148 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1104/2181] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:44 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:48:44.680979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2b3d4fe8-29f1-41ac-bf56-215a854a0c12 req-33511074-4e66-4458-bd34-fdbe2f92f876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56bc4e2-626f-4f58-b751-104d2332d667", "name": "network-vif-plugged", "status": "completed", "tag": "3b76a253-3ccb-40fd-b477-5d121bf281f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:44.734534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2b3d4fe8-29f1-41ac-bf56-215a854a0c12 req-33511074-4e66-4458-bd34-fdbe2f92f876 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.735102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2b3d4fe8-29f1-41ac-bf56-215a854a0c12 req-33511074-4e66-4458-bd34-fdbe2f92f876 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.738185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2b3d4fe8-29f1-41ac-bf56-215a854a0c12 req-33511074-4e66-4458-bd34-fdbe2f92f876 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.754021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:48:44.756962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='354ab56a-9140-4d7e-a2f2-66de89166363',volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:48:44.836477 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2b3d4fe8-29f1-41ac-bf56-215a854a0c12 req-33511074-4e66-4458-bd34-fdbe2f92f876 service nova] Creating event network-vif-plugged:3b76a253-3ccb-40fd-b477-5d121bf281f4 for instance b56bc4e2-626f-4f58-b751-104d2332d667 on n-h2-858384-1 Sep 19 14:48:44.870565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2b3d4fe8-29f1-41ac-bf56-215a854a0c12 req-33511074-4e66-4458-bd34-fdbe2f92f876 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186818 Sep 19 14:48:44.871076 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1105/2182] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:44.896990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:44.897721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:44.926475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.931316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.933507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:44.935079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:44.935579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:44.937702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:45.115905 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45ca276b-4185-486b-830b-515eaa033aab tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.342689 Sep 19 14:48:45.141388 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1078/2183] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:48:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:48:45.165879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0260827e-8851-46d4-af94-4cb9f41108bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29ae5af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:45.355557 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0260827e-8851-46d4-af94-4cb9f41108bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.212777 Sep 19 14:48:45.359371 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1079/2184] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:45 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:45.376536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1188035017", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:45.593509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] validate_networks() for [('f9e16d8c-98c4-40ea-9b7b-262bffe3641c', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:48:45.626648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:45.647450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b87a412e-7dcf-4077-b676-5692c7a44f00 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1571 microversion: 2.1 time: 0.761096 Sep 19 14:48:45.649720 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1106/2185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:44 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1571 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:45.672981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d4ffc5e-f412-4b43-8f62-76d9ec8a6db1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:45.677111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d4ffc5e-f412-4b43-8f62-76d9ec8a6db1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:45.837339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3d4ffc5e-f412-4b43-8f62-76d9ec8a6db1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:45.847679 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d4ffc5e-f412-4b43-8f62-76d9ec8a6db1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1122 microversion: 2.1 time: 0.196478 Sep 19 14:48:45.853303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1107/2186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:45 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1122 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:45.872225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:45.873352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:45.899374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:45.900409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:45.901103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:45.905992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:45.908109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:45.909450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:46.548226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:46.572477 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c20ec91-933f-4577-8cbf-716068fb37ff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.717382 Sep 19 14:48:46.573459 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1108/2187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:45 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:46.599819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:46.603257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:46.623196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:46.624058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:46.624705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:46.625662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:46.626318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:46.626998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:47.353882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:48:47.354732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:48:47.355873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:48:47.357582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:48:47.358493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:48:47.404680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:47.409052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:47.410159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:47.411826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:47.416602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:47.417730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:47.510830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for project 70b97b22e77c48d59731205c993e5789. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:48:47.536283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Getting quotas for user e40c5acb3fa44fe2b0aa0696e3dcf8c2 and project 70b97b22e77c48d59731205c993e5789. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:48:47.600294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:47.608249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:48:47.621474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:48:47.831276 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-804f158f-863f-4c06-a4a7-31552d266c84 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.466237 Sep 19 14:48:47.832094 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1080/2188] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:48:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:48:47.860031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1871039860"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:47.862166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:47.906826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:47.907355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:47.907813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:47.908563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:47.909034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:47.916816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:48.067482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:48.098299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c2ac944-3dcd-4c5a-a936-1749853940c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1379 microversion: 2.1 time: 1.521812 Sep 19 14:48:48.123533 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1109/2189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:46 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1379 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:48.135664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04f089ed-f1f1-4e12-834f-3969ba2d870c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29ab5160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:48.267341 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04f089ed-f1f1-4e12-834f-3969ba2d870c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.137276 Sep 19 14:48:48.276554 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1110/2190] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:48 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:48.296393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:48.297934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:48.324765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:48.331097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:48.333783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:48.342855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:48.346253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:48.349330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:48.658906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:48.697345 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c557e00-edda-4817-8fa5-c28fce139516 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1238 microversion: 2.1 time: 0.424343 Sep 19 14:48:48.699130 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1111/2191] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:48 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1238 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:48.731554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:48.736081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:48.765706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:48.772794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:48.774206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:48.775839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:48.777587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:48.788024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:49.197918 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Adding security group 4de96311-fd7d-4dca-a976-42ec0d25f66e to port b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 Sep 19 14:48:49.520999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:49.544091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4e03026f-dbb9-4f54-815d-581a2d47d099 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.840450 Sep 19 14:48:49.561412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1112/2192] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:48 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:49.584339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:49.588983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:49.609117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:49.610430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:49.611510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:49.615707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:49.619316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:49.620701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:50.081974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:50.137308 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3a36db55-15a4-4ca7-b226-2d4d6baf7668 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1221 microversion: 2.1 time: 0.551237 Sep 19 14:48:50.154939 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1113/2193] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:49 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1221 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:50.193917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:50.198489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:50.226721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:50.228030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:50.228830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:50.230593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:50.231489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:50.232292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:51.243829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:52.073211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:52.160365 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0ce4e48-8977-49d3-8568-91c2d83510fd tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1379 microversion: 2.1 time: 1.976959 Sep 19 14:48:52.175997 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1114/2194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:50 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1379 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:52.238355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad028b2e-7231-4ad4-abe2-831f066e32db tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29a54160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:52.441738 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad028b2e-7231-4ad4-abe2-831f066e32db tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.262324 Sep 19 14:48:52.448422 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1115/2195] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:52 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:52.485740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:52.487393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:52.513217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:52.519465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:52.523775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:52.529109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:52.531093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:52.536955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:53.824399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:53.878026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3e14cb9-22da-4c3e-9e28-87464770c333 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1238 microversion: 2.1 time: 1.415367 Sep 19 14:48:53.887060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1116/2196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:52 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1238 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:53.924465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:53.929068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:53.944160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:53.945971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:53.946411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:53.947417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:53.955431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:53.958853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:54.550684 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-75d4dbdb-3491-4725-8a23-f6d15c7def57 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad/action" status: 202 len: 0 microversion: 2.1 time: 6.700316 Sep 19 14:48:54.551525 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1081/2197] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:48:47 2022] POST /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad/action => generated 0 bytes in 6702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:48:54.559615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-002d463d-a264-461e-9604-9cb2c0fc7d84 req-12268913-b18f-4e13-947c-2e883e43c896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:54.597106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-002d463d-a264-461e-9604-9cb2c0fc7d84 req-12268913-b18f-4e13-947c-2e883e43c896 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:54.605748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-002d463d-a264-461e-9604-9cb2c0fc7d84 req-12268913-b18f-4e13-947c-2e883e43c896 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:54.606482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-002d463d-a264-461e-9604-9cb2c0fc7d84 req-12268913-b18f-4e13-947c-2e883e43c896 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:54.664813 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-002d463d-a264-461e-9604-9cb2c0fc7d84 req-12268913-b18f-4e13-947c-2e883e43c896 service nova] Creating event network-changed:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h1-858384-1 Sep 19 14:48:54.694152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-002d463d-a264-461e-9604-9cb2c0fc7d84 req-12268913-b18f-4e13-947c-2e883e43c896 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138618 Sep 19 14:48:54.696962 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1082/2198] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:54.740502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:54.742170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:54.760758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:54.761546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:54.762411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:54.764931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:54.765624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:54.769535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:55.261674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:55.287113 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1452cfc-9f9c-4a5b-b98e-9e239495a031 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 1.397599 Sep 19 14:48:55.288143 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1117/2199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:53 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:55.328592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:55.329923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:55.368579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:55.369091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:55.369542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:55.370282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:55.370771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:55.371218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:55.846982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.439732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:56.450398 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87502410-53bc-4976-bf0a-79add9b9899c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1325 microversion: 2.1 time: 1.734330 Sep 19 14:48:56.458556 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1083/2200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:54 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1325 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:56.469512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-999f5704-4e54-4f4d-9d7e-99fce88ca5b9 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a71fee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:56.553226 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-999f5704-4e54-4f4d-9d7e-99fce88ca5b9 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.091016 Sep 19 14:48:56.554641 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1084/2201] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:56 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:56.577694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:56.578874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-491be635-1aeb-4c93-8053-f88b47b213ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2a719550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:56.586734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83070316-2933-4d2f-9ea4-8af3b69947f7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1379 microversion: 2.1 time: 1.296503 Sep 19 14:48:56.587376 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1118/2202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:55 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1379 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:56.604311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bac6b972-5171-427a-a54f-d86160a80d93 req-6cdd11e0-a98e-4bbb-b949-5d70f0b625fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ed66d1-7d8a-4250-bac4-614eb9870aad", "tag": "b65542cf-cdee-4c3d-9d66-7d1bd9fa4335"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:56.614722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.631416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bac6b972-5171-427a-a54f-d86160a80d93 req-6cdd11e0-a98e-4bbb-b949-5d70f0b625fd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:56.633046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bac6b972-5171-427a-a54f-d86160a80d93 req-6cdd11e0-a98e-4bbb-b949-5d70f0b625fd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:56.637232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bac6b972-5171-427a-a54f-d86160a80d93 req-6cdd11e0-a98e-4bbb-b949-5d70f0b625fd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:56.658645 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bac6b972-5171-427a-a54f-d86160a80d93 req-6cdd11e0-a98e-4bbb-b949-5d70f0b625fd service nova] Creating event network-changed:b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 for instance 07ed66d1-7d8a-4250-bac4-614eb9870aad on n-h2-858384-1 Sep 19 14:48:56.666806 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bac6b972-5171-427a-a54f-d86160a80d93 req-6cdd11e0-a98e-4bbb-b949-5d70f0b625fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077194 Sep 19 14:48:56.667735 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1119/2203] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:56.673836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:56.675058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:56.682437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:56.683241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:56.683860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:56.685019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:56.685692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:56.686309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:57.078637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:57.092165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1edcfc54-99e6-4cfe-931d-1d7b723caf86 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1306 microversion: 2.1 time: 0.422693 Sep 19 14:48:57.092828 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1120/2204] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:56 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1306 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:57.097982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:57.098911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:57.106397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:57.107185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:57.107790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:57.108708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:57.109339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:57.109936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:57.137732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:57.461707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:57.578296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=26 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:57.918336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-491be635-1aeb-4c93-8053-f88b47b213ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use.", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:48:57.919736 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-491be635-1aeb-4c93-8053-f88b47b213ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.919736 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-491be635-1aeb-4c93-8053-f88b47b213ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e HTTP/1.1 Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:48:57.922707 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: exception: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] Sep 19 14:48:57.924045 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4de96311-fd7d-4dca-a976-42ec0d25f66e'} Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:57.924816 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.925896 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:48:57.927000 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-491be635-1aeb-4c93-8053-f88b47b213ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 400 to user: Security Group 4de96311-fd7d-4dca-a976-42ec0d25f66e in use. Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-7ff92d88-9770-4647-addf-b0c94a4d64b1'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-491be635-1aeb-4c93-8053-f88b47b213ff tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e" status: 400 len: 185 microversion: 2.1 time: 1.359351 Sep 19 14:48:57.928156 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1085/2205] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:48:56 2022] DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e => generated 185 bytes in 1361 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:48:57.954425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-01dc1d9e-39f0-4ea0-9ac9-b89dab4d7590 req-29009bd2-8a94-4733-bfde-37f476ae25d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb30996-2bfa-4603-9b4a-9d883a7893c9", "tag": "37cf8db1-5846-43b6-96e9-b43c8495528b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:48:58.021647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-01dc1d9e-39f0-4ea0-9ac9-b89dab4d7590 req-29009bd2-8a94-4733-bfde-37f476ae25d0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.022310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-01dc1d9e-39f0-4ea0-9ac9-b89dab4d7590 req-29009bd2-8a94-4733-bfde-37f476ae25d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.027393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-01dc1d9e-39f0-4ea0-9ac9-b89dab4d7590 req-29009bd2-8a94-4733-bfde-37f476ae25d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:58.079046 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-01dc1d9e-39f0-4ea0-9ac9-b89dab4d7590 req-29009bd2-8a94-4733-bfde-37f476ae25d0 service nova] Creating event network-changed:37cf8db1-5846-43b6-96e9-b43c8495528b for instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 on n-h2-858384-1 Sep 19 14:48:58.113526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-01dc1d9e-39f0-4ea0-9ac9-b89dab4d7590 req-29009bd2-8a94-4733-bfde-37f476ae25d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186268 Sep 19 14:48:58.115414 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1086/2206] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:48:58.124507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:58.125715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:58.135674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.136897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.137871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:58.139136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.139859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.140513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:58.574776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:58.586729 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe2bc61a-68f3-4dae-aeb1-86a75e13f660 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 1.492642 Sep 19 14:48:58.608860 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1121/2207] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:57 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:58.618808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eff38f26-9611-41de-b636-58f2a3782771 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29afb280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:58.703975 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eff38f26-9611-41de-b636-58f2a3782771 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.090327 Sep 19 14:48:58.705461 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1122/2208] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:48:58 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:58.712693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:58.713691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:58.729892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.730866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.731613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:58.735223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.736076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.737763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:58.928347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:58.938647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-348f49d0-2985-4a19-b4ba-24bbab2989bd tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1325 microversion: 2.1 time: 0.821695 Sep 19 14:48:58.947141 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1087/2209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:58 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1325 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:58.952774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:58.955165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:58.968623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.975578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.977057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:58.978056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:58.978866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:58.979565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:59.048530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:48:59.214946 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-35120c3b-94e1-472d-8d50-9c01dba3f3d1 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 204 len: 0 microversion: 2.1 time: 0.266193 Sep 19 14:48:59.219032 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1088/2210] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:48:58 2022] DELETE /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:59.225085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:59.240269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:59.248420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:59.249688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:59.250402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:59.251469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:59.252686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:59.253349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:59.673044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:48:59.692708 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0560f8f9-b494-4d2d-93f2-ea845b4a5e5a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1379 microversion: 2.1 time: 0.978976 Sep 19 14:48:59.706785 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1123/2211] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:58 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1379 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:59.725567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:48:59.731431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:48:59.754498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:59.755176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:59.755727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:48:59.758117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:48:59.760571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:48:59.761487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:00.101777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:00.113988 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a719facd-c60a-4058-b7dd-a8ee55fe6646 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1646 microversion: 2.1 time: 0.416016 Sep 19 14:49:00.114902 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1124/2212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:59 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1646 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:00.125682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:00.130708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:00.150517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:00.151341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:00.152334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:00.156569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:00.157465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:00.158334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:00.240845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:00.256922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3abb28b8-9ccf-47d8-ba56-3051abfdc8ea tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1306 microversion: 2.1 time: 1.034386 Sep 19 14:49:00.267379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1089/2213] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:48:59 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1306 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:00.287878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d025ad07-8ed2-4b3c-b9a3-2921739015e9 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a61dee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:00.430764 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d025ad07-8ed2-4b3c-b9a3-2921739015e9 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.159453 Sep 19 14:49:00.437987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1090/2214] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:00 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:00.465129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:00.468064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:00.478285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:00.479603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:00.480795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:00.481912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:00.482682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:00.483833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:01.381991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:01.405776 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aae536b5-7a30-4156-a536-f287602326f9 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1325 microversion: 2.1 time: 0.964839 Sep 19 14:49:01.411163 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1091/2215] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:00 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1325 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:01.417384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-bc3e50c2-9286-40d5-8b1e-bc98969c017c req-5161ebae-1e4e-4bdb-bc73-1c8aadc2b6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "name": "network-vif-plugged", "status": "completed", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:01.457119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bc3e50c2-9286-40d5-8b1e-bc98969c017c req-5161ebae-1e4e-4bdb-bc73-1c8aadc2b6eb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:01.460876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bc3e50c2-9286-40d5-8b1e-bc98969c017c req-5161ebae-1e4e-4bdb-bc73-1c8aadc2b6eb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:01.463237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bc3e50c2-9286-40d5-8b1e-bc98969c017c req-5161ebae-1e4e-4bdb-bc73-1c8aadc2b6eb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:01.487560 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-bc3e50c2-9286-40d5-8b1e-bc98969c017c req-5161ebae-1e4e-4bdb-bc73-1c8aadc2b6eb service nova] Creating event network-vif-plugged:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h1-858384-1 Sep 19 14:49:01.494018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-bc3e50c2-9286-40d5-8b1e-bc98969c017c req-5161ebae-1e4e-4bdb-bc73-1c8aadc2b6eb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081199 Sep 19 14:49:01.495517 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1092/2216] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:01.501294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:01.502347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:01.521245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:01.524599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:01.525654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:01.528038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:01.530511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:01.532374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:01.939887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:01.969906 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30b24655-f9d1-400f-8733-b3aac2557a16 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 1.848425 Sep 19 14:49:01.982065 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1125/2217] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:00 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:01.995471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:01.998602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:02.014186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:02.015390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:02.016447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:02.017964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:02.019085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:02.020032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:02.954783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:02.983546 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82375ee1-7c2d-412d-a82d-7e8cc1f5ff8b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1379 microversion: 2.1 time: 1.486312 Sep 19 14:49:02.985653 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1093/2218] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:01 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1379 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:03.025063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:03.074131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:03.081783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:03.126315 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebb5f922-f805-4726-82d7-1c46f4cf1c05 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1646 microversion: 2.1 time: 1.140638 Sep 19 14:49:03.139717 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1126/2219] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:01 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1646 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:03.142258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:03.144250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:03.151928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:03.172684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:03.182661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:03.190398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:03.226585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc695298-f1e7-4fd8-b774-2f317df8466e tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a1f9e50>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:03.452299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc695298-f1e7-4fd8-b774-2f317df8466e tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.295023 Sep 19 14:49:03.453572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1127/2220] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:03 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:03.510161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:03.519123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:03.543722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:03.548316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:03.549965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:03.552584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:03.555702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:03.557127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:04.098964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:04.132907 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70e73dfb-6e2c-4344-881c-e69aa9b40497 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 1.145313 Sep 19 14:49:04.133991 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1094/2221] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:02 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:04.162258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-9da0f572-44cd-46d5-853c-be71f3155663 req-d1dad204-c242-41ab-8716-de19623000d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b", "tag": "0eda42c9-b703-42e0-af43-0c50b53f2a15"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:04.196290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9da0f572-44cd-46d5-853c-be71f3155663 req-d1dad204-c242-41ab-8716-de19623000d7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:04.197611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9da0f572-44cd-46d5-853c-be71f3155663 req-d1dad204-c242-41ab-8716-de19623000d7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:04.198831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9da0f572-44cd-46d5-853c-be71f3155663 req-d1dad204-c242-41ab-8716-de19623000d7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:04.240230 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-9da0f572-44cd-46d5-853c-be71f3155663 req-d1dad204-c242-41ab-8716-de19623000d7 service nova] Creating event network-changed:0eda42c9-b703-42e0-af43-0c50b53f2a15 for instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b on n-h1-858384-1 Sep 19 14:49:04.265293 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-9da0f572-44cd-46d5-853c-be71f3155663 req-d1dad204-c242-41ab-8716-de19623000d7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119644 Sep 19 14:49:04.270601 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1095/2222] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:04.301854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:04.303519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:04.336602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:04.340066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:04.343557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:04.347930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:04.349968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:04.358260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:04.503425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:04.552311 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-40cdd100-39bf-4e09-9021-b1176477a75c tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1325 microversion: 2.1 time: 1.094144 Sep 19 14:49:04.580850 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1128/2223] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:03 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1325 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:04.605734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:04.609091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:04.625888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:04.630360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:04.632510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:04.641086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:04.642323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:04.643729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:05.519006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:05.536616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad4197d6-289f-404e-8bf0-c319c7cddc8b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 1.261404 Sep 19 14:49:05.540881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1096/2224] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:04 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:05.565822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:05.567086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:05.575794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:05.576776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:05.577452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:05.578432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:05.579165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:05.579830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:05.896533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:05.933331 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-325a1d7d-580f-4498-b09a-bc85b79ab310 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 200 len: 1466 microversion: 2.1 time: 0.380293 Sep 19 14:49:05.957124 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1097/2225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:05 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 1466 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:05.978589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab2eeb3d-842c-4528-87e5-7a4eee3735bf tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a8fae50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:06.071183 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab2eeb3d-842c-4528-87e5-7a4eee3735bf tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.112331 Sep 19 14:49:06.072843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1098/2226] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:05 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:06.077739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-36e8b9c4-2c24-4e2d-a86a-091407c71450 req-8500b99c-6a24-484d-9275-ada2a2698702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb30996-2bfa-4603-9b4a-9d883a7893c9", "name": "network-vif-plugged", "status": "completed", "tag": "37cf8db1-5846-43b6-96e9-b43c8495528b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:06.088653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36e8b9c4-2c24-4e2d-a86a-091407c71450 req-8500b99c-6a24-484d-9275-ada2a2698702 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:06.089440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36e8b9c4-2c24-4e2d-a86a-091407c71450 req-8500b99c-6a24-484d-9275-ada2a2698702 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:06.090048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36e8b9c4-2c24-4e2d-a86a-091407c71450 req-8500b99c-6a24-484d-9275-ada2a2698702 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:06.107466 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-36e8b9c4-2c24-4e2d-a86a-091407c71450 req-8500b99c-6a24-484d-9275-ada2a2698702 service nova] Creating event network-vif-plugged:37cf8db1-5846-43b6-96e9-b43c8495528b for instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 on n-h2-858384-1 Sep 19 14:49:06.113526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-36e8b9c4-2c24-4e2d-a86a-091407c71450 req-8500b99c-6a24-484d-9275-ada2a2698702 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039253 Sep 19 14:49:06.124811 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1099/2227] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:06.181514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:06.182526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:06.185889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:06.196751 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9592a2b6-329a-47c1-8289-cb808018be07 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1527 microversion: 2.1 time: 1.613974 Sep 19 14:49:06.212684 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1129/2228] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:04 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1527 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:06.225979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:06.232277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:06.237102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:06.237932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:06.239719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:06.243012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:06.243744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:06.244340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:06.283191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:06.292061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:06.299730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:06.307815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:06.308691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:06.310057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:07.727583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:07.739480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:07.745328 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c20abf2-a0a6-4cda-ba11-1b2eb5d6542d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1325 microversion: 2.1 time: 1.531194 Sep 19 14:49:07.745942 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1130/2229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:06 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1325 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:07.762999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a289cc42-7093-4b2f-a252-a199b887c29a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 1.619967 Sep 19 14:49:07.771594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:07.782553 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1100/2230] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:06 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:07.787311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:07.800522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e4a4e91c-fdf9-4f7a-bb94-397b0bc66a6e req-98447270-0829-4c23-b889-f73fd5788578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed66d1-7d8a-4250-bac4-614eb9870aad", "name": "network-vif-deleted", "tag": "b65542cf-cdee-4c3d-9d66-7d1bd9fa4335"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:07.808478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:07.808991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:07.809436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:07.810189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:07.810630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:07.811109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:07.822127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e4a4e91c-fdf9-4f7a-bb94-397b0bc66a6e req-98447270-0829-4c23-b889-f73fd5788578 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:07.822768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e4a4e91c-fdf9-4f7a-bb94-397b0bc66a6e req-98447270-0829-4c23-b889-f73fd5788578 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:07.823512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e4a4e91c-fdf9-4f7a-bb94-397b0bc66a6e req-98447270-0829-4c23-b889-f73fd5788578 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:07.860725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e4a4e91c-fdf9-4f7a-bb94-397b0bc66a6e req-98447270-0829-4c23-b889-f73fd5788578 service nova] Creating event network-vif-deleted:b65542cf-cdee-4c3d-9d66-7d1bd9fa4335 for instance 07ed66d1-7d8a-4250-bac4-614eb9870aad on n-h2-858384-1 Sep 19 14:49:07.895282 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e4a4e91c-fdf9-4f7a-bb94-397b0bc66a6e req-98447270-0829-4c23-b889-f73fd5788578 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109826 Sep 19 14:49:07.898657 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1101/2231] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:07.908879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:07.910918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:07.922946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:07.925175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:07.926309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:07.928192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:07.930074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:07.931546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:07.943161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:08.445193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:08.460557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0212aff2-9c34-44a1-8841-0229ae47ee55 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1527 microversion: 2.1 time: 0.712971 Sep 19 14:49:08.462136 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1131/2232] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:07 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1527 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:08.478554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:08.479663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:08.489538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:08.490469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:08.491700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:08.494471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:08.495329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:08.496267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:08.513468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad HTTP/1.1 Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:08.515642 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:08.516909 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '07ed66d1-7d8a-4250-bac4-614eb9870aad'} Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:08.518175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:08.519403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:08.520405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:08.522931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:08.525302 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4a33c0c-bf3d-459b-a05e-b45d32b41cef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 404 len: 111 microversion: 2.1 time: 0.058958 Sep 19 14:49:08.526033 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b4c2d81-c1ed-42d8-bcd4-ee291c663568 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1498 microversion: 2.1 time: 0.625493 Sep 19 14:49:08.529675 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1132/2233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:08 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:08.536158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a9f93b16-047a-48f0-80fb-5c9859e4b5da tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a1ef0d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:08.545253 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1102/2234] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:07 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1498 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:08.559285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fac69862-7805-497a-93b1-1c48a4352e50 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:08.598882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a9f93b16-047a-48f0-80fb-5c9859e4b5da tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1453 microversion: 2.1 time: 0.067647 Sep 19 14:49:08.601326 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1133/2235] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:08 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:08.607921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-639dd999-649d-4e90-b1b7-0ca4cd20a465 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2a082700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:08.611740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fac69862-7805-497a-93b1-1c48a4352e50 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/3a9eca60-a465-432c-a880-ce3f6daccf88" status: 202 len: 0 microversion: 2.1 time: 0.063948 Sep 19 14:49:08.612767 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1103/2236] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:08 2022] DELETE /compute/v2.1/flavors/3a9eca60-a465-432c-a880-ce3f6daccf88 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:08.622081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e09b832-5860-4e68-88e0-ceaf3bb08469 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:08.706018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e09b832-5860-4e68-88e0-ceaf3bb08469 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073074 Sep 19 14:49:08.723135 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1104/2237] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:49:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:08.729796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:08.742896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:08.755964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:08.757305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:08.758246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:08.759217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:08.760075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:08.760658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:09.023191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:09.035553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Old instance type tempest-test_resize_flavor_-1311547393, new instance type m1.heat {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 14:49:09.053044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:49:09.057370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:49:09.058242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:49:09.058975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:49:09.059660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:49:09.141557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-639dd999-649d-4e90-b1b7-0ca4cd20a465 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656" status: 202 len: 0 microversion: 2.1 time: 0.537756 Sep 19 14:49:09.142870 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1134/2238] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:08 2022] DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:09.174347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:09.175985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:09.215144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:09.228826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:09.232569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:09.233727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:09.238234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:09.239659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:09.431351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-968ddb54-bc85-4401-b878-8facdb17c8e7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158/action" status: 202 len: 0 microversion: 2.1 time: 0.706310 Sep 19 14:49:09.440239 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1105/2239] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:49:08 2022] POST /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:09.457943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:09.466031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:09.516400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:09.519330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:09.524429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:09.526163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:09.526707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:09.527608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:09.596664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:09.628238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c756f112-12fc-448f-8493-19fe3e1ccc61 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1521 microversion: 2.1 time: 0.481648 Sep 19 14:49:09.639642 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1135/2240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:09 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:09.645601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bedf7868-0047-4e00-986d-2b8e9286989f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2a1ef280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:10.346022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:10.370447 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a5aab06-f7a4-4f1f-96f7-9fa05532562a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 0.928337 Sep 19 14:49:10.371377 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1106/2241] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:09 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:10.376957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:10.378045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:10.386861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:10.387873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:10.388544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:10.389821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:10.391304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:10.391942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:10.879297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:10.915400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-60e8892e-bc4b-42ca-b649-bf65369e45ca tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1536 microversion: 2.1 time: 0.542398 Sep 19 14:49:10.916523 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1107/2242] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:10 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1536 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:10.933756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:10.934633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:10.942216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:10.943386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:10.944623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:10.945669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:10.946361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:10.947774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:11.575711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:11.588891 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89447a8e-b609-4fc2-b143-e09d8100714f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 200 len: 1475 microversion: 2.1 time: 0.670859 Sep 19 14:49:11.591510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1108/2243] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:10 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 1475 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:11.616207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de6a4a71-c8f9-4e69-b62e-9ba02107a592 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29d30310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:11.642970 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bedf7868-0047-4e00-986d-2b8e9286989f tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e" status: 202 len: 0 microversion: 2.1 time: 2.001842 Sep 19 14:49:11.647185 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1136/2244] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:09 2022] DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e => generated 0 bytes in 2004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:11.651184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:11.651964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:11.673455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:11.673979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:11.674824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:11.675725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:11.676211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:11.676649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:11.720761 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de6a4a71-c8f9-4e69-b62e-9ba02107a592 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1462 microversion: 2.1 time: 0.126624 Sep 19 14:49:11.741796 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1109/2245] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:11 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1462 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:11.750040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:11.750564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:11.776814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:11.783480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:11.784636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:11.785472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:11.785964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:11.786405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:11.795004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:49:12.086013 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d9d8b56-c2bb-4212-a21f-7e14e512c580 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 204 len: 0 microversion: 2.1 time: 0.434179 Sep 19 14:49:12.093303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1137/2246] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:11 2022] DELETE /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:12.097394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-172199647"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:12.106237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:12.120469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:12.121276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:12.123120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:12.127629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:12.128367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:12.128967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:12.511088 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09f321c5-1286-48e3-bac6-7903af4c1e90 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464/action" status: 202 len: 0 microversion: 2.1 time: 0.420549 Sep 19 14:49:12.512333 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1138/2247] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:49:12 2022] POST /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:49:12.531887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f6fdabe-ee66-4a5f-8628-5216be3ca570 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'create', calling method: .version_select at 0x7fde2a26e550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-552315981", "description": "tempest-description-1690915643"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:12.620434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:12.637076 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cba7b1fd-a7ed-43c6-b072-85b80dbffb32 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 0.892621 Sep 19 14:49:12.638920 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1110/2248] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:11 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:12.650604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-245c4c5b-03c7-4219-932a-0996d0abeca0 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a7ae700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:12.712404 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-245c4c5b-03c7-4219-932a-0996d0abeca0 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 200 len: 1462 microversion: 2.1 time: 0.071875 Sep 19 14:49:12.722822 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1111/2249] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:12 2022] GET /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 1462 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:12.722822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:12.722822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:12.726468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:12.726993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:12.727434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:12.728353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:12.729910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:12.729910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:12.992836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f6fdabe-ee66-4a5f-8628-5216be3ca570 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.479113 Sep 19 14:49:12.994340 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1139/2250] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:49:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:12.999300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:13.000035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:13.007898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:13.019803 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bff278cd-eb31-47b0-af08-ab8bd21e183e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1536 microversion: 2.1 time: 0.305212 Sep 19 14:49:13.020324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1112/2251] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:12 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1536 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:13.027765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e651375-f688-4bc1-8427-8a5bd2397da1 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a97db80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:13.043857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:13.044412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:13.044881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:13.047538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:13.052968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:13.054423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:13.107984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e651375-f688-4bc1-8427-8a5bd2397da1 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 200 len: 1413 microversion: 2.1 time: 0.084708 Sep 19 14:49:13.110102 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1113/2252] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:13 2022] GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:13.120345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:13.122944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:13.140417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:13.143527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:13.144153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:13.148694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:13.149916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:13.151979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:13.296117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:13.307734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8b8a4bc-d2dc-41d0-b3ae-83b1b274aefa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1527 microversion: 2.1 time: 0.312083 Sep 19 14:49:13.333770 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1140/2253] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:12 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:13.574907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:13.587229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Calling method '.version_select at 0x7fde29aaa700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:13.588795 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b0ff57d-7813-4774-b30d-590cc9b84067 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1468 microversion: 2.1 time: 0.477296 Sep 19 14:49:13.591486 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1114/2254] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:13 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1468 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:13.627891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-493a2ea0-28cb-48f4-b1c2-579c24d19a84 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Action: 'update', calling method: .version_select at 0x7fde2a7e4f70>, body: {"security_group": {"name": "tempest-sg-hth-200712497", "description": "tempest-description-hth-678866328"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:13.750762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:13.751500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Neutron security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf not found {{(pid=128730) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:13.752381 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] HTTP exception thrown: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.752381 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Request method failure captured: Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-security-groups/d6da2242-4fb0-49db-a7ef-8c0fa46a4daf HTTP/1.1 Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIFoeRBJ_6a1r6PayfhydlCgryIs_kCMnrRUvlfWT7rSJAV9Ov-p9hMkY2zzA5I5V3ZaZyuc3ZxeYw2qw_IsQ9koo_Rv7aQWxcfkxrOHeebSjvcvbxcDVxY9cn9NeCLUArcOOSYrS-2e2sWEW29DNzev2F5LPwgXVYmTxL7tDI36J4s Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:13.754953 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_13890fbc447a4c53838df19f85919260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/13890fbc447a4c53838df19f85919260"}]}] Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f453f26a39b84a32b4d08472441c4d02 Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] Sep 19 14:49:13.756237 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd6da2242-4fb0-49db-a7ef-8c0fa46a4daf'} Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:13.757218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:13.758293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.762070 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] Sep 19 14:49:13.765692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:13.768970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Returning 404 to user: Security group d6da2242-4fb0-49db-a7ef-8c0fa46a4daf does not exist Sep 19 14:49:13.768970 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-7b92c62a-8f10-4a21-945f-e0ed7c8b0a79'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:13.770288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e77a76a2-f2d6-4513-99ea-dd366c622b30 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/d6da2242-4fb0-49db-a7ef-8c0fa46a4daf" status: 404 len: 194 microversion: 2.1 time: 0.433597 Sep 19 14:49:13.771383 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1141/2255] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:13 2022] DELETE /compute/v2.1/os-security-groups/d6da2242-4fb0-49db-a7ef-8c0fa46a4daf => generated 194 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:13.783841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1860811369"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:13.789629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:13.801770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:13.802565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:13.807743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:13.811552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:13.812727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:13.816599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:13.943092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:14.209649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-493a2ea0-28cb-48f4-b1c2-579c24d19a84 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "PUT /compute/v2.1/os-security-groups/10804920-9311-4526-bc34-c2dd63381caa" status: 200 len: 216 microversion: 2.1 time: 0.595968 Sep 19 14:49:14.210344 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1115/2256] 10.222.0.81 () {60 vars in 1290 bytes} [Mon Sep 19 14:49:13 2022] PUT /compute/v2.1/os-security-groups/10804920-9311-4526-bc34-c2dd63381caa => generated 216 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:14.223144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:14.223869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:14.236584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:14.237176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:14.237673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:14.238408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:14.239018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:14.254440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:14.286865 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c67ebb1-2a50-450a-87fc-dd3d29c75b2b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "POST /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265/action" status: 202 len: 0 microversion: 2.1 time: 0.513127 Sep 19 14:49:14.289427 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1142/2257] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:49:13 2022] POST /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:49:14.307952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-feb66cf0-40f1-4ce3-98d0-4a65bf6aeceb req-5e879510-a1f4-4d12-b9c6-af8c2941b262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56bc4e2-626f-4f58-b751-104d2332d667", "name": "network-vif-unplugged", "status": "completed", "tag": "3b76a253-3ccb-40fd-b477-5d121bf281f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:14.340598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-feb66cf0-40f1-4ce3-98d0-4a65bf6aeceb req-5e879510-a1f4-4d12-b9c6-af8c2941b262 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:14.341379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-feb66cf0-40f1-4ce3-98d0-4a65bf6aeceb req-5e879510-a1f4-4d12-b9c6-af8c2941b262 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:14.342268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-feb66cf0-40f1-4ce3-98d0-4a65bf6aeceb req-5e879510-a1f4-4d12-b9c6-af8c2941b262 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:14.408980 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-feb66cf0-40f1-4ce3-98d0-4a65bf6aeceb req-5e879510-a1f4-4d12-b9c6-af8c2941b262 service nova] Creating event network-vif-unplugged:3b76a253-3ccb-40fd-b477-5d121bf281f4 for instance b56bc4e2-626f-4f58-b751-104d2332d667 on n-h2-858384-1 Sep 19 14:49:14.425456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-feb66cf0-40f1-4ce3-98d0-4a65bf6aeceb req-5e879510-a1f4-4d12-b9c6-af8c2941b262 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134815 Sep 19 14:49:14.431158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1143/2258] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:14.439971 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd86e11f-363c-45cf-b23d-ade7b35ca54d tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007219 Sep 19 14:49:14.444561 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1144/2259] 10.222.0.81 () {58 vars in 1164 bytes} [Mon Sep 19 14:49:14 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 14:49:14.472506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:14.474887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:14.491184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:14.492116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:14.493058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:14.494276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:14.495312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:14.496067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:14.927039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:14.938582 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0e367246-5372-46ea-9536-dabcc93d10f2 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1536 microversion: 2.1 time: 0.490806 Sep 19 14:49:14.945568 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1145/2260] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:14 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1536 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:14.970825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-656a6657-d405-41b0-bf3a-9a0504565181 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a76dc10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.069362 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-656a6657-d405-41b0-bf3a-9a0504565181 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 200 len: 1413 microversion: 2.1 time: 0.121358 Sep 19 14:49:15.070813 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1146/2261] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:14 2022] GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:15.075358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:15.080919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d202875a-f08b-48d9-befe-0407d815e22c tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2a4b0700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.095687 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3c93570-3d77-4c27-beb8-5000cad029ad tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 0.883350 Sep 19 14:49:15.117887 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1116/2262] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:14 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:15.128927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62a75435-b318-42de-94ec-44ac64a2dc82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a719550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.202546 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62a75435-b318-42de-94ec-44ac64a2dc82 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1453 microversion: 2.1 time: 0.082915 Sep 19 14:49:15.205092 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1117/2263] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:15 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:15.215324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.216582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:15.224731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:15.225707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:15.226437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:15.227464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:15.228164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:15.228817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:15.251781 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d202875a-f08b-48d9-befe-0407d815e22c tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/10804920-9311-4526-bc34-c2dd63381caa" status: 200 len: 216 microversion: 2.1 time: 0.178530 Sep 19 14:49:15.253334 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1147/2264] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:49:15 2022] GET /compute/v2.1/os-security-groups/10804920-9311-4526-bc34-c2dd63381caa => generated 216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:15.277869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dcf45b6e-2e2a-4fd5-bb5d-f482779db0a1 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Calling method '.version_select at 0x7fde2a1ef0d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.299683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:15.300548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:15.301240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:15.302552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lazy-loading 'fault' on Instance uuid dbb30996-2bfa-4603-9b4a-9d883a7893c9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:49:15.400877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c5acb3fa44fe2b0aa0696e3dcf8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b97b22e77c48d59731205c993e5789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:15.416682 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-961ba2f5-1b9d-4dbd-b016-f3f92c99d34d tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 200 len: 1315 microversion: 2.1 time: 0.206963 Sep 19 14:49:15.419287 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1118/2265] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:15 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:15.425712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a8c1e091-10dd-45fd-a56e-926e0e1b8504 req-5ea1c0a9-8bb7-446d-b168-39dabdcc28d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb30996-2bfa-4603-9b4a-9d883a7893c9", "name": "network-vif-deleted", "tag": "37cf8db1-5846-43b6-96e9-b43c8495528b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:15.438984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a8c1e091-10dd-45fd-a56e-926e0e1b8504 req-5ea1c0a9-8bb7-446d-b168-39dabdcc28d0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:15.439989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a8c1e091-10dd-45fd-a56e-926e0e1b8504 req-5ea1c0a9-8bb7-446d-b168-39dabdcc28d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:15.440651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a8c1e091-10dd-45fd-a56e-926e0e1b8504 req-5ea1c0a9-8bb7-446d-b168-39dabdcc28d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:15.458713 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a8c1e091-10dd-45fd-a56e-926e0e1b8504 req-5ea1c0a9-8bb7-446d-b168-39dabdcc28d0 service nova] Creating event network-vif-deleted:37cf8db1-5846-43b6-96e9-b43c8495528b for instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 on n-h2-858384-1 Sep 19 14:49:15.467873 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a8c1e091-10dd-45fd-a56e-926e0e1b8504 req-5ea1c0a9-8bb7-446d-b168-39dabdcc28d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044870 Sep 19 14:49:15.469247 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1119/2266] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:15.478533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aacb0523-a80f-4ee3-8ade-fb5afaad0160 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29ae4430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.810662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dcf45b6e-2e2a-4fd5-bb5d-f482779db0a1 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.550625 Sep 19 14:49:15.810662 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1148/2267] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:49:15 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:15.826802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-507294d7-559e-4ba8-999f-8443db69ff1b tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Calling method '.version_select at 0x7fde2a082550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.982708 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aacb0523-a80f-4ee3-8ade-fb5afaad0160 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/10804920-9311-4526-bc34-c2dd63381caa" status: 202 len: 0 microversion: 2.1 time: 0.511810 Sep 19 14:49:15.984336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1120/2268] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:15 2022] DELETE /compute/v2.1/os-security-groups/10804920-9311-4526-bc34-c2dd63381caa => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:15.991407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:15.992457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:16.012400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.013073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.014874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.017567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.018191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.018733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.126656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-507294d7-559e-4ba8-999f-8443db69ff1b tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:16.127483 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-507294d7-559e-4ba8-999f-8443db69ff1b tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 19 14:49:16.127483 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-507294d7-559e-4ba8-999f-8443db69ff1b tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Request method failure captured: Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-security-groups/bfc833a0-3da1-4123-affe-26519bf873b7 HTTP/1.1 Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIFoeRBJ_6a1r6PayfhydlCgryIs_kCMnrRUvlfWT7rSJAV9Ov-p9hMkY2zzA5I5V3ZaZyuc3ZxeYw2qw_IsQ9koo_Rv7aQWxcfkxrOHeebSjvcvbxcDVxY9cn9NeCLUArcOOSYrS-2e2sWEW29DNzev2F5LPwgXVYmTxL7tDI36J4s Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.129588 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_13890fbc447a4c53838df19f85919260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/13890fbc447a4c53838df19f85919260"}]}] Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f453f26a39b84a32b4d08472441c4d02 Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: exception: Insufficient rights for removing default security group. Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] Sep 19 14:49:16.131191 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'bfc833a0-3da1-4123-affe-26519bf873b7'} Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.132069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 19 14:49:16.133218 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.135533 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-507294d7-559e-4ba8-999f-8443db69ff1b tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-5dcbeab5-2bfd-44ae-b1b0-adb8983b2f33'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-507294d7-559e-4ba8-999f-8443db69ff1b tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/bfc833a0-3da1-4123-affe-26519bf873b7" status: 400 len: 182 microversion: 2.1 time: 0.308272 Sep 19 14:49:16.136941 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1149/2269] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:15 2022] DELETE /compute/v2.1/os-security-groups/bfc833a0-3da1-4123-affe-26519bf873b7 => generated 182 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:49:16.148674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.149294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:16.170990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.171136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.180633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.181596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.183574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.184714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.201447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad HTTP/1.1 Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.203277 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.204855 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '07ed66d1-7d8a-4250-bac4-614eb9870aad'} Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.205711 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.207150 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.208500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.208500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d6cb3cd-2afd-4dc8-ad6d-eefc5d4f4812 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 404 len: 111 microversion: 2.1 time: 0.074017 Sep 19 14:49:16.209074 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1150/2270] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:16 2022] DELETE /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:16.215144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c943b8e-3e6d-4fd7-a052-7d224576a826 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29aaa820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.297405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:16.307692 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6008ee92-7093-48d3-a289-ee7a745e0ed0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1541 microversion: 2.1 time: 0.321833 Sep 19 14:49:16.310997 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c943b8e-3e6d-4fd7-a052-7d224576a826 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 200 len: 1413 microversion: 2.1 time: 0.100178 Sep 19 14:49:16.320519 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1121/2271] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:15 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1541 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:16.321956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1151/2272] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:16 2022] GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:16.327351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Calling method '.version_select at 0x7fde2a0828b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.331403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.332230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:16.341044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.341918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.342557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.343361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.357719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.358267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.369253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:16.369949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Neutron security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 not found {{(pid=128730) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:16.370561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] HTTP exception thrown: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.370561 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Request method failure captured: Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-security-groups/70d58d4a-05bb-4005-a6f5-193e68c098f3 HTTP/1.1 Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIFoeRBJ_6a1r6PayfhydlCgryIs_kCMnrRUvlfWT7rSJAV9Ov-p9hMkY2zzA5I5V3ZaZyuc3ZxeYw2qw_IsQ9koo_Rv7aQWxcfkxrOHeebSjvcvbxcDVxY9cn9NeCLUArcOOSYrS-2e2sWEW29DNzev2F5LPwgXVYmTxL7tDI36J4s Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.372900 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_13890fbc447a4c53838df19f85919260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/13890fbc447a4c53838df19f85919260"}]}] Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f453f26a39b84a32b4d08472441c4d02 Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] Sep 19 14:49:16.374106 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '70d58d4a-05bb-4005-a6f5-193e68c098f3'} Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.375082 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:16.376106 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.379777 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Returning 404 to user: Security group 70d58d4a-05bb-4005-a6f5-193e68c098f3 does not exist Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-729db810-8f0c-4373-9d05-f0e21f54c6b7'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a875c68-607d-432d-be7f-c8b30e44340a tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/70d58d4a-05bb-4005-a6f5-193e68c098f3" status: 404 len: 194 microversion: 2.1 time: 0.051148 Sep 19 14:49:16.383672 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1152/2273] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:49:16 2022] GET /compute/v2.1/os-security-groups/70d58d4a-05bb-4005-a6f5-193e68c098f3 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:16.395679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f082d0cb-01d1-4646-b864-9376cc0c1de2 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a082ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.526215 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f082d0cb-01d1-4646-b864-9376cc0c1de2 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1453 microversion: 2.1 time: 0.141617 Sep 19 14:49:16.526901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1153/2274] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:16 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:16.549752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.550422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 07ed66d1-7d8a-4250-bac4-614eb9870aad] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:16.574016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.574558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.575457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.577190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.578291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.578946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.614932 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad HTTP/1.1 Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.619543 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.620854 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '07ed66d1-7d8a-4250-bac4-614eb9870aad'} Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.621712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. Sep 19 14:49:16.623024 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.624016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Instance 07ed66d1-7d8a-4250-bac4-614eb9870aad could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.624096 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30ae61dd-57e9-4f40-9230-0a499cfc0b3b tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad" status: 404 len: 111 microversion: 2.1 time: 0.087185 Sep 19 14:49:16.626702 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1154/2275] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:16 2022] GET /compute/v2.1/servers/07ed66d1-7d8a-4250-bac4-614eb9870aad => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:16.640181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Action: 'update', calling method: .version_select at 0x7fde29afbd30>, body: {"security_group": {"name": "tempest-sg-124590217", "description": "tempest-description-2083636852"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:16.720853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:16.722127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Neutron security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 not found {{(pid=128730) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:16.723217 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] HTTP exception thrown: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.723217 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Request method failure captured: Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/os-security-groups/fd8dd53b-ccf7-46fd-9b4e-90c319fef075 HTTP/1.1 Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 101 Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIFoeRBJ_6a1r6PayfhydlCgryIs_kCMnrRUvlfWT7rSJAV9Ov-p9hMkY2zzA5I5V3ZaZyuc3ZxeYw2qw_IsQ9koo_Rv7aQWxcfkxrOHeebSjvcvbxcDVxY9cn9NeCLUArcOOSYrS-2e2sWEW29DNzev2F5LPwgXVYmTxL7tDI36J4s Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.727233 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_13890fbc447a4c53838df19f85919260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13890fbc447a4c53838df19f85919260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/13890fbc447a4c53838df19f85919260"}]}] Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 13890fbc447a4c53838df19f85919260 Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618 Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f453f26a39b84a32b4d08472441c4d02 Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1526160618-project Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: {"security_group": {"name": "tempest-sg-124590217", "description": "tempest-description-2083636852"}} Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:16.728902 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'fd8dd53b-ccf7-46fd-9b4e-90c319fef075', 'body': {'security_group': {'name': 'tempest-sg-124590217', 'description': 'tempest-description-2083636852'}}} Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:16.729872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:16.732631 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] Sep 19 14:49:16.734060 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] Sep 19 14:49:16.735656 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.743889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:16.748130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] Returning 404 to user: Security group fd8dd53b-ccf7-46fd-9b4e-90c319fef075 does not exist Sep 19 14:49:16.748130 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-f6b23d9d-7215-4c48-96a2-8b806082cd1d'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.750615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8cd496d-1665-4105-b7bf-5fc4d8a618a4 tempest-SecurityGroupsNegativeTestJSON-1526160618 tempest-SecurityGroupsNegativeTestJSON-1526160618-project] 10.222.0.81 "PUT /compute/v2.1/os-security-groups/fd8dd53b-ccf7-46fd-9b4e-90c319fef075" status: 404 len: 194 microversion: 2.1 time: 0.122356 Sep 19 14:49:16.761507 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1155/2276] 10.222.0.81 () {60 vars in 1290 bytes} [Mon Sep 19 14:49:16 2022] PUT /compute/v2.1/os-security-groups/fd8dd53b-ccf7-46fd-9b4e-90c319fef075 => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:16.771165 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71574023-c38f-4d7d-9a64-4a5d5f8b4b74 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 0.448200 Sep 19 14:49:16.785843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.786901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: dbb30996-2bfa-4603-9b4a-9d883a7893c9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:16.797199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1122/2277] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:16 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:16.802483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29faedc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.811489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.812721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.813170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.819351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.821276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.824836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.867724 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 could not be found. Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 HTTP/1.1 Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.871329 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 could not be found. Sep 19 14:49:16.872922 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'dbb30996-2bfa-4603-9b4a-9d883a7893c9'} Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 could not be found. Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.873781 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 could not be found. Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 could not be found. Sep 19 14:49:16.875215 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.876472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance dbb30996-2bfa-4603-9b4a-9d883a7893c9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.877061 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa115672-1a9f-4c1a-beb8-6103923cc324 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9" status: 404 len: 111 microversion: 2.1 time: 0.111539 Sep 19 14:49:16.882650 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1156/2278] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:16 2022] GET /compute/v2.1/servers/dbb30996-2bfa-4603-9b4a-9d883a7893c9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:16.891573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47a3d732-997e-4085-bb58-ed5265ce3045 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '.version_select at 0x7fde2a1efb80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.939168 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-47a3d732-997e-4085-bb58-ed5265ce3045 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Image not found. Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47a3d732-997e-4085-bb58-ed5265ce3045 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278 HTTP/1.1 Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:16.941182 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '44ec693a-a7fb-49d1-9b89-bfd293c2f278'} Sep 19 14:49:16.942677 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 44ec693a-a7fb-49d1-9b89-bfd293c2f278 to delete Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.944182 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44ec693a-a7fb-49d1-9b89-bfd293c2f278 could not be found. Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:16.945497 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:49:16.946828 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:16.949204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47a3d732-997e-4085-bb58-ed5265ce3045 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:16.950258 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-47a3d732-997e-4085-bb58-ed5265ce3045 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278" status: 404 len: 62 microversion: 2.1 time: 0.063349 Sep 19 14:49:16.951056 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1157/2279] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:16 2022] DELETE /compute/v2.1/images/44ec693a-a7fb-49d1-9b89-bfd293c2f278 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 19 14:49:16.960099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:16.960581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:16.988213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:16.988931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group 4de96311-fd7d-4dca-a976-42ec0d25f66e not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:16.989433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.989688 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:16.989688 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] Sep 19 14:49:16.989965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:16.992130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:16.995126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e HTTP/1.1 Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:49:16.995249 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] Sep 19 14:49:16.996665 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4de96311-fd7d-4dca-a976-42ec0d25f66e'} Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:16.998253 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:17.001061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.009032 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group 4de96311-fd7d-4dca-a976-42ec0d25f66e does not exist Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-311ee8a7-f4b2-4140-b540-59cd1c721843'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c0ff3dc9-9edf-4110-9d0a-a5842821b63d tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e" status: 404 len: 194 microversion: 2.1 time: 0.214823 Sep 19 14:49:17.014152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1123/2280] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:16 2022] DELETE /compute/v2.1/os-security-groups/4de96311-fd7d-4dca-a976-42ec0d25f66e => generated 194 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.017805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:17.019235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:17.026671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2a7e4e50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.049315 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 HTTP/1.1 Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:17.057296 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.060143 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '0b82c3fe-870b-49e7-970d-cd4220021ea9'} Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.061480 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.063503 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.069102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.069102 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c0edc42-f0b2-4644-b1ac-4a09cafd89f5 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 404 len: 111 microversion: 2.1 time: 0.112996 Sep 19 14:49:17.069102 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1158/2281] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:16 2022] DELETE /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:49:17.080980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.085469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: 0b82c3fe-870b-49e7-970d-cd4220021ea9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:17.102384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:17.105580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:17.107793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:17.108850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:17.111516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:17.112649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:17.170281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.179732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:17.180426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group 1cd9f039-f796-4a33-9611-2830032e0656 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:17.180961 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.180961 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 HTTP/1.1 Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:17.182566 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.183959 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '0b82c3fe-870b-49e7-970d-cd4220021ea9'} Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.184661 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. Sep 19 14:49:17.185767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.186954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance 0b82c3fe-870b-49e7-970d-cd4220021ea9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656 HTTP/1.1 Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:49:17.187035 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] Sep 19 14:49:17.192017 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1cd9f039-f796-4a33-9611-2830032e0656'} Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.192881 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:17.194828 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.199092 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] Sep 19 14:49:17.200311 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.201156 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-254d498a-6d01-46ee-991c-876ed9ab4699 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9" status: 404 len: 111 microversion: 2.1 time: 0.109546 Sep 19 14:49:17.201336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group 1cd9f039-f796-4a33-9611-2830032e0656 does not exist Sep 19 14:49:17.201336 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-2cc63cfc-22c2-4130-9f37-da72c3be73c5'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.201336 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e28ed32-54cf-457c-a3f4-cf6bb5ff9864 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656" status: 404 len: 194 microversion: 2.1 time: 0.164569 Sep 19 14:49:17.201336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1124/2282] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:17 2022] DELETE /compute/v2.1/os-security-groups/1cd9f039-f796-4a33-9611-2830032e0656 => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.206603 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1159/2283] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:17 2022] GET /compute/v2.1/servers/0b82c3fe-870b-49e7-970d-cd4220021ea9 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.210850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde2a8f19d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.224030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14500296-078e-4591-b42b-f5fc60eed04f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '.version_select at 0x7fde2a082790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.265262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:17.265861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group 0e684488-d8e1-484a-a321-d6424bfa29a4 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:17.266536 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.266536 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4 HTTP/1.1 Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:49:17.268794 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] Sep 19 14:49:17.270077 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '0e684488-d8e1-484a-a321-d6424bfa29a4'} Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.270963 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:17.272716 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.273856 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group 0e684488-d8e1-484a-a321-d6424bfa29a4 does not exist Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-df5ebc09-bcc2-4369-842d-f85a8d6ee3d4'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b5b4ddc-b109-4efb-916c-0c7df97bc8dc tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4" status: 404 len: 194 microversion: 2.1 time: 0.074086 Sep 19 14:49:17.275512 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1125/2284] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:17 2022] DELETE /compute/v2.1/os-security-groups/0e684488-d8e1-484a-a321-d6424bfa29a4 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.280988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29d9a790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.304492 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14500296-078e-4591-b42b-f5fc60eed04f tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528320486" status: 202 len: 0 microversion: 2.1 time: 0.090681 Sep 19 14:49:17.306812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1160/2285] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 14:49:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528320486 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:17.371987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-69404204-445f-4755-b808-d350b1b7a2ed tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29a54160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.511853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG neutronclient.v2_0.client [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist", "detail": ""}} {{(pid=128731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:17.512462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 not found {{(pid=128731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:17.512999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.512999 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 HTTP/1.1 Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:49:17.515311 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: exception: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] Sep 19 14:49:17.517804 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c76cf3a4-937c-46f7-a0fc-e13c19bc7d21'} Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.519395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:17.522248 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.528333 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 does not exist Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: Neutron server returns request_ids: ['req-7cdc592c-0d74-4ccc-8cfa-6ced8873e7d1'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17d2ea15-c76d-47e3-b37b-118e3c23a6e4 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21" status: 404 len: 194 microversion: 2.1 time: 0.240435 Sep 19 14:49:17.531408 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1126/2286] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:17 2022] DELETE /compute/v2.1/os-security-groups/c76cf3a4-937c-46f7-a0fc-e13c19bc7d21 => generated 194 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.532874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.532874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:17.551198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:17.554002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:17.554522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:17.559465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:17.560039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:17.560590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:17.585223 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-69404204-445f-4755-b808-d350b1b7a2ed tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 200 len: 1413 microversion: 2.1 time: 0.244746 Sep 19 14:49:17.589531 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1161/2287] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:17 2022] GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 1413 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:17.628182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde299c0280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.764515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:17.765341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group ea5c963d-33ff-4f0a-a745-23140ed38d58 not found {{(pid=128730) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:17.765916 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.765916 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58 HTTP/1.1 Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:17.768456 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] Sep 19 14:49:17.770880 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ea5c963d-33ff-4f0a-a745-23140ed38d58'} Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.775445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:17.778526 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.780225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group ea5c963d-33ff-4f0a-a745-23140ed38d58 does not exist Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-8ebcc901-201e-40cf-8944-889d8c8bdc1b'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d04a606-401d-4244-9500-792aca2f41ef tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58" status: 404 len: 194 microversion: 2.1 time: 0.177314 Sep 19 14:49:17.781401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1162/2288] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:17 2022] DELETE /compute/v2.1/os-security-groups/ea5c963d-33ff-4f0a-a745-23140ed38d58 => generated 194 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.794222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8580e213-2df3-4e28-88cc-2e04018e7ed5 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a0821f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.869380 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8580e213-2df3-4e28-88cc-2e04018e7ed5 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1453 microversion: 2.1 time: 0.092436 Sep 19 14:49:17.872301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1163/2289] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:17 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:17.885244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29b13940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.938868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:49:17.939793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Neutron security group c651e703-c090-4f5f-8455-6fc643ad715e not found {{(pid=128730) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:49:17.940821 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.940821 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e HTTP/1.1 Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:17.945023 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] Sep 19 14:49:17.948016 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c651e703-c090-4f5f-8455-6fc643ad715e'} Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.949112 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:49:17.950241 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.951445 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Security group c651e703-c090-4f5f-8455-6fc643ad715e does not exist Sep 19 14:49:17.953046 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-4129b6e0-5131-4cb1-be94-9f5de43a3f56'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:17.954591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff77a273-69e2-4844-bfee-f354d9034863 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e" status: 404 len: 194 microversion: 2.1 time: 0.073675 Sep 19 14:49:17.955453 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1164/2290] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:17 2022] DELETE /compute/v2.1/os-security-groups/c651e703-c090-4f5f-8455-6fc643ad715e => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:17.979677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:17.984997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:18.015653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:18.017142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:18.017603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:18.026789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:18.028453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:18.029386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:18.087661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:18.102940 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ac357bcf-8852-4b18-93c4-04c6e8d32ae5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1541 microversion: 2.1 time: 0.584229 Sep 19 14:49:18.103926 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1127/2291] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:17 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1541 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:18.121053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:18.134718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:18.137077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.149941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:18.151207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:18.151923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:18.152890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:18.160461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:18.161660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:18.252712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:49:18.404722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.546215 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c6630b5c-0a01-456c-b273-9a53e18970f2 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 204 len: 0 microversion: 2.1 time: 0.440063 Sep 19 14:49:18.547901 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1128/2292] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:18 2022] DELETE /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:18.559380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:18.560383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:18.574608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:18.575410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:18.579518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:18.580739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:18.581540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:18.582172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:19.476535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:19.490640 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0f771d5-13a6-4490-bbf9-3f8411609d1e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 1.531538 Sep 19 14:49:19.509530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1165/2293] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:17 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:19.529457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f8e69e2d-1040-4ae9-8123-d57bd89b758e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29aaa550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:20.342653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b698695cf7f467da5b0d5273c3795a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe599a0fd746e6861a30dc82e1e060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:20.358327 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f28848cc-c1ec-4d6e-af45-e6af5bdbc202 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 200 len: 1646 microversion: 2.1 time: 1.803614 Sep 19 14:49:20.359311 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1129/2294] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:18 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 1646 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:20.367568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5c249eb-3726-4caf-b25c-d3cf8d447408 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29af5ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:28.000392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.574480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:29.481465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:30.348428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.964988 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f8e69e2d-1040-4ae9-8123-d57bd89b758e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 200 len: 1422 microversion: 2.1 time: 21.453981 Sep 19 14:49:40.965884 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1166/2295] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:19 2022] GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 1422 bytes in 21455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:40.985602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:40.986236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:40.988672 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5c249eb-3726-4caf-b25c-d3cf8d447408 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1453 microversion: 2.1 time: 20.628051 Sep 19 14:49:40.998122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:40.998631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:40.999130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:40.999726 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1130/2296] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:20 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1453 bytes in 20639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:40.999931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.000424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.001848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:41.018703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:41.019385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:41.045352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.046139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.046594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:41.047391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.047871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.066834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:41.671616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:41.680307 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fcac987e-d755-4fb3-b195-83ac6bbb9258 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1540 microversion: 2.1 time: 0.713599 Sep 19 14:49:41.685168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1167/2297] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:40 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1540 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:41.698765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0727fc81-3bee-401c-80eb-9d9b7d8fa8aa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '.version_select at 0x7fde29aaa8b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:41.727510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0727fc81-3bee-401c-80eb-9d9b7d8fa8aa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Image not found. Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0727fc81-3bee-401c-80eb-9d9b7d8fa8aa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/images/35cf57fa-78f7-4b8d-a147-7c6aa1624d51 HTTP/1.1 Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:41.737069 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '35cf57fa-78f7-4b8d-a147-7c6aa1624d51'} Sep 19 14:49:41.740113 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 35cf57fa-78f7-4b8d-a147-7c6aa1624d51 to delete Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:41.741121 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35cf57fa-78f7-4b8d-a147-7c6aa1624d51 could not be found. Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:41.742524 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:49:41.744010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.745812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0727fc81-3bee-401c-80eb-9d9b7d8fa8aa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:41.747685 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0727fc81-3bee-401c-80eb-9d9b7d8fa8aa tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/images/35cf57fa-78f7-4b8d-a147-7c6aa1624d51" status: 404 len: 62 microversion: 2.1 time: 0.061386 Sep 19 14:49:41.753033 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1168/2298] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:41 2022] DELETE /compute/v2.1/images/35cf57fa-78f7-4b8d-a147-7c6aa1624d51 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:49:41.760648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:41.763673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] [instance: 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:41.781749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.783369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.788092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:41.789143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.789785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.790397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:41.806501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:41.815976 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d5472d7b-02f5-4085-a238-f66f7ad37d23 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 0.815058 Sep 19 14:49:41.830740 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1131/2299] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:40 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:41.852110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d3992eed-1603-40c1-8c27-873297cb890a req-197ccd61-da0d-497c-8b01-cfc2c7f97e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4625dcde-6307-4376-ad72-5ce73c514464", "name": "network-vif-plugged", "status": "completed", "tag": "cf56d438-3242-4fbe-bf8d-6222aca4b97c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:41.860647 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] HTTP exception thrown: Instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b could not be found. Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Request method failure captured: Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b HTTP/1.1 Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDdoWIrN12Ea0s4LhSgQOPX7NeWukUNipM78j2OZThlAfcIxaZkZWkNN21_xKB1tBfPGkNVcmz7Cu6m2X_ixZ2NuL6YomCA-FhBje8VsCiM_zKe2_0FxIZKUd4Mql4nIzmTY4kDOxvah__x76YYTcz8ZyyJu_tbrH4Ujm29jLLKVMU Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:41.865629 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24fe599a0fd746e6861a30dc82e1e060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24fe599a0fd746e6861a30dc82e1e060"}]}] Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 24fe599a0fd746e6861a30dc82e1e060 Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-941113274 Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3b698695cf7f467da5b0d5273c3795a5 Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupsTestJSON-941113274-project Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b could not be found. Sep 19 14:49:41.867284 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6e4c7295-0ba8-4615-8a31-23ebcebe3c1b'} Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b could not be found. Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:41.868161 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b could not be found. Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b could not be found. Sep 19 14:49:41.869553 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:41.885801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Returning 404 to user: Instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:41.887001 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d98623c-d929-4598-8625-66810d39f6e5 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b" status: 404 len: 111 microversion: 2.1 time: 0.132728 Sep 19 14:49:41.896088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d3992eed-1603-40c1-8c27-873297cb890a req-197ccd61-da0d-497c-8b01-cfc2c7f97e99 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.897004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d3992eed-1603-40c1-8c27-873297cb890a req-197ccd61-da0d-497c-8b01-cfc2c7f97e99 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.897315 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1169/2300] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:41 2022] GET /compute/v2.1/servers/6e4c7295-0ba8-4615-8a31-23ebcebe3c1b => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:41.897873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d3992eed-1603-40c1-8c27-873297cb890a req-197ccd61-da0d-497c-8b01-cfc2c7f97e99 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:41.917625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-913bd25b-f879-4ad5-9d6f-f81581a492e3 req-c44c8ef3-fabe-4025-8aac-d42897f89af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4c7295-0ba8-4615-8a31-23ebcebe3c1b", "name": "network-vif-deleted", "tag": "d9147a69-ab3a-48ac-ad66-eac5cde7a687"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:41.924337 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d3992eed-1603-40c1-8c27-873297cb890a req-197ccd61-da0d-497c-8b01-cfc2c7f97e99 service nova] Creating event network-vif-plugged:cf56d438-3242-4fbe-bf8d-6222aca4b97c for instance 4625dcde-6307-4376-ad72-5ce73c514464 on n-h2-858384-1 Sep 19 14:49:41.940332 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d3992eed-1603-40c1-8c27-873297cb890a req-197ccd61-da0d-497c-8b01-cfc2c7f97e99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105874 Sep 19 14:49:41.944579 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1132/2301] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:41.967387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f38a10f-afe6-4f82-976e-8f3b118bd962 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29dd6a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:41.970059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-913bd25b-f879-4ad5-9d6f-f81581a492e3 req-c44c8ef3-fabe-4025-8aac-d42897f89af9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:41.971766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-913bd25b-f879-4ad5-9d6f-f81581a492e3 req-c44c8ef3-fabe-4025-8aac-d42897f89af9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:41.974367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-913bd25b-f879-4ad5-9d6f-f81581a492e3 req-c44c8ef3-fabe-4025-8aac-d42897f89af9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:42.017360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-913bd25b-f879-4ad5-9d6f-f81581a492e3 req-c44c8ef3-fabe-4025-8aac-d42897f89af9 service nova] Creating event network-vif-deleted:d9147a69-ab3a-48ac-ad66-eac5cde7a687 for instance 6e4c7295-0ba8-4615-8a31-23ebcebe3c1b on n-h2-858384-1 Sep 19 14:49:42.028312 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-913bd25b-f879-4ad5-9d6f-f81581a492e3 req-c44c8ef3-fabe-4025-8aac-d42897f89af9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126622 Sep 19 14:49:42.028998 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1170/2302] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:42.045359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:42.060136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:42.075185 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f38a10f-afe6-4f82-976e-8f3b118bd962 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 200 len: 1422 microversion: 2.1 time: 0.128842 Sep 19 14:49:42.086263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:42.093371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:42.093842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:42.095597 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1133/2303] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:41 2022] GET /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 1422 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:42.099561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:42.100128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:42.100585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:42.104934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-90bdfaef-7e1e-471b-a5ed-76ed9e4b8103 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29ef48b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:42.139118 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 HTTP/1.1 Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:42.141273 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:42.142563 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918'} Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:42.143362 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:42.144486 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:42.152800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:42.154165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30aa24c7-5435-4480-a6b0-9f1573023af2 tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 404 len: 111 microversion: 2.1 time: 0.124031 Sep 19 14:49:42.155025 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1171/2304] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:42 2022] DELETE /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:42.168026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e848c297-793c-4897-9c7f-6d32af1cc6da tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a5d5940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:42.264139 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e848c297-793c-4897-9c7f-6d32af1cc6da tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1453 microversion: 2.1 time: 0.107632 Sep 19 14:49:42.268049 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1172/2305] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:42 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:42.280660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc2b7b6e-6be0-4034-af4d-f311477a06c6 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a1f8040>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:43.664581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc2b7b6e-6be0-4034-af4d-f311477a06c6 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 204 len: 0 microversion: 2.1 time: 1.391360 Sep 19 14:49:43.669320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1173/2306] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:42 2022] DELETE /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:43.675509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:43.678171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] [instance: c6453a51-ab3a-4f6d-9103-a5fa529cb918] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:43.695910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:43.696264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:43.699155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:43.703135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:43.705102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:43.706844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:43.748583 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] HTTP exception thrown: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Request method failure captured: Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 HTTP/1.1 Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIDl80U8uN7nM2-kAfWW9KJuN_i5TcgAZExl4I9I1hsA9QwsYG_oIjrztHRiEBq5dVnAQSptOamB30neZweb2Y5Mn9XRcXQddB8lO3DF46FSzPt_Nt3qSRC8mvdT9ZadwTDGCSr0baGHFmKXtImO2PK5TYpRH_hFT8j4LEQ0MD0g-SA Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:49:43.752360 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70b97b22e77c48d59731205c993e5789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70b97b22e77c48d59731205c993e5789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70b97b22e77c48d59731205c993e5789"}]}] Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 70b97b22e77c48d59731205c993e5789 Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229 Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: e40c5acb3fa44fe2b0aa0696e3dcf8c2 Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1102559229-project Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:43.754462 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c6453a51-ab3a-4f6d-9103-a5fa529cb918'} Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:43.756832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. Sep 19 14:49:43.758450 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:49:43.759782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] Returning 404 to user: Instance c6453a51-ab3a-4f6d-9103-a5fa529cb918 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:43.762045 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f71afdd8-13a4-4519-8cf4-7472f219251e tempest-ImagesOneServerNegativeTestJSON-1102559229 tempest-ImagesOneServerNegativeTestJSON-1102559229-project] 10.222.0.81 "GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918" status: 404 len: 111 microversion: 2.1 time: 0.089962 Sep 19 14:49:43.771207 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1174/2307] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:43 2022] GET /compute/v2.1/servers/c6453a51-ab3a-4f6d-9103-a5fa529cb918 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:49:43.779297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:43.783767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:43.792272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:43.793103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:43.793735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:43.794910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:43.795548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:43.796437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.104637 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-90bdfaef-7e1e-471b-a5ed-76ed9e4b8103 tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/cc4a8b4b-fd14-4050-a25d-32c582b6650d" status: 202 len: 0 microversion: 2.1 time: 2.007544 Sep 19 14:49:44.105853 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1134/2308] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:42 2022] DELETE /compute/v2.1/os-security-groups/cc4a8b4b-fd14-4050-a25d-32c582b6650d => generated 0 bytes in 2009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:44.114728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:44.116348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:44.123835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:44.124526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:44.125218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.126207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:44.126936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:44.127579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.547380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:44.557866 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9a61661c-3033-4a33-9930-972161424e3f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1540 microversion: 2.1 time: 0.784909 Sep 19 14:49:44.558467 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1175/2309] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:43 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1540 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:44.579936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-276aebec-e288-4bba-96c4-55b5f6d676d7 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a5b7280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:44.670286 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-276aebec-e288-4bba-96c4-55b5f6d676d7 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1462 microversion: 2.1 time: 0.110407 Sep 19 14:49:44.671671 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1176/2310] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:44 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:44.684637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:44.692072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:44.693279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:44.702687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:44.703508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:44.704183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.705444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:44.706183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:44.706873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.724131 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e02bb52-e5bc-4f6e-b618-2448b42e1095 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1294 microversion: 2.1 time: 0.608590 Sep 19 14:49:44.725729 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1135/2311] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:44 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1294 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:44.751089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b", "name": "network-vif-plugged", "status": "completed", "tag": "0eda42c9-b703-42e0-af43-0c50b53f2a15"}, {"server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "name": "network-vif-plugged", "status": "completed", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:44.781074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:44.781790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:44.782553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.795237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:49:44.800401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] Creating event network-vif-plugged:0eda42c9-b703-42e0-af43-0c50b53f2a15 for instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b on n-h1-858384-1 Sep 19 14:49:44.801373 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] Creating event network-vif-plugged:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:49:44.810869 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-319c6b84-77bd-4978-8033-27b57b5bd78f req-688c4c68-b75a-4083-939e-809140a53bf1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076185 Sep 19 14:49:44.818893 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1136/2312] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:44.825290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "name": "network-vif-unplugged", "status": "completed", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}, {"name": "network-changed", "server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:44.840833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:44.841588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:44.843952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:44.860589 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Creating event network-vif-unplugged:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h2-858384-1 Sep 19 14:49:44.861403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Creating event network-changed:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h2-858384-1 Sep 19 14:49:44.873471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:49:44.889281 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-65d82bdb-7dee-494b-a181-06082b6912a0 req-9f655092-b8cf-4c50-9448-8e4a2e84515d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.068659 Sep 19 14:49:44.890170 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1137/2313] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:44.897581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-86ac0617-66fa-4311-a944-9b5e0903accf tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] Calling method '.version_select at 0x7fde29ef4ee0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:45.090257 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d45a6f5b-ccfb-4d4a-a272-ae6aae158a14 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 204 len: 0 microversion: 2.1 time: 0.416625 Sep 19 14:49:45.091215 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1177/2314] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:44 2022] DELETE /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:45.115235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-483bed84-ffbe-4760-903d-6021caaa2770 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a1f8dc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:45.264662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-483bed84-ffbe-4760-903d-6021caaa2770 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 200 len: 1462 microversion: 2.1 time: 0.171687 Sep 19 14:49:45.284284 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1178/2315] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:45 2022] GET /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 1462 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:45.293413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:45.294177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:45.302182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:45.303145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:45.303792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:45.305064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:45.305756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:45.306450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:45.892728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:45.918992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a6a81320-19cd-40a9-b6c2-e1d829a18c6c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1467 microversion: 2.1 time: 0.628985 Sep 19 14:49:45.934812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1179/2316] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:45 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1467 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:45.946534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1498684018", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "779ee5e7-92ae-45cf-806b-a3db91dc090f"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:46.088278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] validate_networks() for [('779ee5e7-92ae-45cf-806b-a3db91dc090f', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:49:46.704339 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-86ac0617-66fa-4311-a944-9b5e0903accf tempest-SecurityGroupsTestJSON-941113274 tempest-SecurityGroupsTestJSON-941113274-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/fc551dfd-d442-4606-a5de-46c592fe43b9" status: 202 len: 0 microversion: 2.1 time: 1.812248 Sep 19 14:49:46.707982 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1138/2317] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:49:44 2022] DELETE /compute/v2.1/os-security-groups/fc551dfd-d442-4606-a5de-46c592fe43b9 => generated 0 bytes in 1817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:46.720319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:46.721988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:46.737381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:46.738200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:46.739774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:46.741091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:46.743023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:46.743888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:47.631375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:47.678369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-946951a8-9e39-49b5-82c7-cedc1c43d043 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1472 microversion: 2.1 time: 0.968227 Sep 19 14:49:47.679569 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1139/2318] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:46 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1472 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:47.692221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:47.693570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:47.705539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:47.707637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:47.709848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:47.711059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:47.711770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:47.712395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:48.951312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:48.977309 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab4a2dbd-3e37-4c6d-81c8-54740c91225a tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1484 microversion: 2.1 time: 1.296003 Sep 19 14:49:48.979462 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1140/2319] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:47 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1484 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:48.989709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a097f040-5529-46fb-a300-3c117ae6fc28 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2ab231f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:49.162965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a097f040-5529-46fb-a300-3c117ae6fc28 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?changes-since=2022-09-19T14%3A47%3A36Z" status: 200 len: 1902 microversion: 2.1 time: 0.181298 Sep 19 14:49:49.166084 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1141/2320] 10.222.0.81 () {58 vars in 1199 bytes} [Mon Sep 19 14:49:48 2022] GET /compute/v2.1/images?changes-since=2022-09-19T14%3A47%3A36Z => generated 1902 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:49.177634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2e0248d6-c379-4f0b-b814-2e4789513f8e req-d21332dd-6c5a-4099-a116-a79174230772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4625dcde-6307-4376-ad72-5ce73c514464", "name": "network-vif-unplugged", "status": "completed", "tag": "cf56d438-3242-4fbe-bf8d-6222aca4b97c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:49.197397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2e0248d6-c379-4f0b-b814-2e4789513f8e req-d21332dd-6c5a-4099-a116-a79174230772 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.198789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2e0248d6-c379-4f0b-b814-2e4789513f8e req-d21332dd-6c5a-4099-a116-a79174230772 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.200158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2e0248d6-c379-4f0b-b814-2e4789513f8e req-d21332dd-6c5a-4099-a116-a79174230772 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:49.224350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2e0248d6-c379-4f0b-b814-2e4789513f8e req-d21332dd-6c5a-4099-a116-a79174230772 service nova] Creating event network-vif-unplugged:cf56d438-3242-4fbe-bf8d-6222aca4b97c for instance 4625dcde-6307-4376-ad72-5ce73c514464 on n-h2-858384-1 Sep 19 14:49:49.241642 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2e0248d6-c379-4f0b-b814-2e4789513f8e req-d21332dd-6c5a-4099-a116-a79174230772 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072490 Sep 19 14:49:49.243916 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1142/2321] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:49.253561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:49.255677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:49.271036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.272588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.273864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:49.276160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.277403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.278619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:49.297718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:49:49.299310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:49:49.300840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:49:49.304931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:49:49.305624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:49:49.330549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.333619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.334328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:49.338884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.339655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.340454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:49.414037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:49:49.436145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for user b469a10b494b4876896c5300aa676b46 and project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:49:49.483547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:49:49.489629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:49:49.653011 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-221291c2-7a5e-4396-b8a9-223ecb93b669 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.719372 Sep 19 14:49:49.659498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1180/2322] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:49:49.679284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:49.683305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:49.712099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.712636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.713087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:49.713880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:49.714336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:49.714870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:50.213357 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-409a05ca-c035-4c35-b968-46b2d45977eb tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.549787 Sep 19 14:49:50.215065 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1181/2323] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:49:49 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b/os-interface => generated 284 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:50.222536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fcec6ccb-6449-46e3-9216-b8fae12eb4bb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29d87160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:50.301525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:50.369212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-58276cb1-2bf3-4675-98d5-f0475b01ae0b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1469 microversion: 2.1 time: 1.121424 Sep 19 14:49:50.380254 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1143/2324] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:49 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1469 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:50.389788 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fcec6ccb-6449-46e3-9216-b8fae12eb4bb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-682587377" status: 200 len: 484 microversion: 2.1 time: 0.173137 Sep 19 14:49:50.397369 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1182/2325] 10.222.0.81 () {58 vars in 1229 bytes} [Mon Sep 19 14:49:50 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-682587377 => generated 484 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:50.406265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76044b88-1128-4951-9721-b456f76f5c43 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:50.407193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76044b88-1128-4951-9721-b456f76f5c43 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:50.414486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:50.417097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:50.451569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:50.452100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:50.452560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:50.465500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:50.466230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:50.469551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:50.591715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:50.592573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:50.593353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:50.594269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:50.594928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:50.595522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:50.649395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:49:50.681603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for user e2149c78b4d04c10b02d521a5635b29f and project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:49:50.922015 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e16912a4-111f-4af3-9810-b9f9a8758f6b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158/action" status: 202 len: 0 microversion: 2.1 time: 0.517608 Sep 19 14:49:50.924013 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1183/2326] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:49:50 2022] POST /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:49:50.936572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4018fb34-f300-4988-baf0-925866ee92d2 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a76d940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.162520 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4018fb34-f300-4988-baf0-925866ee92d2 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?server=85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 957 microversion: 2.1 time: 0.234738 Sep 19 14:49:51.172053 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1184/2327] 10.222.0.81 () {58 vars in 1209 bytes} [Mon Sep 19 14:49:50 2022] GET /compute/v2.1/images?server=85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 957 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:51.178308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.180323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:51.203043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:51.205364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:51.206887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:51.208586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:51.209338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:51.210008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:51.266520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76044b88-1128-4951-9721-b456f76f5c43 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:51.280271 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76044b88-1128-4951-9721-b456f76f5c43 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1208 microversion: 2.1 time: 0.898181 Sep 19 14:49:51.291741 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1144/2328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:50 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1208 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:51.297985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85824560-cf32-4378-bc17-c11d56364a33 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2aa98a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.418241 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-85824560-cf32-4378-bc17-c11d56364a33 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 485 microversion: 2.1 time: 0.124514 Sep 19 14:49:51.428976 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1145/2329] 10.222.0.81 () {58 vars in 1317 bytes} [Mon Sep 19 14:49:51 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667 => generated 485 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:51.434765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "name": "network-vif-unplugged", "status": "completed", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}, {"server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "name": "network-vif-plugged", "status": "completed", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:51.470936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:51.471849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:51.472445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:51.500452 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Creating event network-vif-unplugged:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:49:51.501543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Creating event network-vif-plugged:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h2-858384-1 Sep 19 14:49:51.509061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:49:51.541080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5d2604f5-10c9-4202-a3b0-eb7555e875dd req-a6496ed9-dbca-486a-b614-22e16155bf69 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.110044 Sep 19 14:49:51.542169 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1146/2330] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:51.547638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-045254e6-a7b1-4877-8682-43bf589fca33 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29ef49d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.633725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-045254e6-a7b1-4877-8682-43bf589fca33 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 485 microversion: 2.1 time: 0.090246 Sep 19 14:49:51.647741 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1147/2331] 10.222.0.81 () {58 vars in 1303 bytes} [Mon Sep 19 14:49:51 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667 => generated 485 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:51.653406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2bdab177-71a9-4f55-b19d-649eee22b1a1 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a73a0d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.763973 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2bdab177-71a9-4f55-b19d-649eee22b1a1 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.113903 Sep 19 14:49:51.776758 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1148/2332] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:49:51 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:51.782554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-30d5750a-bf6e-4ea9-97ae-b8205797ab8c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29ef49d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.862452 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-30d5750a-bf6e-4ea9-97ae-b8205797ab8c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.083918 Sep 19 14:49:51.872434 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1149/2333] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:49:51 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:51.888365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-986435a6-b653-4515-9c01-61cfb7425d61 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29f48550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:51.938012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:51.950199 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f88486f-512f-4085-ba79-1194df3c4494 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1468 microversion: 2.1 time: 0.784066 Sep 19 14:49:51.951835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1185/2334] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:51 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1468 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:52.032666 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-986435a6-b653-4515-9c01-61cfb7425d61 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.158111 Sep 19 14:49:52.043401 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1150/2335] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:49:51 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:52.057574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a20fe88b-da20-47f8-a340-6368ce4ac073 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a5b7820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.142889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3d347006-27c2-46b4-bed2-d245f962862e req-3e4ce819-33b2-4e14-b436-922e41871b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4625dcde-6307-4376-ad72-5ce73c514464", "name": "network-vif-deleted", "tag": "cf56d438-3242-4fbe-bf8d-6222aca4b97c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:52.171522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3d347006-27c2-46b4-bed2-d245f962862e req-3e4ce819-33b2-4e14-b436-922e41871b66 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:52.172034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3d347006-27c2-46b4-bed2-d245f962862e req-3e4ce819-33b2-4e14-b436-922e41871b66 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:52.177769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3d347006-27c2-46b4-bed2-d245f962862e req-3e4ce819-33b2-4e14-b436-922e41871b66 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:52.213771 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3d347006-27c2-46b4-bed2-d245f962862e req-3e4ce819-33b2-4e14-b436-922e41871b66 service nova] Creating event network-vif-deleted:cf56d438-3242-4fbe-bf8d-6222aca4b97c for instance 4625dcde-6307-4376-ad72-5ce73c514464 on n-h2-858384-1 Sep 19 14:49:52.232687 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3d347006-27c2-46b4-bed2-d245f962862e req-3e4ce819-33b2-4e14-b436-922e41871b66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131510 Sep 19 14:49:52.233407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1151/2336] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:52.233794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a20fe88b-da20-47f8-a340-6368ce4ac073 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?changes-since=2022-09-19T14%3A47%3A29Z" status: 200 len: 6326 microversion: 2.1 time: 0.171495 Sep 19 14:49:52.236654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1186/2337] 10.222.0.81 () {58 vars in 1220 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-19T14%3A47%3A29Z => generated 6326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:52.272130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-380cbbe9-de0d-4cc5-a555-b7757bf09724 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29e3ddc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.333313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.335023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:52.351507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:52.352040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:52.353649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:52.354417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:52.357186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:52.357899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:52.388543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-380cbbe9-de0d-4cc5-a555-b7757bf09724 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-682587377" status: 200 len: 664 microversion: 2.1 time: 0.132358 Sep 19 14:49:52.390646 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1152/2338] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-682587377 => generated 664 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:52.419248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d42ea603-2113-442b-8da8-c6c24aa46001 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29f48550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.537870 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d42ea603-2113-442b-8da8-c6c24aa46001 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1465 microversion: 2.1 time: 0.127773 Sep 19 14:49:52.538817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1153/2339] 10.222.0.81 () {58 vars in 1338 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667 => generated 1465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:52.569542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78109893-7240-4142-934b-7a2e7e6d3a5c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29da0790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.669902 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78109893-7240-4142-934b-7a2e7e6d3a5c tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1465 microversion: 2.1 time: 0.104503 Sep 19 14:49:52.672237 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1154/2340] 10.222.0.81 () {58 vars in 1324 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2Fb56bc4e2-626f-4f58-b751-104d2332d667 => generated 1465 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:52.700439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79e528cb-058f-42f8-bc7f-32603f90cff9 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29e3d310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.851301 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79e528cb-058f-42f8-bc7f-32603f90cff9 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.155955 Sep 19 14:49:52.867618 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1155/2341] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:52.872778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d981753-f2ae-4f8c-b712-4cb1e1dcf233 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a61d310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.952648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:52.967823 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-025b1170-113a-4aec-a06d-67afb342ae6f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1266 microversion: 2.1 time: 0.641782 Sep 19 14:49:52.969520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1187/2342] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1266 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:52.993456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:52.995836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:53.003393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:53.004654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:53.005110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:53.005925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:53.006409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:53.007592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:53.019086 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d981753-f2ae-4f8c-b712-4cb1e1dcf233 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.149963 Sep 19 14:49:53.020437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1156/2343] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:53.054844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28abec25-1ccf-4f9a-9e94-03fe9fc0b294 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29de48b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:53.124046 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28abec25-1ccf-4f9a-9e94-03fe9fc0b294 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/65e17483-129b-4a3b-97d8-49cd96ae0799" status: 200 len: 784 microversion: 2.1 time: 0.077040 Sep 19 14:49:53.136001 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1157/2344] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:53 2022] GET /compute/v2.1/images/65e17483-129b-4a3b-97d8-49cd96ae0799 => generated 784 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:53.141169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-275022bb-1494-47de-b76d-80ea2dad0af4 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29e3d550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:53.199630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-275022bb-1494-47de-b76d-80ea2dad0af4 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.062100 Sep 19 14:49:53.210783 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1158/2345] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 14:49:53 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:53.224273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40b3ec58-d1f5-42bc-bf96-f63e0b64cd49 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde29da0790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:53.701051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:53.715215 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5fed584f-ad52-4694-a1ab-d6417f047025 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1468 microversion: 2.1 time: 0.730161 Sep 19 14:49:53.716419 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1188/2346] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:52 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1468 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:53.995884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:53.996951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:54.012820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:54.015100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:54.016407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:54.018009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:54.020962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:54.021535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:54.171281 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40b3ec58-d1f5-42bc-bf96-f63e0b64cd49 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024" status: 204 len: 0 microversion: 2.1 time: 0.956155 Sep 19 14:49:54.175588 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1159/2347] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:53 2022] DELETE /compute/v2.1/images/555b7dbf-db1f-439d-8502-18172a7ce024 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:54.184008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-29e4e23b-a7d6-4e97-9ad8-63f9bc69929d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde298a4a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:54.271305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:54.290874 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc75b625-79be-4381-b0b6-5d773875936d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1266 microversion: 2.1 time: 0.298544 Sep 19 14:49:54.292696 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1189/2348] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:53 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:54.749753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:54.750851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:54.780890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:54.782958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:54.783563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:54.785479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:54.787002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:54.787684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:54.850698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:55.352353 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-29e4e23b-a7d6-4e97-9ad8-63f9bc69929d tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a" status: 204 len: 0 microversion: 2.1 time: 1.174146 Sep 19 14:49:55.355043 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1160/2349] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:54 2022] DELETE /compute/v2.1/images/625b415f-360f-45e8-b472-acca12d6ee6a => generated 0 bytes in 1178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:55.362975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:55.364150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:55.383111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:55.383945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:55.388233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:55.389250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:55.392459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:55.393150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:55.746575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:55.758840 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d58b8875-bf90-47f2-a6ed-3e01da4fa0e0 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1468 microversion: 2.1 time: 1.012594 Sep 19 14:49:55.759658 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1190/2350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:54 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1468 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:55.775351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55c6b2d7-6fa1-4f72-b22b-18e86c61f97b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a931670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:55.882300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:55.890783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb6f5925-4ab4-40ac-91b9-a2a931932f45 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 0.534384 Sep 19 14:49:55.896572 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1161/2351] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:55 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:56.515433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-791874511", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8f665642-12a8-434c-9193-66d028b68652"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:56.651749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] validate_networks() for [('8f665642-12a8-434c-9193-66d028b68652', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:49:56.887804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55c6b2d7-6fa1-4f72-b22b-18e86c61f97b tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6" status: 204 len: 0 microversion: 2.1 time: 1.126280 Sep 19 14:49:56.888663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1191/2352] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:55 2022] DELETE /compute/v2.1/images/06c33067-f7b6-46df-9ce5-fbe5e59582e6 => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:56.896044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:56.897986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:56.912532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:56.918264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:56.919266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:56.920698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:56.923477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:56.924293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:57.795100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:57.817201 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0fdf906d-a9bb-42a0-96c9-b73aa8e0a0d4 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1484 microversion: 2.1 time: 0.925933 Sep 19 14:49:57.821850 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1192/2353] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:56 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1484 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:57.837576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4ad57c6e-9954-4b19-823c-57edf1852ead req-1a46146e-376f-4e18-aa2b-a514527e9b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b", "tag": "0eda42c9-b703-42e0-af43-0c50b53f2a15"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:49:57.861187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4ad57c6e-9954-4b19-823c-57edf1852ead req-1a46146e-376f-4e18-aa2b-a514527e9b44 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:57.864853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4ad57c6e-9954-4b19-823c-57edf1852ead req-1a46146e-376f-4e18-aa2b-a514527e9b44 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:57.865612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4ad57c6e-9954-4b19-823c-57edf1852ead req-1a46146e-376f-4e18-aa2b-a514527e9b44 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:57.895980 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4ad57c6e-9954-4b19-823c-57edf1852ead req-1a46146e-376f-4e18-aa2b-a514527e9b44 service nova] Creating event network-changed:0eda42c9-b703-42e0-af43-0c50b53f2a15 for instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b on n-h1-858384-1 Sep 19 14:49:57.913180 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4ad57c6e-9954-4b19-823c-57edf1852ead req-1a46146e-376f-4e18-aa2b-a514527e9b44 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089673 Sep 19 14:49:57.915552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1193/2354] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:49:57.928782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:57.930314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:57.950119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:57.951107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:57.951971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:57.953061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:57.955950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:57.958431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:58.771752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:58.782252 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d545328-8aa9-4968-8889-7d7fe7993913 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1534 microversion: 2.1 time: 0.865047 Sep 19 14:49:58.783262 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1194/2355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:57 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1534 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:58.789615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:58.796527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:58.814726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:49:58.815853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:49:58.817045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:49:58.817690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:49:58.817815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:58.818881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:49:58.821111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:58.821690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:58.822629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:58.823379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:58.824739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:58.841115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:58.841848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:58.843485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:58.845794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:58.846303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:58.846773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:58.856118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:49:58.902037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Getting quotas for project a2dbb84791334d21b787f11c372cc1a7. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:49:58.922645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Getting quotas for user abf699ae2912462ca84d1bb4bb30a3f6 and project a2dbb84791334d21b787f11c372cc1a7. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:49:58.982230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Going to run 3 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:49:58.993198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:49:59.010447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06319751-a70c-4a15-aea9-3fe2ad3f429a tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 204 len: 0 microversion: 2.1 time: 0.225563 Sep 19 14:49:59.011279 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1195/2356] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:49:58 2022] DELETE /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:59.017145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:59.029998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:59.072581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.074333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.075266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.083016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.084275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.084965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.110871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=1a3d93f5-ecdf-486e-a0d7-43bae7fb209d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:49:59.200114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=665e3b36-5d49-49a1-b034-9e9c5010b5ba,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:49:59.324651 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81b180f7-df7b-4607-b814-52e24d3f3a49 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.420536 Sep 19 14:49:59.333729 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1162/2357] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:49:59.469563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:59.588390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10764dff-a565-4d62-8c88-564a88c9f598 tempest-ListImageFiltersNegativeTestJSON-1707683191 tempest-ListImageFiltersNegativeTestJSON-1707683191-project] Calling method '.version_select at 0x7fde2a832ca0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:59.625235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:59.643120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e5711d71-aeff-414d-b8ca-e10fb66aeada tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 0.625276 Sep 19 14:49:59.661426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1196/2358] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:59 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:59.668961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:59.671002 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-10764dff-a565-4d62-8c88-564a88c9f598 tempest-ListImageFiltersNegativeTestJSON-1707683191 tempest-ListImageFiltersNegativeTestJSON-1707683191-project] HTTP exception thrown: Image not found. Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10764dff-a565-4d62-8c88-564a88c9f598 tempest-ListImageFiltersNegativeTestJSON-1707683191 tempest-ListImageFiltersNegativeTestJSON-1707683191-project] Request method failure captured: Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/images/5d3b8c74-aa29-4f64-bc40-f2fd46a50a95 HTTP/1.1 Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGU90FgNHFTOOmUPzQikyKRc25IxWSIm4wmaJPsfJ-6mgLQatgFgjX9-QKKREo1vjmWnXH9degpBxkB4Otm-11fRTNs1JTEHlF-rg6SDSjyIuTTVRPYB6XmB3ybRdWvootnViTTWlOEqI82dvk3hUBl2eyi9l540XM23ifXoxQT-JQ Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 13f21870979c4d5cb2c7f188afe046e9 Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1707683191 Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:49:59.674515 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_13f21870979c4d5cb2c7f188afe046e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13f21870979c4d5cb2c7f188afe046e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/13f21870979c4d5cb2c7f188afe046e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/13f21870979c4d5cb2c7f188afe046e9"}]}] Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1707683191 Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 13f21870979c4d5cb2c7f188afe046e9 Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1707683191 Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListImageFiltersNegativeTestJSON-1707683191-project Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 69714b49184e495580937fb554052ad5 Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1707683191-project Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5d3b8c74-aa29-4f64-bc40-f2fd46a50a95'} Sep 19 14:49:59.676291 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:49:59.677407 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d3b8c74-aa29-4f64-bc40-f2fd46a50a95 Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:49:59.678670 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d3b8c74-aa29-4f64-bc40-f2fd46a50a95 could not be found. Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:49:59.681266 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:49:59.682972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10764dff-a565-4d62-8c88-564a88c9f598 tempest-ListImageFiltersNegativeTestJSON-1707683191 tempest-ListImageFiltersNegativeTestJSON-1707683191-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:49:59.686202 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-10764dff-a565-4d62-8c88-564a88c9f598 tempest-ListImageFiltersNegativeTestJSON-1707683191 tempest-ListImageFiltersNegativeTestJSON-1707683191-project] 10.222.0.81 "GET /compute/v2.1/images/5d3b8c74-aa29-4f64-bc40-f2fd46a50a95" status: 404 len: 62 microversion: 2.1 time: 0.341897 Sep 19 14:49:59.686202 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1163/2359] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:49:59 2022] GET /compute/v2.1/images/5d3b8c74-aa29-4f64-bc40-f2fd46a50a95 => generated 62 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:49:59.694258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:59.708256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:59.718624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.721877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.723227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.733306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.735346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.736673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.743092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:49:59.743798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:49:59.809901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.811445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.811899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.812677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.814708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.815207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.893399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cfd4f13a-0629-4ff5-ab9b-da88cacf83eb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.207852 Sep 19 14:49:59.898150 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1164/2360] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:49:59 2022] GET /compute/v2.1/servers => generated 1015 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:59.921879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:49:59.926810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:49:59.954990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.955495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.955940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:49:59.957091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:49:59.957633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:49:59.963361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:00.570458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:00.588447 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0920e9d-10c0-4c4f-bf8d-c471937aeda1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1534 microversion: 2.1 time: 0.688284 Sep 19 14:50:00.594339 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1165/2361] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:59 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1534 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:00.606510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:00.616258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b6752d58-fd91-4a5b-a7b1-da491e30ca0f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:00.625885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:00.639689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b6752d58-fd91-4a5b-a7b1-da491e30ca0f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:00.661616 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2cb2c4b6-26bf-44d0-bbc8-954b977543aa tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1474 microversion: 2.1 time: 0.993619 Sep 19 14:50:00.666381 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1197/2362] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:49:59 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1474 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:00.698704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-df8cc107-413b-457f-ab11-c40ebf83e51b req-160a05c1-079e-44bb-abef-0c75a5a06f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc21d495-0399-4b56-9b4b-410e915192de", "tag": "24701317-1249-428b-b54e-b2b4bb1f367b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:00.772436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-df8cc107-413b-457f-ab11-c40ebf83e51b req-160a05c1-079e-44bb-abef-0c75a5a06f86 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:00.772931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-df8cc107-413b-457f-ab11-c40ebf83e51b req-160a05c1-079e-44bb-abef-0c75a5a06f86 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:00.791282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-df8cc107-413b-457f-ab11-c40ebf83e51b req-160a05c1-079e-44bb-abef-0c75a5a06f86 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:00.819622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-df8cc107-413b-457f-ab11-c40ebf83e51b req-160a05c1-079e-44bb-abef-0c75a5a06f86 service nova] Creating event network-changed:24701317-1249-428b-b54e-b2b4bb1f367b for instance dc21d495-0399-4b56-9b4b-410e915192de on n-h2-858384-1 Sep 19 14:50:00.827339 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-df8cc107-413b-457f-ab11-c40ebf83e51b req-160a05c1-079e-44bb-abef-0c75a5a06f86 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153574 Sep 19 14:50:00.827878 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1198/2363] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:00.853741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:00.854737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:00.870031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:00.870541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:00.871391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:00.873377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:00.873862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:00.875292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:00.938257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b6752d58-fd91-4a5b-a7b1-da491e30ca0f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:00.951137 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b6752d58-fd91-4a5b-a7b1-da491e30ca0f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1222 microversion: 2.1 time: 0.346942 Sep 19 14:50:00.954126 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1166/2364] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:00 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1222 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:01.336385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:01.345754 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e60a8207-273e-49d9-835f-1afd94f3d137 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 0.511450 Sep 19 14:50:01.369052 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1199/2365] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:00 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:01.627284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:01.628175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:01.665673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:01.667109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:01.669751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:01.672544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:01.672832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:01.674965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:01.700128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:01.700889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:01.722265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:01.725361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:01.726499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:01.727501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:01.735237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:01.735688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:02.388188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:02.400261 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3a3b6323-6506-4512-b23b-ef506958cf42 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1534 microversion: 2.1 time: 0.782599 Sep 19 14:50:02.402156 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1167/2366] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:01 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1534 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:02.428406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:02.429614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:02.439917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:02.459872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:02.460323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:02.461255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:02.461881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:02.462482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:02.920727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:02.939981 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be7dbcd7-505d-4f23-98d2-cc1ec5d61839 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1218 microversion: 2.1 time: 0.523187 Sep 19 14:50:02.940659 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1168/2367] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:02 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1218 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:02.951748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:02.952668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:02.965620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:02.969435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:02.970708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:02.971717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:02.973117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:02.973724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:03.015775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:03.079465 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d78b6486-1155-4741-990a-cacd604cb2bd tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1474 microversion: 2.1 time: 1.388155 Sep 19 14:50:03.107792 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1200/2368] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:01 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1474 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:03.119410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "name": "network-vif-unplugged", "status": "completed", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:03.139789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:03.140921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:03.141631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:03.168042 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] Creating event network-vif-unplugged:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h1-858384-1 Sep 19 14:50:03.178831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:50:03.215740 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b69210a3-f470-4504-832b-0fa88a5ed4ec req-1ce01048-c3d3-481b-99a8-ced273ed8aea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105500 Sep 19 14:50:03.217881 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1201/2369] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:03.432148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:03.433312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:03.451884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:03.454111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:03.457327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:03.461347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:03.464092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:03.464761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.311731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:04.322355 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5355fa01-7ccb-4f20-ac80-fc3876b735fd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 1.374353 Sep 19 14:50:04.323380 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1169/2370] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:02 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:04.328117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-db34b734-1152-4104-8832-b41bc8d49abf req-8312d565-ca22-4128-8b95-99280629230c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56bc4e2-626f-4f58-b751-104d2332d667", "name": "network-vif-deleted", "tag": "3b76a253-3ccb-40fd-b477-5d121bf281f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:04.345498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db34b734-1152-4104-8832-b41bc8d49abf req-8312d565-ca22-4128-8b95-99280629230c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:04.345865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db34b734-1152-4104-8832-b41bc8d49abf req-8312d565-ca22-4128-8b95-99280629230c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:04.346640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db34b734-1152-4104-8832-b41bc8d49abf req-8312d565-ca22-4128-8b95-99280629230c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.380258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-db34b734-1152-4104-8832-b41bc8d49abf req-8312d565-ca22-4128-8b95-99280629230c service nova] Creating event network-vif-deleted:3b76a253-3ccb-40fd-b477-5d121bf281f4 for instance b56bc4e2-626f-4f58-b751-104d2332d667 on n-h2-858384-1 Sep 19 14:50:04.386628 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-db34b734-1152-4104-8832-b41bc8d49abf req-8312d565-ca22-4128-8b95-99280629230c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061892 Sep 19 14:50:04.387813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1170/2371] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:04.397250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:04.398264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:04.407257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:04.408009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:04.408639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.411088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:04.412103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:04.412765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.576464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:04.593348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fce5594d-e8f9-4906-955c-54724a5b5b9a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1534 microversion: 2.1 time: 1.170044 Sep 19 14:50:04.595881 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1202/2372] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:03 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1534 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:04.610553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:04.611744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:04.620871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:04.621749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:04.622457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.623574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:04.624186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:04.624797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.671277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:04.671778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:04.672214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:04.672949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lazy-loading 'fault' on Instance uuid b56bc4e2-626f-4f58-b751-104d2332d667 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:50:04.811368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:04.831169 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-520741fc-954b-4f5e-bf47-d7a2e70b6306 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1282 microversion: 2.1 time: 0.434283 Sep 19 14:50:04.833156 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1171/2373] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:04 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1282 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:04.897900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:04.908878 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b68e1022-4839-475d-9b2f-d98d7f1ec03f tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 200 len: 1308 microversion: 2.1 time: 0.311647 Sep 19 14:50:04.914086 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1203/2374] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:04 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:05.321780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:05.335111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:05.336308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:05.336687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:05.356999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:05.358149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:05.366993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:05.373137 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] Creating event network-changed:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h1-858384-1 Sep 19 14:50:05.383676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:05.385493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:50:05.401067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:05.403907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:05.412897 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-557bc7e5-765a-4d8c-aa74-b8652f37c0bd req-39281a1a-ec0b-4b48-be63-f633c1b5ec61 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084573 Sep 19 14:50:05.415213 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1172/2375] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:05.417296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:05.418193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:05.418660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:05.627174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:05.628181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:05.652400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:05.652984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:05.653975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:05.654891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:05.656763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:05.657701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.242496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:06.256545 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6aff607e-fc4b-4706-ae7a-a15abcc09f39 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 0.905994 Sep 19 14:50:06.259924 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1204/2376] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:05 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:06.267263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:06.271016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:06.291379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.292713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.293734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.294816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.295966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.301355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.548045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:06.550919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:06.560068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62afeee9-88eb-4d89-9a92-567054f29ab0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1280 microversion: 2.1 time: 0.298386 Sep 19 14:50:06.574773 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0867f641-4c03-4d5b-961c-8db6f5fd68b9 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1534 microversion: 2.1 time: 0.942897 Sep 19 14:50:06.575031 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1205/2377] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:06 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:06.575031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:06.575031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: b56bc4e2-626f-4f58-b751-104d2332d667] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:06.581937 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1173/2378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:05 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1534 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:06.606108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.606108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.606108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.606108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.607079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.607543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.636840 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] HTTP exception thrown: Instance b56bc4e2-626f-4f58-b751-104d2332d667 could not be found. Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Request method failure captured: Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 HTTP/1.1 Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKID_UgPY3P0GG9NFeo7tb1NG7sS0nYnTB_MN9pNiWzljaMMp_geFhNx6RzGVCbMPPmpeUiBk4tCwExcl028IKAviXEear9D7c-kGTvzimrFpYmiCS8oaauAwya1GaVKqbBR7Ctag5HplTiop9BnOKoo8vGAGI7HyHg3mtK-XLSy8yZ8 Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 748bd95ac454426f80b5937ff3080dbc Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ListImageFiltersTestJSON-369610661 Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:50:06.640348 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_748bd95ac454426f80b5937ff3080dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/748bd95ac454426f80b5937ff3080dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/748bd95ac454426f80b5937ff3080dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/748bd95ac454426f80b5937ff3080dbc"}]}] Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ListImageFiltersTestJSON-369610661 Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 748bd95ac454426f80b5937ff3080dbc Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-369610661 Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ListImageFiltersTestJSON-369610661-project Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 2ca604f0c3a1493b9dd60905bbce3291 Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ListImageFiltersTestJSON-369610661-project Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance b56bc4e2-626f-4f58-b751-104d2332d667 could not be found. Sep 19 14:50:06.641724 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'b56bc4e2-626f-4f58-b751-104d2332d667'} Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56bc4e2-626f-4f58-b751-104d2332d667 could not be found. Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:06.642473 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56bc4e2-626f-4f58-b751-104d2332d667 could not be found. Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56bc4e2-626f-4f58-b751-104d2332d667 could not be found. Sep 19 14:50:06.643688 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:06.651557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Returning 404 to user: Instance b56bc4e2-626f-4f58-b751-104d2332d667 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:06.652916 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c4b8939c-6089-4e3b-862b-604db0bcb7f3 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667" status: 404 len: 111 microversion: 2.1 time: 0.085203 Sep 19 14:50:06.653737 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1206/2379] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:06 2022] GET /compute/v2.1/servers/b56bc4e2-626f-4f58-b751-104d2332d667 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:50:06.664232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:06.664753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:06.671958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.672866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.673916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.675228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.675957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.676617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.681982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.717353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:50:06.863311 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-adc5ef1d-6326-4fba-9866-ba7823dde0d6 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 204 len: 0 microversion: 2.1 time: 0.203541 Sep 19 14:50:06.868681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1174/2380] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:06 2022] DELETE /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:06.873367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:06.875463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:06.884656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.885522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.886178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:06.889911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:06.894588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:06.895451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:07.290868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:07.292325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:07.299397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:07.299894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:07.300974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:07.301864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:07.302485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:07.303116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:08.007867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:08.026535 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aeb60587-28ef-436f-813c-d863079b8652 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1473 microversion: 2.1 time: 1.156240 Sep 19 14:50:08.043285 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1207/2381] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:06 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1473 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:08.055773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:08.056697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:08.066676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:08.067534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:08.068410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:08.069382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:08.070487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:08.071185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:08.119967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.332921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:08.355597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:08.359882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-171b68cb-e861-4c06-826b-5956bdfd8638 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1280 microversion: 2.1 time: 0.311320 Sep 19 14:50:08.365219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68b4b6d5-9de6-42dc-87fd-9f9363b2499e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 1.082195 Sep 19 14:50:08.373085 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1175/2382] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:07 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:08.395127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:08.395959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:08.402845 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1208/2383] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:08 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:08.421338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:08.422068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:08.422696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:08.423654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:08.424288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:08.425524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:08.448528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-254772e5-8427-48a9-8548-305db3c2f43e req-50a6a78a-046e-4860-9463-261e9458bda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc21d495-0399-4b56-9b4b-410e915192de", "name": "network-vif-plugged", "status": "completed", "tag": "24701317-1249-428b-b54e-b2b4bb1f367b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:08.469962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-254772e5-8427-48a9-8548-305db3c2f43e req-50a6a78a-046e-4860-9463-261e9458bda6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:08.471152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-254772e5-8427-48a9-8548-305db3c2f43e req-50a6a78a-046e-4860-9463-261e9458bda6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:08.472801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-254772e5-8427-48a9-8548-305db3c2f43e req-50a6a78a-046e-4860-9463-261e9458bda6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:08.504413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-254772e5-8427-48a9-8548-305db3c2f43e req-50a6a78a-046e-4860-9463-261e9458bda6 service nova] Creating event network-vif-plugged:24701317-1249-428b-b54e-b2b4bb1f367b for instance dc21d495-0399-4b56-9b4b-410e915192de on n-h2-858384-1 Sep 19 14:50:08.519849 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-254772e5-8427-48a9-8548-305db3c2f43e req-50a6a78a-046e-4860-9463-261e9458bda6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094683 Sep 19 14:50:08.521682 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1209/2384] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:50:09.058126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:09.059039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:09.090526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:09.092209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:09.094517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:09.098244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:09.098871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:09.100165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:09.231927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:09.243369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6cb99a87-c0ff-4dad-b68a-7201d7044e7b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1534 microversion: 2.1 time: 0.861949 Sep 19 14:50:09.255381 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1176/2385] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:08 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1534 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:09.402165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:09.403766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:09.419877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.427339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:09.427918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:09.428377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:09.429109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:09.429607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:09.430049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:09.690192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:09.700897 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e4d4bb0-37a4-4bf5-9aa8-a18cbbf23813 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1308 microversion: 2.1 time: 0.305065 Sep 19 14:50:09.704341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1177/2386] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:09 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:09.716344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:09.716989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:09.729857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:09.730362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:09.730838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:09.731573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:09.744915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:09.745514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:09.863022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.958766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:09.975229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a61ec81b-6d19-4088-a923-0c8aa1d89a97 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1473 microversion: 2.1 time: 0.921712 Sep 19 14:50:09.980530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1210/2387] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:09 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1473 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:10.006273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:10.026234 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6aa580ea-2ce4-4173-a739-1826905fbe52 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1280 microversion: 2.1 time: 0.315426 Sep 19 14:50:10.027595 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1178/2388] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:09 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:10.283972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:10.284742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:10.295622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:10.298656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:10.302094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:10.303148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:10.303833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:10.305072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:10.727707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:10.728374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:10.740025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:10.741084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:10.741708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:10.749355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:10.750180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:10.750864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:10.950596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.984404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:10.998387 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1455174f-d9de-4635-ac64-a6403f3257ef tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1527 microversion: 2.1 time: 0.718141 Sep 19 14:50:11.000527 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1211/2389] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:10 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1527 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:11.009592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:11.010633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:11.029939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:11.030544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:11.031208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:11.032071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:11.032541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:11.033066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:11.291318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:11.325549 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-75769cab-8600-4d10-97b4-67a4321d0ebd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1488 microversion: 2.1 time: 0.600257 Sep 19 14:50:11.327131 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1179/2390] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:10 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1488 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:11.337472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:11.339087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:11.350407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:11.352027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:11.356911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:11.359274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:11.364360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:11.365446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:11.500066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:11.510356 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f7d8a765-e38c-4a8a-83de-622490799bde tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1473 microversion: 2.1 time: 0.505330 Sep 19 14:50:11.528654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1212/2391] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:11 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:11.537369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:11.538274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:11.554889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:11.556097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:11.557128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:11.558672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:11.559864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:11.563213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:12.246727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:12.264273 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-99770e75-f5fa-4105-8ba4-1a37c6f0dcce tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1527 microversion: 2.1 time: 0.931726 Sep 19 14:50:12.266437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1180/2392] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:11 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1527 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:12.280752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:12.286027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:12.309732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:12.311975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:12.313950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:12.316381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:12.317085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:12.318591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:12.392993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lazy-loading 'flavor' on Instance uuid dc21d495-0399-4b56-9b4b-410e915192de {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:50:12.590067 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21c47a4d-e075-4b06-8a58-7d32a2db74a3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de/action" status: 202 len: 0 microversion: 2.1 time: 0.318966 Sep 19 14:50:12.596992 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1181/2393] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:50:12 2022] POST /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:50:12.610859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7e6b79c1-2c93-42b0-afcd-5f54b14f5dd7 req-fe127e72-c7cd-4002-bec1-6c77dbfe791b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a3d93f5-ecdf-486e-a0d7-43bae7fb209d", "tag": "2fc7f07a-01ce-4996-aa8b-317b2f027ba1"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:12.626598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7e6b79c1-2c93-42b0-afcd-5f54b14f5dd7 req-fe127e72-c7cd-4002-bec1-6c77dbfe791b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:12.626980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7e6b79c1-2c93-42b0-afcd-5f54b14f5dd7 req-fe127e72-c7cd-4002-bec1-6c77dbfe791b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:12.627352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7e6b79c1-2c93-42b0-afcd-5f54b14f5dd7 req-fe127e72-c7cd-4002-bec1-6c77dbfe791b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:12.651756 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7e6b79c1-2c93-42b0-afcd-5f54b14f5dd7 req-fe127e72-c7cd-4002-bec1-6c77dbfe791b service nova] Creating event network-changed:2fc7f07a-01ce-4996-aa8b-317b2f027ba1 for instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d on n-h2-858384-1 Sep 19 14:50:12.665087 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7e6b79c1-2c93-42b0-afcd-5f54b14f5dd7 req-fe127e72-c7cd-4002-bec1-6c77dbfe791b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068647 Sep 19 14:50:12.665880 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1182/2394] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:12.671769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b38d2471-17be-40bd-9d46-48613f848479 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:12.686619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b38d2471-17be-40bd-9d46-48613f848479 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] HTTP exception thrown: Flavor 3a9eca60-a465-432c-a880-ce3f6daccf88 could not be found. Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b38d2471-17be-40bd-9d46-48613f848479 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Request method failure captured: Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/flavors/3a9eca60-a465-432c-a880-ce3f6daccf88 HTTP/1.1 Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKICabWZwN6OghAX0mIH_W6e3BoNoAfvoXFTWajiB4ooyvxZGVESK-YQjCSeqt9VUXiGFOZIwQwhC1D1AvX08FG7UjNXDqtCREyHSvGHDTfSUEQdcx7CEpqid_4bpI6T3U3_G2SHHqcs00_GojjpxfuQxQJ3ywVyNsJezJWieOl9qY0s Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 12ed4a6962574d4ebe6a3a15963fd3dc Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MigrationsAdminTest-1132181864 Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 14:50:12.696275 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_12ed4a6962574d4ebe6a3a15963fd3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/12ed4a6962574d4ebe6a3a15963fd3dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/12ed4a6962574d4ebe6a3a15963fd3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/12ed4a6962574d4ebe6a3a15963fd3dc"}]}] Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MigrationsAdminTest-1132181864 Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 12ed4a6962574d4ebe6a3a15963fd3dc Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MigrationsAdminTest-1132181864 Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MigrationsAdminTest-1132181864-project-admin Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 0f0f6300ffa94b38a82d3884d7c8dfdd Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MigrationsAdminTest-1132181864-project-admin Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: exception: Flavor 3a9eca60-a465-432c-a880-ce3f6daccf88 could not be found. Sep 19 14:50:12.698097 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '3a9eca60-a465-432c-a880-ce3f6daccf88'} Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3a9eca60-a465-432c-a880-ce3f6daccf88 could not be found. Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:12.699287 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3a9eca60-a465-432c-a880-ce3f6daccf88 could not be found. Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3a9eca60-a465-432c-a880-ce3f6daccf88 could not be found. Sep 19 14:50:12.700686 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:12.715455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b38d2471-17be-40bd-9d46-48613f848479 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Returning 404 to user: Flavor 3a9eca60-a465-432c-a880-ce3f6daccf88 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:12.718469 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b38d2471-17be-40bd-9d46-48613f848479 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/3a9eca60-a465-432c-a880-ce3f6daccf88" status: 404 len: 109 microversion: 2.1 time: 0.051508 Sep 19 14:50:12.719972 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1183/2395] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:12 2022] DELETE /compute/v2.1/flavors/3a9eca60-a465-432c-a880-ce3f6daccf88 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:50:12.728127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:12.729372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:12.740750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:12.741672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:12.742515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:12.745209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:12.746760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:12.747594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:13.023661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:13.044902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-454a49e4-5f88-40c3-94bd-53ad44a1d073 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.514013 Sep 19 14:50:13.048520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1213/2396] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:11 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:13.061871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:13.062503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:13.075125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:13.075637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:13.079157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:13.080186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:13.080672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:13.081173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:13.477348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:13.496696 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d080a82-080b-4a12-8826-01c220e61532 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1473 microversion: 2.1 time: 0.774690 Sep 19 14:50:13.498367 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1184/2397] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:12 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1473 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:13.504848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1811445384", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:13.641611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:50:13.889109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:13.909830 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-84ffa58c-8526-460d-8fc1-642d8e4c4331 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1496 microversion: 2.1 time: 0.850790 Sep 19 14:50:13.937687 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1214/2398] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:13 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1496 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:14.077650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:14.080129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:14.124760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.125308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.128500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.138903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.139805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.140290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.683297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:14.702212 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6190a204-7232-4055-8b94-2d426e236796 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 0.629587 Sep 19 14:50:14.728150 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1215/2399] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:14 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:14.733239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c8b678a7-c250-4052-91ab-606ddf8a8745 req-98cb738f-7bd8-43a4-a36d-02aef715160e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "name": "network-vif-plugged", "status": "completed", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:14.759848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c8b678a7-c250-4052-91ab-606ddf8a8745 req-98cb738f-7bd8-43a4-a36d-02aef715160e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.766325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c8b678a7-c250-4052-91ab-606ddf8a8745 req-98cb738f-7bd8-43a4-a36d-02aef715160e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.767058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c8b678a7-c250-4052-91ab-606ddf8a8745 req-98cb738f-7bd8-43a4-a36d-02aef715160e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.795021 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c8b678a7-c250-4052-91ab-606ddf8a8745 req-98cb738f-7bd8-43a4-a36d-02aef715160e service nova] Creating event network-vif-plugged:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h1-858384-1 Sep 19 14:50:14.813068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c8b678a7-c250-4052-91ab-606ddf8a8745 req-98cb738f-7bd8-43a4-a36d-02aef715160e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079979 Sep 19 14:50:14.819237 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1216/2400] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:14.825768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7f3d3138-f269-4f16-88bc-5b50d8dfc883 req-532edc8d-8344-4526-a7fc-0f545295dd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85935aa6-3ccb-46dc-9c8c-8b9581124265", "name": "network-vif-deleted", "tag": "ef325ffb-c62d-47eb-a1d6-5139e491df64"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:14.836981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7f3d3138-f269-4f16-88bc-5b50d8dfc883 req-532edc8d-8344-4526-a7fc-0f545295dd19 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.837734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7f3d3138-f269-4f16-88bc-5b50d8dfc883 req-532edc8d-8344-4526-a7fc-0f545295dd19 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.838856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7f3d3138-f269-4f16-88bc-5b50d8dfc883 req-532edc8d-8344-4526-a7fc-0f545295dd19 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.840723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:50:14.841237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:50:14.842458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:50:14.842960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:50:14.843529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:50:14.866488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.867026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.871319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.872257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.872749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.873186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.881647 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7f3d3138-f269-4f16-88bc-5b50d8dfc883 req-532edc8d-8344-4526-a7fc-0f545295dd19 service nova] Creating event network-vif-deleted:ef325ffb-c62d-47eb-a1d6-5139e491df64 for instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 on n-h1-858384-1 Sep 19 14:50:14.893106 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7f3d3138-f269-4f16-88bc-5b50d8dfc883 req-532edc8d-8344-4526-a7fc-0f545295dd19 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072042 Sep 19 14:50:14.894291 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1217/2401] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:14.910247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:14.911240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:14.926490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.928390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.929131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.930338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:14.931168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:14.932909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:14.945667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:50:14.969765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Getting quotas for user e2149c78b4d04c10b02d521a5635b29f and project 17ce8e19a9bb47f5bdf0d02866b6180d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:50:15.002232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:15.003880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:15.005256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:15.005819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lazy-loading 'fault' on Instance uuid 85935aa6-3ccb-46dc-9c8c-8b9581124265 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:50:15.007480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:50:15.013911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:50:15.091889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a6fbfb5-1d0a-450a-be3d-3d3ae77a018b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591835 Sep 19 14:50:15.093158 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1185/2402] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:50:15.104072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:15.105088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:15.113177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:15.114100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:15.115007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:15.116081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:15.116795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:15.117479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:15.244335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca604f0c3a1493b9dd60905bbce3291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748bd95ac454426f80b5937ff3080dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:15.273587 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25f037a4-9a10-4821-9b6c-6b1066d3a276 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 200 len: 1307 microversion: 2.1 time: 0.370409 Sep 19 14:50:15.274995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1218/2403] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:14 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:15.296772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c72bfe9-2574-4d85-b09f-c149c1abe89f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:15.300876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c72bfe9-2574-4d85-b09f-c149c1abe89f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:15.443103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c72bfe9-2574-4d85-b09f-c149c1abe89f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:15.458185 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c72bfe9-2574-4d85-b09f-c149c1abe89f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1213 microversion: 2.1 time: 0.181643 Sep 19 14:50:15.473350 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1219/2404] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:15 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:15.672485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-cbda8e80-8a00-4a45-808a-3f6921f7dbc1 req-42ac723b-5440-437d-af73-af91d69c9642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665e3b36-5d49-49a1-b034-9e9c5010b5ba", "tag": "4e3f64ab-f569-4753-8e3e-9c134df67129"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:15.711036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cbda8e80-8a00-4a45-808a-3f6921f7dbc1 req-42ac723b-5440-437d-af73-af91d69c9642 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:15.714662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cbda8e80-8a00-4a45-808a-3f6921f7dbc1 req-42ac723b-5440-437d-af73-af91d69c9642 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:15.717122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cbda8e80-8a00-4a45-808a-3f6921f7dbc1 req-42ac723b-5440-437d-af73-af91d69c9642 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:15.767650 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-cbda8e80-8a00-4a45-808a-3f6921f7dbc1 req-42ac723b-5440-437d-af73-af91d69c9642 service nova] Creating event network-changed:4e3f64ab-f569-4753-8e3e-9c134df67129 for instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba on n-h1-858384-1 Sep 19 14:50:15.788915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-cbda8e80-8a00-4a45-808a-3f6921f7dbc1 req-42ac723b-5440-437d-af73-af91d69c9642 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120968 Sep 19 14:50:15.790303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1220/2405] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:15.805145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:15.807237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:15.827865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:15.828706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:15.829393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:15.830617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:15.832643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:15.833424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:16.607163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:16.623710 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-22dfa356-650b-492e-ae13-6d1e757c8c98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 200 len: 1479 microversion: 2.1 time: 1.528664 Sep 19 14:50:16.624309 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1186/2406] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:15 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 1479 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:16.634142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:16.639941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] [instance: 85935aa6-3ccb-46dc-9c8c-8b9581124265] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:16.664331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:16.665396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:16.666226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:16.667324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:16.671084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:16.671823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:16.701298 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] HTTP exception thrown: Instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 could not be found. Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Request method failure captured: Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 HTTP/1.1 Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKID_UgPY3P0GG9NFeo7tb1NG7sS0nYnTB_MN9pNiWzljaMMp_geFhNx6RzGVCbMPPmpeUiBk4tCwExcl028IKAviXEear9D7c-kGTvzimrFpYmiCS8oaauAwya1GaVKqbBR7Ctag5HplTiop9BnOKoo8vGAGI7HyHg3mtK-XLSy8yZ8 Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 748bd95ac454426f80b5937ff3080dbc Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListImageFiltersTestJSON-369610661 Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:50:16.705461 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_748bd95ac454426f80b5937ff3080dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/748bd95ac454426f80b5937ff3080dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/748bd95ac454426f80b5937ff3080dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/748bd95ac454426f80b5937ff3080dbc"}]}] Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListImageFiltersTestJSON-369610661 Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 748bd95ac454426f80b5937ff3080dbc Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-369610661 Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListImageFiltersTestJSON-369610661-project Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 2ca604f0c3a1493b9dd60905bbce3291 Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListImageFiltersTestJSON-369610661-project Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 could not be found. Sep 19 14:50:16.708200 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '85935aa6-3ccb-46dc-9c8c-8b9581124265'} Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 could not be found. Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:16.709056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 could not be found. Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 could not be found. Sep 19 14:50:16.710243 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:16.761264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Returning 404 to user: Instance 85935aa6-3ccb-46dc-9c8c-8b9581124265 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:16.762594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5799d55b-7c6f-417c-a948-eb865bdeecba tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265" status: 404 len: 111 microversion: 2.1 time: 0.137239 Sep 19 14:50:16.767207 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1187/2407] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:16 2022] GET /compute/v2.1/servers/85935aa6-3ccb-46dc-9c8c-8b9581124265 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:50:16.787963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:16.789023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:16.798992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:16.802345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:16.803709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:16.807990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:16.808805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:16.809508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:17.055424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:17.069844 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1f042772-706b-4c76-a740-03112daba676 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1265 microversion: 2.1 time: 0.300998 Sep 19 14:50:17.071316 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1188/2408] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:16 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:17.079726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2044710568"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:17.086025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:17.100820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:17.101624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:17.103968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:17.106289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:17.107962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:17.109428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:17.356089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:17.371953 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b4d1a52-92ee-4987-80e1-5be275a1e21f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.580125 Sep 19 14:50:17.388095 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1221/2409] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:15 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:17.396791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50d31682-53e1-40d2-b032-5e3c52f36ec2 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a9ef160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:17.515858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.585701 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26e22b9f-9168-4d54-81df-c62bac922329 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de/action" status: 202 len: 0 microversion: 2.1 time: 0.512741 Sep 19 14:50:17.596099 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1189/2410] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:50:17 2022] POST /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:50:17.614768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5dccbfcc-830b-4a05-a4c5-4a6a1c7db831 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29ef4280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:17.735562 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5dccbfcc-830b-4a05-a4c5-4a6a1c7db831 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.134555 Sep 19 14:50:17.737376 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1190/2411] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:17 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:18.108735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:18.110173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:18.128943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:18.129443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:18.129893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:18.130627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:18.131125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:18.131618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:18.146885 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-50d31682-53e1-40d2-b032-5e3c52f36ec2 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/images/108ecb0e-69ba-46fd-a389-b9fbb00d39ec" status: 204 len: 0 microversion: 2.1 time: 0.757334 Sep 19 14:50:18.148420 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1222/2412] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:17 2022] DELETE /compute/v2.1/images/108ecb0e-69ba-46fd-a389-b9fbb00d39ec => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:18.157834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8286993-aa45-4a78-aacd-ca7ffc2558cb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a49fee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:18.509588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:18.520145 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fc9460df-6779-46ad-97ec-156ef6e8c9a7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1271 microversion: 2.1 time: 0.421204 Sep 19 14:50:18.521310 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1191/2413] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:18 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1271 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:18.527319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2cad2e5e-b92d-4698-aabf-ca64cbc42503 req-3e707ffa-dff7-4957-95f1-6f5159ea436c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4c3f7a-05ae-4d1d-901d-ff4753932d8a", "tag": "c5108c4b-fc4f-483e-8d28-1daf5a6f908d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:18.540068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2cad2e5e-b92d-4698-aabf-ca64cbc42503 req-3e707ffa-dff7-4957-95f1-6f5159ea436c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:18.540874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2cad2e5e-b92d-4698-aabf-ca64cbc42503 req-3e707ffa-dff7-4957-95f1-6f5159ea436c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:18.541520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2cad2e5e-b92d-4698-aabf-ca64cbc42503 req-3e707ffa-dff7-4957-95f1-6f5159ea436c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:18.578981 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2cad2e5e-b92d-4698-aabf-ca64cbc42503 req-3e707ffa-dff7-4957-95f1-6f5159ea436c service nova] Creating event network-changed:c5108c4b-fc4f-483e-8d28-1daf5a6f908d for instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a on n-h2-858384-1 Sep 19 14:50:18.593266 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2cad2e5e-b92d-4698-aabf-ca64cbc42503 req-3e707ffa-dff7-4957-95f1-6f5159ea436c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068059 Sep 19 14:50:18.595336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1192/2414] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:18.599453 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8286993-aa45-4a78-aacd-ca7ffc2558cb tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/images/3c9cb6de-a5bc-4a2e-bba7-4a680a6af71a" status: 204 len: 0 microversion: 2.1 time: 0.446836 Sep 19 14:50:18.601595 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1223/2415] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:18 2022] DELETE /compute/v2.1/images/3c9cb6de-a5bc-4a2e-bba7-4a680a6af71a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:18.608661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-535fc1aa-5fa9-456e-b6f7-b94103c8ff4a req-1fb0cdd7-1467-4de8-b144-d4f93082ef82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d93f5-ecdf-486e-a0d7-43bae7fb209d", "name": "network-vif-plugged", "status": "completed", "tag": "2fc7f07a-01ce-4996-aa8b-317b2f027ba1"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:18.609792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:18.610515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:18.624519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:18.629589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:18.630125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:18.630996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:18.631562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-535fc1aa-5fa9-456e-b6f7-b94103c8ff4a req-1fb0cdd7-1467-4de8-b144-d4f93082ef82 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:18.632399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-535fc1aa-5fa9-456e-b6f7-b94103c8ff4a req-1fb0cdd7-1467-4de8-b144-d4f93082ef82 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:18.632847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:18.633249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-535fc1aa-5fa9-456e-b6f7-b94103c8ff4a req-1fb0cdd7-1467-4de8-b144-d4f93082ef82 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:18.633360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:18.657211 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-535fc1aa-5fa9-456e-b6f7-b94103c8ff4a req-1fb0cdd7-1467-4de8-b144-d4f93082ef82 service nova] Creating event network-vif-plugged:2fc7f07a-01ce-4996-aa8b-317b2f027ba1 for instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d on n-h2-858384-1 Sep 19 14:50:18.677146 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-535fc1aa-5fa9-456e-b6f7-b94103c8ff4a req-1fb0cdd7-1467-4de8-b144-d4f93082ef82 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071185 Sep 19 14:50:18.681148 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1224/2416] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:18.696385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff8b1523-c052-4341-b175-63c59b025686 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] Calling method '.version_select at 0x7fde2a931820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:19.104557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff8b1523-c052-4341-b175-63c59b025686 tempest-ListImageFiltersTestJSON-369610661 tempest-ListImageFiltersTestJSON-369610661-project] 10.222.0.81 "DELETE /compute/v2.1/images/3a8ce2cf-5e48-4c69-a1ff-ee4eb21a221b" status: 204 len: 0 microversion: 2.1 time: 0.417905 Sep 19 14:50:19.105338 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1225/2417] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:18 2022] DELETE /compute/v2.1/images/3a8ce2cf-5e48-4c69-a1ff-ee4eb21a221b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:19.121457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d17589de-117e-454d-bdd3-f4f9aa048bcc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a190b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:19.137113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:19.150363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5039b28a-621c-4c3c-aa85-2c6be1a9636d tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 0.551941 Sep 19 14:50:19.154354 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1193/2418] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:18 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:19.204502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d17589de-117e-454d-bdd3-f4f9aa048bcc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.096972 Sep 19 14:50:19.215186 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1226/2419] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:19 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:19.545263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:19.545942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:19.565192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:19.566632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:19.567543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:19.568799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:19.569615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:19.570062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:20.183555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:20.184468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:20.198899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:20.199410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:20.199862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:20.200610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:20.201081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:20.201520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:21.127964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:21.137933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9b300c1a-48b9-4ff2-b71c-f63ca62d7a24 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 1.596991 Sep 19 14:50:21.138537 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1194/2420] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:19 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:21.154491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e0f2c8f-fdc8-4f0c-8e06-8325ddcc975b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a636c10>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:21.269999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e0f2c8f-fdc8-4f0c-8e06-8325ddcc975b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.119750 Sep 19 14:50:21.270940 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1195/2421] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:21 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:21.797229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:21.816880 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-99cc810d-8fcc-4f45-bc97-d2f5c4f7cf58 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.636997 Sep 19 14:50:21.817493 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1227/2422] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:20 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:22.167519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:22.168149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:22.182949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:22.183450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:22.183899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:22.184640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:22.185109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:22.185561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:22.287822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0ce0a87-49ff-4eaf-b133-a480fc3afbef tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a26e8b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:22.396577 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0ce0a87-49ff-4eaf-b133-a480fc3afbef tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.113675 Sep 19 14:50:22.405259 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1228/2423] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:22 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:22.846566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:22.848492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:22.867921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:22.870455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:22.872760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:22.873748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:22.874401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:22.875094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:23.803131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:23.833311 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a07533e-8d37-4ea1-9bca-97664ced1b62 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 1.670971 Sep 19 14:50:23.835152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1196/2424] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:22 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:23.853052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b8ef93a7-6dc2-4fc5-87b0-ed5c53ec54c5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a7ae550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:23.982713 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b8ef93a7-6dc2-4fc5-87b0-ed5c53ec54c5 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.143414 Sep 19 14:50:23.983572 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1197/2425] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:23 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:24.545795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:24.570760 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fdaa80df-ba48-4825-b991-c8a3dbe91931 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.729388 Sep 19 14:50:24.582870 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1229/2426] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:22 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:24.861958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:24.867990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:24.878996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:24.880035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:24.880731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:24.882609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:24.883450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:24.884110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:24.915433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.988287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.213623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Calling method '.version_select at 0x7fde2a6304c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:25.236804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:25.240873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:25.241593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:25.244035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:25.244889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:25.245624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:25.277820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:25.287084 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f11e215-3180-41ec-87ad-759c6c5f85d6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 0.431488 Sep 19 14:50:25.293184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1198/2427] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:24 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:25.305579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc47f785-7e37-4341-b8b8-356150000fdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29d9a1f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:25.310683 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75ebee96-a10d-4732-8c9a-68be7145224b tempest-AbsoluteLimitsTestJSON-1424644248 tempest-AbsoluteLimitsTestJSON-1424644248-project] 10.222.0.81 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.360712 Sep 19 14:50:25.314836 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1230/2428] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Sep 19 14:50:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:50:25.329970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c04d1724-73ab-42f6-9ec3-21d0bd9c90ba req-7e9bf91d-2fdd-429f-9257-b61eb3a1035f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:25.358241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c04d1724-73ab-42f6-9ec3-21d0bd9c90ba req-7e9bf91d-2fdd-429f-9257-b61eb3a1035f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:25.358837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c04d1724-73ab-42f6-9ec3-21d0bd9c90ba req-7e9bf91d-2fdd-429f-9257-b61eb3a1035f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:25.362195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c04d1724-73ab-42f6-9ec3-21d0bd9c90ba req-7e9bf91d-2fdd-429f-9257-b61eb3a1035f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:25.393262 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c04d1724-73ab-42f6-9ec3-21d0bd9c90ba req-7e9bf91d-2fdd-429f-9257-b61eb3a1035f service nova] Creating event network-changed:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h1-858384-1 Sep 19 14:50:25.400381 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc47f785-7e37-4341-b8b8-356150000fdd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.105625 Sep 19 14:50:25.405412 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1199/2429] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:25 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:25.410919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c04d1724-73ab-42f6-9ec3-21d0bd9c90ba req-7e9bf91d-2fdd-429f-9257-b61eb3a1035f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084378 Sep 19 14:50:25.412124 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1231/2430] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:25.599028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:25.599789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:25.617216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:25.625482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:25.629656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:25.630704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:25.631471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:25.633024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:26.321195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:26.322729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:26.351067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:26.354225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:26.355181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:26.356621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:26.357254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:26.357867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:26.718882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:26.741138 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcb90e37-e6fc-4c7a-9721-3c97a07723d8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.145477 Sep 19 14:50:26.742497 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1200/2431] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:25 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:26.760373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cf1d0d0-643f-4356-8718-079217c4c5cd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29ae5dc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:26.827207 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cf1d0d0-643f-4356-8718-079217c4c5cd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.071044 Sep 19 14:50:26.852836 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1201/2432] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:26 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:27.157892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:27.214062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21fb5de8-ed26-4a72-b841-385d76f33792 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 0.901275 Sep 19 14:50:27.218004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1232/2433] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:26 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:27.766720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:27.768166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:27.792312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:27.792825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:27.793276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:27.800683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:27.801389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:27.801854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:27.845741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d27956cd-4a82-435e-9cef-fa70b7dba86a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a630310>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:28.005415 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d27956cd-4a82-435e-9cef-fa70b7dba86a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.164009 Sep 19 14:50:28.007156 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1233/2434] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:27 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:28.251324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:28.252734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:28.276754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:28.277378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:28.277843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:28.279989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:28.281267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:28.285176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:28.765209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:28.789210 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00570565-3775-4f32-b179-7bba3cdaefc4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.027907 Sep 19 14:50:28.790337 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1202/2435] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:27 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:28.813587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:28.832989 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5818613a-c6fb-4ccf-b7c4-6c4130168f4f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 0.580675 Sep 19 14:50:28.835023 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1234/2436] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:28 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:29.027172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bec4f15b-cd5c-4a39-a503-f2cf114c06ec tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a0bfdc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:29.138831 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bec4f15b-cd5c-4a39-a503-f2cf114c06ec tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.121028 Sep 19 14:50:29.150761 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1235/2437] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:29 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:29.355730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1991809651", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "dbfeb181-3743-4fc4-84f2-01b4c28ac8b3"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:29.423162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95e075bc-8e05-413b-827d-8a1f442012ff tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Action: 'create', calling method: .version_select at 0x7fde298a4b80>, body: {"keypair": {"name": "tempest-keypair-2059838054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeC87ei7IBKKz1f9rqNxlNhynQpzIEmok8AwNczoKTJkCUQWbp37VkQGOYFuxJtMYI3ZZhp9qIsHNl015TGhYrlvTgrWrY/wHZ6i8bG2lEAunv7s5HtxZgg/YCcN+NHNw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:29.536233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-95e075bc-8e05-413b-827d-8a1f442012ff tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Getting quotas for project ec08eab4f38a4b7584c58dc3882d0f9c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:50:29.545605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-95e075bc-8e05-413b-827d-8a1f442012ff tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Getting quotas for user 66b132a77c82443c9024def6f7037268 and project ec08eab4f38a4b7584c58dc3882d0f9c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:50:29.589860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] validate_networks() for [('dbfeb181-3743-4fc4-84f2-01b4c28ac8b3', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:50:29.631400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95e075bc-8e05-413b-827d-8a1f442012ff tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.839529 Sep 19 14:50:29.653512 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1203/2438] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:50:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:29.825055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:29.825683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:29.856694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:29.857558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:29.858020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:29.863363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:29.867370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:29.868540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.046223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:31.076058 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-67b713d3-ee89-4587-a503-0470439df0bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.255975 Sep 19 14:50:31.076676 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1204/2439] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:29 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:31.088911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:31.089466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:31.136587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.137101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.137539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.141623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.151696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.152423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.466445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:50:31.468145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:50:31.471284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:50:31.472831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:50:31.473952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:50:31.498080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.499513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.500885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.505795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.507407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.508672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.544424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:31.556168 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-000fa789-06a1-4fa9-be07-23a210fac663 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 0.478374 Sep 19 14:50:31.557936 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1205/2440] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:31 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:31.568679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c451c8ba-1b47-4768-b249-ff4dc55505b1 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29f48d30>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:31.576347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Getting quotas for project 1515789b03a84eef85950bd0724ae183. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:50:31.591737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Getting quotas for user 7d9aaa40522843a6970973bca5afc70e and project 1515789b03a84eef85950bd0724ae183. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:50:31.611671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:50:31.615059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:50:31.667157 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c451c8ba-1b47-4768-b249-ff4dc55505b1 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.107188 Sep 19 14:50:31.668049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1206/2441] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:31 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:31.688929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2d58ee5b-bbf2-451c-9fc8-9e2e43406aa6 req-f65d4e43-6d6d-4f58-920d-3a4f5f4c2ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665e3b36-5d49-49a1-b034-9e9c5010b5ba", "name": "network-vif-plugged", "status": "completed", "tag": "4e3f64ab-f569-4753-8e3e-9c134df67129"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:31.747421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2d58ee5b-bbf2-451c-9fc8-9e2e43406aa6 req-f65d4e43-6d6d-4f58-920d-3a4f5f4c2ffe service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.751084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2d58ee5b-bbf2-451c-9fc8-9e2e43406aa6 req-f65d4e43-6d6d-4f58-920d-3a4f5f4c2ffe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.755895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2d58ee5b-bbf2-451c-9fc8-9e2e43406aa6 req-f65d4e43-6d6d-4f58-920d-3a4f5f4c2ffe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.813213 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a10d1daa-0db1-4b17-a438-0aedbbe5e69e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.656548 Sep 19 14:50:31.830740 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1236/2442] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:50:31.831464 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2d58ee5b-bbf2-451c-9fc8-9e2e43406aa6 req-f65d4e43-6d6d-4f58-920d-3a4f5f4c2ffe service nova] Creating event network-vif-plugged:4e3f64ab-f569-4753-8e3e-9c134df67129 for instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba on n-h1-858384-1 Sep 19 14:50:31.857291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2d58ee5b-bbf2-451c-9fc8-9e2e43406aa6 req-f65d4e43-6d6d-4f58-920d-3a4f5f4c2ffe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179771 Sep 19 14:50:31.858575 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1207/2443] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:31.885934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:31.914577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:31.919271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Searching by: {'deleted': False, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:31.944988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.949103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.952570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:31.957984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:31.961182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:31.961664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.058675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:50:32.219966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Calling method '.version_select at 0x7fde2a03bf70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:32.242974 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dafd0de7-8609-4efd-8cdf-b90d4d050f18 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.382659 Sep 19 14:50:32.245856 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1208/2444] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:50:31 2022] GET /compute/v2.1/servers => generated 344 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:32.256784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5750b87a-282d-4cf1-9830-df925f21abf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:32.265782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5750b87a-282d-4cf1-9830-df925f21abf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:32.284734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.292874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.296691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.302506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.309820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.312102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.388293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5750b87a-282d-4cf1-9830-df925f21abf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:32.396997 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5750b87a-282d-4cf1-9830-df925f21abf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1218 microversion: 2.1 time: 0.149673 Sep 19 14:50:32.400807 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1209/2445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:32 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:32.419536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:32.429275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:32.434305 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8227c794-bc96-4d07-9383-5660c8943b97 tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] 10.222.0.81 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.600421 Sep 19 14:50:32.438556 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1237/2446] 10.222.0.81 () {58 vars in 1122 bytes} [Mon Sep 19 14:50:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:32.446324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.447331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.448372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.449649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.451535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.454298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:32.456224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.479225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:32.485209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Searching by: {'deleted': False, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:32.503728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.511886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.512785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.525207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.526663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.531154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:32.655892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:50:32.694265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:32.763897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:32.775807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:32.776796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:32.777574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:33.306826 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75da8d1f-afe4-476a-b291-f10843268559 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.865897 Sep 19 14:50:33.307989 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1238/2447] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:50:32 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:33.325563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1118248596", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:33.501001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] validate_networks() for None {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:50:33.565712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:33.588388 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bc029c32-858c-48e6-a235-c6dc1d7b2c30 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 1.171088 Sep 19 14:50:33.591468 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1210/2448] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:32 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:33.609137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:33.612649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:33.633075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:33.635391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:33.637133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:33.641852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:33.643218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:33.645719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.303628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:34.319781 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2680ae28-b3e3-4b46-809c-ea923e5c8c87 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 0.726817 Sep 19 14:50:34.329307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1211/2449] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:33 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:34.361692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-232b272d-3133-4c77-8c64-f57d5e35be0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29c1a160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:34.365363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Getting quotas for project 285f1d1f91c2453e977648a7a3a611f4. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:50:34.376342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Getting quotas for user c33c9b5c05d7470f849a1728ba7c2bbe and project 285f1d1f91c2453e977648a7a3a611f4. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:50:34.459825 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Request method failure captured: Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 1752 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIG2iAMU6lIoLIK9kS92IhGW3gBoK0Z_9JfrTB4YPNauD9FqjDN9ULYJV50jZy_1ukGEn3smIhrx46CfYTW7fBWkhaqcVl1d8fLFhs8Nhp9uhI_WuwqC5teTtNbXF_MS821aF--1SVNbqczptFup5EpUgn-hxN6kU1mioOCsIRiKMxU Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 285f1d1f91c2453e977648a7a3a611f4 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-658015391 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_285f1d1f91c2453e977648a7a3a611f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/285f1d1f91c2453e977648a7a3a611f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/285f1d1f91c2453e977648a7a3a611f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/285f1d1f91c2453e977648a7a3a611f4"}]}] Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-658015391 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 285f1d1f91c2453e977648a7a3a611f4 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-658015391 Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-658015391-project Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c33c9b5c05d7470f849a1728ba7c2bbe Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-658015391-project Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1118248596", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:50:34.462163 n-d-858384-1 devstack@n-api.service[128730]: exception: Maximum number of metadata items exceeds 128 Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1118248596', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:34.464479 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:34.468165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61d6c5e3-408f-470d-b8f0-81596fef9c2a tempest-AbsoluteLimitsNegativeTestJSON-658015391 tempest-AbsoluteLimitsNegativeTestJSON-658015391-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.154551 Sep 19 14:50:34.475058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1239/2450] 10.222.0.81 () {60 vars in 1148 bytes} [Mon Sep 19 14:50:33 2022] POST /compute/v2.1/servers => generated 87 bytes in 1166 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:50:34.508070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-232b272d-3133-4c77-8c64-f57d5e35be0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.174085 Sep 19 14:50:34.509723 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1212/2451] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:34 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:34.519760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96a43a29-fd5c-4211-af8c-ec40b524a9fc tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:34.523317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:34.524425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:34.536895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.537644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.538401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.539459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.540087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.540672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.589632 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96a43a29-fd5c-4211-af8c-ec40b524a9fc tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.113304 Sep 19 14:50:34.602531 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1240/2452] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:50:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:34.621261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:34.625779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:34.644111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.645055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.645853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.646812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.649527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.650162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.731617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:34.748075 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-85b9f8ac-76c7-4499-98ec-0f971aa6c6b7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1270 microversion: 2.1 time: 0.235937 Sep 19 14:50:34.753546 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1213/2453] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:34 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:34.801747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc21d495-0399-4b56-9b4b-410e915192de", "name": "network-vif-plugged", "status": "completed", "tag": "24701317-1249-428b-b54e-b2b4bb1f367b"}, {"server_uuid": "9d4c3f7a-05ae-4d1d-901d-ff4753932d8a", "name": "network-vif-plugged", "status": "completed", "tag": "c5108c4b-fc4f-483e-8d28-1daf5a6f908d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:34.866575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.867141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.878588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.967211 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] Creating event network-vif-plugged:24701317-1249-428b-b54e-b2b4bb1f367b for instance dc21d495-0399-4b56-9b4b-410e915192de on n-h2-858384-1 Sep 19 14:50:34.980982 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] Creating event network-vif-plugged:c5108c4b-fc4f-483e-8d28-1daf5a6f908d for instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a on n-h2-858384-1 Sep 19 14:50:35.020718 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c89afd5f-9c50-458e-91b4-3f527b2d9526 req-835a2017-a3fb-425e-8453-991921ad353a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.224080 Sep 19 14:50:35.022090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:35.025361 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1214/2454] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:35.033744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-de861e81-7f70-4280-bc6f-c6e3f59e90cb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 0.418683 Sep 19 14:50:35.036350 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1241/2455] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:34 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:35.083908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:35.086466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:35.113378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.114131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.119795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.124534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.125141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.125690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.217796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:50:35.333177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.357590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:35.358604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:35.366367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.373284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.374105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.375244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.375944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.377080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.506491 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a78e8beb-5d87-4c2c-b226-8f49cca973f1 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "DELETE /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 204 len: 0 microversion: 2.1 time: 0.477212 Sep 19 14:50:35.507896 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1215/2456] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:35 2022] DELETE /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:35.516961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:35.520569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:35.541711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.543017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.543714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.545026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.545716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.548243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:36.906475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:36.924251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfab13a1-b477-45f6-a386-727800da2c71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 1.565670 Sep 19 14:50:36.927082 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1242/2457] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:35 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:36.946911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20d8754f-48ad-4cce-8e7b-d25b4f3a4ee4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a9ca3a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:37.027097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:37.037144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20d8754f-48ad-4cce-8e7b-d25b4f3a4ee4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.108052 Sep 19 14:50:37.041662 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1243/2458] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:36 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:37.046054 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4215ad4a-5c59-486d-81a9-e2e8d76c99e5 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1608 microversion: 2.1 time: 1.533837 Sep 19 14:50:37.051574 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1216/2459] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:35 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1608 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:37.064626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:37.068736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:37.069817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:37.071438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:37.075362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.086173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:37.086974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:37.087610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:37.091703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:37.092469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:37.093228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:37.128309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:37.128749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:37.129215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:37.132029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:37.132518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:37.132953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:37.474624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:37.488613 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86bf809d-70f7-4312-b1ae-4abf037eb47f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1276 microversion: 2.1 time: 0.444903 Sep 19 14:50:37.499180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1244/2460] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:37 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1276 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:37.519800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9ca2cb49-6bd2-4eb8-95fa-73ed87edb948 req-754e78c7-5fa6-4988-bd5e-f691c2c50fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "name": "network-vif-plugged", "status": "completed", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:37.537136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9ca2cb49-6bd2-4eb8-95fa-73ed87edb948 req-754e78c7-5fa6-4988-bd5e-f691c2c50fc4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:37.537729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9ca2cb49-6bd2-4eb8-95fa-73ed87edb948 req-754e78c7-5fa6-4988-bd5e-f691c2c50fc4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:37.538240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9ca2cb49-6bd2-4eb8-95fa-73ed87edb948 req-754e78c7-5fa6-4988-bd5e-f691c2c50fc4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:37.555861 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9ca2cb49-6bd2-4eb8-95fa-73ed87edb948 req-754e78c7-5fa6-4988-bd5e-f691c2c50fc4 service nova] Creating event network-vif-plugged:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h1-858384-1 Sep 19 14:50:37.561840 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9ca2cb49-6bd2-4eb8-95fa-73ed87edb948 req-754e78c7-5fa6-4988-bd5e-f691c2c50fc4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060380 Sep 19 14:50:37.563400 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1245/2461] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:37.712542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:37.724158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7bf608de-c050-4a47-90f4-d5abe91ceceb tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1322 microversion: 2.1 time: 0.671241 Sep 19 14:50:37.728848 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1217/2462] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:37 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:37.951040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:37.952703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:37.986886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:37.987597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:37.988052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:38.005914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:38.006267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:38.006730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:38.058302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6283c00e-03df-40e8-bf9a-d61711b50ecd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29b60160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:38.164895 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6283c00e-03df-40e8-bf9a-d61711b50ecd tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.111063 Sep 19 14:50:38.171043 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1218/2463] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:38 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:50:38.187346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:38.193027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:38.218466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.228894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:38.230686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:38.232618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:38.234367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:38.236284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:38.239164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:38.832048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:38.858888 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f31d014c-55c4-4a4a-8784-5ce919ec8da3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1313 microversion: 2.1 time: 0.909220 Sep 19 14:50:38.862575 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1246/2464] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:37 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:38.882096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:38.885819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:38.921991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:38.924028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:38.926370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:38.927186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:38.933657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:38.936285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:39.149409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:39.158641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:39.162095 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56678c4d-d48c-4194-b751-49e1efab3951 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1276 microversion: 2.1 time: 0.296012 Sep 19 14:50:39.172044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c06291e-832f-458b-b173-d28a9c5d59ed tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1608 microversion: 2.1 time: 0.998931 Sep 19 14:50:39.175584 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1247/2465] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:38 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:39.188013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1219/2466] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:38 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1608 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:39.192383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:39.193263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:39.208975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9aa7ae01-e4ab-4988-8021-d55971508310 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a4cadc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:39.209307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:39.209870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:39.211060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:39.215664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:39.216555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:39.217012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:39.288267 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9aa7ae01-e4ab-4988-8021-d55971508310 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.098333 Sep 19 14:50:39.305523 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1220/2467] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:39 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:39.321764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2037117405", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "76ade142-62ee-4a36-9cac-23e7f2069146"}], "security_groups": [{"name": "tempest-securitygroup--278736088"}], "key_name": "tempest-keypair-2059838054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:39.685366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] validate_networks() for [('76ade142-62ee-4a36-9cac-23e7f2069146', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:50:40.156480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:40.201678 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-717e4705-0e23-4b33-8603-d8c564a59ff3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 200 len: 1514 microversion: 2.1 time: 1.024421 Sep 19 14:50:40.225663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1248/2468] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:39 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 1514 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:40.262614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:40.265490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:40.294551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:40.305875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:40.306361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:40.307264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:40.307919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:40.308369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.101999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:41.115274 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea605dfa-d191-4f06-8452-bfb9530f7851 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1463 microversion: 2.1 time: 0.888088 Sep 19 14:50:41.115883 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1249/2469] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:40 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1463 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:41.134103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:41.134739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:41.161387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.166362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.167045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.167820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.168325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.168716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.576959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Getting quotas for project ec08eab4f38a4b7584c58dc3882d0f9c. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:50:41.594374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Getting quotas for user 66b132a77c82443c9024def6f7037268 and project ec08eab4f38a4b7584c58dc3882d0f9c. Resources: dict_keys(['metadata_items']) {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:50:41.633745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:50:41.637075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:50:41.637945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:50:41.640289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:50:41.641064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:50:41.683453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.684232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.684830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.685757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.686376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.686991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.723134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Getting quotas for project ec08eab4f38a4b7584c58dc3882d0f9c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:50:41.729318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:41.732582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Getting quotas for user 66b132a77c82443c9024def6f7037268 and project ec08eab4f38a4b7584c58dc3882d0f9c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:50:41.743212 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a511722-cb1c-46b9-ac9c-f9a04b4d5c0b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 0.625920 Sep 19 14:50:41.744153 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1250/2470] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:41 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:41.756748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:41.759032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:41.775703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.778488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.779173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.781330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.781884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:50:41.784490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.787213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:50:41.789376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.873631 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae7d70f3-462b-4b15-aaa6-86665d6243f8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.566409 Sep 19 14:50:41.875991 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1221/2471] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:50:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:50:41.893236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:41.895674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:41.913835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.914579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.915229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:41.916162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:41.916814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:41.918098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:42.054853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:42.083454 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3d5eb81-8298-4431-a8bc-ea3c6042dbb6 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1253 microversion: 2.1 time: 0.331980 Sep 19 14:50:42.084080 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1251/2472] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:41 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1253 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:42.127237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd3a3f0a-d5b2-421d-a6fe-f58d1e21204d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29de4ca0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:42.258718 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd3a3f0a-d5b2-421d-a6fe-f58d1e21204d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.173528 Sep 19 14:50:42.259325 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1252/2473] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:42 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:42.272745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:42.273370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:42.304057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:42.305025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:42.305229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:42.317181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:42.322429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:42.325757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:42.426538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:42.453193 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df17e2f2-5999-474e-8696-99cd198c5f84 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba" status: 200 len: 1514 microversion: 2.1 time: 0.575802 Sep 19 14:50:42.455455 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1222/2474] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:41 2022] GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba => generated 1514 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:42.469043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b864ee74-4ec1-401a-895b-8b4d17242536 req-2082b7a8-e73b-4337-9c3b-49f6c89c30b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b", "name": "network-vif-deleted", "tag": "0eda42c9-b703-42e0-af43-0c50b53f2a15"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:42.503792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b864ee74-4ec1-401a-895b-8b4d17242536 req-2082b7a8-e73b-4337-9c3b-49f6c89c30b1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:42.504557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b864ee74-4ec1-401a-895b-8b4d17242536 req-2082b7a8-e73b-4337-9c3b-49f6c89c30b1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:42.507003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b864ee74-4ec1-401a-895b-8b4d17242536 req-2082b7a8-e73b-4337-9c3b-49f6c89c30b1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:42.558004 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b864ee74-4ec1-401a-895b-8b4d17242536 req-2082b7a8-e73b-4337-9c3b-49f6c89c30b1 service nova] Creating event network-vif-deleted:0eda42c9-b703-42e0-af43-0c50b53f2a15 for instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b on n-h1-858384-1 Sep 19 14:50:42.586422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.598679 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b864ee74-4ec1-401a-895b-8b4d17242536 req-2082b7a8-e73b-4337-9c3b-49f6c89c30b1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133961 Sep 19 14:50:42.603781 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1223/2475] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:42.640651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa9035c1-e367-4e67-b725-8179bc5b0c08 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:42.646846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa9035c1-e367-4e67-b725-8179bc5b0c08 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:42.920008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa9035c1-e367-4e67-b725-8179bc5b0c08 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:42.943172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa9035c1-e367-4e67-b725-8179bc5b0c08 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1278 microversion: 2.1 time: 0.333996 Sep 19 14:50:42.943789 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1224/2476] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:42 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1278 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:42.948395 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-63d84be8-ff34-43d4-a67e-d5d5b9926478 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1614 microversion: 2.1 time: 0.684279 Sep 19 14:50:42.951620 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1253/2477] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:42 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1614 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:42.977172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:42.979049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:42.981011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:42.991768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:43.008951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.012986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.016112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.018047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.019103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.021894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.022914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.023857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.024615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.027632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.028932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.030312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.413763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:43.425190 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-42365b20-5f60-4a1a-81c0-7f08d2f77223 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 0.467782 Sep 19 14:50:43.430983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1254/2478] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:42 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:43.436181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:43.447711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:43.471704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.475485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.482621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.483727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.484897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.488201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.498152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:43.522308 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b6b6a45a-5710-471c-a281-815f136277a4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 200 len: 1513 microversion: 2.1 time: 0.566575 Sep 19 14:50:43.523737 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1225/2479] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:42 2022] GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 1513 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:43.533176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:43.539612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:43.552887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.553360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.554026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.563292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:43.564181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:43.581540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:43.629970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0f0f6300ffa94b38a82d3884d7c8dfdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ed4a6962574d4ebe6a3a15963fd3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:43.632908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] flavor_id is None. Assuming migration. {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 19 14:50:43.634934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 14:50:43.786495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:43.803512 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76d6a9ba-d0a3-4974-94dc-a1ee89d280c0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1253 microversion: 2.1 time: 0.272504 Sep 19 14:50:43.805400 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1226/2480] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:43 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1253 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:43.826148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-451969ab-ff6f-4fa7-820a-87741311f761 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde299f4a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:43.941177 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-451969ab-ff6f-4fa7-820a-87741311f761 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.132223 Sep 19 14:50:43.952355 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1227/2481] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:43 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:44.007681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:44.009263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:44.035216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.035958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.036572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.037486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.038108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.038696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.091797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:50:44.326966 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2aaff025-b87c-46e3-8d6c-f9ade44a239d tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.894424 Sep 19 14:50:44.328405 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1255/2482] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:50:43 2022] POST /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:50:44.340611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:44.343294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:44.357414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7e4ed210-1ea9-480d-9201-71bbbd323047 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 204 len: 0 microversion: 2.1 time: 0.394437 Sep 19 14:50:44.358451 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1228/2483] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:43 2022] DELETE /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:44.363012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.367382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.368185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.370817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.372735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d7289bcb-b2aa-4826-ad00-f01cbabc1377 req-9f1a5988-3c69-40ba-9950-bf956bc4132d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78a464e-7f62-4a1b-9923-ac635f8f7a90", "tag": "dc2083b3-7903-46a2-b405-8611008a4154"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:44.374308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.383609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.429036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d7289bcb-b2aa-4826-ad00-f01cbabc1377 req-9f1a5988-3c69-40ba-9950-bf956bc4132d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.430005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d7289bcb-b2aa-4826-ad00-f01cbabc1377 req-9f1a5988-3c69-40ba-9950-bf956bc4132d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.431560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d7289bcb-b2aa-4826-ad00-f01cbabc1377 req-9f1a5988-3c69-40ba-9950-bf956bc4132d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.477396 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d7289bcb-b2aa-4826-ad00-f01cbabc1377 req-9f1a5988-3c69-40ba-9950-bf956bc4132d service nova] Creating event network-changed:dc2083b3-7903-46a2-b405-8611008a4154 for instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 on n-h1-858384-1 Sep 19 14:50:44.492846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=18 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.502200 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d7289bcb-b2aa-4826-ad00-f01cbabc1377 req-9f1a5988-3c69-40ba-9950-bf956bc4132d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141251 Sep 19 14:50:44.503695 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1229/2484] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:44.525004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:44.528246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:44.548963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.550973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.552400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.554952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.555743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.557443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.596580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:44.605492 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e860399-f140-427f-87c4-36c80f8fdd2d tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1330 microversion: 2.1 time: 0.268713 Sep 19 14:50:44.627147 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1256/2485] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:44 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1330 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:44.641056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:44.642164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:44.660387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.663724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.665595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.666595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:44.668157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:44.669358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:44.952510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:44.965411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.975600 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-53d4c62e-b06e-4e6e-b6a0-b1a3bc0c3c70 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 200 len: 1519 microversion: 2.1 time: 0.340576 Sep 19 14:50:44.992144 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1257/2486] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:44 2022] GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:44.995292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:44.999033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:44.999671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:45.012680 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4d3370c-60e7-4117-bcdc-1149bc295d46 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1472 microversion: 2.1 time: 0.506886 Sep 19 14:50:45.014548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:45.015177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:45.017557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:45.018405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:45.027762 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1230/2487] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:44 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1472 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:45.034044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:45.034565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:45.039241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:45.039917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:45.046473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:45.047159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:45.048744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:45.050500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:45.051251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:45.052019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:45.198956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:45.221490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-35f1b8e6-ee92-4255-b2a4-331a1d634f3e tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1253 microversion: 2.1 time: 0.192327 Sep 19 14:50:45.239147 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1231/2488] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:45 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1253 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:45.239147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c0125faf-ea14-4482-89ca-4d2aed8788e3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde298a4b80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:45.313517 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c0125faf-ea14-4482-89ca-4d2aed8788e3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.086208 Sep 19 14:50:45.323131 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1232/2489] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:45 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:45.411879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:45.430394 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4997c0d9-2d40-4c30-a441-21c476e1eb4f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 0.436506 Sep 19 14:50:45.446927 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1258/2490] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:44 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:45.636603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:45.637455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:45.655249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:45.668729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:45.672369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:45.678348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:45.678990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:45.679434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:46.007925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:46.008646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:46.031743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:46.039501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:46.047493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:46.050160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:46.052202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:46.054104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:46.692633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:46.702973 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9af97be2-14d8-4c91-ac1f-a97ce2bb2e74 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1338 microversion: 2.1 time: 1.071962 Sep 19 14:50:46.714381 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1233/2491] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:45 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1338 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:46.732968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:46.735272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:46.750586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:46.753483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:46.755135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:46.758342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:46.759844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:46.760511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:47.660285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:47.673565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc614e85-c3ed-4d70-b33c-745d2221f419 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 200 len: 1519 microversion: 2.1 time: 1.673745 Sep 19 14:50:47.700014 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1259/2492] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:45 2022] GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 1519 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:47.708584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:47.709607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:47.722584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:47.729256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:47.730151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:47.731403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:47.732201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:47.732950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:48.387209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:48.402644 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c974b47-9039-4e51-b68f-7300402883ff tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1253 microversion: 2.1 time: 0.697970 Sep 19 14:50:48.404442 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1260/2493] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:47 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1253 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:48.417342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc547ff6-f81b-489a-ba5d-74ac4cb34aff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29e25310>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:48.521581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc547ff6-f81b-489a-ba5d-74ac4cb34aff tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.114152 Sep 19 14:50:48.529740 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1261/2494] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:48 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:48.531314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:48.536526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:48.549778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:48.550775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:48.552582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:48.556527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:48.556993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:48.558068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:49.390794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:49.449946 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83d66961-00f8-4e25-8144-f2cc3acef32e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1472 microversion: 2.1 time: 2.730416 Sep 19 14:50:49.462783 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1234/2495] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:46 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1472 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:49.475516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:49.476216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:49.496933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:49.497621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:49.498130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:49.499064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:49.499599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:49.500038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:50.347596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:50.362958 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1ab0162-6001-4dc1-bb7c-233ca6352ed8 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1336 microversion: 2.1 time: 0.907054 Sep 19 14:50:50.363558 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1235/2496] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:49 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1336 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:50.395439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:50.403008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:50.422445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:50.426213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:50.427697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:50.431727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:50.434734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:50.437413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:50.483006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:50.499327 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0243c92a-8e84-48ba-ac36-81048ffb27e9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 1.975508 Sep 19 14:50:50.506088 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1262/2497] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:48 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:50.517561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a05d8159-6804-40ee-a1e0-c9bf5828b65f req-64a85d12-4ede-42a8-880a-105fcf23556c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d93f5-ecdf-486e-a0d7-43bae7fb209d", "name": "network-vif-deleted", "tag": "2fc7f07a-01ce-4996-aa8b-317b2f027ba1"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:50.521226 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] HTTP exception thrown: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d HTTP/1.1 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1a3d93f5-ecdf-486e-a0d7-43bae7fb209d'} Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:50.523402 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:50.528456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:50.533656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 404 to user: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:50.537540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a11b852b-4d83-4ad4-95a2-41c594064a9f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 404 len: 111 microversion: 2.1 time: 0.154173 Sep 19 14:50:50.548338 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1236/2498] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:50 2022] GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:50:50.565868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:50.572842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:50.576022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a05d8159-6804-40ee-a1e0-c9bf5828b65f req-64a85d12-4ede-42a8-880a-105fcf23556c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:50.582880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a05d8159-6804-40ee-a1e0-c9bf5828b65f req-64a85d12-4ede-42a8-880a-105fcf23556c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:50.585064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a05d8159-6804-40ee-a1e0-c9bf5828b65f req-64a85d12-4ede-42a8-880a-105fcf23556c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:50.591655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:50.598625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:50.599571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:50.600570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:50.601273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:50.603634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:50.619362 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a05d8159-6804-40ee-a1e0-c9bf5828b65f req-64a85d12-4ede-42a8-880a-105fcf23556c service nova] Creating event network-vif-deleted:2fc7f07a-01ce-4996-aa8b-317b2f027ba1 for instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d on n-h2-858384-1 Sep 19 14:50:50.632923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a05d8159-6804-40ee-a1e0-c9bf5828b65f req-64a85d12-4ede-42a8-880a-105fcf23556c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120963 Sep 19 14:50:50.634951 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1263/2499] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:50.641241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0dec8c75-ffbd-446c-8e15-974d3f64f676 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a07aee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:50.662096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:50.754633 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0dec8c75-ffbd-446c-8e15-974d3f64f676 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.118170 Sep 19 14:50:50.759041 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1264/2500] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:50 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:51.004809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:51.005553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:51.015632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.022140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.023325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.024314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.024951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.027193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.247676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:51.261627 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee286de6-a4cf-4ee7-b572-f6967cdce0a9 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1253 microversion: 2.1 time: 0.705694 Sep 19 14:50:51.262691 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1237/2501] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:50 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1253 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:51.278680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:51.301359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:51.306232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:51.325020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.326972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.329020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.333680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.334608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.335768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.472089 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03e41e10-4a0e-4914-9824-3859c8e026c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.206340 Sep 19 14:50:51.482109 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1238/2502] 10.222.0.81 () {58 vars in 1230 bytes} [Mon Sep 19 14:50:51 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:50:51.488745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:51.489653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:51.497601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.498370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.499158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.502678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.503506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.504077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.668669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:51.692868 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8574865-7921-4bd4-ad0a-c101b5ac621a tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1336 microversion: 2.1 time: 0.209429 Sep 19 14:50:51.693676 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1239/2503] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:51 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1336 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:51.704940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77ca932c-37ed-453b-8411-39bb45e5c38a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77ca932c-37ed-453b-8411-39bb45e5c38a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 19 14:50:51.709047 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:51.713427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77ca932c-37ed-453b-8411-39bb45e5c38a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:51.716696 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-77ca932c-37ed-453b-8411-39bb45e5c38a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016061 Sep 19 14:50:51.727602 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1240/2504] 10.222.0.81 () {58 vars in 1182 bytes} [Mon Sep 19 14:50:51 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:50:51.740608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:51.741529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:51.753461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.756776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.757503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:51.758477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:51.760304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:51.761940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.211706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:52.224466 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21ffe3bf-e435-4800-86d4-c293af30d592 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1472 microversion: 2.1 time: 1.463135 Sep 19 14:50:52.240434 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1265/2505] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:50 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1472 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:52.245079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:52.270399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:52.271302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:52.280185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.281017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.281645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.283850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.288444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.289318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.376408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:50:52.492880 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b971f7b2-5ef2-446a-9524-06ae10f3b90b tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.250900 Sep 19 14:50:52.505201 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1266/2506] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:50:52 2022] GET /compute/v2.1/servers => generated 681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:52.520440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94ea1e2b-ee51-4335-aae7-9cae5531740f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29f265e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:52.567687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:52.613583 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94ea1e2b-ee51-4335-aae7-9cae5531740f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1440 microversion: 2.1 time: 0.106987 Sep 19 14:50:52.621892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc0a2de9-66ec-4d70-ae99-4ed4c5fa66e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 0.893033 Sep 19 14:50:52.637748 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1241/2507] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:51 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:52.637959 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1267/2508] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:52 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1440 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:52.637959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:52.648408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:52.649030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:52.666423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:52.667011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.servers [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Removing options 'limit' from query {{(pid=128730) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 19 14:50:52.667726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:52.686970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.687483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.687927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.689313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.689769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.690195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.707350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.711174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.712835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.716292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.720773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.723251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.780799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:50:52.824951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.833091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.833979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.834622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lazy-loading 'fault' on Instance uuid 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:50:52.859011 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-918d06ae-7c67-49f9-8ff5-53659ce8894f tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.233162 Sep 19 14:50:52.859755 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1268/2509] 10.222.0.81 () {58 vars in 1144 bytes} [Mon Sep 19 14:50:52 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:52.878668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:52.879326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:52.895254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.896081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.896709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.897597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:52.898208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:52.898829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:52.925376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=18 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:53.029812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7662235a95b945d3a417c78cb457ce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aabb0c0ff64ece9d49a90817f9c171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:53.041858 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b51d32dc-4e5f-4a7e-b913-f56c814d6e4c tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 200 len: 1212 microversion: 2.1 time: 0.417219 Sep 19 14:50:53.042513 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1242/2510] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:52 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 1212 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:53.067948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-087d956e-8546-46eb-8a33-b0c434d218bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-087d956e-8546-46eb-8a33-b0c434d218bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi '-1' Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 19 14:50:53.074906 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 19 14:50:53.083499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.086782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-087d956e-8546-46eb-8a33-b0c434d218bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:53.087904 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-087d956e-8546-46eb-8a33-b0c434d218bc tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.038424 Sep 19 14:50:53.089284 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1243/2511] 10.222.0.81 () {58 vars in 1142 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:50:53.105859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a2961cf-9935-4169-82b4-cd9cf49b23e2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a2961cf-9935-4169-82b4-cd9cf49b23e2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: action_args: {} Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'testing' Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 19 14:50:53.119072 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a2961cf-9935-4169-82b4-cd9cf49b23e2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:53.123360 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a2961cf-9935-4169-82b4-cd9cf49b23e2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018612 Sep 19 14:50:53.131730 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1244/2512] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:50:53.149935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e775a5db-4700-480e-b76f-0078bb3de0c4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.162027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e775a5db-4700-480e-b76f-0078bb3de0c4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:53.163435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e775a5db-4700-480e-b76f-0078bb3de0c4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:53.175620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.compute.servers [None req-e775a5db-4700-480e-b76f-0078bb3de0c4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Flavor 'non_existing_flavor' could not be found {{(pid=128731) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 19 14:50:53.177214 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e775a5db-4700-480e-b76f-0078bb3de0c4 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.044120 Sep 19 14:50:53.178309 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1245/2513] 10.222.0.81 () {58 vars in 1178 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:50:53.192624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.201448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:53.205567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:53.226231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:53.228572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:53.229941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:53.230957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:53.231428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:53.233280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:53.394896 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81ad033b-30e8-4a61-b10d-6365c95c8bea tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.207507 Sep 19 14:50:53.396997 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1246/2514] 10.222.0.81 () {58 vars in 1174 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:50:53.409018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.409799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:53.423300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:53.424528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:53.426035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:53.427206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:53.427947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:53.428401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:53.738711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:53.747138 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8f0d001-679e-4ca0-a893-59640c8dab6f tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1403 microversion: 2.1 time: 0.883131 Sep 19 14:50:53.762774 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1269/2515] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:52 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1403 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:53.770427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.785070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:53.785756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:53.805853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:53.809414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:53.810337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:53.811431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:53.812113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:53.819870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:53.950466 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f35c02e4-bdc8-45de-94ab-e70a2068053c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.197512 Sep 19 14:50:53.958995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1270/2516] 10.222.0.81 () {58 vars in 1184 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:50:53.958995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90abf52e-5dc3-4149-b365-7114f0ca03d2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a0929d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.961579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:53.970966 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c7dcd87-750f-4b3a-84c3-bca641a84ae3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 0.572242 Sep 19 14:50:53.987177 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1247/2517] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:53.994172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:53.995032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:54.003290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.003996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.004667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.005736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.006711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.007736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.066219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90abf52e-5dc3-4149-b365-7114f0ca03d2 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1449 microversion: 2.1 time: 0.113485 Sep 19 14:50:54.070975 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1271/2518] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1449 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:54.079343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:54.090292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:54.093210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:54.115041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.128180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.129120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.131517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.132804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.138313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.181211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:50:54.255124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:54.278084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.278569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.291552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.871241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:54.888878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6fd52909-f9dc-45dd-b938-eaf02302ff76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 0.896777 Sep 19 14:50:54.891247 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1248/2519] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:53 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:54.908299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:54.909160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] [instance: 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:54.925526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.926996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.929074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.932148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:54.932851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:54.933557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:54.968870 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] HTTP exception thrown: Instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b could not be found. Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Request method failure captured: Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b HTTP/1.1 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIEeDa5hptBW588pa1RQFt3U-phFcdgQrTM942t-squSsigILwoBq7MnvUnT0w76SeDtZy--ZDHLuhydZ4KAvVW1IpYIgwqqym0ypspWDtFT0qzVrhPUu2jyYT2WvEGuSDoaNmXwH7Qc_MC3-ezIbErW-QdNcdhExQHjxzj96UdK500 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 50aabb0c0ff64ece9d49a90817f9c171 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestBootFromVolume-931135717 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50aabb0c0ff64ece9d49a90817f9c171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50aabb0c0ff64ece9d49a90817f9c171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50aabb0c0ff64ece9d49a90817f9c171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50aabb0c0ff64ece9d49a90817f9c171"}]}] Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestBootFromVolume-931135717 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 50aabb0c0ff64ece9d49a90817f9c171 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestBootFromVolume-931135717 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestBootFromVolume-931135717-project Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 7662235a95b945d3a417c78cb457ce05 Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestBootFromVolume-931135717-project Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b could not be found. Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b'} Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b could not be found. Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b could not be found. Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:54.976942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b could not be found. Sep 19 14:50:54.981320 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:50:54.984515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Returning 404 to user: Instance 57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:54.988497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32d44d05-ae9a-4199-a1c8-3a9fccbbeec0 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b" status: 404 len: 111 microversion: 2.1 time: 0.095170 Sep 19 14:50:54.990244 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1249/2520] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:54 2022] GET /compute/v2.1/servers/57c2c1bc-2efe-4e99-ab0b-20a2103c8f9b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:50:54.997784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78946b3c-1ff5-4684-a555-69887239f1ea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29ee3280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:55.042933 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c3eb210-893b-41a4-9f95-f7b23a8e5730 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.970418 Sep 19 14:50:55.056412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1272/2521] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:50:54 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:55.080127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-079db04c-edc8-4bb8-9524-101d1f8df774 req-530775df-72f8-4f36-b7ac-65561350b81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78a464e-7f62-4a1b-9923-ac635f8f7a90", "name": "network-vif-plugged", "status": "completed", "tag": "dc2083b3-7903-46a2-b405-8611008a4154"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:55.086406 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78946b3c-1ff5-4684-a555-69887239f1ea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 200 len: 1449 microversion: 2.1 time: 0.094549 Sep 19 14:50:55.090265 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1250/2522] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:50:54 2022] GET /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 1449 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:55.092658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-079db04c-edc8-4bb8-9524-101d1f8df774 req-530775df-72f8-4f36-b7ac-65561350b81f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:55.093144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-079db04c-edc8-4bb8-9524-101d1f8df774 req-530775df-72f8-4f36-b7ac-65561350b81f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:55.093673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-079db04c-edc8-4bb8-9524-101d1f8df774 req-530775df-72f8-4f36-b7ac-65561350b81f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:55.108007 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-079db04c-edc8-4bb8-9524-101d1f8df774 req-530775df-72f8-4f36-b7ac-65561350b81f service nova] Creating event network-vif-plugged:dc2083b3-7903-46a2-b405-8611008a4154 for instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 on n-h1-858384-1 Sep 19 14:50:55.111239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:55.112518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:55.114015 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-079db04c-edc8-4bb8-9524-101d1f8df774 req-530775df-72f8-4f36-b7ac-65561350b81f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055514 Sep 19 14:50:55.115401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1273/2523] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:55.120975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47a6de77-9d43-4a5b-9ba7-e80f8f0357e8 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] Calling method '.version_select at 0x7fde2a133ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:55.122829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:55.123747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:55.124267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:55.127134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:55.128402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:55.129067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:55.152122 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-47a6de77-9d43-4a5b-9ba7-e80f8f0357e8 tempest-ServersTestBootFromVolume-931135717 tempest-ServersTestBootFromVolume-931135717-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134908873" status: 202 len: 0 microversion: 2.1 time: 0.033528 Sep 19 14:50:55.153530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1274/2524] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134908873 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:50:55.159405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:55.160577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:55.168144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:55.168949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:55.169815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:55.170975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:55.172083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:55.172900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:56.035560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:56.076096 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57eb5508-7cc8-4c4d-9459-3d53e4204777 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1403 microversion: 2.1 time: 0.957848 Sep 19 14:50:56.077268 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1251/2525] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:55 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1403 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:56.093273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:56.098976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74a907e9-046f-40c1-8c4b-b43dbad70db8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:56.108073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-15b94a70-569b-4c6a-8d5e-f5719524daea tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 0.953156 Sep 19 14:50:56.108999 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1275/2526] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:55 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:56.111332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74a907e9-046f-40c1-8c4b-b43dbad70db8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:56.116739 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74a907e9-046f-40c1-8c4b-b43dbad70db8 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.030249 Sep 19 14:50:56.119779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb573709-143a-411a-9b77-b54b06097710 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a0bf790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:56.120891 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1252/2527] 10.222.0.81 () {58 vars in 1178 bytes} [Mon Sep 19 14:50:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:50:56.132193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:56.138713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:56.155349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:56.159825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:56.174180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:56.176933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:56.179286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:56.180493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:56.900938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:56.913269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e1655655-3a44-4f0c-9d70-fc80c2d7287a tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1318 microversion: 2.1 time: 0.790983 Sep 19 14:50:56.917499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1253/2528] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:56 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:56.931657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:56.941581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:56.949103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Searching by: {'deleted': False, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:50:56.966791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:56.967426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:56.968798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:56.971033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:56.980105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:56.980732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:56.999637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=9 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:57.047703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:50:57.137014 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-42361fe2-df4d-424a-9d60-33758f17bdf3 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.218032 Sep 19 14:50:57.139795 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1254/2529] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:50:56 2022] GET /compute/v2.1/servers => generated 681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:57.148484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-316b3797-cb4e-4094-887a-e35c810c5aae req-f71237b8-5ea9-45bc-b0e8-2e6ea623026a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1a54a-99bb-46aa-a947-6e5bf160596e", "tag": "de4fc87e-e7d4-4522-9af9-593805cd7e30"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:57.187401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-316b3797-cb4e-4094-887a-e35c810c5aae req-f71237b8-5ea9-45bc-b0e8-2e6ea623026a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.189024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-316b3797-cb4e-4094-887a-e35c810c5aae req-f71237b8-5ea9-45bc-b0e8-2e6ea623026a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.189686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-316b3797-cb4e-4094-887a-e35c810c5aae req-f71237b8-5ea9-45bc-b0e8-2e6ea623026a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.207121 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-316b3797-cb4e-4094-887a-e35c810c5aae req-f71237b8-5ea9-45bc-b0e8-2e6ea623026a service nova] Creating event network-changed:de4fc87e-e7d4-4522-9af9-593805cd7e30 for instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e on n-h2-858384-1 Sep 19 14:50:57.221447 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-316b3797-cb4e-4094-887a-e35c810c5aae req-f71237b8-5ea9-45bc-b0e8-2e6ea623026a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080041 Sep 19 14:50:57.222211 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1255/2530] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:57.235573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:57.244690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:57.252708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.265523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.267184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.268197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.268748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.269256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.516798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb573709-143a-411a-9b77-b54b06097710 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 204 len: 0 microversion: 2.1 time: 1.406479 Sep 19 14:50:57.518500 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1276/2531] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:56 2022] DELETE /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 0 bytes in 1409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:57.527281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:57.529212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:57.542873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.544794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.546037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.547107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.548782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.549470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.866691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:57.879184 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-52c294ec-6c66-4f93-8c74-0e160d62463b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 0.359357 Sep 19 14:50:57.881014 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1277/2532] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:57 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:57.889503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:57.890370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:57.914310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.914954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.915605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.917272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.917914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.918739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.919155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:57.939964 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04729c66-a41f-427c-ae6d-e72fb5e23263 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1403 microversion: 2.1 time: 0.711889 Sep 19 14:50:57.942977 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1256/2533] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:57 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1403 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:57.946920 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] HTTP exception thrown: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d HTTP/1.1 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1a3d93f5-ecdf-486e-a0d7-43bae7fb209d'} Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:50:57.951654 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 404 to user: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:50:57.955929 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5197abb4-fd2b-423a-9cee-fe347d80034a tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 404 len: 111 microversion: 2.1 time: 0.070672 Sep 19 14:50:57.957254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cae0eeb6-21d6-4305-9a5f-0c9a45364619 req-dd13c6fc-919a-4673-9aa3-2ffb2a327e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc21d495-0399-4b56-9b4b-410e915192de", "name": "network-vif-unplugged", "status": "completed", "tag": "24701317-1249-428b-b54e-b2b4bb1f367b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:57.957353 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1278/2534] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:57 2022] DELETE /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:50:57.964669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:57.965407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:57.972555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.973296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.973918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.975014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.975641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.976401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:57.977329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cae0eeb6-21d6-4305-9a5f-0c9a45364619 req-dd13c6fc-919a-4673-9aa3-2ffb2a327e58 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:57.977830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cae0eeb6-21d6-4305-9a5f-0c9a45364619 req-dd13c6fc-919a-4673-9aa3-2ffb2a327e58 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:57.981933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cae0eeb6-21d6-4305-9a5f-0c9a45364619 req-dd13c6fc-919a-4673-9aa3-2ffb2a327e58 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:58.026738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:50:58.030381 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cae0eeb6-21d6-4305-9a5f-0c9a45364619 req-dd13c6fc-919a-4673-9aa3-2ffb2a327e58 service nova] Creating event network-vif-unplugged:24701317-1249-428b-b54e-b2b4bb1f367b for instance dc21d495-0399-4b56-9b4b-410e915192de on n-h2-858384-1 Sep 19 14:50:58.052516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cae0eeb6-21d6-4305-9a5f-0c9a45364619 req-dd13c6fc-919a-4673-9aa3-2ffb2a327e58 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107887 Sep 19 14:50:58.056574 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1257/2535] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:58.066697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:58.088074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:58.107193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:58.109199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:58.114522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:58.131701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:58.146047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:58.149183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:58.239422 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-adaeb30b-a091-4dcb-911e-5100b9d94d55 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 204 len: 0 microversion: 2.1 time: 0.280463 Sep 19 14:50:58.241975 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1279/2536] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:57 2022] DELETE /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:58.267623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:58.268260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:58.279534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:58.281294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:58.282932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:58.284845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:58.285348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:58.287932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:58.332189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:58.411144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:50:58.682670 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-943f1fee-4b22-4e73-bf9d-5c4dec485ec7 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "DELETE /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba" status: 204 len: 0 microversion: 2.1 time: 0.438390 Sep 19 14:50:58.683323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1280/2537] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:58 2022] DELETE /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:58.706125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1488030415", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "779ee5e7-92ae-45cf-806b-a3db91dc090f"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:50:58.838513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] validate_networks() for [('779ee5e7-92ae-45cf-806b-a3db91dc090f', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:50:59.362135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:50:59.376137 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb5b7446-6cf9-45b2-a3af-2e4c64703b82 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1509 microversion: 2.1 time: 1.317953 Sep 19 14:50:59.377147 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1258/2538] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:58 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1509 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:59.404149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:59.405275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:59.426429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:59.427555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:59.428369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:59.429408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:59.430155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:59.431025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:59.468951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:50:59.610612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:59.632291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78f94f3a-f8b3-47e1-8289-39ccdded5e6c tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 204 len: 0 microversion: 2.1 time: 0.235236 Sep 19 14:50:59.633307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1259/2539] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:50:59 2022] DELETE /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:59.639968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:59.641584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:50:59.648580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:59.649145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:59.649688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:59.650500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:59.651188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:59.651716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:00.272538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:00.305069 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78b19709-be71-4adb-9095-a1717b7ac224 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 0.668385 Sep 19 14:51:00.306585 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1260/2540] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:50:59 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:00.312949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:00.316885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:00.327215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:00.328440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:00.329167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:00.330249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:00.334567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:00.335076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:00.341659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:00.583631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:51:00.584152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:51:00.585514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:51:00.586240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:51:00.586966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:51:00.604201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:00.605277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:00.607517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:00.608534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:00.609288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:00.612259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:00.646291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:51:00.655051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Getting quotas for user b469a10b494b4876896c5300aa676b46 and project cdc1cd2ca2f1477e9ff02f91a17b8609. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:51:00.680952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:51:00.684735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:51:00.745318 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ba18a97-76eb-46a6-8976-900f2aae5c95 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054485 Sep 19 14:51:00.746576 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1281/2541] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:51:00.757371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:00.758308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:00.766362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:00.767228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:00.767870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:00.768780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:00.769371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:00.770477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:01.012008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:01.035364 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a9383146-23fc-47a1-9390-c5dd20b08829 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1403 microversion: 2.1 time: 0.726573 Sep 19 14:51:01.037485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1261/2542] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:00 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1403 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:01.059288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:01.061232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:01.072599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:01.074160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:01.075215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:01.077532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:01.079285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:01.079767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:01.101639 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] HTTP exception thrown: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d HTTP/1.1 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1a3d93f5-ecdf-486e-a0d7-43bae7fb209d'} Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:01.103503 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 404 to user: Instance 1a3d93f5-ecdf-486e-a0d7-43bae7fb209d could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:01.108663 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bf26246-6a27-492b-b950-e2bd82882f68 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d" status: 404 len: 111 microversion: 2.1 time: 0.066192 Sep 19 14:51:01.110606 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1262/2543] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:01 2022] GET /compute/v2.1/servers/1a3d93f5-ecdf-486e-a0d7-43bae7fb209d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:01.115001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-faa4c761-7fc6-4c07-8271-d25dae5e021d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:01.115634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-faa4c761-7fc6-4c07-8271-d25dae5e021d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:01.257046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-faa4c761-7fc6-4c07-8271-d25dae5e021d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:01.274028 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-faa4c761-7fc6-4c07-8271-d25dae5e021d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1208 microversion: 2.1 time: 0.163338 Sep 19 14:51:01.275585 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1263/2544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:01 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:01.293673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:01.294581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:01.303702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:01.304223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:01.304724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:01.305516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:01.306142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:01.306584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:01.777136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:01.790307 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f24345f-f245-4dc7-934e-32d66a5cf8b1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1509 microversion: 2.1 time: 1.042382 Sep 19 14:51:01.796778 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1282/2545] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:00 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1509 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:01.826270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:01.827249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:01.836870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:01.837683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:01.838349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:01.839489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:01.840198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:01.840860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:02.497605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:02.520015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6bdde429-8ba5-482e-9160-e6ca6c7853c0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba" status: 200 len: 1520 microversion: 2.1 time: 1.238019 Sep 19 14:51:02.521379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1264/2546] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:01 2022] GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba => generated 1520 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:02.527472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:02.540038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:02.556158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:02.560083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:02.561818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:02.563387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:02.565215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:02.565669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:02.738346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:51:02.738827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:51:02.739322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:51:02.739740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:51:02.740161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:51:02.891626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:02.914722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:02.922455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:02.922899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:02.923742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:02.924143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:02.924712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:03.012289 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e42e381-0802-4b38-a978-ca362245cd21 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "POST /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90/action" status: 202 len: 1111 microversion: 2.1 time: 0.488704 Sep 19 14:51:03.025935 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1265/2547] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:51:02 2022] POST /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90/action => generated 1111 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 19 14:51:03.034735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:03.036427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:03.048846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:03.049362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:03.049892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:03.050635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:03.051761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:03.052253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:03.115917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:03.157200 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c861dec-11a8-4050-bf00-4fde2ae933d4 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 1.342421 Sep 19 14:51:03.160967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1283/2548] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:01 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:03.173870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:03.177677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:03.186534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:03.202965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:03.205711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:03.208641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:03.210712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:03.212026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:03.213465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:03.615100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:03.631147 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9911f0c5-85cc-48dd-8e31-5eb720d89c38 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1266 microversion: 2.1 time: 0.463080 Sep 19 14:51:03.632607 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1284/2549] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:03 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:03.642064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:03.648957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:03.656995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:03.657513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:03.657958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:03.658902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:03.659570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:03.660007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:04.660947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:04.669031 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0a71234-c59d-4b22-8811-d8bee349d513 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1403 microversion: 2.1 time: 1.641883 Sep 19 14:51:04.673858 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1266/2550] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:03 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1403 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:04.686790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fa0a625d-dcd1-4559-afbb-d73a8d17f7dd req-cf6d0f01-d2f2-416d-8ce4-d2435d55cadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4c3f7a-05ae-4d1d-901d-ff4753932d8a", "name": "network-vif-deleted", "tag": "c5108c4b-fc4f-483e-8d28-1daf5a6f908d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:04.703262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fa0a625d-dcd1-4559-afbb-d73a8d17f7dd req-cf6d0f01-d2f2-416d-8ce4-d2435d55cadf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:04.703818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fa0a625d-dcd1-4559-afbb-d73a8d17f7dd req-cf6d0f01-d2f2-416d-8ce4-d2435d55cadf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:04.704381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fa0a625d-dcd1-4559-afbb-d73a8d17f7dd req-cf6d0f01-d2f2-416d-8ce4-d2435d55cadf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:04.753396 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fa0a625d-dcd1-4559-afbb-d73a8d17f7dd req-cf6d0f01-d2f2-416d-8ce4-d2435d55cadf service nova] Creating event network-vif-deleted:c5108c4b-fc4f-483e-8d28-1daf5a6f908d for instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a on n-h2-858384-1 Sep 19 14:51:04.759530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fa0a625d-dcd1-4559-afbb-d73a8d17f7dd req-cf6d0f01-d2f2-416d-8ce4-d2435d55cadf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084111 Sep 19 14:51:04.760449 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1267/2551] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:04.777072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:04.778045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:04.796066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:04.796663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:04.797760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:04.799300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:04.800052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:04.802174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:04.862104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:04.862727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:04.863341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:04.864295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lazy-loading 'fault' on Instance uuid 665e3b36-5d49-49a1-b034-9e9c5010b5ba {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:05.082584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:05.095523 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd9a4c8b-3c57-4350-8244-60c2d466d737 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 1.459652 Sep 19 14:51:05.096385 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1285/2552] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:03 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:05.112777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:05.118668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:05.133001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:05.133879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:05.135190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:05.136757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:05.137432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:05.138368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:05.411097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf699ae2912462ca84d1bb4bb30a3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dbb84791334d21b787f11c372cc1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:05.434180 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-651bfac6-fce7-407b-ae79-b1a38efddb80 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba" status: 200 len: 1312 microversion: 2.1 time: 0.672284 Sep 19 14:51:05.435480 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1268/2553] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:04 2022] GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba => generated 1312 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:05.441561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-62461d4f-e389-4e42-982d-f3a35077e199 req-cfd89ddb-41ae-41ff-900a-ac905a23b7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665e3b36-5d49-49a1-b034-9e9c5010b5ba", "name": "network-vif-deleted", "tag": "4e3f64ab-f569-4753-8e3e-9c134df67129"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:05.454929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-62461d4f-e389-4e42-982d-f3a35077e199 req-cfd89ddb-41ae-41ff-900a-ac905a23b7d6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:05.455762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-62461d4f-e389-4e42-982d-f3a35077e199 req-cfd89ddb-41ae-41ff-900a-ac905a23b7d6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:05.456257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-62461d4f-e389-4e42-982d-f3a35077e199 req-cfd89ddb-41ae-41ff-900a-ac905a23b7d6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:05.471426 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-62461d4f-e389-4e42-982d-f3a35077e199 req-cfd89ddb-41ae-41ff-900a-ac905a23b7d6 service nova] Creating event network-vif-deleted:4e3f64ab-f569-4753-8e3e-9c134df67129 for instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba on n-h1-858384-1 Sep 19 14:51:05.476984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-62461d4f-e389-4e42-982d-f3a35077e199 req-cfd89ddb-41ae-41ff-900a-ac905a23b7d6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040070 Sep 19 14:51:05.479399 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1269/2554] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:05.486443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:05.488470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:05.495925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:05.496536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:05.497043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:05.497865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:05.498395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:05.499109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.050638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:06.079478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5af3c12-8457-4462-b8df-9d80d5c08a71 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 0.979321 Sep 19 14:51:06.087268 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1286/2555] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:05 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:06.104165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fe4bbc6a-d66e-453a-9e34-ea085e907d77 req-eac2d26b-4fa0-4efd-89ed-2620247756ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1a54a-99bb-46aa-a947-6e5bf160596e", "name": "network-vif-plugged", "status": "completed", "tag": "de4fc87e-e7d4-4522-9af9-593805cd7e30"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:06.138613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fe4bbc6a-d66e-453a-9e34-ea085e907d77 req-eac2d26b-4fa0-4efd-89ed-2620247756ff service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.139489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fe4bbc6a-d66e-453a-9e34-ea085e907d77 req-eac2d26b-4fa0-4efd-89ed-2620247756ff service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.141079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fe4bbc6a-d66e-453a-9e34-ea085e907d77 req-eac2d26b-4fa0-4efd-89ed-2620247756ff service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.167053 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fe4bbc6a-d66e-453a-9e34-ea085e907d77 req-eac2d26b-4fa0-4efd-89ed-2620247756ff service nova] Creating event network-vif-plugged:de4fc87e-e7d4-4522-9af9-593805cd7e30 for instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e on n-h2-858384-1 Sep 19 14:51:06.181461 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fe4bbc6a-d66e-453a-9e34-ea085e907d77 req-eac2d26b-4fa0-4efd-89ed-2620247756ff service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092372 Sep 19 14:51:06.182269 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1287/2556] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:06.216306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:06.217037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:06.251626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.252345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.254869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.256421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.257376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.258392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.336840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:06.357382 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7ac0fc9-f311-47e5-85d6-d89be3a503d3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.875710 Sep 19 14:51:06.357920 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1270/2557] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:05 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:06.373664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:06.375907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:06.384444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.385552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.386196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.387183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.388023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.389116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.922506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:06.935493 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc6ca056-d006-40a5-b4de-bf2f513b1b1c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1403 microversion: 2.1 time: 0.751679 Sep 19 14:51:06.947555 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1288/2558] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:06 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1403 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:06.970495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:06.974567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 665e3b36-5d49-49a1-b034-9e9c5010b5ba] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:06.990605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.991446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.992112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:06.993170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:06.994346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:06.995085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:07.021756 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] HTTP exception thrown: Instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba could not be found. Sep 19 14:51:07.023910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba HTTP/1.1 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba could not be found. Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '665e3b36-5d49-49a1-b034-9e9c5010b5ba'} Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba could not be found. Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba could not be found. Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.036836 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba could not be found. Sep 19 14:51:07.042069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.043779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:07.049392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 404 to user: Instance 665e3b36-5d49-49a1-b034-9e9c5010b5ba could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:07.050299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-57ccac62-c36e-4339-bbe5-aa2576d168c2 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba" status: 404 len: 111 microversion: 2.1 time: 0.101620 Sep 19 14:51:07.051351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-253ecd04-2f1d-454b-aff0-b18dab1c37a2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.689057 Sep 19 14:51:07.054376 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1289/2559] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:06 2022] GET /compute/v2.1/servers/665e3b36-5d49-49a1-b034-9e9c5010b5ba => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:07.067392 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1271/2560] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:06 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:07.076768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:07.078015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] [instance: 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:07.085760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:07.086520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:07.087362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:07.088304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:07.088997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:07.089648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:07.127744 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] HTTP exception thrown: Instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a could not be found. Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Request method failure captured: Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a HTTP/1.1 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIGTHqgPakuqT6266FyZ4kFHf1d9YBkdRFMmTHDThZQQZk7CQp8IOsVSIy1hTUkhbBYpDPm6yO3vr7cWKPF0rrLkxa_s_kKF8gsC38JmdgPxvk0GOqKzM9UwHxYCYBaH5Zgn30Kb9Bdbj1OILBtxXOVw_Rkue2_gpSmFAnd7fasFDkM Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a2dbb84791334d21b787f11c372cc1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a2dbb84791334d21b787f11c372cc1a7"}]}] Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a2dbb84791334d21b787f11c372cc1a7 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1330700886 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: abf699ae2912462ca84d1bb4bb30a3f6 Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ListServersNegativeTestJSON-1330700886-project Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a could not be found. Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9d4c3f7a-05ae-4d1d-901d-ff4753932d8a'} Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a could not be found. Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a could not be found. Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.130071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a could not be found. Sep 19 14:51:07.134339 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:07.137287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] Returning 404 to user: Instance 9d4c3f7a-05ae-4d1d-901d-ff4753932d8a could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:07.138392 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f622019-fc2a-4551-b286-a579a6e350f0 tempest-ListServersNegativeTestJSON-1330700886 tempest-ListServersNegativeTestJSON-1330700886-project] 10.222.0.81 "GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a" status: 404 len: 111 microversion: 2.1 time: 0.069860 Sep 19 14:51:07.143000 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1272/2561] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:07 2022] GET /compute/v2.1/servers/9d4c3f7a-05ae-4d1d-901d-ff4753932d8a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:07.150310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:07.151251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:07.159426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:07.160249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:07.160914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:07.161885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:07.162568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:07.163238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:07.208704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-256810737", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:07.313417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] validate_networks() for [('92f9fd13-f239-4a35-8368-72647fe18630', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:51:07.563167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:07.580065 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-699d6bc8-093d-4449-8841-a7d8ee75a45e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 0.433833 Sep 19 14:51:07.590776 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1273/2562] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:07 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:07.590776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:07.590776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:07.603997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:07.604493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:07.604923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:07.605739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:07.606170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:07.606802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.143132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:08.153684 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-96975d4d-fe21-4f8d-a539-9e0029917816 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.571603 Sep 19 14:51:08.168051 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1274/2563] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:07 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:08.180611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8ac72925-3128-4eb4-a74f-f0122db4fe1a req-bfb453cc-1e1b-41cd-8531-c7b11bae71c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc21d495-0399-4b56-9b4b-410e915192de", "name": "network-vif-deleted", "tag": "24701317-1249-428b-b54e-b2b4bb1f367b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:08.199151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ac72925-3128-4eb4-a74f-f0122db4fe1a req-bfb453cc-1e1b-41cd-8531-c7b11bae71c4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.199888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ac72925-3128-4eb4-a74f-f0122db4fe1a req-bfb453cc-1e1b-41cd-8531-c7b11bae71c4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.200485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ac72925-3128-4eb4-a74f-f0122db4fe1a req-bfb453cc-1e1b-41cd-8531-c7b11bae71c4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.213683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8ac72925-3128-4eb4-a74f-f0122db4fe1a req-bfb453cc-1e1b-41cd-8531-c7b11bae71c4 service nova] Creating event network-vif-deleted:24701317-1249-428b-b54e-b2b4bb1f367b for instance dc21d495-0399-4b56-9b4b-410e915192de on n-h2-858384-1 Sep 19 14:51:08.219807 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8ac72925-3128-4eb4-a74f-f0122db4fe1a req-bfb453cc-1e1b-41cd-8531-c7b11bae71c4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050349 Sep 19 14:51:08.231282 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1275/2564] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:08.237452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:08.238721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:08.248088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.248948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.249553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.251082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.251892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.252552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.499065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:08.515597 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-593bbf0b-9989-4257-aedc-83218bd4f3eb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1590 microversion: 2.1 time: 0.282062 Sep 19 14:51:08.530776 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1276/2565] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:08 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1590 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:08.532063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-aee80304-e142-483a-ab94-95808ec08f79 req-40f1b6c6-eace-4aee-95ef-3ac23f2ffe4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7439dbfa-e2a7-43f2-baa1-034e60b035b7", "tag": "2da9c6aa-4872-4d7e-b1a1-77958d346853"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:08.553435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:51:08.554017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:51:08.554693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:51:08.555409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:51:08.556140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:51:08.569925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aee80304-e142-483a-ab94-95808ec08f79 req-40f1b6c6-eace-4aee-95ef-3ac23f2ffe4d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.573141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aee80304-e142-483a-ab94-95808ec08f79 req-40f1b6c6-eace-4aee-95ef-3ac23f2ffe4d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.577430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.579821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aee80304-e142-483a-ab94-95808ec08f79 req-40f1b6c6-eace-4aee-95ef-3ac23f2ffe4d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.580310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.580970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.583202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.586963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.587576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.618431 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-aee80304-e142-483a-ab94-95808ec08f79 req-40f1b6c6-eace-4aee-95ef-3ac23f2ffe4d service nova] Creating event network-changed:2da9c6aa-4872-4d7e-b1a1-77958d346853 for instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 on n-h1-858384-1 Sep 19 14:51:08.621070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Getting quotas for project 2183c652081d42bda062953f266f52c0. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:51:08.635726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Getting quotas for user 604ca7ed8dd7491fb44f75ffe905478a and project 2183c652081d42bda062953f266f52c0. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:51:08.644191 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-aee80304-e142-483a-ab94-95808ec08f79 req-40f1b6c6-eace-4aee-95ef-3ac23f2ffe4d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124388 Sep 19 14:51:08.646286 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1277/2566] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:08.655427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:08.657801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:08.666126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:51:08.668691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:51:08.673325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.674050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.674555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.675542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.676861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.677483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.733592 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8708e9d9-5372-492d-b658-3da2fec6ae17 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679757 Sep 19 14:51:08.734594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1290/2567] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:51:08.744035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:08.744800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:08.756390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.757340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.758031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:08.759121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:08.760012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:08.760640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:09.108269 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e53f398e-fb6c-4d89-8866-3787d07bc81c tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.371806 Sep 19 14:51:09.109733 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1291/2568] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:51:08 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e/os-interface => generated 284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:09.114614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:09.115469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:09.130009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:09.130521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:09.131006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:09.131725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:09.132184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:09.132609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:10.256110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:10.265905 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4dc3f071-f53b-421a-8af9-7de4c9601946 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 1.615884 Sep 19 14:51:10.267150 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1278/2569] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:08 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:10.280047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:10.293529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:10.297213 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97bc0061-c4d8-4b1a-bd3f-fb51fa4a6423 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1477 microversion: 2.1 time: 1.185578 Sep 19 14:51:10.298545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:10.299355 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1292/2570] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:09 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1477 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:10.315658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:10.318154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:10.319160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:10.321501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:10.322128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:10.331892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:10.334418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:10.337013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:10.340564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:10.345390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:10.346104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:10.347029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:10.347634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:10.348238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:10.592027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:10.606967 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c1c9bf1-37a6-4e9d-883b-dff187334279 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1275 microversion: 2.1 time: 0.338549 Sep 19 14:51:10.607560 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1279/2571] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:10 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:11.069982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:11.082686 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4ab95220-f47d-44c8-84a7-12ef699cce0b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.782104 Sep 19 14:51:11.084147 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1293/2572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:10 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:11.293169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:11.293778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:11.296273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.310241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:11.311017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:11.311609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:11.312665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:11.316276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:11.316276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:11.321743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:11.322598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:11.337184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:11.350308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:11.351130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:11.352067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:11.353865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:11.354576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:11.394944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:12.047412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:12.086989 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f34b8533-ef0d-43dd-9016-900dc8f572b9 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.797488 Sep 19 14:51:12.110132 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1280/2573] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:11 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:12.116767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:12.123514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:12.126977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:12.135081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:12.136278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:12.137733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:12.139539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:12.141058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:12.141696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:12.151014 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f24daaa-9006-4cde-8de4-ce7e8ec2a341 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1476 microversion: 2.1 time: 0.833070 Sep 19 14:51:12.152159 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1294/2574] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:11 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1476 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:12.158662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:12.159494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:12.179828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:12.180653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:12.183318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:12.184719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:12.185512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:12.188443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:12.436264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:12.452526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-51feaa75-95d8-4241-8973-089cae009722 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1281 microversion: 2.1 time: 0.339009 Sep 19 14:51:12.456020 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1281/2575] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:12 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1281 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:12.653710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "name": "network-vif-unplugged", "status": "completed", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:12.665930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:12.667005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:12.668030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:12.687916 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] Creating event network-vif-unplugged:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h2-858384-1 Sep 19 14:51:12.700355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] Instance a86e8432-55c5-4300-b805-81f0cba98dfb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:51:12.716803 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-80d35e23-4289-4c6a-8680-9160ad057003 req-cc353501-a426-4437-9bd3-e55edf2d657c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067147 Sep 19 14:51:12.717906 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1282/2576] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:12.930493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:12.941629 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3daebd6d-2808-4569-9c68-f0e31ffbf609 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.787985 Sep 19 14:51:12.955453 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1295/2577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:12 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:13.116842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:13.117739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:13.124915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:13.125515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:13.126201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:13.127051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:13.127591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:13.128245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:13.177546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:13.178301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:13.184711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:13.185309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:13.185938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:13.186776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:13.188007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:13.188513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:13.921189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:13.956385 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-19c210a3-d780-42de-b696-87f1e5bafa99 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1476 microversion: 2.1 time: 0.782335 Sep 19 14:51:13.973096 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1296/2578] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:13 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1476 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:13.986787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:13.987924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:14.003124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.004699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.006249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.007169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.007890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.008571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.017630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:14.041122 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7012af7d-06a7-46dc-9f92-afbeb969e4a7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.927933 Sep 19 14:51:14.043836 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1283/2579] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:13 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:14.058444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:14.061364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:14.077034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.078415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.080114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.081158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.081793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.082387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.505404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:14.521440 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d03760b-bc71-406d-8c13-118f69ba40e7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.545930 Sep 19 14:51:14.527922 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1297/2580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:13 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:14.577770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:14.596372 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89f1238c-9a7e-49a5-871b-ac2cde5fd254 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.550025 Sep 19 14:51:14.607983 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1284/2581] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:14 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:14.726874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:14.728483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:14.746053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-60f6aa6b-a870-4942-9d23-27a96712c878 req-69356e09-453b-4d36-ba2c-e22c5d25da07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1a54a-99bb-46aa-a947-6e5bf160596e", "tag": "de4fc87e-e7d4-4522-9af9-593805cd7e30"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:14.773105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.779475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.782694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.783793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.786386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.787410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-60f6aa6b-a870-4942-9d23-27a96712c878 req-69356e09-453b-4d36-ba2c-e22c5d25da07 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.789418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.792409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-60f6aa6b-a870-4942-9d23-27a96712c878 req-69356e09-453b-4d36-ba2c-e22c5d25da07 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.794693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-60f6aa6b-a870-4942-9d23-27a96712c878 req-69356e09-453b-4d36-ba2c-e22c5d25da07 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.807577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.836996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-60f6aa6b-a870-4942-9d23-27a96712c878 req-69356e09-453b-4d36-ba2c-e22c5d25da07 service nova] Creating event network-changed:de4fc87e-e7d4-4522-9af9-593805cd7e30 for instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e on n-h2-858384-1 Sep 19 14:51:14.850267 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-60f6aa6b-a870-4942-9d23-27a96712c878 req-69356e09-453b-4d36-ba2c-e22c5d25da07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110433 Sep 19 14:51:14.854048 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1285/2582] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:51:14.988498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:14.989500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:14.996313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:14.997128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:14.997767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:14.998782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.000050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.000709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.244484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:15.258043 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc5f6015-7633-4e2e-b437-ee57fc55ccde tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1590 microversion: 2.1 time: 0.538199 Sep 19 14:51:15.275511 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1298/2583] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:14 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1590 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:15.279635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:15.280274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:15.289446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.290209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.290868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.291741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.292365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.292964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.487647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:15.510354 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7064e5aa-3cee-4483-b32b-c1414891ff0e tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1476 microversion: 2.1 time: 0.527985 Sep 19 14:51:15.514563 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1286/2584] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:14 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:15.545874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:15.569673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.570047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.573385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.596625 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] Creating event network-changed:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h2-858384-1 Sep 19 14:51:15.605909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] Instance a86e8432-55c5-4300-b805-81f0cba98dfb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:51:15.622636 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3b2e0d05-bd05-48c8-b992-05d1e105baff req-66a143d5-c6cb-4a0f-9e1c-f27139201dac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105470 Sep 19 14:51:15.623672 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1287/2585] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:15.630633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:15.631875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:15.639390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.641055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.641860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.643034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.643758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.644434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.849795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:15.865554 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2cc45db-bb1a-45a6-8937-55ab6bf497d3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.604981 Sep 19 14:51:15.866506 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1299/2586] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:15 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:15.871826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:15.872661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:15.887901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.888403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.888843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:15.889851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:15.890359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:15.890840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:16.282960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:16.320372 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f743dd81-5223-41da-ac64-d71d0da69c0a tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.440133 Sep 19 14:51:16.322593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1300/2587] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:15 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:16.498896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:16.525267 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7ae63205-c3b0-4655-b010-1444bd8da560 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.898591 Sep 19 14:51:16.525897 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1288/2588] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:15 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:16.544533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:16.545371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:16.563277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:16.566087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:16.566928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:16.568033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:16.568613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:16.570338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:16.890573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:16.891310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:16.902398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:16.903028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:16.903729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:16.904672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:16.905343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:16.906518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:17.614996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:17.632997 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0bd5662d-a946-4275-a644-586ab429ebe7 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1476 microversion: 2.1 time: 1.092736 Sep 19 14:51:17.633598 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1301/2589] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:16 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1476 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:17.650732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:17.651197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:17.661226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:17.668373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:17.668882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:17.669589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:17.670312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:17.670790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:17.671804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:17.685543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a226f189-e30c-474c-bf9c-33084e5f84ec tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.799517 Sep 19 14:51:17.690370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1289/2590] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:16 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:17.698790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:17.700520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:17.722574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:17.726563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:17.727418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:17.728779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:17.729444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:17.730423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:18.268163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:18.284902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-249f2b02-e8ef-47ad-93ca-62c974d45889 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.637730 Sep 19 14:51:18.285731 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1302/2591] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:17 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:18.298937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9196db20-531f-4d3e-a1e8-7d7d5bcf31ab req-e19fdc76-718d-451c-a0ac-78139a3156aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d2ebb3-f952-4730-b8ec-946a1bd54be9", "tag": "15f6af30-d79a-4b16-a1c8-f13a63b51e6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:18.341664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9196db20-531f-4d3e-a1e8-7d7d5bcf31ab req-e19fdc76-718d-451c-a0ac-78139a3156aa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:18.347147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9196db20-531f-4d3e-a1e8-7d7d5bcf31ab req-e19fdc76-718d-451c-a0ac-78139a3156aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:18.347591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9196db20-531f-4d3e-a1e8-7d7d5bcf31ab req-e19fdc76-718d-451c-a0ac-78139a3156aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:18.394323 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9196db20-531f-4d3e-a1e8-7d7d5bcf31ab req-e19fdc76-718d-451c-a0ac-78139a3156aa service nova] Creating event network-changed:15f6af30-d79a-4b16-a1c8-f13a63b51e6d for instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 on n-h2-858384-1 Sep 19 14:51:18.407441 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9196db20-531f-4d3e-a1e8-7d7d5bcf31ab req-e19fdc76-718d-451c-a0ac-78139a3156aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120301 Sep 19 14:51:18.416654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1303/2592] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:18.468920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:18.486450 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40460c71-c85a-41ab-a4ee-80a9f7dfd188 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.794311 Sep 19 14:51:18.500230 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1290/2593] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:17 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:18.710599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:18.715006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:18.719497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:18.720315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:18.736242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.738616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:18.742168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.742650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:18.743143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:18.743897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:18.746807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:18.752089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:18.785112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:18.787019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:18.788169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:18.799604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:18.800818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:18.801825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.173749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:19.186048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20d08e9f-7fef-402c-a099-32deff0b3aee tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.470806 Sep 19 14:51:19.189366 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1291/2594] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:18 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:19.205705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:19.214298 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5fd2a7b4-39b2-4f7d-ae63-50338560c148 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1471 microversion: 2.1 time: 0.553124 Sep 19 14:51:19.215708 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1304/2595] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:18 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:19.241626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:19.242323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:19.251292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.252061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.252784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.253954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.254620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.265425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.318695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:19.320411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:19.337760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.338275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.338718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.346301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.347087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.347792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.489183 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c905d28e-9c27-417c-9ca5-fbdbb27196c1 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "POST /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.253345 Sep 19 14:51:19.491469 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1292/2596] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:51:19 2022] POST /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:51:19.503152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:19.504250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:19.514359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.516243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.516729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.517734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.518338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.520292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.704875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:19.713574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-37fcb73a-ac42-4c28-a58c-a039b38a54c8 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.403301 Sep 19 14:51:19.715009 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1305/2597] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:19 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:19.729554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:19.730837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:19.741515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.742259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.742932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.743911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:19.744583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:19.745564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:19.818462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:19.833952 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c98060e4-863c-4d27-915b-7f6a3e17eb29 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 0.338057 Sep 19 14:51:19.835100 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1293/2598] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:19 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:20.037018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:20.057600 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fdc3f52c-093f-4600-8335-882b18f5dc60 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.339272 Sep 19 14:51:20.058505 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1306/2599] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:19 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:20.213413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:20.214445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:20.226369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:20.227154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:20.227806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:20.228734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:20.231899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:20.232330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:20.600089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:20.617153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3675fa7-8200-4c35-80a8-d033e8677169 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1516 microversion: 2.1 time: 0.406396 Sep 19 14:51:20.621681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1294/2600] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:20 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:20.742833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:20.743453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:20.754211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:20.756740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:20.757291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:20.758049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:20.761863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:20.762518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:20.857770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:20.864104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:20.892863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:20.893373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:20.899302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:20.900139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:20.900616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:20.901246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:21.262850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:21.273226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:21.279098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8013b05c-fe87-42dc-95ba-7ac071ba4957 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 0.425232 Sep 19 14:51:21.281136 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1295/2601] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:20 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:21.284958 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d17b3ef9-318a-4a90-85ce-6c626828f36d tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 0.548169 Sep 19 14:51:21.286546 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1307/2602] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:20 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:21.301571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:21.302498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:21.307138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b6ce8be3-dd5f-4e00-9598-8caa3bdd6be1 req-620b51ce-f9c0-466d-b6ff-beaa229d13b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7439dbfa-e2a7-43f2-baa1-034e60b035b7", "name": "network-vif-plugged", "status": "completed", "tag": "2da9c6aa-4872-4d7e-b1a1-77958d346853"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:21.319354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:21.320241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:21.320878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:21.321711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:21.322424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:21.323050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:21.332773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b6ce8be3-dd5f-4e00-9598-8caa3bdd6be1 req-620b51ce-f9c0-466d-b6ff-beaa229d13b6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:21.333478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b6ce8be3-dd5f-4e00-9598-8caa3bdd6be1 req-620b51ce-f9c0-466d-b6ff-beaa229d13b6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:21.334095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b6ce8be3-dd5f-4e00-9598-8caa3bdd6be1 req-620b51ce-f9c0-466d-b6ff-beaa229d13b6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:21.360475 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b6ce8be3-dd5f-4e00-9598-8caa3bdd6be1 req-620b51ce-f9c0-466d-b6ff-beaa229d13b6 service nova] Creating event network-vif-plugged:2da9c6aa-4872-4d7e-b1a1-77958d346853 for instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 on n-h1-858384-1 Sep 19 14:51:21.374067 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b6ce8be3-dd5f-4e00-9598-8caa3bdd6be1 req-620b51ce-f9c0-466d-b6ff-beaa229d13b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091255 Sep 19 14:51:21.375286 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1296/2603] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:21.598373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:21.609967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a1e77bdb-bce9-4e7e-8796-47887cb53418 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.322052 Sep 19 14:51:21.610960 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1308/2604] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:21 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:21.647096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:21.648353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:21.656200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:21.657826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:21.658486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:21.659461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:21.660142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:21.660808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:21.678554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.843537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:21.854451 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a474b4d-ec37-40a2-afb4-bf0df9a22cdd tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 0.212446 Sep 19 14:51:21.859322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1297/2605] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:21 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:22.313720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:22.315617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:22.316203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:22.318333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:22.329995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:22.330688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:22.331278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:22.332116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:22.332937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:22.336328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:22.370880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:22.379009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:22.380301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:22.381686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:22.382423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:22.383145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:23.311016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:23.344895 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d40e7da4-faad-4d9d-9373-5d4bac7bcb33 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 1.043013 Sep 19 14:51:23.359254 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1309/2606] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:22 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:23.372595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:23.373708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:23.430336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:23.431327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:23.432605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:23.433615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:23.436725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:23.437037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:24.015585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:24.030865 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c0d5380-7025-42a4-badf-6a3b6c96b827 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1308 microversion: 2.1 time: 1.719462 Sep 19 14:51:24.049688 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1298/2607] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:22 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1308 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:24.059323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:24.060678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:24.090610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:24.095458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:24.096165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:24.097996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:24.099349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:24.101652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:24.601261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:24.615060 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-19ed2135-e771-4ba9-9379-61fd02dc1d5b tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 1.253623 Sep 19 14:51:24.621151 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1310/2608] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:23 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:24.631327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "name": "network-vif-plugged", "status": "completed", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:24.652030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:24.653625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:24.654397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:24.676987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:24.695792 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] Creating event network-vif-plugged:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h2-858384-1 Sep 19 14:51:24.696734 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5bece16f-cd09-4446-b6d7-4316a354849c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 0.644058 Sep 19 14:51:24.707174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] Instance a86e8432-55c5-4300-b805-81f0cba98dfb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:51:24.719871 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1299/2609] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:24 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:24.727659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:24.731241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:24.742322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:24.745229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:24.747246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:24.748456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e6df4e66-c6b8-465c-9d04-8a700e526d47 req-85112395-9e7a-477d-9b73-84c2dd902929 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125296 Sep 19 14:51:24.750468 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1311/2610] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:24.759135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:24.759858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:24.760332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:25.059921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:25.060804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:25.071588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:25.077136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:25.077934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:25.079025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:25.079616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:25.084529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:25.662523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:25.676350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a6ded444-25a2-49ca-b7ae-06dcf0dfd610 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 0.955006 Sep 19 14:51:25.679378 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1300/2611] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:24 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:25.705247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:25.706394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:25.717107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.731153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:25.732367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:25.732978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:25.734480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:25.736292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:25.737058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:25.741941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:25.756052 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7e3726c4-9a8d-49c1-9d71-77b71f0d3590 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1489 microversion: 2.1 time: 0.700533 Sep 19 14:51:25.760210 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1312/2612] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:25 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1489 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:25.772689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:25.774398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:25.796646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:25.797615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:25.798286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:25.800546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:25.802381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:25.804884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:26.272043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:26.282719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2859460-27a6-49ae-8169-49cc134fe33a tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.582181 Sep 19 14:51:26.283637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1301/2613] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:25 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:26.305369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-301228690"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:26.308273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:26.315567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:26.316356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:26.316948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:26.317850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:26.318465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:26.319102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:26.319878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:26.333390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-279e2eb3-0f29-4822-8373-ca91da039739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 0.571056 Sep 19 14:51:26.335077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1313/2614] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:25 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:26.684250 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8a87d351-fe04-46e2-9904-9bc68ec24378 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "POST /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7/action" status: 202 len: 0 microversion: 2.1 time: 0.399110 Sep 19 14:51:26.693177 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1302/2615] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:51:26 2022] POST /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 14:51:26.699847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e4abdfae-6489-4f40-b014-d0ccade9fc98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a00e700>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:26.740650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:26.741380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:26.767156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:26.767742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:26.768206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:26.769011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:26.769484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:26.774489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:26.807316 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e4abdfae-6489-4f40-b014-d0ccade9fc98 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0" status: 200 len: 1413 microversion: 2.1 time: 0.112528 Sep 19 14:51:26.807928 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1314/2616] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:51:26 2022] GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:26.831499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-359e57c6-3817-4c0c-a80e-875f506a1169 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a087b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:26.949298 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-359e57c6-3817-4c0c-a80e-875f506a1169 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0" status: 200 len: 1413 microversion: 2.1 time: 0.127620 Sep 19 14:51:26.959615 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1315/2617] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:51:26 2022] GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:26.965203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6452af88-5107-45b2-af78-4ef0400a639f req-ee548b84-d2d5-4ad2-b26b-f3d8120da440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78a464e-7f62-4a1b-9923-ac635f8f7a90", "name": "network-vif-unplugged", "status": "completed", "tag": "dc2083b3-7903-46a2-b405-8611008a4154"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:26.996309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6452af88-5107-45b2-af78-4ef0400a639f req-ee548b84-d2d5-4ad2-b26b-f3d8120da440 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:26.997057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6452af88-5107-45b2-af78-4ef0400a639f req-ee548b84-d2d5-4ad2-b26b-f3d8120da440 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:26.997676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6452af88-5107-45b2-af78-4ef0400a639f req-ee548b84-d2d5-4ad2-b26b-f3d8120da440 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:27.027717 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6452af88-5107-45b2-af78-4ef0400a639f req-ee548b84-d2d5-4ad2-b26b-f3d8120da440 service nova] Creating event network-vif-unplugged:dc2083b3-7903-46a2-b405-8611008a4154 for instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 on n-h1-858384-1 Sep 19 14:51:27.042936 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6452af88-5107-45b2-af78-4ef0400a639f req-ee548b84-d2d5-4ad2-b26b-f3d8120da440 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078974 Sep 19 14:51:27.044520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1316/2618] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:27.060535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d4cf04aa-e61b-43d8-bb77-17a4efddaf4b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2a00e4c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:27.336331 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d4cf04aa-e61b-43d8-bb77-17a4efddaf4b tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0" status: 204 len: 0 microversion: 2.1 time: 0.289034 Sep 19 14:51:27.336959 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1317/2619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:27 2022] DELETE /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:27.345638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "name": "network-vif-unplugged", "status": "completed", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:27.378394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:27.380078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:27.380756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:27.413615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] Creating event network-vif-unplugged:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h1-858384-1 Sep 19 14:51:27.427634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] Instance a86e8432-55c5-4300-b805-81f0cba98dfb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:51:27.440878 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-de619ff3-7ef9-4459-84a6-be02a991fe70 req-b0212b9b-7b61-4f73-a358-3720cc40fb65 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102198 Sep 19 14:51:27.442016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1318/2620] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:27.447662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:27.448715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:27.456229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:27.457007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:27.457637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:27.458599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:27.459247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:27.459842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:28.255780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:28.273702 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48a6b0fc-5a5e-49d0-be29-b35a756cd25d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 1.561494 Sep 19 14:51:28.277523 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1303/2621] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:26 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:28.284262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37f0dba2-b54b-4952-a89c-83a1fb59fcea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde292aa160>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:28.314473 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-37f0dba2-b54b-4952-a89c-83a1fb59fcea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Image not found. Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37f0dba2-b54b-4952-a89c-83a1fb59fcea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 HTTP/1.1 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9cd56adb-c352-4ba4-a8b7-13e4ff306eb0'} Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 19 14:51:28.318513 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 could not be found. Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:51:28.327356 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:28.333918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:28.338427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.339121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37f0dba2-b54b-4952-a89c-83a1fb59fcea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:28.340770 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37f0dba2-b54b-4952-a89c-83a1fb59fcea tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0" status: 404 len: 62 microversion: 2.1 time: 0.061656 Sep 19 14:51:28.341908 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1304/2622] 10.222.0.81 () {58 vars in 1233 bytes} [Mon Sep 19 14:51:28 2022] GET /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:51:28.349193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:28.350040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:28.360197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:28.361647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:28.362833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:28.363823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:28.364603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:28.365281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:28.369668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0433e35-cf50-41c0-a74b-ab28b9381283 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 0.919881 Sep 19 14:51:28.372426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1319/2623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:27 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:28.391418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:28.393007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:28.422866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:28.424198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:28.427766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:28.431736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:28.433461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:28.434033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:29.032558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:29.050734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5cc1df13-b9d3-495d-be19-4f8b9b3d0131 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1507 microversion: 2.1 time: 0.677785 Sep 19 14:51:29.062784 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1320/2624] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:28 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1507 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:29.160077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9fac2254-83af-40d3-9e80-4d5f3eb47a0a req-8fa70652-cf5c-40e8-8dfd-2bc9c8934e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d2ebb3-f952-4730-b8ec-946a1bd54be9", "name": "network-vif-plugged", "status": "completed", "tag": "15f6af30-d79a-4b16-a1c8-f13a63b51e6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:29.188314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fac2254-83af-40d3-9e80-4d5f3eb47a0a req-8fa70652-cf5c-40e8-8dfd-2bc9c8934e66 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:29.188803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fac2254-83af-40d3-9e80-4d5f3eb47a0a req-8fa70652-cf5c-40e8-8dfd-2bc9c8934e66 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:29.189246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fac2254-83af-40d3-9e80-4d5f3eb47a0a req-8fa70652-cf5c-40e8-8dfd-2bc9c8934e66 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:29.227222 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9fac2254-83af-40d3-9e80-4d5f3eb47a0a req-8fa70652-cf5c-40e8-8dfd-2bc9c8934e66 service nova] Creating event network-vif-plugged:15f6af30-d79a-4b16-a1c8-f13a63b51e6d for instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 on n-h2-858384-1 Sep 19 14:51:29.245228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9fac2254-83af-40d3-9e80-4d5f3eb47a0a req-8fa70652-cf5c-40e8-8dfd-2bc9c8934e66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090629 Sep 19 14:51:29.249280 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1321/2625] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:29.305358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:29.307324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:29.322427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:29.323599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:29.324701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:29.325909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:29.328219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:29.329326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:29.588948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:29.607029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01dec428-b979-4aea-9480-bad594a76ae2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 1.258556 Sep 19 14:51:29.611461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1305/2626] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:28 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:29.618667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:29.623650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:29.656300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:29.664869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:29.665609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:29.668145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:29.669301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:29.671494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:30.227195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:30.237034 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0ec2e89-b17e-42d4-a07d-2ed0863f512c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 0.938888 Sep 19 14:51:30.245945 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1322/2627] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:29 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:30.258659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:30.274093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:30.274582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:30.283303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:30.319843 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] Creating event network-changed:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h1-858384-1 Sep 19 14:51:30.335536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] Instance a86e8432-55c5-4300-b805-81f0cba98dfb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 14:51:30.380190 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-41e8d9f0-ba76-481e-a22d-fd76f7d07732 req-b54c38c1-1220-44a2-b17d-cef2f6ef07f3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131577 Sep 19 14:51:30.393539 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1323/2628] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:30.429017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:30.431061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:30.450143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:30.455310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:30.456062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:30.457076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:30.457787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:30.458556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:30.632117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:30.649333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1eaa46de-2fd4-416b-b7a0-5752d3a8dbb6 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1323 microversion: 2.1 time: 1.036586 Sep 19 14:51:30.666571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1306/2629] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:29 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1323 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:30.694857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:30.695836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:30.704569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:30.705467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:30.706139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:30.709649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:30.710570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:30.711323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:31.318658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:31.347623 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-838f4b1f-b813-4c87-ba5d-0d05765b226d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 0.679674 Sep 19 14:51:31.349842 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1307/2630] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:30 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:31.377487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:31.384727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:31.421653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:31.422510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:31.422717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:31.423507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:31.423964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:31.424394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:31.461715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:31.471105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56c45996-5886-4c0c-a1d0-65e5a1a5749f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1489 microversion: 2.1 time: 1.075557 Sep 19 14:51:31.480267 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1324/2631] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:30 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1489 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:31.490629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9595c846-2b6b-4f83-a276-74aeaebe063d req-4c6b59b2-87aa-4c47-b31e-ef0cfd50d229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78a464e-7f62-4a1b-9923-ac635f8f7a90", "name": "network-vif-plugged", "status": "completed", "tag": "dc2083b3-7903-46a2-b405-8611008a4154"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:31.543047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9595c846-2b6b-4f83-a276-74aeaebe063d req-4c6b59b2-87aa-4c47-b31e-ef0cfd50d229 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:31.544216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9595c846-2b6b-4f83-a276-74aeaebe063d req-4c6b59b2-87aa-4c47-b31e-ef0cfd50d229 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:31.544818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9595c846-2b6b-4f83-a276-74aeaebe063d req-4c6b59b2-87aa-4c47-b31e-ef0cfd50d229 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:31.573410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9595c846-2b6b-4f83-a276-74aeaebe063d req-4c6b59b2-87aa-4c47-b31e-ef0cfd50d229 service nova] Creating event network-vif-plugged:dc2083b3-7903-46a2-b405-8611008a4154 for instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 on n-h1-858384-1 Sep 19 14:51:31.584660 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9595c846-2b6b-4f83-a276-74aeaebe063d req-4c6b59b2-87aa-4c47-b31e-ef0cfd50d229 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102615 Sep 19 14:51:31.586066 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1325/2632] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:31.603142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:31.606313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:31.647995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:31.648145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:31.648501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:31.649422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:31.649873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:31.650511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:31.752952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:32.087876 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4725bfb6-46b3-474e-aaf4-23c938e60c89 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 204 len: 0 microversion: 2.1 time: 0.497139 Sep 19 14:51:32.092021 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1326/2633] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:31 2022] DELETE /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:32.123298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:32.130383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:32.156837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:32.159264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:32.175515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:32.176815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:32.177944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:32.178697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:32.179422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:32.834069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:32.870590 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7e62d550-c5e0-400a-ac2f-7e4ad476ef41 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 1.514269 Sep 19 14:51:32.892173 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1308/2634] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:31 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:32.931631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85bc0435-c07a-4b5e-a9b9-b3a1c88c7911 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde2926b4c0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.001811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:33.008240 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-85bc0435-c07a-4b5e-a9b9-b3a1c88c7911 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Image not found. Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85bc0435-c07a-4b5e-a9b9-b3a1c88c7911 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 HTTP/1.1 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9cd56adb-c352-4ba4-a8b7-13e4ff306eb0'} Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 to delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 could not be found. Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.010318 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:51:33.015148 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.016808 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-533fef61-3f83-48c5-bd13-5669cca9f824 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1519 microversion: 2.1 time: 0.916273 Sep 19 14:51:33.016808 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1327/2635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:32 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1519 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:33.018721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85bc0435-c07a-4b5e-a9b9-b3a1c88c7911 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:33.019787 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-85bc0435-c07a-4b5e-a9b9-b3a1c88c7911 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0" status: 404 len: 62 microversion: 2.1 time: 0.126337 Sep 19 14:51:33.031053 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1309/2636] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:32 2022] DELETE /compute/v2.1/images/9cd56adb-c352-4ba4-a8b7-13e4ff306eb0 => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:51:33.056461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.059716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:33.069477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.070244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.070868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.071788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.072248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.072679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.386253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6f3cb0e-0f3c-4d9d-a63c-caaa5e765651 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Action: 'create', calling method: .version_select at 0x7fde292938b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:33.497869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f6f3cb0e-0f3c-4d9d-a63c-caaa5e765651 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Getting quotas for project e5c731c68308499c9bc1d3dd1840cc30. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:51:33.526485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f6f3cb0e-0f3c-4d9d-a63c-caaa5e765651 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Getting quotas for user f80b157302a740e98eb2f2a7ae4f2e3e and project e5c731c68308499c9bc1d3dd1840cc30. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:51:33.643864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f6f3cb0e-0f3c-4d9d-a63c-caaa5e765651 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Getting quotas for project e5c731c68308499c9bc1d3dd1840cc30. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:51:33.655443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f6f3cb0e-0f3c-4d9d-a63c-caaa5e765651 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Getting quotas for user f80b157302a740e98eb2f2a7ae4f2e3e and project e5c731c68308499c9bc1d3dd1840cc30. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:51:33.681456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6f3cb0e-0f3c-4d9d-a63c-caaa5e765651 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.649041 Sep 19 14:51:33.683018 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1310/2637] 10.222.0.81 () {62 vars in 1214 bytes} [Mon Sep 19 14:51:33 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:33.693021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.694107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:33.706188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.707061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.708708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.709960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.710608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.711387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.731961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:33.745811 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c478a950-6c3b-48c3-9b04-c9d784ff03ed tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 0.701775 Sep 19 14:51:33.746412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1328/2638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:33 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:33.756993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32f65fc9-08ad-4945-8d3f-4abb8ff517b7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1373051338", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:33.774364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32f65fc9-08ad-4945-8d3f-4abb8ff517b7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 243 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1373051338", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1373051338', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '92f9fd13-f239-4a35-8368-72647fe18630'}]}}} Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:33.776642 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32f65fc9-08ad-4945-8d3f-4abb8ff517b7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32f65fc9-08ad-4945-8d3f-4abb8ff517b7 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.029624 Sep 19 14:51:33.781855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1329/2639] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:33 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:51:33.799213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b1dd774-c596-472f-9431-6b41fc6c1fad tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.837021 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b1dd774-c596-472f-9431-6b41fc6c1fad tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.050557 Sep 19 14:51:33.843645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1330/2640] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 14:51:33 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:33.854005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c84ed68-3e42-4648-b8e1-ee620d020fb1 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.854522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0c84ed68-3e42-4648-b8e1-ee620d020fb1 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 98413b81-5e38-4dbc-ba04-ca6580e7a38c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:33.861100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Instance is already in deleting state, ignoring this request Sep 19 14:51:33.861968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a9b7bef3-d2ad-4297-89ed-0bd6ffc2039e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 204 len: 0 microversion: 2.1 time: 0.177550 Sep 19 14:51:33.862650 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1311/2641] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:33 2022] DELETE /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:33.867160 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0c84ed68-3e42-4648-b8e1-ee620d020fb1 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] HTTP exception thrown: Instance 98413b81-5e38-4dbc-ba04-ca6580e7a38c could not be found. Sep 19 14:51:33.872816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b0bd52e-e538-4706-9947-1ef49455d11c tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c84ed68-3e42-4648-b8e1-ee620d020fb1 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/98413b81-5e38-4dbc-ba04-ca6580e7a38c/metadata HTTP/1.1 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 98413b81-5e38-4dbc-ba04-ca6580e7a38c could not be found. Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '98413b81-5e38-4dbc-ba04-ca6580e7a38c'} Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98413b81-5e38-4dbc-ba04-ca6580e7a38c could not be found. Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98413b81-5e38-4dbc-ba04-ca6580e7a38c could not be found. Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:33.877133 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98413b81-5e38-4dbc-ba04-ca6580e7a38c could not be found. Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c84ed68-3e42-4648-b8e1-ee620d020fb1 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 404 to user: Instance 98413b81-5e38-4dbc-ba04-ca6580e7a38c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c84ed68-3e42-4648-b8e1-ee620d020fb1 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/98413b81-5e38-4dbc-ba04-ca6580e7a38c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.034116 Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1331/2642] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:51:33 2022] GET /compute/v2.1/servers/98413b81-5e38-4dbc-ba04-ca6580e7a38c/metadata => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.893500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:33.907433 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1b0bd52e-e538-4706-9947-1ef49455d11c tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df" status: 200 len: 235 microversion: 2.64 time: 0.039014 Sep 19 14:51:33.908250 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1312/2643] 10.222.0.81 () {60 vars in 1304 bytes} [Mon Sep 19 14:51:33 2022] GET /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df => generated 235 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:33.908621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.909135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.909579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.910308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.914724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.915302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.924115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:33.924834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:33.934564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.935168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.936616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:33.936887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:33.937351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:33.937779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:34.316693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:34.334058 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-327d63c0-e9d3-4f28-85cd-310dd5210ecb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1495 microversion: 2.1 time: 0.453571 Sep 19 14:51:34.337173 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1332/2644] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:33 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1495 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:34.345615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:34.357871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-941f24c1-5bec-496e-85b2-96f0126bba03 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:34.360346 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b32816d-4f63-4504-b0d0-7a8580ffb401 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1470 microversion: 2.1 time: 0.450705 Sep 19 14:51:34.360944 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1313/2645] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:33 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:34.366676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3ddbf63-2667-4f2d-8269-bf1dde8b2eb2 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1599849039", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3ddbf63-2667-4f2d-8269-bf1dde8b2eb2 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 499 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1599849039", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1599849039', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '92f9fd13-f239-4a35-8368-72647fe18630'}]}}} Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:51:34.375711 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.379493 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.387654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3ddbf63-2667-4f2d-8269-bf1dde8b2eb2 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:34.396423 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3ddbf63-2667-4f2d-8269-bf1dde8b2eb2 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.034232 Sep 19 14:51:34.397208 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1314/2646] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:34 2022] POST /compute/v2.1/servers => generated 687 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:51:34.429022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-941f24c1-5bec-496e-85b2-96f0126bba03 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df" status: 204 len: 0 microversion: 2.64 time: 0.087976 Sep 19 14:51:34.430371 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1333/2647] 10.222.0.81 () {60 vars in 1307 bytes} [Mon Sep 19 14:51:34 2022] DELETE /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:51:34.440388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bada8ef0-fff4-4466-a42d-094b9daf1503 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:34.452580 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-bada8ef0-fff4-4466-a42d-094b9daf1503 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] HTTP exception thrown: Instance group 0fb54436-b9cf-445b-a05a-b886433431df could not be found. Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bada8ef0-fff4-4466-a42d-094b9daf1503 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Request method failure captured: Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df HTTP/1.1 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIH0wB4sAaEMs8xCR0NqtUPCWqClNWP0qMN3l4XP554G6thVmrx0qnqkL9y3Hncj3FF7lBgP2kXe48q1f40fNkLFDM3CX1PsPJ8ZEP456mubgYCW3GgAQMCT6uQCxOcuK5vw-QuoyzVgwF3HxsOeCU6AbvMLyNT-95NArnsyPbl0Tcg Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.64 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e5c731c68308499c9bc1d3dd1840cc30 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerGroup264TestJSON-803289790 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e5c731c68308499c9bc1d3dd1840cc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e5c731c68308499c9bc1d3dd1840cc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e5c731c68308499c9bc1d3dd1840cc30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e5c731c68308499c9bc1d3dd1840cc30"}]}] Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerGroup264TestJSON-803289790 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e5c731c68308499c9bc1d3dd1840cc30 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerGroup264TestJSON-803289790 Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerGroup264TestJSON-803289790-project Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f80b157302a740e98eb2f2a7ae4f2e3e Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerGroup264TestJSON-803289790-project Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance group 0fb54436-b9cf-445b-a05a-b886433431df could not be found. Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '0fb54436-b9cf-445b-a05a-b886433431df'} Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0fb54436-b9cf-445b-a05a-b886433431df could not be found. Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0fb54436-b9cf-445b-a05a-b886433431df could not be found. Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.461914 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.467011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.467011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.467011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:34.467011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:34.467011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0fb54436-b9cf-445b-a05a-b886433431df could not be found. Sep 19 14:51:34.467011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.469367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bada8ef0-fff4-4466-a42d-094b9daf1503 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] Returning 404 to user: Instance group 0fb54436-b9cf-445b-a05a-b886433431df could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:34.470429 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bada8ef0-fff4-4466-a42d-094b9daf1503 tempest-ServerGroup264TestJSON-803289790 tempest-ServerGroup264TestJSON-803289790-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df" status: 404 len: 117 microversion: 2.64 time: 0.035051 Sep 19 14:51:34.471529 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1315/2648] 10.222.0.81 () {60 vars in 1307 bytes} [Mon Sep 19 14:51:34 2022] DELETE /compute/v2.1/os-server-groups/0fb54436-b9cf-445b-a05a-b886433431df => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:51:34.493391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393c1e54-c82d-4b9c-8ace-c1bf04ed7de9 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1870935615", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393c1e54-c82d-4b9c-8ace-c1bf04ed7de9 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 500 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1870935615", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1870935615', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '92f9fd13-f239-4a35-8368-72647fe18630'}]}}} Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:51:34.497886 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.501382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-393c1e54-c82d-4b9c-8ace-c1bf04ed7de9 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:34.503805 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-393c1e54-c82d-4b9c-8ace-c1bf04ed7de9 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.014173 Sep 19 14:51:34.508018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1334/2649] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:34 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:51:34.561110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9967d5bb-18c0-4e4f-893a-33b3830d1449 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1157109545", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9967d5bb-18c0-4e4f-893a-33b3830d1449 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 754 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1157109545", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1157109545', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '92f9fd13-f239-4a35-8368-72647fe18630'}]}}} Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:51:34.567563 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:51:34.570260 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:51:34.573959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.573959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.580208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9967d5bb-18c0-4e4f-893a-33b3830d1449 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:34.582355 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9967d5bb-18c0-4e4f-893a-33b3830d1449 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024645 Sep 19 14:51:34.585241 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1316/2650] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:34 2022] POST /compute/v2.1/servers => generated 1197 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 19 14:51:34.675022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e40da60-900a-46fe-8f31-62d6b4123693 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434519992", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e40da60-900a-46fe-8f31-62d6b4123693 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 1265 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434519992", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "92f9fd13-f239-4a35-8368-72647fe18630"}]}} Sep 19 14:51:34.679161 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-434519992', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '92f9fd13-f239-4a35-8368-72647fe18630'}]}}} Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.681380 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:51:34.684084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:51:34.687603 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 19 14:51:34.687603 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.687603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e40da60-900a-46fe-8f31-62d6b4123693 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:34.687603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e40da60-900a-46fe-8f31-62d6b4123693 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012147 Sep 19 14:51:34.688608 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1335/2651] 10.222.0.81 () {60 vars in 1148 bytes} [Mon Sep 19 14:51:34 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 19 14:51:34.693310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b56a902d-c45e-4b9a-86ee-79e4424f561c tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:34.693879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b56a902d-c45e-4b9a-86ee-79e4424f561c tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 339eaf24-9059-4052-858d-0d1fbe89f6f7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:34.701028 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b56a902d-c45e-4b9a-86ee-79e4424f561c tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] HTTP exception thrown: Instance 339eaf24-9059-4052-858d-0d1fbe89f6f7 could not be found. Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b56a902d-c45e-4b9a-86ee-79e4424f561c tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/339eaf24-9059-4052-858d-0d1fbe89f6f7/metadata/test2 HTTP/1.1 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 339eaf24-9059-4052-858d-0d1fbe89f6f7 could not be found. Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': '339eaf24-9059-4052-858d-0d1fbe89f6f7', 'id': 'test2'} Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339eaf24-9059-4052-858d-0d1fbe89f6f7 could not be found. Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339eaf24-9059-4052-858d-0d1fbe89f6f7 could not be found. Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:34.703559 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339eaf24-9059-4052-858d-0d1fbe89f6f7 could not be found. Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b56a902d-c45e-4b9a-86ee-79e4424f561c tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 404 to user: Instance 339eaf24-9059-4052-858d-0d1fbe89f6f7 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b56a902d-c45e-4b9a-86ee-79e4424f561c tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/339eaf24-9059-4052-858d-0d1fbe89f6f7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.017089 Sep 19 14:51:34.707892 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1317/2652] 10.222.0.81 () {58 vars in 1281 bytes} [Mon Sep 19 14:51:34 2022] GET /compute/v2.1/servers/339eaf24-9059-4052-858d-0d1fbe89f6f7/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:34.721122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:34.721630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:34.735641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:34.736140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:34.736581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:34.737313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:34.737770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:34.738195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:34.776160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:34.777581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:34.793539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:34.794858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:34.799507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:34.800036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:34.801141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:34.801888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:34.803289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:34.941944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b290358-9b38-49ac-8976-1373c7a0d6c8 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "DELETE /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 204 len: 0 microversion: 2.1 time: 0.225460 Sep 19 14:51:34.943158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1336/2653] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:34 2022] DELETE /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:34.955259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:34.956208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:34.964140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:34.964665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:34.965818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:34.966803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:34.968188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:34.969459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:35.494903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:35.537025 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a1a2259-a10e-4d47-991c-b66c101878ec tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1525 microversion: 2.1 time: 0.588534 Sep 19 14:51:35.554815 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1337/2654] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:34 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1525 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:35.572568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:35.573935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:35.585920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:35.586345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:35.587297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:35.587755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:35.588280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:35.588605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:35.808804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:35.831060 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d174f079-9584-4208-8c81-31edae4a3cf2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1522 microversion: 2.1 time: 1.057316 Sep 19 14:51:35.835764 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1318/2655] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:34 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1522 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:35.853454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:35.854760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:35.877889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:35.878390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:35.885597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:35.886532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:35.887054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:35.887494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:35.941592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:36.467847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:36.477538 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aad3efdd-8ad2-49fe-80ee-1fd26d9ffc49 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1495 microversion: 2.1 time: 0.921453 Sep 19 14:51:36.481107 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1338/2656] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:35 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1495 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:36.505108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6f546806-db5e-4979-95f1-9d8c4f41a464 req-64705319-43b8-4f30-8527-2a903a3c66d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7439dbfa-e2a7-43f2-baa1-034e60b035b7", "name": "network-vif-plugged", "status": "completed", "tag": "2da9c6aa-4872-4d7e-b1a1-77958d346853"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:36.518093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6f546806-db5e-4979-95f1-9d8c4f41a464 req-64705319-43b8-4f30-8527-2a903a3c66d0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:36.518927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6f546806-db5e-4979-95f1-9d8c4f41a464 req-64705319-43b8-4f30-8527-2a903a3c66d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:36.523097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6f546806-db5e-4979-95f1-9d8c4f41a464 req-64705319-43b8-4f30-8527-2a903a3c66d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:36.545898 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6f546806-db5e-4979-95f1-9d8c4f41a464 req-64705319-43b8-4f30-8527-2a903a3c66d0 service nova] Creating event network-vif-plugged:2da9c6aa-4872-4d7e-b1a1-77958d346853 for instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 on n-h1-858384-1 Sep 19 14:51:36.552770 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6f546806-db5e-4979-95f1-9d8c4f41a464 req-64705319-43b8-4f30-8527-2a903a3c66d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051557 Sep 19 14:51:36.553908 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1339/2657] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:36.567019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:36.568354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:36.577688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:36.578865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:36.579568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:36.580900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:36.581550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:36.582185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:36.910252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:36.920874 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-628d0432-eec8-4112-892f-f11a69d57a11 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1463 microversion: 2.1 time: 1.080376 Sep 19 14:51:36.921718 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1319/2658] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:35 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1463 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:36.952925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:36.953875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:36.957219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:36.968720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:36.969380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:36.972663 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76d6e852-4cb7-4062-81cd-bfafb5506d5d tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1525 microversion: 2.1 time: 0.411370 Sep 19 14:51:36.973195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:36.973347 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1340/2659] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:36 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1525 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:36.984839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:36.985621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:36.990818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.210534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:37.210807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:37.223848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.224352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.224798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.230621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.231416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.235444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.282315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:37.362316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:37.384973 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c443a33-694d-4d79-a9e4-0d15b92bcbe5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1507 microversion: 2.1 time: 0.442355 Sep 19 14:51:37.397682 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1320/2660] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:36 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:37.425145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:37.425771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:37.433012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.440743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.441736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.442710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.443520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.444306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.798308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:37.815297 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5dae61d9-fdb6-4345-98d9-22c054c2477f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 200 len: 1507 microversion: 2.1 time: 0.390347 Sep 19 14:51:37.817533 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1321/2661] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:37 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:37.835774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:37.837812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:37.843684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-932e0cd1-ab53-4078-9f8a-bbbb7209bb64 tempest-MigrationsAdminTest-1132181864 tempest-MigrationsAdminTest-1132181864-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1614 microversion: 2.1 time: 0.866809 Sep 19 14:51:37.844828 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1341/2662] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:36 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1614 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:37.849427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.850327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.851042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.851967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.852742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.853532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.854826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3a83b1ee-a560-4124-ab43-e8daeb95fb1a req-e0103ae6-fe16-4496-a24a-2b26371d75de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7439dbfa-e2a7-43f2-baa1-034e60b035b7", "name": "network-vif-deleted", "tag": "2da9c6aa-4872-4d7e-b1a1-77958d346853"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:37.899189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3a83b1ee-a560-4124-ab43-e8daeb95fb1a req-e0103ae6-fe16-4496-a24a-2b26371d75de service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.906086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.906910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3a83b1ee-a560-4124-ab43-e8daeb95fb1a req-e0103ae6-fe16-4496-a24a-2b26371d75de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.907581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3a83b1ee-a560-4124-ab43-e8daeb95fb1a req-e0103ae6-fe16-4496-a24a-2b26371d75de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.908638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.911367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.913875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lazy-loading 'fault' on Instance uuid 7439dbfa-e2a7-43f2-baa1-034e60b035b7 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:37.928470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3a83b1ee-a560-4124-ab43-e8daeb95fb1a req-e0103ae6-fe16-4496-a24a-2b26371d75de service nova] Creating event network-vif-deleted:2da9c6aa-4872-4d7e-b1a1-77958d346853 for instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 on n-h1-858384-1 Sep 19 14:51:37.935570 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3a83b1ee-a560-4124-ab43-e8daeb95fb1a req-e0103ae6-fe16-4496-a24a-2b26371d75de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084606 Sep 19 14:51:37.938853 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1342/2663] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:37.948857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:37.949753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:37.959081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.959917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.960603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:37.970883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:37.972219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:37.972845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.011747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:38.018226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:38.025620 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6cfadf17-99e0-47b7-9902-c4d3150cce0f tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1298 microversion: 2.1 time: 0.205911 Sep 19 14:51:38.026907 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1322/2664] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:37 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:38.032796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:38.033564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:38.053868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.066581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.067434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.068431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.069769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.070419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.118438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:38.271640 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d883a28-dab4-48c5-a598-ef6bbf6b94c7 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 204 len: 0 microversion: 2.1 time: 0.330756 Sep 19 14:51:38.274645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1343/2665] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:37 2022] DELETE /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:38.294865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:38.296335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:38.320808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.323720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.327451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.330403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.332923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.333474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.346188 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3e6283d-0dba-40ad-befc-555d88c544e6 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 204 len: 0 microversion: 2.1 time: 0.317494 Sep 19 14:51:38.346895 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1323/2666] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:38 2022] DELETE /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:38.376263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:38.378499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:38.403432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.408207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.412384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.413355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.414176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.419779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.522928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:38.539405 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ed8e149-55c4-4e49-82de-b852cedf4e5e tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1483 microversion: 2.1 time: 0.263556 Sep 19 14:51:38.540105 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1344/2667] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:38 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1483 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:38.569518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1073158922", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "dbfeb181-3743-4fc4-84f2-01b4c28ac8b3"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:38.685321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] validate_networks() for [('dbfeb181-3743-4fc4-84f2-01b4c28ac8b3', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:51:38.732362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:38.747647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-63e67f3a-fe84-416d-bd66-c802d802da8c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1469 microversion: 2.1 time: 0.394896 Sep 19 14:51:38.749213 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1324/2668] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:38 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:39.051826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:39.053140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:39.059926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.061465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.062068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.063009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.063629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.064249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.110701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.112756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.113198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.114011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lazy-loading 'fault' on Instance uuid 7439dbfa-e2a7-43f2-baa1-034e60b035b7 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:39.311498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:39.325962 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba6ba8cc-9966-429e-a740-ef91d516d22e tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1298 microversion: 2.1 time: 0.276125 Sep 19 14:51:39.332041 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1325/2669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:39 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1298 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:39.341113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-068baf8c-9ead-4d56-8994-2749711443f5 req-df97857a-1576-43c3-b024-d1c0c1727720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d2ebb3-f952-4730-b8ec-946a1bd54be9", "name": "network-vif-deleted", "tag": "15f6af30-d79a-4b16-a1c8-f13a63b51e6d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:39.355629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-068baf8c-9ead-4d56-8994-2749711443f5 req-df97857a-1576-43c3-b024-d1c0c1727720 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.356132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-068baf8c-9ead-4d56-8994-2749711443f5 req-df97857a-1576-43c3-b024-d1c0c1727720 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.356574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-068baf8c-9ead-4d56-8994-2749711443f5 req-df97857a-1576-43c3-b024-d1c0c1727720 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.377498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-068baf8c-9ead-4d56-8994-2749711443f5 req-df97857a-1576-43c3-b024-d1c0c1727720 service nova] Creating event network-vif-deleted:15f6af30-d79a-4b16-a1c8-f13a63b51e6d for instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 on n-h2-858384-1 Sep 19 14:51:39.406009 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-068baf8c-9ead-4d56-8994-2749711443f5 req-df97857a-1576-43c3-b024-d1c0c1727720 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068819 Sep 19 14:51:39.407250 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1326/2670] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:39.570190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:39.572170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:39.584321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.586184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.588810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.591594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.592741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.593464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.649339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:39.651858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:39.652690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:39.653423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lazy-loading 'fault' on Instance uuid 01d2ebb3-f952-4730-b8ec-946a1bd54be9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:39.987080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604ca7ed8dd7491fb44f75ffe905478a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2183c652081d42bda062953f266f52c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:40.004487 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aecef684-12c9-481c-8a20-8fa404efdc04 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 200 len: 1313 microversion: 2.1 time: 0.441587 Sep 19 14:51:40.019788 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1327/2671] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:39 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:40.019788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:40.019788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:40.024576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.025086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.025527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.026513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.028481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.028956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.119371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:51:40.120598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:51:40.121322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:51:40.121983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:51:40.122738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:51:40.136833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.137872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.139111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.140176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.141026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.142124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.169609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Getting quotas for project 1515789b03a84eef85950bd0724ae183. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:51:40.176363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Getting quotas for user 7d9aaa40522843a6970973bca5afc70e and project 1515789b03a84eef85950bd0724ae183. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:51:40.190914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:51:40.193633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:51:40.249992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2521223f-5a76-463c-957c-a0032b16d923 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689872 Sep 19 14:51:40.251602 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1345/2672] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:51:40.280474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7d025cb-c438-4f96-ac5d-d96965d50739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:40.281584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7d025cb-c438-4f96-ac5d-d96965d50739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:40.298650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:40.308988 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1b69a9ee-eb27-450f-b195-28b09cd1b59f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1469 microversion: 2.1 time: 0.301090 Sep 19 14:51:40.312844 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1328/2673] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:40 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:40.355434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:40.356510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:40.367810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.368879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.369588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.370807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.372006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.372255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7d025cb-c438-4f96-ac5d-d96965d50739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:40.373688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.381331 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7d025cb-c438-4f96-ac5d-d96965d50739 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1218 microversion: 2.1 time: 0.111927 Sep 19 14:51:40.383193 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1346/2674] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:40 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:40.424501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:40.425143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:40.425985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:40.426636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lazy-loading 'fault' on Instance uuid 7439dbfa-e2a7-43f2-baa1-034e60b035b7 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:40.503449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a10b494b4876896c5300aa676b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc1cd2ca2f1477e9ff02f91a17b8609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:40.525486 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3bb3137-cbb9-4ff5-82dc-22a6a29e0beb tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 200 len: 1298 microversion: 2.1 time: 0.172346 Sep 19 14:51:40.526897 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1329/2675] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:40 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:40.639255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-187073828", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "1a0de976-beb9-486c-9d16-71a1c943e067"}, {"uuid": "c0987607-b849-4751-92b2-9bd78e81004d"}, {"uuid": "1a0de976-beb9-486c-9d16-71a1c943e067"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:40.807633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] validate_networks() for [('1a0de976-beb9-486c-9d16-71a1c943e067', None, None, None, None, None), ('c0987607-b849-4751-92b2-9bd78e81004d', None, None, None, None, None), ('1a0de976-beb9-486c-9d16-71a1c943e067', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:51:41.033084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:41.033715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] [instance: 01d2ebb3-f952-4730-b8ec-946a1bd54be9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:41.052208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:41.052208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:41.052208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:41.052923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:41.053392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:41.053828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:41.104630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] HTTP exception thrown: Instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 could not be found. Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Request method failure captured: Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 HTTP/1.1 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIHa4sz2xicQf6akdx9NmS_nQ49YOTF_G0BZHfvhhJJkHhKZzHw12D4JJCCJev51p9VDd9rLWStMNOWMlbd-4Za14aIO1tY71myIUEgxgGi45UuVunKSUNea3MBMfzYctNQ10SKs4voarTJt1NIPzG3vg30jpsAV1C5ww-ETCutyWXA Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2183c652081d42bda062953f266f52c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2183c652081d42bda062953f266f52c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2183c652081d42bda062953f266f52c0"}]}] Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 2183c652081d42bda062953f266f52c0 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1056877142 Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 604ca7ed8dd7491fb44f75ffe905478a Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1056877142-project Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 could not be found. Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '01d2ebb3-f952-4730-b8ec-946a1bd54be9'} Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 could not be found. Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 could not be found. Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:41.107119 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 could not be found. Sep 19 14:51:41.113732 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:41.114542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] Returning 404 to user: Instance 01d2ebb3-f952-4730-b8ec-946a1bd54be9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:41.115682 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5ed0634-d3e3-4acf-8137-af8ba1f4e937 tempest-ServerMetadataNegativeTestJSON-1056877142 tempest-ServerMetadataNegativeTestJSON-1056877142-project] 10.222.0.81 "GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9" status: 404 len: 111 microversion: 2.1 time: 0.087050 Sep 19 14:51:41.119350 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1330/2676] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:41 2022] GET /compute/v2.1/servers/01d2ebb3-f952-4730-b8ec-946a1bd54be9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:41.337833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:41.339279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:41.364602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:41.367486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:41.368352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:41.369357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:41.376533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:41.378491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:42.526257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:42.537322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be84470c-66f6-4ae2-9b81-6f990fa2adae tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1469 microversion: 2.1 time: 1.203596 Sep 19 14:51:42.542038 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1331/2677] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:41 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1469 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:42.550222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:42.558126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:42.569037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:42.569551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:42.570002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:42.570834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:42.571431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:42.571872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:42.850578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:42.874223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49aece72-4507-4432-997f-449eeee9e78d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1276 microversion: 2.1 time: 0.330741 Sep 19 14:51:42.876150 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1332/2678] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:42 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:42.884827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:42.885766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 7439dbfa-e2a7-43f2-baa1-034e60b035b7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:42.900428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:42.901894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:42.902372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:42.908385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:42.909088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:42.909669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:42.930645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 could not be found. Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 HTTP/1.1 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 could not be found. Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7439dbfa-e2a7-43f2-baa1-034e60b035b7'} Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 could not be found. Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 could not be found. Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:42.933023 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:42.938450 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:42.938450 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:42.938450 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:42.938450 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:42.938450 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 could not be found. Sep 19 14:51:42.938450 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:42.941038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance 7439dbfa-e2a7-43f2-baa1-034e60b035b7 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:42.943069 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d556c0f3-b0c5-49f8-b8a2-f2900da732cc tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7" status: 404 len: 111 microversion: 2.1 time: 0.064817 Sep 19 14:51:42.952659 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1333/2679] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:42 2022] GET /compute/v2.1/servers/7439dbfa-e2a7-43f2-baa1-034e60b035b7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:42.969684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be520ccd-e124-4bcb-9cca-0d812a806da9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29268790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:43.012939 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-be520ccd-e124-4bcb-9cca-0d812a806da9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Image not found. Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be520ccd-e124-4bcb-9cca-0d812a806da9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 HTTP/1.1 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '23398b0f-6fa0-4813-be30-ae68543a7b23'} Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 23398b0f-6fa0-4813-be30-ae68543a7b23 to delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23398b0f-6fa0-4813-be30-ae68543a7b23 could not be found. Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.015327 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be520ccd-e124-4bcb-9cca-0d812a806da9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be520ccd-e124-4bcb-9cca-0d812a806da9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23" status: 404 len: 62 microversion: 2.1 time: 0.060122 Sep 19 14:51:43.020900 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1334/2680] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:42 2022] DELETE /compute/v2.1/images/23398b0f-6fa0-4813-be30-ae68543a7b23 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 19 14:51:43.026118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:43.026615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:43.072142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.072670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.073108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.073927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.075344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.075968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.112570 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de HTTP/1.1 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dc21d495-0399-4b56-9b4b-410e915192de'} Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:43.114163 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.118606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:43.125025 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5049a32a-6168-43f3-af5f-69d5361548f3 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 404 len: 111 microversion: 2.1 time: 0.103306 Sep 19 14:51:43.129020 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1335/2681] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:43 2022] DELETE /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:43.138639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-baf5ab5d-85cf-4138-bc4e-669f44488168 req-077a56f3-bcbe-44ed-a547-1f35ba9544c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78a464e-7f62-4a1b-9923-ac635f8f7a90", "name": "network-vif-deleted", "tag": "dc2083b3-7903-46a2-b405-8611008a4154"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:43.165323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:43.168960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-baf5ab5d-85cf-4138-bc4e-669f44488168 req-077a56f3-bcbe-44ed-a547-1f35ba9544c8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.170874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-baf5ab5d-85cf-4138-bc4e-669f44488168 req-077a56f3-bcbe-44ed-a547-1f35ba9544c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.176737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-baf5ab5d-85cf-4138-bc4e-669f44488168 req-077a56f3-bcbe-44ed-a547-1f35ba9544c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.206154 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-baf5ab5d-85cf-4138-bc4e-669f44488168 req-077a56f3-bcbe-44ed-a547-1f35ba9544c8 service nova] Creating event network-vif-deleted:dc2083b3-7903-46a2-b405-8611008a4154 for instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 on n-h1-858384-1 Sep 19 14:51:43.212442 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-baf5ab5d-85cf-4138-bc4e-669f44488168 req-077a56f3-bcbe-44ed-a547-1f35ba9544c8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081851 Sep 19 14:51:43.216561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1336/2682] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:43.226932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:43.227635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: dc21d495-0399-4b56-9b4b-410e915192de] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:43.255417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.255840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.256276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.257172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.257806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.258391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.288620 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de HTTP/1.1 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dc21d495-0399-4b56-9b4b-410e915192de'} Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.295276 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.300569 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.300569 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.300569 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:43.300569 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:43.300569 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. Sep 19 14:51:43.300569 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.305452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance dc21d495-0399-4b56-9b4b-410e915192de could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:43.306569 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a9fcd7cd-204f-416a-91e6-c703cc351926 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de" status: 404 len: 111 microversion: 2.1 time: 0.088328 Sep 19 14:51:43.307314 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1337/2683] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:43 2022] GET /compute/v2.1/servers/dc21d495-0399-4b56-9b4b-410e915192de => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:43.325346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:43.337200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:43.342365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Searching by: {'deleted': False, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:51:43.356801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.359808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.367687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.375925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.376780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.377457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.433112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:43.443333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:51:43.510149 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-876ce588-e760-4f40-a9a3-64103926eddb tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.201597 Sep 19 14:51:43.511140 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1338/2684] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:51:43 2022] GET /compute/v2.1/servers => generated 340 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:43.521388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c7e7519-a435-4271-a80d-dadd1bd1006c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde29259700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:43.562473 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9c7e7519-a435-4271-a80d-dadd1bd1006c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Image not found. Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c7e7519-a435-4271-a80d-dadd1bd1006c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb HTTP/1.1 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'b92ef571-e3b6-464c-978b-4c26e049e8cb'} Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b92ef571-e3b6-464c-978b-4c26e049e8cb to delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b92ef571-e3b6-464c-978b-4c26e049e8cb could not be found. Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.565565 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:51:43.569578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:43.572780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c7e7519-a435-4271-a80d-dadd1bd1006c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:43.573907 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c7e7519-a435-4271-a80d-dadd1bd1006c tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb" status: 404 len: 62 microversion: 2.1 time: 0.061760 Sep 19 14:51:43.581678 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1339/2685] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:43 2022] DELETE /compute/v2.1/images/b92ef571-e3b6-464c-978b-4c26e049e8cb => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:51:43.586915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:43.597270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:43.598533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Searching by: {'deleted': False, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:51:43.606789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.607968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.608792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.609785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.610500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.611182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:43.730152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:43.735468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:51:43.900455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:43.911621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:43.912310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:43.915656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.391346 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-38618029-ccd7-4da8-b0d2-1aec93a67f4b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.808161 Sep 19 14:51:44.392282 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1340/2686] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:51:43 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:44.397513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:44.398360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:44.417245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.418526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.419495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.420973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.424602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.425414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.515448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.516010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.516447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.516935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lazy-loading 'fault' on Instance uuid a86e8432-55c5-4300-b805-81f0cba98dfb {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:44.708819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:44.722945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab1cc42d-be7a-4886-be81-7df39fd27759 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 200 len: 1303 microversion: 2.1 time: 0.329445 Sep 19 14:51:44.724331 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1341/2687] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:44 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 1303 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:44.732097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:44.733378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:44.755442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.756225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.757720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.761157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.762371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.767295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.807182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 HTTP/1.1 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4625dcde-6307-4376-ad72-5ce73c514464'} Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:44.809068 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:44.814121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:44.815213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:44.815954 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-336626fa-cc6a-4864-a094-bb9610ed3d37 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 404 len: 111 microversion: 2.1 time: 0.089469 Sep 19 14:51:44.819854 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1342/2688] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:44 2022] DELETE /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:44.827391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:44.828433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:44.844954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.845996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.846557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:44.847962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:44.848465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:44.849960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.119885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:45.136830 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a4cae980-80a0-49bf-a1f3-a9a60330e8ef tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1276 microversion: 2.1 time: 0.317797 Sep 19 14:51:45.143939 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1343/2689] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:44 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:45.153030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-077cdc56-bb1b-440d-8e2f-961a6a023892 req-13238014-2084-4f6f-880f-8311d856d0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86e8432-55c5-4300-b805-81f0cba98dfb", "name": "network-vif-deleted", "tag": "be3635f1-e65c-4df6-94e8-7b79cccc5b3a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:45.176838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-077cdc56-bb1b-440d-8e2f-961a6a023892 req-13238014-2084-4f6f-880f-8311d856d0e9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.177939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-077cdc56-bb1b-440d-8e2f-961a6a023892 req-13238014-2084-4f6f-880f-8311d856d0e9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.178388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-077cdc56-bb1b-440d-8e2f-961a6a023892 req-13238014-2084-4f6f-880f-8311d856d0e9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.210696 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-077cdc56-bb1b-440d-8e2f-961a6a023892 req-13238014-2084-4f6f-880f-8311d856d0e9 service nova] Creating event network-vif-deleted:be3635f1-e65c-4df6-94e8-7b79cccc5b3a for instance a86e8432-55c5-4300-b805-81f0cba98dfb on n-h1-858384-1 Sep 19 14:51:45.217982 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-077cdc56-bb1b-440d-8e2f-961a6a023892 req-13238014-2084-4f6f-880f-8311d856d0e9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068602 Sep 19 14:51:45.219295 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1344/2690] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:45.227304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d5071c8-7b87-452d-a812-3e03321e51c7 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.245628 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d5071c8-7b87-452d-a812-3e03321e51c7 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016558 Sep 19 14:51:45.255586 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1345/2691] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:51:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:45.272871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.273632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: 4625dcde-6307-4376-ad72-5ce73c514464] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:45.302655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.303192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.303638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.304354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.304812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.305236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.328863 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 HTTP/1.1 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4625dcde-6307-4376-ad72-5ce73c514464'} Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.334731 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance 4625dcde-6307-4376-ad72-5ce73c514464 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-755dbe1a-d4ed-43bf-b213-940ccb1b0fd4 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464" status: 404 len: 111 microversion: 2.1 time: 0.075379 Sep 19 14:51:45.340561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1346/2692] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:45 2022] GET /compute/v2.1/servers/4625dcde-6307-4376-ad72-5ce73c514464 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:45.346143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c2a0c20-dd34-488b-a723-ea6ed2a493b9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '.version_select at 0x7fde298a4b80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.370782 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-0c2a0c20-dd34-488b-a723-ea6ed2a493b9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Image not found. Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c2a0c20-dd34-488b-a723-ea6ed2a493b9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 HTTP/1.1 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '8fe1e30c-56e2-4aad-99ea-25d67d120748'} Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8fe1e30c-56e2-4aad-99ea-25d67d120748 to delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fe1e30c-56e2-4aad-99ea-25d67d120748 could not be found. Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.372676 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:51:45.378864 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.384824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c2a0c20-dd34-488b-a723-ea6ed2a493b9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:45.384824 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c2a0c20-dd34-488b-a723-ea6ed2a493b9 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748" status: 404 len: 62 microversion: 2.1 time: 0.043223 Sep 19 14:51:45.394478 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1347/2693] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:45 2022] DELETE /compute/v2.1/images/8fe1e30c-56e2-4aad-99ea-25d67d120748 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:51:45.400649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.401177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:45.418326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.419469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.420498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.421550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.422037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.422461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.469860 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa HTTP/1.1 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'be5b0455-403e-47af-a5a7-63e230f449fa'} Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:45.475446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.480386 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.491204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:45.492492 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-929b4c92-2ca4-4048-958c-4f7b23578062 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "DELETE /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 404 len: 111 microversion: 2.1 time: 0.096802 Sep 19 14:51:45.499370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1348/2694] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:45 2022] DELETE /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:45.504546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.505409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] [instance: be5b0455-403e-47af-a5a7-63e230f449fa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:45.524873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.526314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.527817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.528721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.534188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.534674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.565526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] HTTP exception thrown: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Request method failure captured: Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa HTTP/1.1 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIDpn5G60Bgjmf9WgMaTHtzPj3jsQEuCrYVMILYnlQ6MqDE9YLIEehLE2q7Vrb9VR9blaRBr-tQA-CUGWu0K0ZqXFtz1qqkkMBWcuggESwYHY-HzvxQjX2yKQ2lBvvS9PQ8vIAd5ZHNiY9u0t_xTjT16D29w0c5P1WwlLsoRLfmpY9o Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cdc1cd2ca2f1477e9ff02f91a17b8609"}]}] Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cdc1cd2ca2f1477e9ff02f91a17b8609 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesTestJSON-2015675172 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b469a10b494b4876896c5300aa676b46 Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesTestJSON-2015675172-project Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'be5b0455-403e-47af-a5a7-63e230f449fa'} Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.567166 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] Returning 404 to user: Instance be5b0455-403e-47af-a5a7-63e230f449fa could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a91b9fd8-3057-4eed-a8be-f056f217d811 tempest-ImagesTestJSON-2015675172 tempest-ImagesTestJSON-2015675172-project] 10.222.0.81 "GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa" status: 404 len: 111 microversion: 2.1 time: 0.067905 Sep 19 14:51:45.571654 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1349/2695] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:45 2022] GET /compute/v2.1/servers/be5b0455-403e-47af-a5a7-63e230f449fa => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:45.608614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.610234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:45.636679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.640352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.642220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.644198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.646568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.654157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.723487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:45.747441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:51:45.748596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:51:45.749098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:51:45.749517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:51:45.750094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:51:45.775313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.777617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.779726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.781743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.782273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.786505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.861920 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa3fc422-f064-4743-a088-6a83c1b2b413 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 204 len: 0 microversion: 2.1 time: 0.260026 Sep 19 14:51:45.863733 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1350/2696] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:45 2022] DELETE /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:45.870288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Getting quotas for project 330cbd8155454fa38afb8a95b0e4fd9f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:51:45.883310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:45.887086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Getting quotas for user f857828528b349c684b49b9d756d3868 and project 330cbd8155454fa38afb8a95b0e4fd9f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:51:45.887389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: a86e8432-55c5-4300-b805-81f0cba98dfb] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:45.911164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.913713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:51:45.914290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.915694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.916541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:45.917217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:51:45.922681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:45.924228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:45.956856 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] HTTP exception thrown: Instance a86e8432-55c5-4300-b805-81f0cba98dfb could not be found. Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Request method failure captured: Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb HTTP/1.1 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKICY_clGVW5C8ktUYPrC2cGwi-Hl4s1sGHlv6oW6jfGFHnfTng85OuGSeX7lbfM8Nng4t9O4chUw2Z6G7ZB2mFmVajS3PjphNPFRSNiKfE6kb9fjorvVnegAB6oWlg9gpAp03wSd63ooFP0xTqAU-0FzyGwhFXGiZ1EVc31bg6CMiOg Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/17ce8e19a9bb47f5bdf0d02866b6180d"}]}] Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MigrationsAdminTest-787798632 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MigrationsAdminTest-787798632-project Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: e2149c78b4d04c10b02d521a5635b29f Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MigrationsAdminTest-787798632-project Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance a86e8432-55c5-4300-b805-81f0cba98dfb could not be found. Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'a86e8432-55c5-4300-b805-81f0cba98dfb'} Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86e8432-55c5-4300-b805-81f0cba98dfb could not be found. Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86e8432-55c5-4300-b805-81f0cba98dfb could not be found. Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:45.961432 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86e8432-55c5-4300-b805-81f0cba98dfb could not be found. Sep 19 14:51:45.966079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:45.969443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Returning 404 to user: Instance a86e8432-55c5-4300-b805-81f0cba98dfb could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:45.970705 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48af2e6c-ec60-4d54-9235-6d9a06a26d60 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb" status: 404 len: 111 microversion: 2.1 time: 0.104992 Sep 19 14:51:45.976223 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1351/2697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:45 2022] GET /compute/v2.1/servers/a86e8432-55c5-4300-b805-81f0cba98dfb => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:45.987174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:46.000016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:46.017017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.019363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.020143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.022225 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7bf38122-b6dc-44ce-bf43-f788eadd64b5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.406500 Sep 19 14:51:46.023028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.024421 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1347/2698] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:51:46.025152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.025720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.041021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:46.043934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:46.062596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.063548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.064155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.067872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.068676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.069286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.125238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:46.362379 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9936c0a2-e3e4-41e0-8f80-bd3752da37d3 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 204 len: 0 microversion: 2.1 time: 0.334050 Sep 19 14:51:46.367268 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1348/2699] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:46 2022] DELETE /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:46.379484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25cd4e35-05b3-4043-88ac-44bc499ce40b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:46.380678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25cd4e35-05b3-4043-88ac-44bc499ce40b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:46.523184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25cd4e35-05b3-4043-88ac-44bc499ce40b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:46.534129 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25cd4e35-05b3-4043-88ac-44bc499ce40b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1212 microversion: 2.1 time: 0.165231 Sep 19 14:51:46.551073 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1349/2700] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:46 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:46.577598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:46.583141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:46.610457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.611320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.612021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.613398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.614031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.619105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.656504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:46.679090 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bffa79ba-4fac-4aa0-8158-5d48224d927b tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1714 microversion: 2.1 time: 0.700055 Sep 19 14:51:46.691043 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1352/2701] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:45 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1714 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:46.694895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:46.695516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:46.724142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.726916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.727532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:46.728286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:46.733088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:46.733563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:47.281440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:47.304812 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b378a49-b65f-47ed-8357-73c27e103e25 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1533 microversion: 2.1 time: 0.623138 Sep 19 14:51:47.341031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:47.342797 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1353/2702] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:46 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1533 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:47.361311 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-81a5e863-bbe9-4b28-b0b6-5749986f39c6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.804454 Sep 19 14:51:47.365313 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1350/2703] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:46 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:47.558402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:47.559193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:47.579980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:47.584671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:47.585140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:47.594157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:47.594710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:47.595190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:47.714742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:47.729297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:47.737716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:47.746543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:47.748920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:47.752146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:47.753133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:47.757061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:47.938389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:47.948094 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a0a2cfa6-aefb-439b-82e5-ce3324530024 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1216 microversion: 2.1 time: 0.393815 Sep 19 14:51:47.950144 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1354/2704] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:47 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1216 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:48.214410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:48.227004 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d17a07c2-c1f4-4a50-9f55-1ea12eae03d5 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1714 microversion: 2.1 time: 0.516101 Sep 19 14:51:48.227649 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1351/2705] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:47 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1714 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:48.367130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:48.379400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:48.391041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:48.392436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:48.398476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:48.413798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:48.414543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:48.415174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:48.425726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:48.426388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:48.426864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:48.443848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:48.444473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:48.447212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:48.448000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:48.458649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:48.464474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:49.127399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:49.148521 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bdd8f2de-83cc-4a15-9ddf-e47a46847dc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.752913 Sep 19 14:51:49.149843 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1352/2706] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:48 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:49.156273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:49.162291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:49.172094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:49.173029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:49.173890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:49.175022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:49.175750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:49.176414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:49.326504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:49.328417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:49.342125 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7fa2aad7-f190-498c-9ba9-16a568a3a784 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1533 microversion: 2.1 time: 0.997052 Sep 19 14:51:49.343634 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1355/2707] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:48 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1533 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:49.346140 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d775aec2-cef3-4d3f-b29c-675bf21b07a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1270 microversion: 2.1 time: 0.191703 Sep 19 14:51:49.349990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:49.351164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:49.359957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:49.361101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:49.361803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:49.362417 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1353/2708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:49 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:49.363078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:49.363774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:49.364442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:49.775768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:49.789954 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd5715cf-87f8-4872-ab1f-d70b723a4111 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1714 microversion: 2.1 time: 0.444615 Sep 19 14:51:49.790548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1356/2709] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:49 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1714 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:50.183671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:50.184946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:50.199579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:50.203896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:50.204631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:50.206234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:50.209413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:50.210078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:50.371457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:50.372469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:50.380236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:50.380738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:50.381175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:50.381889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:50.393624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:50.394592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:50.671696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:50.715526 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-316c2daf-085f-469c-9ca3-75a32d23ce58 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.533174 Sep 19 14:51:50.720483 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1354/2710] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:50 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:50.726146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:50.727191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:50.750604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:50.752144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:50.755906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:50.757086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:50.758430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:50.761402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:50.908674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:50.919648 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-15a26269-79dc-4a5c-8464-d1116a0c061b tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1533 microversion: 2.1 time: 0.551969 Sep 19 14:51:50.920270 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1357/2711] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:50 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1533 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:50.946372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8ab8363f-cea0-4a29-8141-ce4aad52822e req-823bbb1a-e329-4c80-bd69-5d5e0afe1078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1a54a-99bb-46aa-a947-6e5bf160596e", "name": "network-vif-deleted", "tag": "de4fc87e-e7d4-4522-9af9-593805cd7e30"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:51.024351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ab8363f-cea0-4a29-8141-ce4aad52822e req-823bbb1a-e329-4c80-bd69-5d5e0afe1078 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.029985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ab8363f-cea0-4a29-8141-ce4aad52822e req-823bbb1a-e329-4c80-bd69-5d5e0afe1078 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.031934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ab8363f-cea0-4a29-8141-ce4aad52822e req-823bbb1a-e329-4c80-bd69-5d5e0afe1078 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.088258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8ab8363f-cea0-4a29-8141-ce4aad52822e req-823bbb1a-e329-4c80-bd69-5d5e0afe1078 service nova] Creating event network-vif-deleted:de4fc87e-e7d4-4522-9af9-593805cd7e30 for instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e on n-h2-858384-1 Sep 19 14:51:51.124837 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8ab8363f-cea0-4a29-8141-ce4aad52822e req-823bbb1a-e329-4c80-bd69-5d5e0afe1078 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198448 Sep 19 14:51:51.138724 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1358/2712] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:51.171244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:51.172005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:51.179679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.180129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.181448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.182719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.183391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.184019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.248285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:51.312347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.314900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.318949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.319459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lazy-loading 'fault' on Instance uuid 5bf1a54a-99bb-46aa-a947-6e5bf160596e {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:51.333585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:51.358318 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7bd69f52-6c30-4d75-b260-b1bc315d6799 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1270 microversion: 2.1 time: 0.634104 Sep 19 14:51:51.360929 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1355/2713] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:50 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1270 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:51.542037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b132a77c82443c9024def6f7037268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec08eab4f38a4b7584c58dc3882d0f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:51.558419 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62488eb2-2a5a-4fa9-9c62-8324b02dcbb9 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 200 len: 1368 microversion: 2.1 time: 0.417838 Sep 19 14:51:51.566125 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1359/2714] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:51 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:51.744620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:51.747109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:51.775188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.779471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.780668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.781631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.784098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.787419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.955236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:51.956379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:51.975868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.976645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.979300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:51.981568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:51.983232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:51.986691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:52.181123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:52.198001 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dceec9ee-f54e-4c84-820c-b2fcbe724425 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1491 microversion: 2.1 time: 0.249566 Sep 19 14:51:52.198863 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1360/2715] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:51 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1491 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:52.304397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:52.317752 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d4369ee-80d5-40c4-b332-ec735c70058c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.577761 Sep 19 14:51:52.319179 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1356/2716] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:51 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:52.387059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:52.387863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:52.412752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:52.421915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:52.422492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:52.425546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:52.426058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:52.430905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:52.588378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:52.590246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] [instance: 5bf1a54a-99bb-46aa-a947-6e5bf160596e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:52.602153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:52.606672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:52.608047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:52.619423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:52.624277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:52.625287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:52.662119 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] HTTP exception thrown: Instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e could not be found. Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Request method failure captured: Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e HTTP/1.1 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIG0imphGVPjfMzSoTYftAeZQeTnPjuxB4MXDzd7oBQ4ce4_ZYfDKpd3_jmwkuIpat_fsr55L9GJBmtvr2N_UcfmbXJkDGpHN0ftozbJl4zQypkoR9gz13xURKp7gKxLsCk8cH733hK8lsxGSXYsIngaqGc9pEqSkNaxUiTM4cnjr98 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: ec08eab4f38a4b7584c58dc3882d0f9c Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestManualDisk-1172660197 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec08eab4f38a4b7584c58dc3882d0f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec08eab4f38a4b7584c58dc3882d0f9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec08eab4f38a4b7584c58dc3882d0f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec08eab4f38a4b7584c58dc3882d0f9c"}]}] Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestManualDisk-1172660197 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: ec08eab4f38a4b7584c58dc3882d0f9c Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestManualDisk-1172660197 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestManualDisk-1172660197-project Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 66b132a77c82443c9024def6f7037268 Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestManualDisk-1172660197-project Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e could not be found. Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '5bf1a54a-99bb-46aa-a947-6e5bf160596e'} Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e could not be found. Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e could not be found. Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:52.669684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e could not be found. Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:51:52.675192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Returning 404 to user: Instance 5bf1a54a-99bb-46aa-a947-6e5bf160596e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:52.677637 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad9f4b9c-106e-41dc-bdb2-258a7724ce5e tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e" status: 404 len: 111 microversion: 2.1 time: 0.099397 Sep 19 14:51:52.681467 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1357/2717] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:52 2022] GET /compute/v2.1/servers/5bf1a54a-99bb-46aa-a947-6e5bf160596e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:52.687304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-162bb06f-7f40-403c-a666-2f9b1e522321 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] Calling method '.version_select at 0x7fde2e1d35e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:52.735347 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-162bb06f-7f40-403c-a666-2f9b1e522321 tempest-ServersTestManualDisk-1172660197 tempest-ServersTestManualDisk-1172660197-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059838054" status: 202 len: 0 microversion: 2.1 time: 0.052443 Sep 19 14:51:52.736464 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1358/2718] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059838054 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:51:52.940130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-facc06d7-acea-474c-8240-eccd066af200 req-153776d7-96fe-4fe2-8d8b-2faee102c75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb9718d-4011-4760-ae1d-90ce1ec53158", "name": "network-vif-deleted", "tag": "8c233232-c61c-406e-b95f-b4a77b3dcc0d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:52.979499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-facc06d7-acea-474c-8240-eccd066af200 req-153776d7-96fe-4fe2-8d8b-2faee102c75b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:52.980267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-facc06d7-acea-474c-8240-eccd066af200 req-153776d7-96fe-4fe2-8d8b-2faee102c75b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:52.981619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-facc06d7-acea-474c-8240-eccd066af200 req-153776d7-96fe-4fe2-8d8b-2faee102c75b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:53.018937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-facc06d7-acea-474c-8240-eccd066af200 req-153776d7-96fe-4fe2-8d8b-2faee102c75b service nova] Creating event network-vif-deleted:8c233232-c61c-406e-b95f-b4a77b3dcc0d for instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 on n-h1-858384-1 Sep 19 14:51:53.035958 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-facc06d7-acea-474c-8240-eccd066af200 req-153776d7-96fe-4fe2-8d8b-2faee102c75b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098291 Sep 19 14:51:53.037401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1359/2719] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:53.226020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:53.226845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:53.245638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:53.246987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:53.250360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:53.252533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:53.253134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:53.255773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:53.377736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:53.378870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:53.382959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:53.383843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lazy-loading 'fault' on Instance uuid 7eb9718d-4011-4760-ae1d-90ce1ec53158 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:51:53.657988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:53.664610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:53.665712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:53.688566 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94b6e7db-cafb-49e7-b990-f49ac8969e96 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 200 len: 1369 microversion: 2.1 time: 0.466626 Sep 19 14:51:53.706735 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1360/2720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:53 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 1369 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:53.730060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:53.735208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:53.745410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:53.757223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e559ebe5-7883-412a-af3b-35fc754ae603 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1333 microversion: 2.1 time: 1.375484 Sep 19 14:51:53.760028 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1361/2721] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:52 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1333 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:53.760946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:53.764237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:53.765803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:53.770295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:53.770981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:53.771675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:54.449502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:54.458907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d83beac-72d6-47d3-b4a1-cda644a11b16 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.749763 Sep 19 14:51:54.463123 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1361/2722] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:53 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:54.717116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:54.718381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 7eb9718d-4011-4760-ae1d-90ce1ec53158] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:54.727659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:54.734562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:54.737959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:54.738652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:54.739584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:54.744902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:54.745623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:54.774652 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] HTTP exception thrown: Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 could not be found. Sep 19 14:51:54.781335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:54.782589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:54.798229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Request method failure captured: Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 HTTP/1.1 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKICY_clGVW5C8ktUYPrC2cGwi-Hl4s1sGHlv6oW6jfGFHnfTng85OuGSeX7lbfM8Nng4t9O4chUw2Z6G7ZB2mFmVajS3PjphNPFRSNiKfE6kb9fjorvVnegAB6oWlg9gpAp03wSd63ooFP0xTqAU-0FzyGwhFXGiZ1EVc31bg6CMiOg Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/17ce8e19a9bb47f5bdf0d02866b6180d"}]}] Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MigrationsAdminTest-787798632 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MigrationsAdminTest-787798632-project Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: e2149c78b4d04c10b02d521a5635b29f Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MigrationsAdminTest-787798632-project Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 could not be found. Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7eb9718d-4011-4760-ae1d-90ce1ec53158'} Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 could not be found. Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 could not be found. Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:51:54.799539 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 could not be found. Sep 19 14:51:54.803715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:51:54.805756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:54.806781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Returning 404 to user: Instance 7eb9718d-4011-4760-ae1d-90ce1ec53158 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:51:54.807532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:54.808520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:54.809772 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8e721c5-9488-48b4-8781-85d55036678f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158" status: 404 len: 111 microversion: 2.1 time: 0.097458 Sep 19 14:51:54.811144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:54.812560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:54.815523 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1362/2723] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:54 2022] GET /compute/v2.1/servers/7eb9718d-4011-4760-ae1d-90ce1ec53158 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:51:54.834172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e58d4383-7cae-4cc2-bc30-d84980fbc98a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '.version_select at 0x7fde291281f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:54.905370 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e58d4383-7cae-4cc2-bc30-d84980fbc98a tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525947213" status: 202 len: 0 microversion: 2.1 time: 0.088228 Sep 19 14:51:54.910099 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1363/2724] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525947213 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:51:55.468458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:55.477083 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9db605fe-8e2a-43ec-9f8e-4514335fefb1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1333 microversion: 2.1 time: 0.700181 Sep 19 14:51:55.479134 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1362/2725] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:54 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1333 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:55.491355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:55.492656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:55.504488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:55.507783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:55.509703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:55.510684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:55.513678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:55.515365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:55.857626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6188fa6b-6296-4dad-a88a-72b6b07815de req-cf2dce4e-f53c-46e9-8ce6-cb5b15c38d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b37c941-abc2-43d2-939f-dfe8bb75987d", "tag": "50ff1028-55f6-47b7-afd5-df974bea7f6a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:55.879444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.884214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6188fa6b-6296-4dad-a88a-72b6b07815de req-cf2dce4e-f53c-46e9-8ce6-cb5b15c38d10 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:55.884965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6188fa6b-6296-4dad-a88a-72b6b07815de req-cf2dce4e-f53c-46e9-8ce6-cb5b15c38d10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:55.889364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6188fa6b-6296-4dad-a88a-72b6b07815de req-cf2dce4e-f53c-46e9-8ce6-cb5b15c38d10 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:55.919921 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6188fa6b-6296-4dad-a88a-72b6b07815de req-cf2dce4e-f53c-46e9-8ce6-cb5b15c38d10 service nova] Creating event network-changed:50ff1028-55f6-47b7-afd5-df974bea7f6a for instance 1b37c941-abc2-43d2-939f-dfe8bb75987d on n-h2-858384-1 Sep 19 14:51:55.929772 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6188fa6b-6296-4dad-a88a-72b6b07815de req-cf2dce4e-f53c-46e9-8ce6-cb5b15c38d10 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078115 Sep 19 14:51:55.932277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1363/2726] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:51:56.480719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:56.497597 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1b4bbed-2d26-4b76-83c7-9baba8410ee2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 1.009959 Sep 19 14:51:56.511073 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1364/2727] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:55 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:56.527239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:56.529637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:56.542325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=16 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:56.550000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:56.551706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:56.554646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:56.556031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:56.557469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:56.559265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:57.183143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:57.193884 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f7edbb9-0d8a-4920-9849-08ff9c7103ec tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.680102 Sep 19 14:51:57.194489 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1364/2728] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:56 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:51:57.528322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:57.529952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:57.545945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:57.546700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:57.548015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:57.554266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:57.556038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:57.556651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:58.230921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:58.233907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:58.275094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:58.277575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:58.278095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:58.283106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:58.284953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:58.286482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:58.635114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:58.686785 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c54c3ec9-6b15-4ff0-9372-a5a5ad2b16c2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 1.164236 Sep 19 14:51:58.705327 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1365/2729] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:57 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:58.869462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:58.872015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:58.895131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:58.900751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:58.901851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:58.904145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:58.908491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:58.909582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:58.994009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:51:59.030128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:59.040355 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c25b2713-45a1-41ee-b408-fcd4b47a075c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.815892 Sep 19 14:51:59.043037 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1365/2730] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:58 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:59.191426 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b3739e36-ca92-4a46-975b-31509d3496c5 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "DELETE /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 204 len: 0 microversion: 2.1 time: 0.329884 Sep 19 14:51:59.195417 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1366/2731] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:51:58 2022] DELETE /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:51:59.203299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:59.204105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:59.217978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:59.218508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:59.219627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:59.221160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:59.221693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:59.223039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:59.717846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:51:59.718972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:51:59.727939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:59.728457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:59.729784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:59.730592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:59.731178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:59.732356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:59.815152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:51:59.826470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6abcf792-2edc-40c0-af1a-2f750c97b195 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1467 microversion: 2.1 time: 0.628705 Sep 19 14:51:59.835716 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1366/2732] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:59 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1467 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:51:59.921724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8dcbf969-7184-4c4f-b714-357658e1fa5f req-e1db147b-0e90-4a04-a035-4254136a6432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "tag": "7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:51:59.971294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8dcbf969-7184-4c4f-b714-357658e1fa5f req-e1db147b-0e90-4a04-a035-4254136a6432 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:59.977560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8dcbf969-7184-4c4f-b714-357658e1fa5f req-e1db147b-0e90-4a04-a035-4254136a6432 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:59.978648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8dcbf969-7184-4c4f-b714-357658e1fa5f req-e1db147b-0e90-4a04-a035-4254136a6432 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:00.006160 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8dcbf969-7184-4c4f-b714-357658e1fa5f req-e1db147b-0e90-4a04-a035-4254136a6432 service nova] Creating event network-changed:7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:00.027918 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8dcbf969-7184-4c4f-b714-357658e1fa5f req-e1db147b-0e90-4a04-a035-4254136a6432 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111733 Sep 19 14:52:00.029161 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1367/2733] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:52:00.096134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:00.097265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:00.113692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:00.114191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:00.114625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:00.115909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:00.116372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:00.116796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:00.581427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:00.594457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7c223b6-5e5b-4913-a7fe-827e016e4a7c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.883482 Sep 19 14:52:00.615217 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1367/2734] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:51:59 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:00.862820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:00.863747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:00.887397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:00.887904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:00.893675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:00.897263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:00.897786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:00.898238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:01.078928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:01.097283 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c98a94bc-3352-4da9-b785-50013a9cbc18 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 1.023091 Sep 19 14:52:01.098652 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1368/2735] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:00 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:01.561814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:01.581472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5345e40f-aafa-44d2-974b-e4ac35dd769d tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1467 microversion: 2.1 time: 0.725230 Sep 19 14:52:01.584132 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1368/2736] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:00 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1467 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:01.621804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:01.623916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:01.639571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:01.640068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:01.640790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:01.649128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:01.649872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:01.650535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:02.139698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:02.141097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:02.151907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:02.158690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:02.161483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:02.165802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:02.169994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:02.176026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:02.681376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:02.696778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82a2f5b0-485e-4589-a0f8-c868cae0499b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 1.078948 Sep 19 14:52:02.697370 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1369/2737] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:01 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:02.714834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:02.715471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:02.735603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:02.736108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:02.736544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:02.737271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:02.737714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:02.738136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:02.805139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:02.821800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7355f527-9986-41cc-869b-982709459dd2 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.686098 Sep 19 14:52:02.836167 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1369/2738] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:02 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:02.847445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c6d4ba31-a7ed-48f6-9ff5-f2a27097deaa req-9b5d64be-fe52-4579-a682-1490a455240a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66966956-5029-45de-857c-13bcc6f6cc3f", "name": "network-vif-deleted", "tag": "adbf3bd5-48b6-4b80-8902-6ec5d598fda3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:02.870421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c6d4ba31-a7ed-48f6-9ff5-f2a27097deaa req-9b5d64be-fe52-4579-a682-1490a455240a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:02.871916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c6d4ba31-a7ed-48f6-9ff5-f2a27097deaa req-9b5d64be-fe52-4579-a682-1490a455240a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:02.873469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c6d4ba31-a7ed-48f6-9ff5-f2a27097deaa req-9b5d64be-fe52-4579-a682-1490a455240a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:02.887494 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c6d4ba31-a7ed-48f6-9ff5-f2a27097deaa req-9b5d64be-fe52-4579-a682-1490a455240a service nova] Creating event network-vif-deleted:adbf3bd5-48b6-4b80-8902-6ec5d598fda3 for instance 66966956-5029-45de-857c-13bcc6f6cc3f on n-h1-858384-1 Sep 19 14:52:02.895313 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c6d4ba31-a7ed-48f6-9ff5-f2a27097deaa req-9b5d64be-fe52-4579-a682-1490a455240a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051952 Sep 19 14:52:02.899771 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1370/2739] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:02.980727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:02.993628 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed5af0ad-7267-43c9-80e2-0ebb35c3fa0f tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 200 len: 1297 microversion: 2.1 time: 0.294606 Sep 19 14:52:03.012351 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1370/2740] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:02 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 1297 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:03.722727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:03.724957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:03.753916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:03.754915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:03.755614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:03.764754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:03.765675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:03.766527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:03.849450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:03.850019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:03.863450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:03.870005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:03.870958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:03.872714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:03.875350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:03.876139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:04.420061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:04.432325 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23765d3d-798d-4a08-b527-8f49715b7650 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.716226 Sep 19 14:52:04.448078 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1371/2741] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:03 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:04.459239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:04.464724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 66966956-5029-45de-857c-13bcc6f6cc3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:04.491782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:04.492576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:04.493169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:04.494359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:04.496087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:04.496726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:04.521504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:04.530539 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffdb6508-331a-4fd3-800d-9c34da2e8a81 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.686004 Sep 19 14:52:04.552015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] HTTP exception thrown: Instance 66966956-5029-45de-857c-13bcc6f6cc3f could not be found. Sep 19 14:52:04.554697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1371/2742] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:03 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Request method failure captured: Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f HTTP/1.1 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKICY_clGVW5C8ktUYPrC2cGwi-Hl4s1sGHlv6oW6jfGFHnfTng85OuGSeX7lbfM8Nng4t9O4chUw2Z6G7ZB2mFmVajS3PjphNPFRSNiKfE6kb9fjorvVnegAB6oWlg9gpAp03wSd63ooFP0xTqAU-0FzyGwhFXGiZ1EVc31bg6CMiOg Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/17ce8e19a9bb47f5bdf0d02866b6180d"}]}] Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MigrationsAdminTest-787798632 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MigrationsAdminTest-787798632-project Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: e2149c78b4d04c10b02d521a5635b29f Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MigrationsAdminTest-787798632-project Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 66966956-5029-45de-857c-13bcc6f6cc3f could not be found. Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '66966956-5029-45de-857c-13bcc6f6cc3f'} Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66966956-5029-45de-857c-13bcc6f6cc3f could not be found. Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66966956-5029-45de-857c-13bcc6f6cc3f could not be found. Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:04.561859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66966956-5029-45de-857c-13bcc6f6cc3f could not be found. Sep 19 14:52:04.566994 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:04.568068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-65f98884-661b-4ad0-a7b7-c5a8af9732e8 req-f553d146-2e06-4b57-8251-17c1d72be1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b37c941-abc2-43d2-939f-dfe8bb75987d", "name": "network-vif-plugged", "status": "completed", "tag": "50ff1028-55f6-47b7-afd5-df974bea7f6a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:04.569578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Returning 404 to user: Instance 66966956-5029-45de-857c-13bcc6f6cc3f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:04.570462 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1cfee5f8-d152-4f0c-b7f2-334a25eaf0de tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f" status: 404 len: 111 microversion: 2.1 time: 0.121130 Sep 19 14:52:04.572103 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1372/2743] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:04 2022] GET /compute/v2.1/servers/66966956-5029-45de-857c-13bcc6f6cc3f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:52:04.590426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-65f98884-661b-4ad0-a7b7-c5a8af9732e8 req-f553d146-2e06-4b57-8251-17c1d72be1b8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:04.593498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-65f98884-661b-4ad0-a7b7-c5a8af9732e8 req-f553d146-2e06-4b57-8251-17c1d72be1b8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:04.595224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-65f98884-661b-4ad0-a7b7-c5a8af9732e8 req-f553d146-2e06-4b57-8251-17c1d72be1b8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:04.596166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:04.600279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:04.625851 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-65f98884-661b-4ad0-a7b7-c5a8af9732e8 req-f553d146-2e06-4b57-8251-17c1d72be1b8 service nova] Creating event network-vif-plugged:50ff1028-55f6-47b7-afd5-df974bea7f6a for instance 1b37c941-abc2-43d2-939f-dfe8bb75987d on n-h2-858384-1 Sep 19 14:52:04.627052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:04.632083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:04.632827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:04.632961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-65f98884-661b-4ad0-a7b7-c5a8af9732e8 req-f553d146-2e06-4b57-8251-17c1d72be1b8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076399 Sep 19 14:52:04.634100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:04.634866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:04.636303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1372/2744] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:04.636916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:04.771033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:52:05.424457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-699447fe-9d76-46fa-a306-8f1dac47ae58 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 204 len: 0 microversion: 2.1 time: 0.845352 Sep 19 14:52:05.425522 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1373/2745] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:52:04 2022] DELETE /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:52:05.436866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:05.438286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:05.464214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:05.465194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:05.465395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:05.467129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:05.468245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:05.469005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:05.469483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:05.472147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:05.479691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:05.483194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:05.483866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:05.486621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:05.487525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:05.490636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:06.279753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:06.289030 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3daf6fd3-b462-4030-a155-f305133acf22 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1468 microversion: 2.1 time: 0.858518 Sep 19 14:52:06.307954 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1373/2746] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:05 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1468 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:06.323355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:06.325432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:06.339882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:06.346643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:06.347477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:06.351494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:06.352298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:06.353109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:06.389931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:06.401580 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-adae4faa-b0c3-42db-8fe0-1bb46dff8192 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1318 microversion: 2.1 time: 0.942353 Sep 19 14:52:06.419331 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1374/2747] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:05 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:06.425232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1a6c5260-abec-4d75-8905-b1a984f56b38 req-fecbc1e8-5428-44ef-a29a-8e008ab44394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "tag": "35aaf68e-ad43-4aa2-9147-e19d82f9e3ff"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:06.436941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:06.439544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1a6c5260-abec-4d75-8905-b1a984f56b38 req-fecbc1e8-5428-44ef-a29a-8e008ab44394 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:06.440352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1a6c5260-abec-4d75-8905-b1a984f56b38 req-fecbc1e8-5428-44ef-a29a-8e008ab44394 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:06.441116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1a6c5260-abec-4d75-8905-b1a984f56b38 req-fecbc1e8-5428-44ef-a29a-8e008ab44394 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:06.467126 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1a6c5260-abec-4d75-8905-b1a984f56b38 req-fecbc1e8-5428-44ef-a29a-8e008ab44394 service nova] Creating event network-changed:35aaf68e-ad43-4aa2-9147-e19d82f9e3ff for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:06.480540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1a6c5260-abec-4d75-8905-b1a984f56b38 req-fecbc1e8-5428-44ef-a29a-8e008ab44394 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057925 Sep 19 14:52:06.484611 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1375/2748] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:06.867429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:06.876281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2e5bccba-5d1c-4748-a06c-284d718f8e58 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.566955 Sep 19 14:52:06.876886 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1374/2749] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:06 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:07.323193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:07.324295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:07.334614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:07.335685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:07.336647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:07.337867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:07.338603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:07.339500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:07.345282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:07.432233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:07.432861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:07.445864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:07.446365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:07.446829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:07.447555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:07.448011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:07.448439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:07.855529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:07.871374 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1013160-cef8-4ea8-a5c0-38cc0f1eb04c tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1468 microversion: 2.1 time: 0.553090 Sep 19 14:52:07.889888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1376/2750] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:07 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1468 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:07.904540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:07.905181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:07.930988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:07.931499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:07.931946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:07.932672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:07.933141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:07.933581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:08.127451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:08.136978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6503ed34-5a01-4a08-8f64-ff3a9c64411e tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1508 microversion: 2.1 time: 0.708736 Sep 19 14:52:08.158978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1375/2751] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:07 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1508 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:08.175741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:08.177066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:08.207135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:08.209425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:08.213902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:08.219016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:08.221658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:08.222950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:08.555442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:08.570916 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c96d90cf-071d-4bb3-81b5-a4d03075016d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.672847 Sep 19 14:52:08.571543 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1377/2752] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:07 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:09.041730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:09.053055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da9f6de7-cc5d-456f-82f2-f57ebf468049 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1508 microversion: 2.1 time: 0.888194 Sep 19 14:52:09.053967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1376/2753] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:08 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1508 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:09.061852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:09.067668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:09.072833 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14e39122-4632-486f-976d-3f490eab3006 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] 10.222.0.81 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.290643 Sep 19 14:52:09.073874 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1378/2754] 10.222.0.81 () {58 vars in 1128 bytes} [Mon Sep 19 14:52:08 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 19 14:52:09.079262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.080121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.080789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:09.081746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.082435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.083166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:09.099655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:09.104798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:09.123796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.124316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.131134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:09.131986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.132477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.132924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:09.309104 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2bdab58-f77b-46b1-8361-eaf515842821 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "PUT /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1080 microversion: 2.1 time: 0.230174 Sep 19 14:52:09.311743 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1379/2755] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 14:52:09 2022] PUT /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1080 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:09.317508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1831af01-cb2a-4aef-98d6-f266946c1dc9 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Calling method '.version_select at 0x7fde292215e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:09.368892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1831af01-cb2a-4aef-98d6-f266946c1dc9 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] HTTP exception thrown: Image not found. Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1831af01-cb2a-4aef-98d6-f266946c1dc9 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Request method failure captured: Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIIYz6b6Twg02LX90aTzajBqd0IbjSXABGVBmVh4uP37baxaMh4xfUYDkiMJRUhkrZYE8M9LtJuQv8uw3MgyA6Tl0CNzDT3CLdGbyDPPEM9wz8ph_TLPYShhFHUNOLuLZX26I2iq_iGBil8TNaWR7RdpY928mukC3WHKJzJoHnsqNqA Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec557e04d3cf4ec686438b1df4dab717"}]}] Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 1400066dae9244229d2d9bb3c55b53eb Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '-1'} Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.371533 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1831af01-cb2a-4aef-98d6-f266946c1dc9 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:09.377099 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1831af01-cb2a-4aef-98d6-f266946c1dc9 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] 10.222.0.81 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.063473 Sep 19 14:52:09.380762 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1380/2756] 10.222.0.81 () {58 vars in 1134 bytes} [Mon Sep 19 14:52:09 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:52:09.392737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:09.397940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:09.406401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.406946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.407444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:09.408250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.408712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.409202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:09.961341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:09.979900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c91eaf77-7801-4157-a235-a49c5fed4863 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1468 microversion: 2.1 time: 0.924531 Sep 19 14:52:09.991541 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1377/2757] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:09 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1468 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:09.991541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f96428ac-6ed1-4bbb-abe6-d31ac14d7607 req-b00f4c63-63fe-40d1-909f-268ed1757b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "name": "network-vif-unplugged", "status": "completed", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:09.997650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f96428ac-6ed1-4bbb-abe6-d31ac14d7607 req-b00f4c63-63fe-40d1-909f-268ed1757b23 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:09.998147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f96428ac-6ed1-4bbb-abe6-d31ac14d7607 req-b00f4c63-63fe-40d1-909f-268ed1757b23 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:09.998582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f96428ac-6ed1-4bbb-abe6-d31ac14d7607 req-b00f4c63-63fe-40d1-909f-268ed1757b23 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.011265 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f96428ac-6ed1-4bbb-abe6-d31ac14d7607 req-b00f4c63-63fe-40d1-909f-268ed1757b23 service nova] Creating event network-vif-unplugged:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h2-858384-1 Sep 19 14:52:10.018030 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f96428ac-6ed1-4bbb-abe6-d31ac14d7607 req-b00f4c63-63fe-40d1-909f-268ed1757b23 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034843 Sep 19 14:52:10.019766 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1378/2758] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:10.031586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5fb8ebda-3bb3-449d-b1a5-4a81d963798d tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Calling method '.version_select at 0x7fde2e1d5ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:10.064028 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5fb8ebda-3bb3-449d-b1a5-4a81d963798d tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] HTTP exception thrown: Image not found. Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5fb8ebda-3bb3-449d-b1a5-4a81d963798d tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Request method failure captured: Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/images/de1e1ff0-f433-48db-b989-5901b9f1b4ej HTTP/1.1 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIIYz6b6Twg02LX90aTzajBqd0IbjSXABGVBmVh4uP37baxaMh4xfUYDkiMJRUhkrZYE8M9LtJuQv8uw3MgyA6Tl0CNzDT3CLdGbyDPPEM9wz8ph_TLPYShhFHUNOLuLZX26I2iq_iGBil8TNaWR7RdpY928mukC3WHKJzJoHnsqNqA Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec557e04d3cf4ec686438b1df4dab717"}]}] Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 1400066dae9244229d2d9bb3c55b53eb Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: exception: Image not found. Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'de1e1ff0-f433-48db-b989-5901b9f1b4ej'} Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image de1e1ff0-f433-48db-b989-5901b9f1b4ej to delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image de1e1ff0-f433-48db-b989-5901b9f1b4ej could not be found. Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.066463 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5fb8ebda-3bb3-449d-b1a5-4a81d963798d tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Returning 404 to user: Image not found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5fb8ebda-3bb3-449d-b1a5-4a81d963798d tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] 10.222.0.81 "DELETE /compute/v2.1/images/de1e1ff0-f433-48db-b989-5901b9f1b4ej" status: 404 len: 62 microversion: 2.1 time: 0.047678 Sep 19 14:52:10.079469 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1379/2759] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:10 2022] DELETE /compute/v2.1/images/de1e1ff0-f433-48db-b989-5901b9f1b4ej => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:52:10.084321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:10.085130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:10.091664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:10.103932 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9aab2a25-3fd7-41f1-85a3-28390536731d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1506 microversion: 2.1 time: 0.723327 Sep 19 14:52:10.105481 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1381/2760] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:09 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:10.111909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f51466be-7579-47ee-b116-21edcd38940a tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Calling method '.version_select at 0x7fde291934c0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:10.120777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.121292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.122352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.123105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.123767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.124197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.133352 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f51466be-7579-47ee-b116-21edcd38940a tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] HTTP exception thrown: Image not found. Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f51466be-7579-47ee-b116-21edcd38940a tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Request method failure captured: Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/ca94616b-bebc-45d4-95ab-720810e579f31 HTTP/1.1 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIIYz6b6Twg02LX90aTzajBqd0IbjSXABGVBmVh4uP37baxaMh4xfUYDkiMJRUhkrZYE8M9LtJuQv8uw3MgyA6Tl0CNzDT3CLdGbyDPPEM9wz8ph_TLPYShhFHUNOLuLZX26I2iq_iGBil8TNaWR7RdpY928mukC3WHKJzJoHnsqNqA Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec557e04d3cf4ec686438b1df4dab717"}]}] Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 1400066dae9244229d2d9bb3c55b53eb Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ca94616b-bebc-45d4-95ab-720810e579f31'} Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ca94616b-bebc-45d4-95ab-720810e579f31 to delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca94616b-bebc-45d4-95ab-720810e579f31 could not be found. Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.136093 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:52:10.140296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.144847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f51466be-7579-47ee-b116-21edcd38940a tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:10.145839 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f51466be-7579-47ee-b116-21edcd38940a tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] 10.222.0.81 "DELETE /compute/v2.1/images/ca94616b-bebc-45d4-95ab-720810e579f31" status: 404 len: 62 microversion: 2.1 time: 0.037810 Sep 19 14:52:10.146497 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1382/2761] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:52:10 2022] DELETE /compute/v2.1/images/ca94616b-bebc-45d4-95ab-720810e579f31 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:52:10.157136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:10.158738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:10.166440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.167355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.168014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.169761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.170442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.171138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.528888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:10.529311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:10.542661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f468e010-d8ef-4b4b-9301-fbb6aed2c883 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1506 microversion: 2.1 time: 0.389851 Sep 19 14:52:10.545013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1383/2762] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:10 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:10.551753 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1107b04e-0049-464b-8ed5-feca56d03b1e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.480762 Sep 19 14:52:10.552372 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1380/2763] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:10 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:10.555232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95a0928c-b130-4b04-8b6d-a8847afe1894 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Calling method '.version_select at 0x7fde291933a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:10.567614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:10.570523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:10.589184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.589560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.590011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.595920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.596447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.597074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.598655 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-95a0928c-b130-4b04-8b6d-a8847afe1894 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] HTTP exception thrown: Image not found. Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95a0928c-b130-4b04-8b6d-a8847afe1894 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Request method failure captured: Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/tempest-invalid-2018470420 HTTP/1.1 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIIYz6b6Twg02LX90aTzajBqd0IbjSXABGVBmVh4uP37baxaMh4xfUYDkiMJRUhkrZYE8M9LtJuQv8uw3MgyA6Tl0CNzDT3CLdGbyDPPEM9wz8ph_TLPYShhFHUNOLuLZX26I2iq_iGBil8TNaWR7RdpY928mukC3WHKJzJoHnsqNqA Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec557e04d3cf4ec686438b1df4dab717"}]}] Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 1400066dae9244229d2d9bb3c55b53eb Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'tempest-invalid-2018470420'} Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2018470420 to delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2018470420 could not be found. Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.600576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:52:10.605714 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.608913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:10.610289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95a0928c-b130-4b04-8b6d-a8847afe1894 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:10.611540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95a0928c-b130-4b04-8b6d-a8847afe1894 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] 10.222.0.81 "DELETE /compute/v2.1/images/tempest-invalid-2018470420" status: 404 len: 62 microversion: 2.1 time: 0.064840 Sep 19 14:52:10.612121 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1384/2764] 10.222.0.81 () {58 vars in 1206 bytes} [Mon Sep 19 14:52:10 2022] DELETE /compute/v2.1/images/tempest-invalid-2018470420 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:52:10.625744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f885576d-7d7e-42de-aa47-fe08fc0288b2 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Calling method '.version_select at 0x7fde29154f70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:10.675715 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f885576d-7d7e-42de-aa47-fe08fc0288b2 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] HTTP exception thrown: Image not found. Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f885576d-7d7e-42de-aa47-fe08fc0288b2 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Request method failure captured: Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/images/5c9e19a0-cd90-4f98-b68b-677c9af0640c HTTP/1.1 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIIYz6b6Twg02LX90aTzajBqd0IbjSXABGVBmVh4uP37baxaMh4xfUYDkiMJRUhkrZYE8M9LtJuQv8uw3MgyA6Tl0CNzDT3CLdGbyDPPEM9wz8ph_TLPYShhFHUNOLuLZX26I2iq_iGBil8TNaWR7RdpY928mukC3WHKJzJoHnsqNqA Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec557e04d3cf4ec686438b1df4dab717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec557e04d3cf4ec686438b1df4dab717"}]}] Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ec557e04d3cf4ec686438b1df4dab717 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436811631 Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 1400066dae9244229d2d9bb3c55b53eb Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436811631-project Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: exception: Image not found. Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5c9e19a0-cd90-4f98-b68b-677c9af0640c'} Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c9e19a0-cd90-4f98-b68b-677c9af0640c to delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c9e19a0-cd90-4f98-b68b-677c9af0640c could not be found. Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.677965 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f885576d-7d7e-42de-aa47-fe08fc0288b2 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] Returning 404 to user: Image not found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f885576d-7d7e-42de-aa47-fe08fc0288b2 tempest-ImagesDeleteNegativeTestJSON-436811631 tempest-ImagesDeleteNegativeTestJSON-436811631-project] 10.222.0.81 "DELETE /compute/v2.1/images/5c9e19a0-cd90-4f98-b68b-677c9af0640c" status: 404 len: 62 microversion: 2.1 time: 0.061344 Sep 19 14:52:10.683691 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1385/2765] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:10 2022] DELETE /compute/v2.1/images/5c9e19a0-cd90-4f98-b68b-677c9af0640c => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:52:10.732862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:10.733290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:10.734144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:10.736461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:10.736917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:10.826128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d8c245fa-89fe-47fc-b316-93a58321715f req-3d9e66d3-d00c-4b48-b7a1-a0cd4aaaaabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b081d47-7f8b-440a-9bc0-6b9670da1d1f", "name": "network-vif-deleted", "tag": "08209337-5402-43db-bf7e-9d611727ed29"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:10.885644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d8c245fa-89fe-47fc-b316-93a58321715f req-3d9e66d3-d00c-4b48-b7a1-a0cd4aaaaabb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.888597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:10.889464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d8c245fa-89fe-47fc-b316-93a58321715f req-3d9e66d3-d00c-4b48-b7a1-a0cd4aaaaabb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.891058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d8c245fa-89fe-47fc-b316-93a58321715f req-3d9e66d3-d00c-4b48-b7a1-a0cd4aaaaabb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.905552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.906084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.906484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.907222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:10.907668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:10.908098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:10.923151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d8c245fa-89fe-47fc-b316-93a58321715f req-3d9e66d3-d00c-4b48-b7a1-a0cd4aaaaabb service nova] Creating event network-vif-deleted:08209337-5402-43db-bf7e-9d611727ed29 for instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f on n-h2-858384-1 Sep 19 14:52:10.930047 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d8c245fa-89fe-47fc-b316-93a58321715f req-3d9e66d3-d00c-4b48-b7a1-a0cd4aaaaabb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114044 Sep 19 14:52:10.931653 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1386/2766] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:10.964368 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03898350-3db7-41a0-9a37-3cd7e3742528 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "POST /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d/action" status: 202 len: 1112 microversion: 2.1 time: 0.400914 Sep 19 14:52:10.966586 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1381/2767] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:52:10 2022] POST /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d/action => generated 1112 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 19 14:52:10.998269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:11.003070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:11.011856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:11.013045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:11.032679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.035878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.037429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:11.038420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.040100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.040895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.041604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:11.042334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.043256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:11.052484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.053526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.054236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:11.199915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.203308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.203967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:11.204659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lazy-loading 'fault' on Instance uuid 3b081d47-7f8b-440a-9bc0-6b9670da1d1f {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:52:11.425455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2149c78b4d04c10b02d521a5635b29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ce8e19a9bb47f5bdf0d02866b6180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:11.433680 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-11b3e89e-51e5-45aa-868d-c51f56da2f27 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 200 len: 1302 microversion: 2.1 time: 0.431466 Sep 19 14:52:11.453361 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1382/2768] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:11 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 1302 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:11.582969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:11.583712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:11.607994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:11.624560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.628618 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bff23c9c-08a1-4040-a818-69a49f469f84 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 0.644089 Sep 19 14:52:11.629095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.630547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:11.632279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:11.633475 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1387/2769] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:10 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:11.635276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:11.636003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:12.162739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:12.182626 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f073462c-4605-4a14-89c5-f5880531edfd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.600538 Sep 19 14:52:12.183374 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1383/2770] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:11 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:12.461959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:12.462918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] [instance: 3b081d47-7f8b-440a-9bc0-6b9670da1d1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:12.475774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:12.478997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:12.483183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:12.485112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:12.485786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:12.486440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:12.531760 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] HTTP exception thrown: Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f could not be found. Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Request method failure captured: Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f HTTP/1.1 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKICY_clGVW5C8ktUYPrC2cGwi-Hl4s1sGHlv6oW6jfGFHnfTng85OuGSeX7lbfM8Nng4t9O4chUw2Z6G7ZB2mFmVajS3PjphNPFRSNiKfE6kb9fjorvVnegAB6oWlg9gpAp03wSd63ooFP0xTqAU-0FzyGwhFXGiZ1EVc31bg6CMiOg Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/17ce8e19a9bb47f5bdf0d02866b6180d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/17ce8e19a9bb47f5bdf0d02866b6180d"}]}] Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MigrationsAdminTest-787798632 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 17ce8e19a9bb47f5bdf0d02866b6180d Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MigrationsAdminTest-787798632 Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MigrationsAdminTest-787798632-project Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: e2149c78b4d04c10b02d521a5635b29f Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MigrationsAdminTest-787798632-project Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f could not be found. Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '3b081d47-7f8b-440a-9bc0-6b9670da1d1f'} Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f could not be found. Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f could not be found. Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:12.534857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f could not be found. Sep 19 14:52:12.541940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:52:12.546771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] Returning 404 to user: Instance 3b081d47-7f8b-440a-9bc0-6b9670da1d1f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:12.550172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78432380-3613-4394-b986-9170600d5e32 tempest-MigrationsAdminTest-787798632 tempest-MigrationsAdminTest-787798632-project] 10.222.0.81 "GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f" status: 404 len: 111 microversion: 2.1 time: 0.092253 Sep 19 14:52:12.559699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1388/2771] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:12 2022] GET /compute/v2.1/servers/3b081d47-7f8b-440a-9bc0-6b9670da1d1f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:52:12.659345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:12.660411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:12.677037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:12.678129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:12.678936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:12.689370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:12.689969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:12.690416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:13.211218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:13.215320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:13.239461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:13.240964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:13.242037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:13.246357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:13.252192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:13.253273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:13.769870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:13.783891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:13.811304 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3abfb057-ebc3-4ff4-896e-fc8a173bfd0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.606321 Sep 19 14:52:13.811711 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ecdae245-d028-4ef3-aa69-4c67411fca00 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 1.155814 Sep 19 14:52:13.817447 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1389/2772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:13 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:13.831644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1384/2773] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:12 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:13.855208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f923748d-bfa7-403d-859b-5ffdc603df7b req-a971051a-a31f-4936-80b5-b67de611914f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "tag": "e9c07cf6-ebe9-484e-b684-dcf10b456ffc"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:13.871010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f923748d-bfa7-403d-859b-5ffdc603df7b req-a971051a-a31f-4936-80b5-b67de611914f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:13.872134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f923748d-bfa7-403d-859b-5ffdc603df7b req-a971051a-a31f-4936-80b5-b67de611914f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:13.873123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f923748d-bfa7-403d-859b-5ffdc603df7b req-a971051a-a31f-4936-80b5-b67de611914f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:13.896080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f923748d-bfa7-403d-859b-5ffdc603df7b req-a971051a-a31f-4936-80b5-b67de611914f service nova] Creating event network-changed:e9c07cf6-ebe9-484e-b684-dcf10b456ffc for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:13.904955 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f923748d-bfa7-403d-859b-5ffdc603df7b req-a971051a-a31f-4936-80b5-b67de611914f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075170 Sep 19 14:52:13.915340 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1390/2774] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:14.843854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:14.844474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:14.847324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:14.850388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:14.865591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:14.874048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:14.876335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:14.876992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:14.878000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:14.881486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:14.882606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:14.883690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:14.884411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:14.886146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:14.890139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:14.891523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:15.905453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:15.929636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a20bf7d-998d-4db6-9ca2-3672a63cd60e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 1.093891 Sep 19 14:52:15.935002 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1385/2775] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:14 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:16.236683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:16.246802 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95a1f1da-feef-411e-9120-59217a941ec3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 1.409497 Sep 19 14:52:16.247890 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1391/2776] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:14 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:16.966961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:16.967866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:16.987984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:16.988563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:16.989025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:16.993044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:16.995625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:16.996354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:17.280077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:17.282112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:17.336054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:17.344958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:17.347077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:17.348132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:17.350385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:17.352548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:18.248114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:18.263379 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abffc573-acc7-4802-bb3b-ef50bfa276a0 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 1.309515 Sep 19 14:52:18.268762 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1386/2777] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:16 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:18.666413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:18.684949 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d92b1ebb-b86a-4f89-a385-ac9ac4023b42 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 1.417825 Sep 19 14:52:18.696068 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1392/2778] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:17 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:19.013055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1892501891", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:19.091549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:19.159049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] validate_networks() for [('df72bf36-05bf-4553-9191-d4a4e19a956a', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:19.290194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:19.298225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:19.317950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:19.323322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:19.325416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:19.327869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:19.329677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:19.335148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:20.500911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:20.529735 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb06cc3c-848a-4d94-a4f5-2647e20ea811 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 1.242840 Sep 19 14:52:20.533038 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1393/2779] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:19 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:20.546292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:20.547460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:20.559292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:20.560799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:20.561900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:20.562857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:20.563625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:20.564212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:21.177918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:21.188554 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8780115f-9ec8-4e87-9305-2fc7a652551c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 0.651457 Sep 19 14:52:21.211183 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1394/2780] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:20 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:21.637316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-adf0dff8-3922-458e-ad54-5362f5f40a37 tempest-NetworksTest-1213376008 tempest-NetworksTest-1213376008-project-admin] Calling method '.version_select at 0x7fde2912cca0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:22.495511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-adf0dff8-3922-458e-ad54-5362f5f40a37 tempest-NetworksTest-1213376008 tempest-NetworksTest-1213376008-project-admin] 10.222.0.81 "GET /compute/v2.1/os-networks" status: 200 len: 9371 microversion: 2.1 time: 1.282774 Sep 19 14:52:22.496409 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1395/2781] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:52:21 2022] GET /compute/v2.1/os-networks => generated 9371 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:22.504458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:22.508762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:22.532391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:22.533918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:22.540249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:22.541049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:22.541174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:22.541619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:22.541711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:22.541999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:22.542239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:22.542477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:22.543564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:22.572426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:22.573695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:22.576231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:22.577801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:22.590881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:22.591700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:22.666155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Getting quotas for project a245ad65a629467e8cb341a4045aa529. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:22.673868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Getting quotas for user 2f16b23334a84b8880c4955c0b7ed71d and project a245ad65a629467e8cb341a4045aa529. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:22.692714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:22.696343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:22.788899 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e647b199-87d6-4d5b-8314-d7ceabd7e398 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.518544 Sep 19 14:52:22.791248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1387/2782] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 4521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:22.805265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:22.805959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:22.817845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:22.818693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:22.819378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:22.820330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:22.821008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:22.821635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:23.265789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:23.276759 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cbb98e6e-e4ba-482d-bff8-c84823f2e7c7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.778765 Sep 19 14:52:23.295514 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1396/2783] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:22 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:23.295514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-018a2d1c-c7ab-46f7-a0c2-323baa41cc1e tempest-NetworksTest-1213376008 tempest-NetworksTest-1213376008-project-admin] Calling method '.version_select at 0x7fde292b6550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:23.641364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:23.651421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0e39f70c-adfb-4af6-9765-2176864948d6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 0.858845 Sep 19 14:52:23.658449 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1388/2784] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:22 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:23.672128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f65a271-e1f9-42ef-9587-a7486b548201 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:23.673265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f65a271-e1f9-42ef-9587-a7486b548201 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:23.878385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3f65a271-e1f9-42ef-9587-a7486b548201 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:23.889194 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f65a271-e1f9-42ef-9587-a7486b548201 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1214 microversion: 2.1 time: 0.225883 Sep 19 14:52:23.889861 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1389/2785] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:23 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:24.269284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1366135959", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "2d014e9a-a207-4ca5-a77f-5e99dd012249"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:24.346584 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-018a2d1c-c7ab-46f7-a0c2-323baa41cc1e tempest-NetworksTest-1213376008 tempest-NetworksTest-1213376008-project-admin] 10.222.0.81 "GET /compute/v2.1/os-networks/639a7146-e83b-4789-be3c-bfe8c8684fb1" status: 200 len: 652 microversion: 2.1 time: 1.063590 Sep 19 14:52:24.347411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] validate_networks() for [('2d014e9a-a207-4ca5-a77f-5e99dd012249', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:24.348938 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1397/2786] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 14:52:23 2022] GET /compute/v2.1/os-networks/639a7146-e83b-4789-be3c-bfe8c8684fb1 => generated 652 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:24.354583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:24.355775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:24.367034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:24.367897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:24.368562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:24.369612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:24.370344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:24.371523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:24.891156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:24.904812 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ce84aa1-fe07-446e-8323-1964cd5ff328 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.554554 Sep 19 14:52:24.905413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1398/2787] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:24 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:24.920647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2219370-948c-427c-a0c8-7a93b8c10597 tempest-NetworksTest-1213376008 tempest-NetworksTest-1213376008-project-admin] Calling method '.version_select at 0x7fde2912cca0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:25.473064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2219370-948c-427c-a0c8-7a93b8c10597 tempest-NetworksTest-1213376008 tempest-NetworksTest-1213376008-project-admin] 10.222.0.81 "GET /compute/v2.1/os-networks" status: 200 len: 10053 microversion: 2.1 time: 0.566403 Sep 19 14:52:25.473791 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1399/2788] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:52:24 2022] GET /compute/v2.1/os-networks => generated 10053 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:52:25.483456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:25.486676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:25.509472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:25.511175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:25.512358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:25.513501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:25.514137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:25.515670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:25.856214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:25.857365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:25.858017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:25.858600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:25.859324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:25.888687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:25.889520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:25.892166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:25.893307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:25.899253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:25.900021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:25.963377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Getting quotas for project 88691d3462d64061ac749bd7a33d201f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:25.983803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:25.986855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Getting quotas for user a895a93d8dac4699adc352b43f09abb8 and project 88691d3462d64061ac749bd7a33d201f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:25.998734 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3022b8cb-d8e5-45b7-8695-a236a050da54 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 0.517969 Sep 19 14:52:26.000628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1400/2789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:25 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:26.017077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:26.018006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:26.018179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:26.030015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:26.034836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:26.035653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:26.037409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:26.040415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:26.041079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:26.044805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:26.144388 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55deeccc-4f72-4147-bb5f-77594993bcdf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.962759 Sep 19 14:52:26.147366 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1390/2790] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 14:52:26.153648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:26.156212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:26.171268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:26.173475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:26.174150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:26.175258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:26.175907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:26.176560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:26.221848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:26.236566 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4f74fe0-a4de-4e45-b04d-c748a915e30b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1272 microversion: 2.1 time: 0.230441 Sep 19 14:52:26.260657 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1401/2791] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:26 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:26.266879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61573ee7-c1c5-4165-9dd2-fa367364115e tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:26.270428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61573ee7-c1c5-4165-9dd2-fa367364115e tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:26.458927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61573ee7-c1c5-4165-9dd2-fa367364115e tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:26.469390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61573ee7-c1c5-4165-9dd2-fa367364115e tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:26.471687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61573ee7-c1c5-4165-9dd2-fa367364115e tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:26.472878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61573ee7-c1c5-4165-9dd2-fa367364115e tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1262 microversion: 2.26 time: 0.211144 Sep 19 14:52:26.492143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1402/2792] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:26 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1262 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:26.616338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:26.629355 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9213a908-45ea-459a-b873-54facaf1a126 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.480538 Sep 19 14:52:26.634955 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1391/2793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:26 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:27.028326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:27.031033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:27.040701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.041568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.042259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.044470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.045355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.046011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.051281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:27.261629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:27.262337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:27.279545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.280087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.288818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.289602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.290090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.290537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.453932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:27.467822 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1272b79c-b5ad-4360-aed4-380401b75ef2 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1517 microversion: 2.1 time: 0.446114 Sep 19 14:52:27.483783 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1403/2794] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:27 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1517 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:27.503473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:27.504939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:27.515378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.516273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.516960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.517935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.519791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.524380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.557467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:27.566912 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-767a40a7-457d-4569-9a0f-53ff1c467d0f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1272 microversion: 2.1 time: 0.309236 Sep 19 14:52:27.588929 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1392/2795] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:27 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1272 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:27.650420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:27.660245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:27.661225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:27.676325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:27.678052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:27.679353 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3167b8b6-9fd1-4cdf-aba4-cd971fe423bf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1266 microversion: 2.26 time: 0.180019 Sep 19 14:52:27.685892 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1404/2796] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:27 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:27.690647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.691965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.693025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:27.694601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:27.695816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:27.696615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.230930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6a9aef31-f2d9-474b-aa44-d72bd118370f req-b96d5d2d-0ad9-4b0c-90e6-57046c8dd7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-plugged", "status": "completed", "tag": "e9c07cf6-ebe9-484e-b684-dcf10b456ffc"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:28.242369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6a9aef31-f2d9-474b-aa44-d72bd118370f req-b96d5d2d-0ad9-4b0c-90e6-57046c8dd7a7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.243204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6a9aef31-f2d9-474b-aa44-d72bd118370f req-b96d5d2d-0ad9-4b0c-90e6-57046c8dd7a7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.243871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6a9aef31-f2d9-474b-aa44-d72bd118370f req-b96d5d2d-0ad9-4b0c-90e6-57046c8dd7a7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.259433 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6a9aef31-f2d9-474b-aa44-d72bd118370f req-b96d5d2d-0ad9-4b0c-90e6-57046c8dd7a7 service nova] Creating event network-vif-plugged:e9c07cf6-ebe9-484e-b684-dcf10b456ffc for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:28.265762 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6a9aef31-f2d9-474b-aa44-d72bd118370f req-b96d5d2d-0ad9-4b0c-90e6-57046c8dd7a7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039779 Sep 19 14:52:28.269209 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1405/2797] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:52:28.386183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:28.400528 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f76a370-82ad-44a5-ba24-e9247cd4157b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.745755 Sep 19 14:52:28.420282 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1393/2798] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:27 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:28.503586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:28.504493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:28.519855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.520390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.520829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.524137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.524644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.525094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.599127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:28.600332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:28.609021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.610085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.610926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.611909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.612596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.615384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.872657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:28.893089 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6400699b-2d4d-4d30-81a5-d328aeca260d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1523 microversion: 2.1 time: 0.395556 Sep 19 14:52:28.896373 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1406/2799] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:28 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:28.912727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:28.913575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:28.933999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.934647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.935199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:28.936725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:28.937290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:28.937901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:29.032321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:29.044019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f01e9c0a-e7c5-411a-b415-60fa492ca787 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.448213 Sep 19 14:52:29.047022 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1394/2800] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:28 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:29.119163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:29.144105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:29.147767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:29.150455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-767b0b6c-a955-40e2-82b0-7dd4d63de280 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1314 microversion: 2.26 time: 0.251144 Sep 19 14:52:29.158495 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1407/2801] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:28 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:29.432138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:29.435925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:29.455693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:29.457796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:29.458502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:29.459463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:29.460128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:29.461948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:29.752530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:29.765308 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-53ecfc6e-04e5-4363-82b6-d4eafd3b9456 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.342392 Sep 19 14:52:29.765921 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1395/2802] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:29 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:29.920279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:29.921001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:29.953980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:29.954864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:29.955359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:29.956106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:29.962453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:29.963040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:30.091097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:30.092477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:30.102900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:30.103770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:30.140031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:30.142523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:30.144397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:30.151054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:30.721539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:30.735037 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1f78d02f-2527-4c87-a2d7-4fc7c903422f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1523 microversion: 2.1 time: 0.819843 Sep 19 14:52:30.755407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1408/2803] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:29 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1523 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:30.760632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:30.767379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:30.779572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:30.779916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:30.780345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:30.781063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:30.781497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:30.781944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:31.050700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:31.059123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:31.060575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:31.061712 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de5eb4a9-b718-4b42-96f1-d98ce540ff28 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1320 microversion: 2.26 time: 0.305033 Sep 19 14:52:31.062273 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1409/2804] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:30 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:31.093751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-622e4375-2b9b-402d-bcfc-87c8435f4896 req-8f4b3686-4a84-4554-9ba3-bc5c124b6d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-plugged", "status": "completed", "tag": "7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:31.102433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:31.116288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-054a4abb-bc5d-4e88-9f60-32070d03c5e7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 1.045094 Sep 19 14:52:31.123067 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1396/2805] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:30 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:31.126582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-622e4375-2b9b-402d-bcfc-87c8435f4896 req-8f4b3686-4a84-4554-9ba3-bc5c124b6d82 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:31.127107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-622e4375-2b9b-402d-bcfc-87c8435f4896 req-8f4b3686-4a84-4554-9ba3-bc5c124b6d82 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:31.127534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-622e4375-2b9b-402d-bcfc-87c8435f4896 req-8f4b3686-4a84-4554-9ba3-bc5c124b6d82 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:31.146261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:31.147317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:31.163978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:31.164939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:31.168047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:31.170267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:31.176924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:31.177881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:31.179472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-622e4375-2b9b-402d-bcfc-87c8435f4896 req-8f4b3686-4a84-4554-9ba3-bc5c124b6d82 service nova] Creating event network-vif-plugged:7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:31.196042 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-622e4375-2b9b-402d-bcfc-87c8435f4896 req-8f4b3686-4a84-4554-9ba3-bc5c124b6d82 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114977 Sep 19 14:52:31.206994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1410/2806] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:31.764501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:31.765213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:31.784661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:31.785429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:31.786056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:31.787012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:31.787924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:31.790068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:31.831201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:31.835051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:31.857051 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa55014c-d6f2-49a0-9d3c-e55a76500a8e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.727829 Sep 19 14:52:31.857880 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1397/2807] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:31 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:32.090866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:32.091881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:32.106976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:32.107690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:32.109028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:32.110590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:32.113429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:32.114188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:32.291620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:32.320272 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-832cde80-27ea-4d3a-a710-843df060afb8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1523 microversion: 2.1 time: 0.560982 Sep 19 14:52:32.326159 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1411/2808] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:31 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:32.345676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:32.348847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:32.381718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:32.382562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:32.383049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:32.383805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:32.384286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:32.384733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:32.423272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:32.454058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:32.456183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:32.457624 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cceaba1c-d8a0-4e4f-ae13-83423d2b6cd9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1320 microversion: 2.26 time: 0.372142 Sep 19 14:52:32.458765 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1398/2809] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:32 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:32.890469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:32.891392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:32.909174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:32.915949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:32.918487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:32.920501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:32.923277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:32.924632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:32.979373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:32.998054 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bf549bbe-c69b-4813-a195-09e488064a21 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.666572 Sep 19 14:52:33.017769 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1412/2810] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:32 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:33.241489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b37c941-abc2-43d2-939f-dfe8bb75987d", "name": "network-vif-unplugged", "status": "completed", "tag": "50ff1028-55f6-47b7-afd5-df974bea7f6a"}, {"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-plugged", "status": "completed", "tag": "35aaf68e-ad43-4aa2-9147-e19d82f9e3ff"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:33.283439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:33.285558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:33.286027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:33.343480 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] Creating event network-vif-unplugged:50ff1028-55f6-47b7-afd5-df974bea7f6a for instance 1b37c941-abc2-43d2-939f-dfe8bb75987d on n-h2-858384-1 Sep 19 14:52:33.345893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] Creating event network-vif-plugged:35aaf68e-ad43-4aa2-9147-e19d82f9e3ff for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:33.390839 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-32f2019c-7d82-4f2d-a82f-4de402148a68 req-79057d60-412d-41b0-9e2b-82419e3f5760 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.154360 Sep 19 14:52:33.399152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1413/2811] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:52:33.420686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:33.428524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:33.459238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:33.462257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:33.469126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:33.470884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:33.487934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:33.492045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:33.935496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:33.959060 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c925094-1fb3-4bbd-9b28-0cf31bcd4542 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 1.076541 Sep 19 14:52:33.974307 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1399/2812] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:32 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:33.974307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:33.979055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:33.998702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:33.999893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:34.000601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:34.001558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:34.005867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:34.006568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:34.045486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:34.061435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76374874-6912-41ee-b997-74eb9dcac2b8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1523 microversion: 2.1 time: 0.660452 Sep 19 14:52:34.076189 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1414/2813] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:33 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1523 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:34.091325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:34.094789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:34.107917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:34.117369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:34.118078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:34.119388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:34.120019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:34.121230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:34.173283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:34.192033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:34.201316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:34.204860 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d1464c1-be25-4594-beb9-0529840e4f5b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1320 microversion: 2.26 time: 0.240293 Sep 19 14:52:34.220943 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1400/2814] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:33 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:34.477964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:34.504804 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37aa9352-0dfa-42c7-9c5e-4b66204cafe8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.426708 Sep 19 14:52:34.509623 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1415/2815] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:34 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:34.536982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7e63bff-d3a0-4c55-9d5b-cdaed5207c15 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2e183af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1796685322", "description": "tempest-description-1536150379"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:34.808275 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7e63bff-d3a0-4c55-9d5b-cdaed5207c15 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.513149 Sep 19 14:52:34.808946 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1401/2816] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:52:34.824142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab630121-b960-44f2-8995-9abf91ab5bbe tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde299cf550>, body: {"security_group_rule": {"parent_group_id": "e448ade1-2770-4065-914c-b696b6af3ed4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:34.987445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:34.988063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:34.999910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.003201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.006053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.007619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.009136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.010412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.271575 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab630121-b960-44f2-8995-9abf91ab5bbe tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.452398 Sep 19 14:52:35.280055 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1416/2817] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:52:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:35.293977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:35.296140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:35.314454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.316184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.316871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.319257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.320634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.321604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.352670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:35.366085 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23222798-6691-49fc-8a4b-c57e7d1cdd80 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1354 microversion: 2.1 time: 0.383145 Sep 19 14:52:35.367604 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1402/2818] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:34 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1354 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:35.398662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:35.400267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:35.409138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.409951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.410614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.411804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.412726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.413349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.801836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:35.815641 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2cbe347a-c39e-4729-82cf-634780f4b60c tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1523 microversion: 2.1 time: 0.534187 Sep 19 14:52:35.822796 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1417/2819] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:35 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:35.828252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fedf0ba8-d47b-4a98-971c-f389af1a2705 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde298f48b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-514745395", "description": "tempest-description-2107452887"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:35.923343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:36.010396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:36.209133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:36.221195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:36.224929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:36.231838 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-450ca53b-8dcc-431f-9c1a-6fdbc2633a57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.836848 Sep 19 14:52:36.232628 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1403/2820] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:35 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:36.240832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:36.247698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:36.260533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:36.263395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:36.268812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:36.269848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:36.271224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:36.272723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:36.463221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:36.703374 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fedf0ba8-d47b-4a98-971c-f389af1a2705 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.883709 Sep 19 14:52:36.712262 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1418/2821] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:36.714637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5cfc893c-e27c-4c23-a0c8-8befedbd2929 req-6a20da49-cd4f-4c65-903a-4a22004e5ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4335f57-09f8-499b-91c3-6fc75237c0cf", "tag": "7c6d7337-7915-4073-bd2b-16d6935bb7a5"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:36.763972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5cfc893c-e27c-4c23-a0c8-8befedbd2929 req-6a20da49-cd4f-4c65-903a-4a22004e5ab8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:36.765523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5cfc893c-e27c-4c23-a0c8-8befedbd2929 req-6a20da49-cd4f-4c65-903a-4a22004e5ab8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:36.766892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5cfc893c-e27c-4c23-a0c8-8befedbd2929 req-6a20da49-cd4f-4c65-903a-4a22004e5ab8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:36.792311 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5cfc893c-e27c-4c23-a0c8-8befedbd2929 req-6a20da49-cd4f-4c65-903a-4a22004e5ab8 service nova] Creating event network-changed:7c6d7337-7915-4073-bd2b-16d6935bb7a5 for instance a4335f57-09f8-499b-91c3-6fc75237c0cf on n-h1-858384-1 Sep 19 14:52:36.808082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5cfc893c-e27c-4c23-a0c8-8befedbd2929 req-6a20da49-cd4f-4c65-903a-4a22004e5ab8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097301 Sep 19 14:52:36.809876 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1419/2822] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:36.826309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:36.829808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:36.867323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:36.868444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:36.869062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:36.870010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:36.871206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:36.872772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:37.119947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:37.132794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8fe13935-48d0-4421-9248-c8239f3f24cc tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.895986 Sep 19 14:52:37.133551 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1404/2823] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:36 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:37.146403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-aed9376f-cad9-4f97-9771-609bffcdff1e req-80675e02-cc0a-4037-b474-5524dc05c6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b37c941-abc2-43d2-939f-dfe8bb75987d", "name": "network-vif-plugged", "status": "completed", "tag": "50ff1028-55f6-47b7-afd5-df974bea7f6a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:37.181899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aed9376f-cad9-4f97-9771-609bffcdff1e req-80675e02-cc0a-4037-b474-5524dc05c6dd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:37.182839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aed9376f-cad9-4f97-9771-609bffcdff1e req-80675e02-cc0a-4037-b474-5524dc05c6dd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:37.183893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aed9376f-cad9-4f97-9771-609bffcdff1e req-80675e02-cc0a-4037-b474-5524dc05c6dd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:37.205503 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-aed9376f-cad9-4f97-9771-609bffcdff1e req-80675e02-cc0a-4037-b474-5524dc05c6dd service nova] Creating event network-vif-plugged:50ff1028-55f6-47b7-afd5-df974bea7f6a for instance 1b37c941-abc2-43d2-939f-dfe8bb75987d on n-h2-858384-1 Sep 19 14:52:37.219090 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-aed9376f-cad9-4f97-9771-609bffcdff1e req-80675e02-cc0a-4037-b474-5524dc05c6dd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080721 Sep 19 14:52:37.219761 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1405/2824] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:37.223029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:37.225510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5e58c2d-87c3-4462-9b0f-95e6202f0064 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2a3c11f0>, body: {"security_group_rule": {"parent_group_id": "631739c0-ed10-4ab2-9f63-f674fa2f86f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:37.236783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81be8436-ad5a-4b5b-a442-a6694e1c793d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1804 microversion: 2.1 time: 0.422515 Sep 19 14:52:37.254943 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1420/2825] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:36 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1804 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:37.262143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:37.267897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:37.284820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:37.285336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:37.285775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:37.286505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:37.287004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:37.287440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.257728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:38.272418 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-73f7e3db-d3b6-466b-91a0-251c80c40df1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1523 microversion: 2.1 time: 1.028945 Sep 19 14:52:38.274426 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1421/2826] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:37 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1523 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:38.285239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:38.286430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:38.306977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=75 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:38.321695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.322644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.324024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.326186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.327051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.328972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.536715 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5e58c2d-87c3-4462-9b0f-95e6202f0064 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.315500 Sep 19 14:52:38.538585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1406/2827] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:52:37 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:38.557659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:38.564397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:38.614998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.628061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.628893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.630815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.641864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.644376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.728475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:38.759971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:38.775267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:38.783926 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a9e13af-c7aa-4e22-9106-eb17199c0b57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.503208 Sep 19 14:52:38.785894 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1422/2828] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:38 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:38.828925 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0aef75e3-dad7-43fd-bfde-063e9b4cdb2e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39/ips" status: 200 len: 218 microversion: 2.1 time: 0.275291 Sep 19 14:52:38.841829 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1407/2829] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 14:52:38 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39/ips => generated 218 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:38.843482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:38.844792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:38.855245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ecd8c11e-b913-4e39-819f-3963afbc150d tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2e178700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1011678710", "description": "tempest-description-596630432"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:38.863272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.863770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.864192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.864915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.865374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.865797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:39.734159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:39.758302 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c69035d1-13be-42e9-b7af-13958bee1261 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.961111 Sep 19 14:52:39.763107 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1423/2830] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:38 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:39.772913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:39.776246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:39.791805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:39.793980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:39.795538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:39.804604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:39.804604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:39.805336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:39.839490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:39.877034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:52:40.077568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb99d521-76f3-4f01-9f30-b14b7ac3597f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 204 len: 0 microversion: 2.1 time: 0.312947 Sep 19 14:52:40.081972 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1424/2831] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:52:39 2022] DELETE /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:52:40.100575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:40.101699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:40.118085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.118929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.119630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:40.121641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.128561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.129403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:40.235483 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ecd8c11e-b913-4e39-819f-3963afbc150d tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.392483 Sep 19 14:52:40.238406 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1408/2832] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:40.250370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-20148105-22bb-4802-b005-6acbbb43e72e req-8e4a6bbe-5f57-4db9-974a-c9f7a99d4a07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f302a7cc-4dc3-4c3e-a4f0-ff86038040a9", "tag": "556be746-ff32-4417-a1e6-d6a840641e9a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:40.300861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-20148105-22bb-4802-b005-6acbbb43e72e req-8e4a6bbe-5f57-4db9-974a-c9f7a99d4a07 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.301892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-20148105-22bb-4802-b005-6acbbb43e72e req-8e4a6bbe-5f57-4db9-974a-c9f7a99d4a07 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.302625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-20148105-22bb-4802-b005-6acbbb43e72e req-8e4a6bbe-5f57-4db9-974a-c9f7a99d4a07 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:40.321752 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-20148105-22bb-4802-b005-6acbbb43e72e req-8e4a6bbe-5f57-4db9-974a-c9f7a99d4a07 service nova] Creating event network-changed:556be746-ff32-4417-a1e6-d6a840641e9a for instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 on n-h2-858384-1 Sep 19 14:52:40.345184 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-20148105-22bb-4802-b005-6acbbb43e72e req-8e4a6bbe-5f57-4db9-974a-c9f7a99d4a07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091998 Sep 19 14:52:40.346482 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1409/2833] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:40.354511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:40.355441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:40.364198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.365543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.366150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:40.367265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.367894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.368486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.022323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.033480 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-90e9d843-fa60-4d8c-88fe-dccfd5883496 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1508 microversion: 2.1 time: 0.946404 Sep 19 14:52:41.034819 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1425/2834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:40 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1508 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:41.041024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:41.041859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:41.052167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:41.052721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:41.053168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.053896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:41.054358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:41.054808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.266377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.284770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.286352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.287503 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc4bdbd5-0124-4a2d-8c76-d0b1ec1cc568 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.939411 Sep 19 14:52:41.288898 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1410/2835] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:40 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:41.295644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bad9a179-4a92-44ad-a180-04789e830286 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2e15d700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-226926352", "description": "tempest-description-375523089"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:41.456338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.467594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e9a43e2-8626-4f8f-b3f3-18b65ff81681 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1810 microversion: 2.1 time: 0.430833 Sep 19 14:52:41.486800 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1426/2836] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:41 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1810 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:41.722528 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bad9a179-4a92-44ad-a180-04789e830286 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.432339 Sep 19 14:52:41.723277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1411/2837] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:41 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:41.728528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:41.733079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:41.740639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:41.741503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:41.742277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.743281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:41.743972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:41.744682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.852152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab1fb398-3e8d-440e-b546-bdd3619abdb3 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] Action: 'create', calling method: .version_select at 0x7fde29154c10>, body: {"security_group": {"name": "tempest-securitygroup-1232724519", "description": "tempest-description-334295443"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:42.071566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:42.098551 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9db4fb62-dbef-45e1-afe4-3ad8ce855701 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.372157 Sep 19 14:52:42.103098 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1412/2838] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:41 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:42.115297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:42.116669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:42.128541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.132619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.134384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.136817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.137552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.139015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.514541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:42.524538 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94e68a69-842a-4f8e-9e40-4bc0b7ae8fc1 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 200 len: 1508 microversion: 2.1 time: 0.420020 Sep 19 14:52:42.529893 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1413/2839] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:42 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:42.543277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d19f53a5-84de-4d52-a0fd-8bccce03fe96 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2e1d5dc0>, body: {"security_group_rule": {"parent_group_id": "c0b99aae-3941-4ce3-a0d5-785a8fe981e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d43cb8a6-5766-42ac-8f88-39b45be6a698"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:42.547893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab1fb398-3e8d-440e-b546-bdd3619abdb3 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.059515 Sep 19 14:52:42.560885 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1427/2840] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:41 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:42.568269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:42.575865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:42.599606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.600362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.600998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.601916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.602599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.604384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.892731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:42.905220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:42.910303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:42.914048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-388a5266-929b-415b-ac80-fd015dac6cda tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.351802 Sep 19 14:52:42.916739 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1428/2841] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:42 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:43.060723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1036735126", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:43.176014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:43.542659 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d19f53a5-84de-4d52-a0fd-8bccce03fe96 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.010553 Sep 19 14:52:43.553979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1414/2842] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:52:42 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:43.563332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:43.564028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:43.579035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:43.581258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:43.581995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:43.583098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:43.583820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:43.584509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.109991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:44.128637 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06641058-e6bb-45a2-ab5e-a028e41cc95c tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 200 len: 1789 microversion: 2.1 time: 0.570192 Sep 19 14:52:44.149515 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1415/2843] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:43 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 1789 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:44.171315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:44.174806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:44.199136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.199711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.200164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.201136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.201619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.202117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.237290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:52:44.366221 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a41765e4-66d5-4856-9c96-14747ace0ef8 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 204 len: 0 microversion: 2.1 time: 0.213845 Sep 19 14:52:44.370527 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1416/2844] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:52:44 2022] DELETE /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:52:44.377896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-07e90dd8-c0eb-4a91-b1a1-8cc66a7b2f79 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] Action: 'create', calling method: .version_select at 0x7fde2e15ddc0>, body: {"security_group": {"name": "tempest-securitygroup-579351504", "description": "tempest-description-1373588001"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:44.442987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:44.443741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:44.444229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:44.444644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:44.445060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:44.473928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.475508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.476568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.479033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.481266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.483046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.545557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:44.559207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:44.590359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:44.593265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:44.681784 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cb001d0-0a92-44f8-95fa-fa7cb557fbd9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762562 Sep 19 14:52:44.688724 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1429/2845] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:44.696026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-99dfca4c-66ae-48fd-bbac-c60374b9e78e req-5129b7f7-e9e2-4fec-92f1-454ad357a78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4335f57-09f8-499b-91c3-6fc75237c0cf", "name": "network-vif-plugged", "status": "completed", "tag": "7c6d7337-7915-4073-bd2b-16d6935bb7a5"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:44.710187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-99dfca4c-66ae-48fd-bbac-c60374b9e78e req-5129b7f7-e9e2-4fec-92f1-454ad357a78c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.710685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-99dfca4c-66ae-48fd-bbac-c60374b9e78e req-5129b7f7-e9e2-4fec-92f1-454ad357a78c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.711149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-99dfca4c-66ae-48fd-bbac-c60374b9e78e req-5129b7f7-e9e2-4fec-92f1-454ad357a78c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.726236 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-99dfca4c-66ae-48fd-bbac-c60374b9e78e req-5129b7f7-e9e2-4fec-92f1-454ad357a78c service nova] Creating event network-vif-plugged:7c6d7337-7915-4073-bd2b-16d6935bb7a5 for instance a4335f57-09f8-499b-91c3-6fc75237c0cf on n-h1-858384-1 Sep 19 14:52:44.732358 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-99dfca4c-66ae-48fd-bbac-c60374b9e78e req-5129b7f7-e9e2-4fec-92f1-454ad357a78c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047856 Sep 19 14:52:44.733303 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1430/2846] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:44.761086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:44.772074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:44.798090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.801074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.802601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.804465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.806159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.806600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:45.248887 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-07e90dd8-c0eb-4a91-b1a1-8cc66a7b2f79 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.875699 Sep 19 14:52:45.249749 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1417/2847] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:45.262829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-93713fc1-1b69-4910-870a-f2f9161c56b9 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde29e35040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1400884350", "description": "tempest-description-1531950462"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:45.487920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:45.501227 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3655e04d-a561-4805-8125-29c7cebe96aa tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1314 microversion: 2.1 time: 0.766612 Sep 19 14:52:45.507215 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1431/2848] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:44 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:45.513400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b52acdc3-f9c2-47dd-94b5-b11aec44985e req-50185411-26e9-4861-a0ee-7b34604d520d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-deleted", "tag": "e9c07cf6-ebe9-484e-b684-dcf10b456ffc"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:45.555053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b52acdc3-f9c2-47dd-94b5-b11aec44985e req-50185411-26e9-4861-a0ee-7b34604d520d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:45.561054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b52acdc3-f9c2-47dd-94b5-b11aec44985e req-50185411-26e9-4861-a0ee-7b34604d520d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:45.562968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b52acdc3-f9c2-47dd-94b5-b11aec44985e req-50185411-26e9-4861-a0ee-7b34604d520d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:45.613843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b52acdc3-f9c2-47dd-94b5-b11aec44985e req-50185411-26e9-4861-a0ee-7b34604d520d service nova] Creating event network-vif-deleted:e9c07cf6-ebe9-484e-b684-dcf10b456ffc for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:45.637850 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b52acdc3-f9c2-47dd-94b5-b11aec44985e req-50185411-26e9-4861-a0ee-7b34604d520d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128899 Sep 19 14:52:45.639440 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1432/2849] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:45.647208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:45.654359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:45.670101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:45.671339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:45.672432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:45.673463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:45.674187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:45.674898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.406002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.456656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.462804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.467368 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ec9e0e1e-cf4c-497c-832c-818809702bb4 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.824543 Sep 19 14:52:46.477020 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1433/2850] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:45 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:46.486594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-420043476", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "dbfeb181-3743-4fc4-84f2-01b4c28ac8b3"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:46.580212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] validate_networks() for [('dbfeb181-3743-4fc4-84f2-01b4c28ac8b3', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:46.586244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-93713fc1-1b69-4910-870a-f2f9161c56b9 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.335209 Sep 19 14:52:46.587835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1418/2851] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:45 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:46.592942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:46.593678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:46.608399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.608737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.609165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.610085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.610606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.611091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.924670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.941978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-679d46e5-7a5a-4cbd-911a-ad04908205ab tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1211 microversion: 2.1 time: 0.352543 Sep 19 14:52:46.942518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1419/2852] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:46 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1211 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:46.973226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:46.974022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:47.003425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.006208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.008285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.015198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.033603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.034185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.117621 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] HTTP exception thrown: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Request method failure captured: Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 HTTP/1.1 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIH19uVgR-ilTo7o_HG7Obtw9pQwOwpigSKi8xWt_DRH3LEngRSxUWC38ACnAI_NdrtmJgeEMWGYQ_YTMzrCYIdJoS7CkrevkOQPLpdmyU5dIXybYdJ3125ALPwG2a-z_sIaeGmjVSpIEkZdfm3iy229Kdi1LCkdVRLTCl_p7B45f0o Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/330cbd8155454fa38afb8a95b0e4fd9f"}]}] Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestMultiNic-1216875611 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f857828528b349c684b49b9d756d3868 Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'df32f195-86cf-4e85-9060-49f2cbde0e39'} Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:47.122671 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Returning 404 to user: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:47.127391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-af43fd26-9b5d-47ff-92ff-cc9e2ed77e61 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 404 len: 111 microversion: 2.1 time: 0.180402 Sep 19 14:52:47.139466 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1420/2853] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:46 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:52:47.271134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e22b4b1d-fa82-478a-a9f5-b9408c3d08c6 tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] Action: 'create', calling method: .version_select at 0x7fde2e183940>, body: {"security_group": {"name": "tempest-securitygroup-909603317", "description": "tempest-description-438484992"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:48.335290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:48.335898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:48.336420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:48.337572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:48.338072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:48.353176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.354109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.359388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.363388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.364027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.367008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.393266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Getting quotas for project 1515789b03a84eef85950bd0724ae183. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:48.402725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Getting quotas for user 7d9aaa40522843a6970973bca5afc70e and project 1515789b03a84eef85950bd0724ae183. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:48.427273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:48.431008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:48.506077 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09622bb0-8c96-4d8e-8ed6-8340c0fd121d tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.027546 Sep 19 14:52:48.506932 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1434/2854] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:48.519096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:48.520105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:48.529290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.530059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.530580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.531576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.532344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.543363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.574510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e22b4b1d-fa82-478a-a9f5-b9408c3d08c6 tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.433758 Sep 19 14:52:48.575478 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1421/2855] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:47 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:48.593946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f5023c85-ef62-4e54-ba03-c66aebc57eac tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde298a59d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1225854213", "description": "tempest-description-871955912"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:48.985911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.000588 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f7b44339-f6c7-4f5f-bf95-5d2c26b43d3f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1501 microversion: 2.1 time: 0.492297 Sep 19 14:52:49.002011 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1435/2856] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:48 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1501 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:49.012558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-unplugged", "status": "completed", "tag": "7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d"}, {"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-unplugged", "status": "completed", "tag": "35aaf68e-ad43-4aa2-9147-e19d82f9e3ff"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:49.043195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.043997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.044600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.065427 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] Creating event network-vif-unplugged:7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:49.066345 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] Creating event network-vif-unplugged:35aaf68e-ad43-4aa2-9147-e19d82f9e3ff for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:49.076730 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e3500eda-65f4-4d53-a855-1a58df8ac994 req-377f4c73-5d0a-4d1d-a89a-263de1d48a6e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.073076 Sep 19 14:52:49.078050 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1436/2857] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:49.085314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:49.086009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.094603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.095341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.096252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.097012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.097518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.098158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.402967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f5023c85-ef62-4e54-ba03-c66aebc57eac tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.824445 Sep 19 14:52:49.413199 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1422/2858] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:49.421423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-deleted", "tag": "7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d"}, {"server_uuid": "df32f195-86cf-4e85-9060-49f2cbde0e39", "name": "network-vif-deleted", "tag": "35aaf68e-ad43-4aa2-9147-e19d82f9e3ff"}, {"server_uuid": "1b37c941-abc2-43d2-939f-dfe8bb75987d", "name": "network-vif-deleted", "tag": "50ff1028-55f6-47b7-afd5-df974bea7f6a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:49.439209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:49.447054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.458070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.460454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.461339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.464032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.465891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.469865 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f098930b-a096-4c40-a09e-80e18b940be3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.387957 Sep 19 14:52:49.470737 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1437/2859] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:49 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:49.482720 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Creating event network-vif-deleted:7c52ca1f-afe1-46bc-9bd4-01cf1b77ea8d for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:49.483256 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Creating event network-vif-deleted:35aaf68e-ad43-4aa2-9147-e19d82f9e3ff for instance df32f195-86cf-4e85-9060-49f2cbde0e39 on n-h1-858384-1 Sep 19 14:52:49.483767 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] Creating event network-vif-deleted:50ff1028-55f6-47b7-afd5-df974bea7f6a for instance 1b37c941-abc2-43d2-939f-dfe8bb75987d on n-h2-858384-1 Sep 19 14:52:49.487755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:49.488614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.500535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.501554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.502300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.503352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.504132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.505318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.505454 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d61d18e5-7b59-48cd-8a32-6fe51c1436ba req-0f87c0a3-f8e2-47ec-af92-e87d86691e7f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090558 Sep 19 14:52:49.507049 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1423/2860] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:49.516134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:49.517743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.528440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.528909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.529453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.545756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.546367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.548178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.626581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.643248 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fc98252-c86f-479a-85c8-d272d936bdae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1273 microversion: 2.1 time: 0.169871 Sep 19 14:52:49.644174 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1438/2861] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:49 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:49.662067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4d6cdb3b-2130-4ba4-b0f1-c5ea70b3ff9a tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] Action: 'create', calling method: .version_select at 0x7fde2e290430>, body: {"security_group": {"name": "tempest-securitygroup-772104742", "description": "tempest-description-1109353168"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:49.694058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.704555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:49.716580 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-27736de3-9238-4cf5-b210-cbbf9b1a49f5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1269 microversion: 2.1 time: 0.205237 Sep 19 14:52:49.717262 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1424/2862] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:49 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:49.739502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:49.744197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.752231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.753014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.754369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.755323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.756439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.757074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.075721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4d6cdb3b-2130-4ba4-b0f1-c5ea70b3ff9a tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.430213 Sep 19 14:52:50.076323 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1439/2863] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:50.091819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ffa54cd-bb7d-4298-ada4-73e7dc73e9e1 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde292b6b80>, body: {"security_group_rule": {"parent_group_id": "bfe5b2fb-f5bd-43dc-a73f-e62431ae753b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4efcc8c6-57ae-4b58-88a7-8298f64eca0b"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:50.230130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lazy-loading 'flavor' on Instance uuid a4335f57-09f8-499b-91c3-6fc75237c0cf {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:52:50.382978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8cb4b31e-45a0-48a7-afe6-f46ae0251a64 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "POST /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf/action" status: 200 len: 32 microversion: 2.1 time: 0.644446 Sep 19 14:52:50.383637 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1425/2864] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:52:49 2022] POST /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf/action => generated 32 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:52:50.396046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d579aefb-ff38-4814-bc43-495ad66b03d2 tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] Calling method '.version_select at 0x7fde2e183af0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:51.022009 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ffa54cd-bb7d-4298-ada4-73e7dc73e9e1 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.935808 Sep 19 14:52:51.023912 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1440/2865] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:52:50 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:51.030340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:51.031376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:51.062377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.062928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.065416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.075856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.076285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.076883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.489154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.501139 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b9721d5-a09c-4f5f-b20e-528eaedae8bd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.475636 Sep 19 14:52:51.502302 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1441/2866] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:51 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:51.508654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:51.509524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:51.530331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.531588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.532395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.542781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.543784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.544573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.886274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.902187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.904043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.905976 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c56bdd2-7542-412b-b85f-b9c45add8c49 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.402218 Sep 19 14:52:51.907180 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1442/2867] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:51 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:51.912702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:51.913321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:51.920246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.920749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.921194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.921902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.922367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.922854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.295003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.312120 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf94d537-a745-446a-bb4f-baac30a8c0ed tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1315 microversion: 2.1 time: 0.402659 Sep 19 14:52:52.314238 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1443/2868] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:51 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:52.323845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:52.325642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:52.337389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.338913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.340058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.342198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.343978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.345923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.514360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.525020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5cf24b2c-fe32-4087-8b42-de743f143bc4 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1275 microversion: 2.1 time: 0.208976 Sep 19 14:52:52.526785 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1444/2869] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:52 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:52.532196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4eded85e-77d7-433d-ae7c-3c9eb55c3a6b tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde29154670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:53.249324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4eded85e-77d7-433d-ae7c-3c9eb55c3a6b tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/4efcc8c6-57ae-4b58-88a7-8298f64eca0b" status: 202 len: 0 microversion: 2.1 time: 0.721216 Sep 19 14:52:53.255518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1445/2870] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:52:52 2022] DELETE /compute/v2.1/os-security-groups/4efcc8c6-57ae-4b58-88a7-8298f64eca0b => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:52:53.268340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b32cdffc-5e63-4f8b-afe3-5a271919fed1 req-24fd85c7-4da3-4cd7-add0-2166d893cb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f302a7cc-4dc3-4c3e-a4f0-ff86038040a9", "name": "network-vif-plugged", "status": "completed", "tag": "556be746-ff32-4417-a1e6-d6a840641e9a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:53.304404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b32cdffc-5e63-4f8b-afe3-5a271919fed1 req-24fd85c7-4da3-4cd7-add0-2166d893cb97 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.306082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b32cdffc-5e63-4f8b-afe3-5a271919fed1 req-24fd85c7-4da3-4cd7-add0-2166d893cb97 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.308198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b32cdffc-5e63-4f8b-afe3-5a271919fed1 req-24fd85c7-4da3-4cd7-add0-2166d893cb97 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.329505 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b32cdffc-5e63-4f8b-afe3-5a271919fed1 req-24fd85c7-4da3-4cd7-add0-2166d893cb97 service nova] Creating event network-vif-plugged:556be746-ff32-4417-a1e6-d6a840641e9a for instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 on n-h2-858384-1 Sep 19 14:52:53.342456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b32cdffc-5e63-4f8b-afe3-5a271919fed1 req-24fd85c7-4da3-4cd7-add0-2166d893cb97 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083714 Sep 19 14:52:53.345092 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1446/2871] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:53.351236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:53.352282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:53.361025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.361720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.362342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.363306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.363943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.364536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.418978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:54.428301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.438339 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7823287a-b839-4d72-8008-9eac179b4e55 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 1.091845 Sep 19 14:52:54.443479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1447/2872] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:53 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:54.471451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:54.472913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:54.490623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.498702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.499649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.500569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.501219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.501848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.809667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.828662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.830196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.831455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f05d83e1-ca20-4295-9b45-28f87224cd13 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1362 microversion: 2.26 time: 0.375899 Sep 19 14:52:54.832030 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1448/2873] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:54 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:54.836850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20cdb254-9e66-4bde-9b0e-3849af1a7dd2 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde29c1a700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.131477 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20cdb254-9e66-4bde-9b0e-3849af1a7dd2 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/bfe5b2fb-f5bd-43dc-a73f-e62431ae753b" status: 200 len: 248 microversion: 2.1 time: 0.298148 Sep 19 14:52:55.132072 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1449/2874] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:52:54 2022] GET /compute/v2.1/os-security-groups/bfe5b2fb-f5bd-43dc-a73f-e62431ae753b => generated 248 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:55.137383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.138280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:55.160124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.160635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.161083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.161806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.162271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.162703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.612830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:55.629999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d480d36-9da5-434d-a4ef-6ebb9174c5be tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1315 microversion: 2.1 time: 0.496816 Sep 19 14:52:55.634382 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1450/2875] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:55 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:55.645236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.649799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:55.667135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.668483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.669195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.670163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.671072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.672090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.045306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.055242 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d579aefb-ff38-4814-bc43-495ad66b03d2 tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] 10.222.0.81 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11158 microversion: 2.1 time: 5.668184 Sep 19 14:52:56.056367 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-095a2074-66be-4cec-be14-1841aba1c7e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1317 microversion: 2.1 time: 0.419167 Sep 19 14:52:56.056506 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1426/2876] 10.222.0.81 () {58 vars in 1191 bytes} [Mon Sep 19 14:52:50 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11158 bytes in 5670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:52:56.061363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bc3e4239-b2c3-4086-8d02-900ae4af24fc req-b10f518e-86d7-46cf-b3de-3fd621e3c480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55da8d7b-72af-408b-b106-083426af6edf", "tag": "5c270f0e-bc8d-4c2b-afbc-8734e6ea2423"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:56.083032 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1451/2877] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:55 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:56.087798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bc3e4239-b2c3-4086-8d02-900ae4af24fc req-b10f518e-86d7-46cf-b3de-3fd621e3c480 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.090157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d1bf518-7893-4603-81fc-a52216f6bf44 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde298a8790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-720548571", "description": "tempest-description-577665982"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:56.090809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bc3e4239-b2c3-4086-8d02-900ae4af24fc req-b10f518e-86d7-46cf-b3de-3fd621e3c480 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.091306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bc3e4239-b2c3-4086-8d02-900ae4af24fc req-b10f518e-86d7-46cf-b3de-3fd621e3c480 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.113081 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bc3e4239-b2c3-4086-8d02-900ae4af24fc req-b10f518e-86d7-46cf-b3de-3fd621e3c480 service nova] Creating event network-changed:5c270f0e-bc8d-4c2b-afbc-8734e6ea2423 for instance 55da8d7b-72af-408b-b106-083426af6edf on n-h1-858384-1 Sep 19 14:52:56.119787 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bc3e4239-b2c3-4086-8d02-900ae4af24fc req-b10f518e-86d7-46cf-b3de-3fd621e3c480 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061798 Sep 19 14:52:56.121188 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1427/2878] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:56.141856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:56.144023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:56.159115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.160564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.161449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.163401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.165834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.167132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.557420 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d1bf518-7893-4603-81fc-a52216f6bf44 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.472561 Sep 19 14:52:56.566887 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1452/2879] 10.222.0.81 () {60 vars in 1180 bytes} [Mon Sep 19 14:52:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:56.577731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1687443820", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "f7528ce0-0461-4aa4-8888-783d94f24dab"}, {"uuid": "d4455d2a-b4f5-42d4-8f73-dd3c95144b03"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:56.690332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] validate_networks() for [('f7528ce0-0461-4aa4-8888-783d94f24dab', None, None, None, None, None), ('d4455d2a-b4f5-42d4-8f73-dd3c95144b03', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:56.747611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.758182 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8d02db7-33b0-42f1-b756-dc70885ec09c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.635479 Sep 19 14:52:56.770635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1428/2880] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:56 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:56.782047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:56.785132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:56.801145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.810557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.811429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.813341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.814705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.816237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.160754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:57.171020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:57.172820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:57.174231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0d419bf-a016-4450-b814-5cdf4e520b78 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1545 microversion: 2.26 time: 0.401613 Sep 19 14:52:57.175108 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1429/2881] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:56 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1545 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:57.180738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-69660296-db70-454c-9ae7-5b68ce39b1cc tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] Calling method '.version_select at 0x7fde298a58b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:57.659613 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-69660296-db70-454c-9ae7-5b68ce39b1cc tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.483243 Sep 19 14:52:57.660208 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1430/2882] 10.222.0.81 () {58 vars in 1191 bytes} [Mon Sep 19 14:52:57 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:57.665070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d22a65bb-7541-4274-8bf5-5afc372e429d tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2a07a700>, body: {"security_group_rule": {"parent_group_id": "c0ee991b-179e-41dc-9b0b-083ea248b205", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:58.341332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:58.342190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:58.345338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:58.346352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:58.347796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:58.362442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.363657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.364517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.366987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.368087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.368988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.386155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d22a65bb-7541-4274-8bf5-5afc372e429d tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.724589 Sep 19 14:52:58.387073 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1431/2883] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:52:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:58.393342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:58.394181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:58.418294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Getting quotas for project 330cbd8155454fa38afb8a95b0e4fd9f. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:58.419461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.419961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.420401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.421119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.421575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.422163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.426887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Getting quotas for user f857828528b349c684b49b9d756d3868 and project 330cbd8155454fa38afb8a95b0e4fd9f. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:58.444811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:58.448655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:58.512319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b3dae47-a967-49e2-95c3-8677e02d0bb5 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.943678 Sep 19 14:52:58.513454 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1453/2884] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:58.518584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:58.519581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:58.526358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:58.529086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.529945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.530585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.531678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.532973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.533879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.738742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.749200 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff28e0d9-ea6b-4f8b-aa2f-515a1602eb6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1315 microversion: 2.1 time: 0.361046 Sep 19 14:52:58.749829 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1432/2885] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:58 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:58.769445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29893160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:58.801232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.801741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.802192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.802689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:58.819083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.822106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.822106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.824414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.824902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.825346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.838886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.848410 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c8a0b8d8-44fa-4d1e-8a24-07ae7c8f6cf5 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1317 microversion: 2.1 time: 0.333664 Sep 19 14:52:58.849430 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1454/2886] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:58 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:58.856667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85bd2cf7-721f-4615-8d0b-6126e74ed01c tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] Calling method '.version_select at 0x7fde29ee3d30>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:58.885788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.886387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.887242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.933376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.934073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.934991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.978434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:52:58.999518 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7fb1e96-b793-404a-9a45-5e4ebb5c7465 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-820469739" status: 201 len: 0 microversion: 2.26 time: 0.238610 Sep 19 14:52:59.001242 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1433/2887] 10.222.0.81 () {62 vars in 1377 bytes} [Mon Sep 19 14:52:58 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-820469739 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 19 14:52:59.008443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.009482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:59.020015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.020981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.021621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.022528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.024138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.024791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.250719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:59.259574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5ae8ad6-7cd4-46e3-b1ec-ea91eef229db tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.257069 Sep 19 14:52:59.260218 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1434/2888] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:59.282846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-813e6e3e-b6b1-41d0-bd93-017787e827e8 req-d44b3efe-11c1-4aed-9fa1-50c0b5b787e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abd8475-c423-4c22-9504-869890eb5eaa", "tag": "5c6276fe-94b2-4b19-aeda-efc82ce07632"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:59.284511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-85bd2cf7-721f-4615-8d0b-6126e74ed01c tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/0146a620-cc6c-48c0-81dd-922f0f368088" status: 202 len: 0 microversion: 2.1 time: 0.431949 Sep 19 14:52:59.285294 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1455/2889] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:52:58 2022] DELETE /compute/v2.1/os-security-groups/0146a620-cc6c-48c0-81dd-922f0f368088 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:52:59.294238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b587e278-cbf7-4c3c-a1f4-2dc99e5e02ca req-bfc36f5e-0429-48e3-b1f9-5f4f5b59569c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55da8d7b-72af-408b-b106-083426af6edf", "name": "network-vif-plugged", "status": "completed", "tag": "5c270f0e-bc8d-4c2b-afbc-8734e6ea2423"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:59.310390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-813e6e3e-b6b1-41d0-bd93-017787e827e8 req-d44b3efe-11c1-4aed-9fa1-50c0b5b787e2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.313943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-813e6e3e-b6b1-41d0-bd93-017787e827e8 req-d44b3efe-11c1-4aed-9fa1-50c0b5b787e2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.315109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-813e6e3e-b6b1-41d0-bd93-017787e827e8 req-d44b3efe-11c1-4aed-9fa1-50c0b5b787e2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.347714 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-813e6e3e-b6b1-41d0-bd93-017787e827e8 req-d44b3efe-11c1-4aed-9fa1-50c0b5b787e2 service nova] Creating event network-changed:5c6276fe-94b2-4b19-aeda-efc82ce07632 for instance 2abd8475-c423-4c22-9504-869890eb5eaa on n-h2-858384-1 Sep 19 14:52:59.348701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b587e278-cbf7-4c3c-a1f4-2dc99e5e02ca req-bfc36f5e-0429-48e3-b1f9-5f4f5b59569c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.349309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b587e278-cbf7-4c3c-a1f4-2dc99e5e02ca req-bfc36f5e-0429-48e3-b1f9-5f4f5b59569c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.352544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b587e278-cbf7-4c3c-a1f4-2dc99e5e02ca req-bfc36f5e-0429-48e3-b1f9-5f4f5b59569c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.363692 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-813e6e3e-b6b1-41d0-bd93-017787e827e8 req-d44b3efe-11c1-4aed-9fa1-50c0b5b787e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100667 Sep 19 14:52:59.371139 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1435/2890] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:59.388481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-18818927-1166-4e55-b137-1dbbd52c9235 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Action: 'create', calling method: .version_select at 0x7fde2e1dfa60>, body: {"security_group_rule": {"parent_group_id": "c0ee991b-179e-41dc-9b0b-083ea248b205", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:59.393948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b587e278-cbf7-4c3c-a1f4-2dc99e5e02ca req-bfc36f5e-0429-48e3-b1f9-5f4f5b59569c service nova] Creating event network-vif-plugged:5c270f0e-bc8d-4c2b-afbc-8734e6ea2423 for instance 55da8d7b-72af-408b-b106-083426af6edf on n-h1-858384-1 Sep 19 14:52:59.415131 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b587e278-cbf7-4c3c-a1f4-2dc99e5e02ca req-bfc36f5e-0429-48e3-b1f9-5f4f5b59569c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124186 Sep 19 14:52:59.422071 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1456/2891] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:59.452385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cd0d2c6a-1a30-498c-bdc9-004c5f3113e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.455051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cd0d2c6a-1a30-498c-bdc9-004c5f3113e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:59.644875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd0d2c6a-1a30-498c-bdc9-004c5f3113e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:59.655562 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cd0d2c6a-1a30-498c-bdc9-004c5f3113e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1213 microversion: 2.1 time: 0.230983 Sep 19 14:52:59.658272 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1457/2892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:59.674989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0633f0d0-46ed-45fb-9a6a-58b9fb20b9ee tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde292b6040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.704227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0633f0d0-46ed-45fb-9a6a-58b9fb20b9ee tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.705114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0633f0d0-46ed-45fb-9a6a-58b9fb20b9ee tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.708170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0633f0d0-46ed-45fb-9a6a-58b9fb20b9ee tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.757004 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0633f0d0-46ed-45fb-9a6a-58b9fb20b9ee tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-820469739" status: 204 len: 0 microversion: 2.26 time: 0.096150 Sep 19 14:52:59.763145 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1458/2893] 10.222.0.81 () {60 vars in 1358 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-820469739 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:52:59.771737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee27f7dc-6740-4db7-967b-84373c0aed13 tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] Calling method '.version_select at 0x7fde2921b1f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.169144 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee27f7dc-6740-4db7-967b-84373c0aed13 tempest-SecurityGroupsTestAdminJSON-887761846 tempest-SecurityGroupsTestAdminJSON-887761846-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/50446286-5b75-4bbf-9f00-d5a65eeb2aee" status: 202 len: 0 microversion: 2.1 time: 0.404519 Sep 19 14:53:00.170353 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1459/2894] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:52:59 2022] DELETE /compute/v2.1/os-security-groups/50446286-5b75-4bbf-9f00-d5a65eeb2aee => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:00.176328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29ee3700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.197349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.200941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.205528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.206216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.208477 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-18818927-1166-4e55-b137-1dbbd52c9235 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.835040 Sep 19 14:53:00.209315 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1436/2895] 10.222.0.81 () {60 vars in 1195 bytes} [Mon Sep 19 14:52:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:00.215984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.220074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.220689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.221172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.221683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.222476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.234770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.235361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.235624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.235961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.236086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.236815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.237347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.249344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.286564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.287114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.287566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.313562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:00.333906 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-58afae59-4363-43bd-b3fe-27741bead80f tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.162167 Sep 19 14:53:00.335542 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1460/2896] 10.222.0.81 () {60 vars in 1295 bytes} [Mon Sep 19 14:53:00 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:53:00.342078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.343079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.351147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.352320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.352929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.353958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.354780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.355584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.593039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:00.611619 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5238cd00-6239-4a4d-9b18-a5b60ac49e93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1315 microversion: 2.1 time: 0.400562 Sep 19 14:53:00.611888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1437/2897] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:00 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:00.621423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86c00fba-f261-4f87-8bd9-9eea6d175bf2 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] Calling method '.version_select at 0x7fde2e1dfb80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.631145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:00.641307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb7189e1-8b83-4d12-8b93-3e4aeaa898d0 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1317 microversion: 2.1 time: 0.304471 Sep 19 14:53:00.642494 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1461/2898] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:00 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:00.647597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c4904234-11d0-4ba7-82df-211851889733 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde299f41f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.738339 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c4904234-11d0-4ba7-82df-211851889733 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/c0ee991b-179e-41dc-9b0b-083ea248b205" status: 200 len: 663 microversion: 2.1 time: 0.094635 Sep 19 14:53:00.747746 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1462/2899] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 14:53:00 2022] GET /compute/v2.1/os-security-groups/c0ee991b-179e-41dc-9b0b-083ea248b205 => generated 663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:00.747746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.747746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.754464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.755004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.755446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.756569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.757323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.757918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.069231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.073839 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86c00fba-f261-4f87-8bd9-9eea6d175bf2 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/2de48521-3fcb-42f5-9310-90898d5e493c" status: 202 len: 0 microversion: 2.1 time: 0.459645 Sep 19 14:53:01.078593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1438/2900] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:00 2022] DELETE /compute/v2.1/os-security-groups/2de48521-3fcb-42f5-9310-90898d5e493c => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:01.086287 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2b399e0-5f55-449d-b2a8-2a37f63a5fcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.345906 Sep 19 14:53:01.093010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e70aa47b-9be0-42d0-afa3-b912b557d857 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde2a0a7280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.103254 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1463/2901] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:00 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:01.114334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.114997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:01.123949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e70aa47b-9be0-42d0-afa3-b912b557d857 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.124473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e70aa47b-9be0-42d0-afa3-b912b557d857 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.126896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e70aa47b-9be0-42d0-afa3-b912b557d857 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.127860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.128367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.128809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.129523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.129982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.130412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.153583 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e70aa47b-9be0-42d0-afa3-b912b557d857 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 200 len: 12 microversion: 2.26 time: 0.073357 Sep 19 14:53:01.154522 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1439/2902] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:53:01 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 12 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:01.161358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d821208-9b0d-4ca9-8455-b04a3c8d1b8c tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde2e183940>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.238858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.253694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57ed9c81-5fe5-4524-abff-750e03b633ff tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1273 microversion: 2.1 time: 0.148613 Sep 19 14:53:01.256585 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1464/2903] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:01 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:01.271589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-98c11bcc-20dd-4889-815c-0c019cd4c368 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] Calling method '.version_select at 0x7fde299f4430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.482875 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d821208-9b0d-4ca9-8455-b04a3c8d1b8c tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-group-rules/80f68f26-ae9e-4790-8e64-8ea8e9a7c1a6" status: 202 len: 0 microversion: 2.1 time: 0.326926 Sep 19 14:53:01.483450 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1440/2904] 10.222.0.81 () {58 vars in 1287 bytes} [Mon Sep 19 14:53:01 2022] DELETE /compute/v2.1/os-security-group-rules/80f68f26-ae9e-4790-8e64-8ea8e9a7c1a6 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:01.490358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde2e136a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.511453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.511946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.512384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.512871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:01.533287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.539049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.539540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.540304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.540802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.541256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.607961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.611430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.611902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.632625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.633113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.633550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.687485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:01.706592 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-995e5e72-3a86-4514-b10c-46324e1a1aaf tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2015485843" status: 201 len: 0 microversion: 2.26 time: 0.221119 Sep 19 14:53:01.707466 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1441/2905] 10.222.0.81 () {62 vars in 1380 bytes} [Mon Sep 19 14:53:01 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2015485843 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 19 14:53:01.720441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a542688f-2df2-45da-90fe-396a88390fc6 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde297def70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.727405 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-98c11bcc-20dd-4889-815c-0c019cd4c368 tempest-SecurityGroupsTestAdminJSON-1687735220 tempest-SecurityGroupsTestAdminJSON-1687735220-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/16ee8261-0761-4601-bab7-90ad90dc313f" status: 202 len: 0 microversion: 2.1 time: 0.467591 Sep 19 14:53:01.736168 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1465/2906] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:01 2022] DELETE /compute/v2.1/os-security-groups/16ee8261-0761-4601-bab7-90ad90dc313f => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:01.742312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.743361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:01.753129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.753951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.754629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.755380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.755842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.756271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.998589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.011589 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-38927713-5dd4-4342-9d13-2b2af5a6cda3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1501 microversion: 2.1 time: 0.273654 Sep 19 14:53:02.012193 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1466/2907] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:01 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1501 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.037793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.038969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.047994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.048957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.049821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.050832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.051806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.052609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.208399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a542688f-2df2-45da-90fe-396a88390fc6 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c0ee991b-179e-41dc-9b0b-083ea248b205" status: 202 len: 0 microversion: 2.1 time: 0.493548 Sep 19 14:53:02.208983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1442/2908] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:01 2022] DELETE /compute/v2.1/os-security-groups/c0ee991b-179e-41dc-9b0b-083ea248b205 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:02.219955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3b05f74f-1a74-4156-b514-036d3bc4fb11 req-63f16c50-080a-4af9-a325-b9add519e704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abd8475-c423-4c22-9504-869890eb5eaa", "name": "network-vif-plugged", "status": "completed", "tag": "5c6276fe-94b2-4b19-aeda-efc82ce07632"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:02.239028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3b05f74f-1a74-4156-b514-036d3bc4fb11 req-63f16c50-080a-4af9-a325-b9add519e704 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.239573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3b05f74f-1a74-4156-b514-036d3bc4fb11 req-63f16c50-080a-4af9-a325-b9add519e704 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.240486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3b05f74f-1a74-4156-b514-036d3bc4fb11 req-63f16c50-080a-4af9-a325-b9add519e704 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.258517 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3b05f74f-1a74-4156-b514-036d3bc4fb11 req-63f16c50-080a-4af9-a325-b9add519e704 service nova] Creating event network-vif-plugged:5c6276fe-94b2-4b19-aeda-efc82ce07632 for instance 2abd8475-c423-4c22-9504-869890eb5eaa on n-h2-858384-1 Sep 19 14:53:02.273018 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3b05f74f-1a74-4156-b514-036d3bc4fb11 req-63f16c50-080a-4af9-a325-b9add519e704 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059888 Sep 19 14:53:02.274286 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1443/2909] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:02.285497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa1cfbe9-8230-48ac-b329-a9d4b230de57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde299f55e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.298306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1cfbe9-8230-48ac-b329-a9d4b230de57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.312667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1cfbe9-8230-48ac-b329-a9d4b230de57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.315010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1cfbe9-8230-48ac-b329-a9d4b230de57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.332007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.341487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa1cfbe9-8230-48ac-b329-a9d4b230de57 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 200 len: 36 microversion: 2.26 time: 0.065500 Sep 19 14:53:02.343118 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1444/2910] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 36 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.350322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.352394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.360436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.361340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.361966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.363049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.363791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.365008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.376893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c8229df5-93f7-4ec3-a866-bdfbbbf1cc7f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1317 microversion: 2.1 time: 0.361831 Sep 19 14:53:02.377629 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1467/2911] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.401072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.402126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.405445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:02.413511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:02.416609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.418920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.420761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.422206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.424679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.425297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.516352 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f892922-971a-43f3-b02f-cfe0c87098eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 204 len: 0 microversion: 2.1 time: 0.171169 Sep 19 14:53:02.518820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1445/2912] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:02 2022] DELETE /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:53:02.524592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde299f5ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.571683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG neutronclient.v2_0.client [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist", "detail": ""}} {{(pid=128730) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 19 14:53:02.574247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.security_group_api [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Neutron security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b not found {{(pid=128730) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 19 14:53:02.574247 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] HTTP exception thrown: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.574247 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Request method failure captured: Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-security-groups/4efcc8c6-57ae-4b58-88a7-8298f64eca0b HTTP/1.1 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIIyLmkkJ4PNKkBp2DlcKXyK3qF3dHka1xN8X7evSJ1zP35qDFXgXTpVpSomxADOmYf5_FvsPs0Sbpj-3sOjvMQTs_Cwg28fJO9yrJgki73rawB78w5DWlvABBQ7ESfqUwlLyTmi4lzat1Hr-nQ7jb4nyxmPitvRHKDMx-QZHeGAGb8 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: b3c122c57bfa4c3899833e9f719ebc66 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-17806908 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b3c122c57bfa4c3899833e9f719ebc66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b3c122c57bfa4c3899833e9f719ebc66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b3c122c57bfa4c3899833e9f719ebc66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b3c122c57bfa4c3899833e9f719ebc66"}]}] Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-SecurityGroupRulesTestJSON-17806908 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: b3c122c57bfa4c3899833e9f719ebc66 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-17806908 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-SecurityGroupRulesTestJSON-17806908-project Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ed782d9b048b41149994a8622a41aca2 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-SecurityGroupRulesTestJSON-17806908-project Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: exception: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4efcc8c6-57ae-4b58-88a7-8298f64eca0b'} Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 19 14:53:02.577546 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Returning 404 to user: Security group 4efcc8c6-57ae-4b58-88a7-8298f64eca0b does not exist Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: Neutron server returns request_ids: ['req-e915f97a-aef6-4e8e-a405-583a9b07ec20'] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-29fe8f63-0130-4624-9243-bc376599df18 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/4efcc8c6-57ae-4b58-88a7-8298f64eca0b" status: 404 len: 194 microversion: 2.1 time: 0.058863 Sep 19 14:53:02.583621 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1446/2913] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:02 2022] DELETE /compute/v2.1/os-security-groups/4efcc8c6-57ae-4b58-88a7-8298f64eca0b => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:02.592743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.592743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.603166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.605020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.605386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.606362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.606846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.607286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.614504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.623889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c772ec5-6e18-4c17-89a6-79542f32467a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.230543 Sep 19 14:53:02.628835 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1468/2914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.638245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29bbf1f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.646616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.647147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.647590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.648285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.654798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.655483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.656099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.656881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.657341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.657790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.682657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.683183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.683630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.712526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:02.740621 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a951a04-4a86-4dbc-b936-67f2a4575f50 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2015485843" status: 204 len: 0 microversion: 2.26 time: 0.110302 Sep 19 14:53:02.743195 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1469/2915] 10.222.0.81 () {60 vars in 1364 bytes} [Mon Sep 19 14:53:02 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2015485843 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:53:02.753292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.753876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.764648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.765581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.766032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.766845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.767459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.767899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.869206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.879769 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-821b7f9b-401b-4544-8e56-1a14311fca35 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1313 microversion: 2.1 time: 0.296499 Sep 19 14:53:02.896384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1447/2916] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.902243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-33777dd0-ce37-49ba-b5d1-99442c4c34ba tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde29dcf8b0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.037428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:03.047008 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37908802-6f88-4596-8dae-78aae90facc8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1507 microversion: 2.1 time: 0.301439 Sep 19 14:53:03.059837 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1470/2917] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:03.069982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e85e71f0-d6d1-4375-b9ca-4fc8eed21203 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde299cf940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.078897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e85e71f0-d6d1-4375-b9ca-4fc8eed21203 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.079702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e85e71f0-d6d1-4375-b9ca-4fc8eed21203 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.080249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e85e71f0-d6d1-4375-b9ca-4fc8eed21203 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.088887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:DELETE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:03.092572 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e85e71f0-d6d1-4375-b9ca-4fc8eed21203 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 200 len: 12 microversion: 2.26 time: 0.031656 Sep 19 14:53:03.093781 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1471/2918] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:53:03 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:03.107886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29d79a60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.117245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.118146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.118891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.119725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.126948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.127827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.128723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.129211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.129783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.130306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.167691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.169113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.171282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.198874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:03.228315 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e4e6dd6-63a4-4c81-bf42-ff87eaa94918 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.127108 Sep 19 14:53:03.230452 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1472/2919] 10.222.0.81 () {60 vars in 1295 bytes} [Mon Sep 19 14:53:03 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 14:53:03.246149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29ba6280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.265643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.266244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.266912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.267585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.277842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.279074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.279700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.280636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.282018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.283116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.321681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.323181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.323792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.336465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.337231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.338666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.377574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:03.398985 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f7312c6a-7b69-4f8c-895f-c4c5da1dfa97 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2038478691" status: 201 len: 0 microversion: 2.26 time: 0.162538 Sep 19 14:53:03.400086 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1473/2920] 10.222.0.81 () {62 vars in 1380 bytes} [Mon Sep 19 14:53:03 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2038478691 => generated 0 bytes in 164 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 19 14:53:03.417453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.418623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.424881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.425370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.425800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.426687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.427330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.427960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.428307 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-33777dd0-ce37-49ba-b5d1-99442c4c34ba tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/bfe5b2fb-f5bd-43dc-a73f-e62431ae753b" status: 202 len: 0 microversion: 2.1 time: 0.530870 Sep 19 14:53:03.428902 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1448/2921] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:02 2022] DELETE /compute/v2.1/os-security-groups/bfe5b2fb-f5bd-43dc-a73f-e62431ae753b => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:03.434657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde299f5a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.454483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.463685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.464307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.465041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.482819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.483326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.483982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.484868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.485493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.486085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.525219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.526326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.527136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.539663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.540548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.542356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.580727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:03.604408 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3a76260-1325-45c9-9273-0f65ae5a4e2b tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2015753456" status: 201 len: 0 microversion: 2.26 time: 0.173359 Sep 19 14:53:03.606012 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1449/2922] 10.222.0.81 () {62 vars in 1380 bytes} [Mon Sep 19 14:53:03 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-2015753456 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 19 14:53:03.611570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea478436-b692-4e75-b1bc-f3a42f55675c tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde2e183ca0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.888963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:03.898545 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-901d5099-33f3-4572-ac55-cc82a34b5435 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1317 microversion: 2.1 time: 0.496518 Sep 19 14:53:03.899199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1474/2923] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:03 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:03.918796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde2e28b940>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.928582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.929391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.930182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.930890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.939646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.940230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.940674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.941573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.942204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.942832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.969173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.969671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.970111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.987328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:04.006804 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdb45535-62b6-4cdd-be40-58e09a623a37 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.106273 Sep 19 14:53:04.007800 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1475/2924] 10.222.0.81 () {60 vars in 1295 bytes} [Mon Sep 19 14:53:03 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:53:04.017193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.018378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.027176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.027176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.028020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.029013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.029240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.029868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.286218 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea478436-b692-4e75-b1bc-f3a42f55675c tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/d43cb8a6-5766-42ac-8f88-39b45be6a698" status: 202 len: 0 microversion: 2.1 time: 0.678852 Sep 19 14:53:04.287346 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1450/2925] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:03 2022] DELETE /compute/v2.1/os-security-groups/d43cb8a6-5766-42ac-8f88-39b45be6a698 => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:04.294954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.295740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.303240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.304071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.304755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.305486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.306162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.307242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.319271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.343834 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78d7a15c-8cd9-481c-8838-1b1fd836e2a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.334640 Sep 19 14:53:04.362319 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1476/2926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:04.382056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba0870c7-5db3-40ef-b4f0-e477c7fb35b7 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde2e290040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.399731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba0870c7-5db3-40ef-b4f0-e477c7fb35b7 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.401698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba0870c7-5db3-40ef-b4f0-e477c7fb35b7 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.402469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba0870c7-5db3-40ef-b4f0-e477c7fb35b7 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.415958 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba0870c7-5db3-40ef-b4f0-e477c7fb35b7 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 200 len: 12 microversion: 2.26 time: 0.053830 Sep 19 14:53:04.417077 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1477/2927] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:04.426462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.428434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.445112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.445944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.446611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.448211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.448931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.449603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.737882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.747229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c59bf16c-a04d-4e2c-8c09-eed38bd2cd33 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 0.458306 Sep 19 14:53:04.763089 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1451/2928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:04.771710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b17a26f3-59e3-49ec-880b-afdc697f86f4 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde2a9ca3a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.801224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.813286 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-108e19f5-ec50-4b13-8c15-9a20e18efc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 200 len: 1507 microversion: 2.1 time: 0.394507 Sep 19 14:53:04.827641 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1478/2929] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:04.841939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29b608b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.850993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.851503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.851948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.852436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.859251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.859693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.860135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.860861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.861407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.861750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.896647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.897233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.897575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.910327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:04.929042 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d162a815-3b76-4471-83a5-92455691926d tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.100260 Sep 19 14:53:04.930267 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1479/2930] 10.222.0.81 () {60 vars in 1295 bytes} [Mon Sep 19 14:53:04 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:53:04.938977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.940005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.948954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.949947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.950627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.951588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.952524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.953178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.379310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:05.392177 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f36acae2-e84f-4397-bf7a-0342a00ac576 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1508 microversion: 2.1 time: 0.460543 Sep 19 14:53:05.393677 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1480/2931] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:05.413629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde2e241310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:05.422563 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b17a26f3-59e3-49ec-880b-afdc697f86f4 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c0b99aae-3941-4ce3-a0d5-785a8fe981e5" status: 202 len: 0 microversion: 2.1 time: 0.657622 Sep 19 14:53:05.423641 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1452/2932] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:04 2022] DELETE /compute/v2.1/os-security-groups/c0b99aae-3941-4ce3-a0d5-785a8fe981e5 => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:05.431367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-da6ad22c-ab2f-4daf-a839-05383860a472 req-99eea649-e552-4b88-b1a0-94872c07346c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55da8d7b-72af-408b-b106-083426af6edf", "name": "network-vif-deleted", "tag": "5c270f0e-bc8d-4c2b-afbc-8734e6ea2423"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:05.457287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.458123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.458946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.459685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:05.465369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-da6ad22c-ab2f-4daf-a839-05383860a472 req-99eea649-e552-4b88-b1a0-94872c07346c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.465865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-da6ad22c-ab2f-4daf-a839-05383860a472 req-99eea649-e552-4b88-b1a0-94872c07346c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.466309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-da6ad22c-ab2f-4daf-a839-05383860a472 req-99eea649-e552-4b88-b1a0-94872c07346c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.468468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.469313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.469858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.471636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.473152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.473989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.494055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-da6ad22c-ab2f-4daf-a839-05383860a472 req-99eea649-e552-4b88-b1a0-94872c07346c service nova] Creating event network-vif-deleted:5c270f0e-bc8d-4c2b-afbc-8734e6ea2423 for instance 55da8d7b-72af-408b-b106-083426af6edf on n-h1-858384-1 Sep 19 14:53:05.503482 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-da6ad22c-ab2f-4daf-a839-05383860a472 req-99eea649-e552-4b88-b1a0-94872c07346c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076868 Sep 19 14:53:05.504835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1453/2933] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:05.518462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:05.520349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:05.549727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.550235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.550680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.563671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.564202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.564640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.565368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.565834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.570236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.589688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.590187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.590605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.647360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:05.696970 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40a131d2-00f2-4f54-be1c-b6d234fc6fa5 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-845169146" status: 201 len: 0 microversion: 2.26 time: 0.301646 Sep 19 14:53:05.698007 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1481/2934] 10.222.0.81 () {62 vars in 1377 bytes} [Mon Sep 19 14:53:05 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-845169146 => generated 0 bytes in 303 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 19 14:53:05.706394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:05.707075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:05.722707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.725992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.729520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.732200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.733027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.733745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.998510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:06.012829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:06.037149 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d34dda79-25ae-4143-be1f-80c230d30dfe tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1508 microversion: 2.1 time: 0.337943 Sep 19 14:53:06.038119 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-750d11e6-3ffb-465b-b8d6-7fea62a64107 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.532130 Sep 19 14:53:06.038831 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1482/2935] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:05 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.039637 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1454/2936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:05 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.051495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde299f5160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.057292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff1a16b6-7a57-4d39-9668-9f3e8aba8855 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde29903b80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.080349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.081399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.082079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.083721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.093474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.094592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.098028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.099805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.109457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.110671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.161815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.163200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.164275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.182599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.194463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.195868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.234841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:06.267028 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d9ebe522-640a-4df9-81c8-a668e606ba3c tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-310782686" status: 201 len: 0 microversion: 2.26 time: 0.220807 Sep 19 14:53:06.274487 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1455/2937] 10.222.0.81 () {62 vars in 1377 bytes} [Mon Sep 19 14:53:06 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags/tempest-tag-310782686 => generated 0 bytes in 232 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 19 14:53:06.288462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.289601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.300878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.301921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.302597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.306200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.306924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.307499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.559449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff1a16b6-7a57-4d39-9668-9f3e8aba8855 tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/631739c0-ed10-4ab2-9f63-f674fa2f86f9" status: 202 len: 0 microversion: 2.1 time: 0.518307 Sep 19 14:53:06.563830 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1483/2938] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:06 2022] DELETE /compute/v2.1/os-security-groups/631739c0-ed10-4ab2-9f63-f674fa2f86f9 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:06.574645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.575891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.586632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:06.593890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.595202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.596330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.597631 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-862933a9-4e72-4601-bdb6-29e406eff775 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 0.313447 Sep 19 14:53:06.598237 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1456/2939] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:06 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.599162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.600451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.608921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.645980 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf HTTP/1.1 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '55da8d7b-72af-408b-b106-083426af6edf'} Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:06.648438 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8fe121b8-dd21-4443-87fc-415dfeebb503 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 404 len: 111 microversion: 2.1 time: 0.084324 Sep 19 14:53:06.656790 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1484/2940] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:06 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:06.663134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:06.666805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.676416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.677210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.678014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.679292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.680388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.681087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.709553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:06.780102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08611cc0-82bd-4679-a089-713bb03e3729 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "PUT /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1080 microversion: 2.1 time: 0.124612 Sep 19 14:53:06.794782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1485/2941] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 14:53:06 2022] PUT /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1080 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.794782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Action: 'update_all', calling method: .version_select at 0x7fde2e28b940>, body: {"tags": ["tempest-tag-2039808637", "tempest-tag-1432284564"]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:06.802308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.802863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.803311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.803804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.813104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.813644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.815004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.815747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.816367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.816799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.868384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.868920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.870056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.875003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a3c780f-fc15-4a76-986b-a15b8d36cf2e tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde29f26820>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP0hBCJEH/eaShcAijHk8ZMgEq1CHyuHtQh6niFkvF/uauJ2VfvB+i/M/UnEf6RHb/SCIs3ISEQHFnUfgBxIdzXhckkoGhnf7ZxPacrh5UfMnxQy67wMTQvzqJMA9uL/A=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a3c780f-fc15-4a76-986b-a15b8d36cf2e tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 257 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP0hBCJEH/eaShcAijHk8ZMgEq1CHyuHtQh6niFkvF/uauJ2VfvB+i/M/UnEf6RHb/SCIs3ISEQHFnUfgBxIdzXhckkoGhnf7ZxPacrh5UfMnxQy67wMTQvzqJMA9uL/A=="}} Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP0hBCJEH/eaShcAijHk8ZMgEq1CHyuHtQh6niFkvF/uauJ2VfvB+i/M/UnEf6RHb/SCIs3ISEQHFnUfgBxIdzXhckkoGhnf7ZxPacrh5UfMnxQy67wMTQvzqJMA9uL/A=='}}} Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 19 14:53:06.880098 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 19 14:53:06.886020 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:06.890135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a3c780f-fc15-4a76-986b-a15b8d36cf2e tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:06.891230 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a3c780f-fc15-4a76-986b-a15b8d36cf2e tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.279161 Sep 19 14:53:06.892329 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1457/2942] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:06 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:53:06.901092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d328a7c-71b3-4660-a076-2b7817de9bdc tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] Calling method '.version_select at 0x7fde298a54c0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.905583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:06.929209 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c478541-9afd-4dd4-bfc2-de6d12e4f639 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 200 len: 62 microversion: 2.26 time: 0.147016 Sep 19 14:53:06.930340 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1486/2943] 10.222.0.81 () {62 vars in 1312 bytes} [Mon Sep 19 14:53:06 2022] PUT /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 62 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.936177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1607386892", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:07.022157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:53:07.451064 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d328a7c-71b3-4660-a076-2b7817de9bdc tempest-SecurityGroupRulesTestJSON-17806908 tempest-SecurityGroupRulesTestJSON-17806908-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/e448ade1-2770-4065-914c-b696b6af3ed4" status: 202 len: 0 microversion: 2.1 time: 0.557422 Sep 19 14:53:07.451748 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1458/2944] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:53:06 2022] DELETE /compute/v2.1/os-security-groups/e448ade1-2770-4065-914c-b696b6af3ed4 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:07.457127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:07.458150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:07.467956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.474455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.475216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.476335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.477100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.477952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.985410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:07.993791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-672ebb92-2f8c-4730-b26e-d8559c0a9214 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1506 microversion: 2.1 time: 0.540707 Sep 19 14:53:08.004272 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1459/2945] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:07 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:08.010253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde297de940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1633515302", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:08.039156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:08.049845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for user 5678b26305e54e7d9ad09f0f405ccd71 and project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:08.084537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:53:08.085091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:53:08.085469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:53:08.085866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:53:08.088756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:53:08.095093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:08.116385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=21 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 2167 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1633515302", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:08.124209 n-d-858384-1 devstack@n-api.service[128730]: exception: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1633515302', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:08.126625 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:08.130247 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:08.134093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.134093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.134093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.138447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:08.138447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-faf047ad-2a28-42ec-a008-0e3f10485979 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.132250 Sep 19 14:53:08.138918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.139515 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1460/2946] 10.222.0.81 () {60 vars in 1160 bytes} [Mon Sep 19 14:53:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:08.142186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.142186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.149037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9963fb31-b82b-4c18-a6c4-1c4b1fffa468 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29d70550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:08.160236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9963fb31-b82b-4c18-a6c4-1c4b1fffa468 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.160995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9963fb31-b82b-4c18-a6c4-1c4b1fffa468 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.161663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9963fb31-b82b-4c18-a6c4-1c4b1fffa468 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.185273 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9963fb31-b82b-4c18-a6c4-1c4b1fffa468 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 200 len: 62 microversion: 2.26 time: 0.044380 Sep 19 14:53:08.186530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1461/2947] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 14:53:08 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 62 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:08.192190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:08.193190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:08.201569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.202512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.203215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.204200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.204899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.205578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.225959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:08.233511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:08.249907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:53:08.252691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:53:08.318427 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eb85df32-9245-4ad6-b7b5-51c0b03c07d4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386664 Sep 19 14:53:08.319827 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1487/2948] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:53:08.325907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:08.328272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:08.341854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.342808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.343477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.344407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.345043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.345807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.556155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.573694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9abebbac-74e8-4c15-8911-3bd8c0824741 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 1.252492 Sep 19 14:53:09.574812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1488/2949] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:08 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:09.707963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-945d7ebd-a882-406e-ad8f-29e730fd2645 req-03bfa10c-5d19-4bed-8f8d-8268e85873db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f39fde9-0849-49b0-b4da-ac029be93c8c", "tag": "3b58fa49-8d4e-40c3-b3aa-eb9700d0db05"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:09.732720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.733307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-945d7ebd-a882-406e-ad8f-29e730fd2645 req-03bfa10c-5d19-4bed-8f8d-8268e85873db service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.733657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-945d7ebd-a882-406e-ad8f-29e730fd2645 req-03bfa10c-5d19-4bed-8f8d-8268e85873db service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.736903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-945d7ebd-a882-406e-ad8f-29e730fd2645 req-03bfa10c-5d19-4bed-8f8d-8268e85873db service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.741639 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62e2dc1d-5b48-40dc-8b29-1154aae39760 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 1.553610 Sep 19 14:53:09.742212 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1462/2950] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:08 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:09.747207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:09.751847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:09.767278 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-945d7ebd-a882-406e-ad8f-29e730fd2645 req-03bfa10c-5d19-4bed-8f8d-8268e85873db service nova] Creating event network-changed:3b58fa49-8d4e-40c3-b3aa-eb9700d0db05 for instance 9f39fde9-0849-49b0-b4da-ac029be93c8c on n-h1-858384-1 Sep 19 14:53:09.769688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.770463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.777618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.781196 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-945d7ebd-a882-406e-ad8f-29e730fd2645 req-03bfa10c-5d19-4bed-8f8d-8268e85873db service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204572 Sep 19 14:53:09.782298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.782442 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1489/2951] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:09.783270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.783920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.790251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4a603a3-d5d5-4550-929f-8e9581d18c98 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde299cfd30>, body: {"keypair": {"name": "tempest-keypair-1614317432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPjhsqoLMXRVgEhTWphOpPuyr4wSP/y9GW564z1WPR8+QIh/MNDBQknyC/SyEFcu8Kx4H+y716pr0GSACdgId/JK3GPoWAmlKGVA+MnryQjde4lr7OD+xMmACztOp5xxg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:09.842948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f4a603a3-d5d5-4550-929f-8e9581d18c98 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:09.873875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f4a603a3-d5d5-4550-929f-8e9581d18c98 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for user 5678b26305e54e7d9ad09f0f405ccd71 and project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:09.887910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:09.938605 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4a603a3-d5d5-4550-929f-8e9581d18c98 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152442 Sep 19 14:53:09.950714 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1490/2952] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:09.969272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '.version_select at 0x7fde29b598b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:09.999316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.001185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.002254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.003701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.018693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.027631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.028442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.029563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.030211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.030839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.056970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:10.067155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-767c21e8-f8b3-4e53-aceb-d0c06ea12441 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1506 microversion: 2.1 time: 0.323598 Sep 19 14:53:10.080189 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1463/2953] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:09 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:10.082111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.082917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.083529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.094541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.096570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.107877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.108973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.109722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.111356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.111591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'flavor' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:10.112273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.112981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.154859 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-762e1dfa-767b-4f8c-9e87-4ca811e4dfc3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.202266 Sep 19 14:53:10.156407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1491/2954] 10.222.0.81 () {60 vars in 1295 bytes} [Mon Sep 19 14:53:09 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:53:10.164889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde29b60430>, body: {"keypair": {"name": "tempest-keypair-1614317432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWwML0WSr67whzIPOCsZbig4YwW1ZY/dbQWbRp1yBxKQnLZK2IWLwhslBh2tAW14YiyEAy4VRpOkSUnI9/dSrj/LzIdsVZLXfPNT1FjxWW7d+6NRTdQ0SjlFnasIu/tYg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:10.205939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:10.217074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for user 5678b26305e54e7d9ad09f0f405ccd71 and project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:10.227740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:10.243712 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2015008b-5e32-4043-9e14-0a7acd974cbe tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1267 microversion: 2.1 time: 0.158684 Sep 19 14:53:10.246298 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1464/2955] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:10 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:10.254632 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] HTTP exception thrown: Key pair 'tempest-keypair-1614317432' already exists. Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 273 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: {"keypair": {"name": "tempest-keypair-1614317432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWwML0WSr67whzIPOCsZbig4YwW1ZY/dbQWbRp1yBxKQnLZK2IWLwhslBh2tAW14YiyEAy4VRpOkSUnI9/dSrj/LzIdsVZLXfPNT1FjxWW7d+6NRTdQ0SjlFnasIu/tYg=="}} Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: exception: Key pair 'tempest-keypair-1614317432' already exists. Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1614317432', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWwML0WSr67whzIPOCsZbig4YwW1ZY/dbQWbRp1yBxKQnLZK2IWLwhslBh2tAW14YiyEAy4VRpOkSUnI9/dSrj/LzIdsVZLXfPNT1FjxWW7d+6NRTdQ0SjlFnasIu/tYg=='}}} Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result.read() Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5678b26305e54e7d9ad09f0f405ccd71-tempest-keypair-1614317432' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 19 14:53:10.268275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi session.flush() Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result.read() Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 19 14:53:10.274835 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5678b26305e54e7d9ad09f0f405ccd71-tempest-keypair-1614317432' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 19, 14, 53, 10, 240672), 'updated_at': None, 'name': 'tempest-keypair-1614317432', 'user_id': '5678b26305e54e7d9ad09f0f405ccd71', 'fingerprint': '14:e1:93:e2:0f:c5:b1:2d:05:cf:47:52:db:d5:ba:2a', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWwML0WSr67whzIPOCsZbig4YwW1ZY/dbQWbRp1yBxKQnLZK2IWLwhslBh2tAW14YiyEAy4VRpOkSUnI9/dSrj/LzIdsVZLXfPNT1FjxWW7d+6NRTdQ0SjlFnasIu/tYg==', 'type': 'ssh'}] Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6787, in import_key_pair Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi keypair.create() Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._create() Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1614317432' already exists. Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 19 14:53:10.285470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1614317432' already exists. Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1614317432' already exists. Sep 19 14:53:10.296859 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:10.298152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:10.298152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.298459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 409 to user: Key pair 'tempest-keypair-1614317432' already exists. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:10.298459 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8cee28a5-ce06-47fc-aa9f-290a42287c18 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.126595 Sep 19 14:53:10.303061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.303569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.304215 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1492/2956] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:10 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:53:10.315154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.316129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.316576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.317187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.319962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.322884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.341643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.342439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.344221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.345271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.352325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.353696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.390347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:10.436627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:10.521697 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6710c5a-0a43-4005-a711-bd5fa8c06e99 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "PUT /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1082 microversion: 2.1 time: 0.272580 Sep 19 14:53:10.540584 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1465/2957] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 14:53:10 2022] PUT /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1082 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:10.558353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73aa4ae9-6645-4bcc-be5c-052d3aeec9ec tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Calling method '.version_select at 0x7fde2c220a60>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.607559 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73aa4ae9-6645-4bcc-be5c-052d3aeec9ec tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614317432" status: 202 len: 0 microversion: 2.1 time: 0.064740 Sep 19 14:53:10.616850 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1466/2958] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614317432 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:53:10.632149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.634194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.652695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.655405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.657712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.661285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.661822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.663480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.669857 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-339a8bc4-595f-425c-bd6c-978701776341 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 204 len: 0 microversion: 2.26 time: 0.358168 Sep 19 14:53:10.672744 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1493/2959] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:53:10 2022] DELETE /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:53:10.689213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.692281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.706398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.708094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.709859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.711738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.715057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.717242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.144840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.158457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7ac77d48-6d0a-48bf-8274-fb35f6896601 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 0.483005 Sep 19 14:53:11.159848 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1494/2960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:10 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:11.166919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfb2cbe3-2a8a-448e-8b5e-d6eba10672a4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde29b605e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVXzsq+8C7NGkGHcd5QxCvcWHy5VBNBP4+OsautfuCr4AdHJdqtMlTmN69a6jtTypjiWkTeZWR+4MokrhwJxPhhakOa2HxEXoaM20OejnswujQJJ3Uyl8x4m5+tDU7h7w=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfb2cbe3-2a8a-448e-8b5e-d6eba10672a4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 247 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVXzsq+8C7NGkGHcd5QxCvcWHy5VBNBP4+OsautfuCr4AdHJdqtMlTmN69a6jtTypjiWkTeZWR+4MokrhwJxPhhakOa2HxEXoaM20OejnswujQJJ3Uyl8x4m5+tDU7h7w=="}} Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVXzsq+8C7NGkGHcd5QxCvcWHy5VBNBP4+OsautfuCr4AdHJdqtMlTmN69a6jtTypjiWkTeZWR+4MokrhwJxPhhakOa2HxEXoaM20OejnswujQJJ3Uyl8x4m5+tDU7h7w=='}}} Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi '' Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:53:11.174779 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfb2cbe3-2a8a-448e-8b5e-d6eba10672a4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:11.178932 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfb2cbe3-2a8a-448e-8b5e-d6eba10672a4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015015 Sep 19 14:53:11.183715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.184365 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1495/2961] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:11 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:53:11.190635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:11.191737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:11.196539 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25380f95-fbe5-4032-8a41-80ea2dd339ac tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1508 microversion: 2.1 time: 0.575715 Sep 19 14:53:11.199023 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1467/2962] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:10 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:11.201530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.202249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.202922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.204164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.204986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.205662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.206097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:11.206730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:11.222340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.222882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.223328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.224040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.224685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.225278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.560649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.567687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.578944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ac8105a-20b8-4863-8341-2f7611ed8b45 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.378305 Sep 19 14:53:11.579786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1468/2963] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:11 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:11.595259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.597165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.598431 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24d67cb5-3a01-45fe-a9a1-585a52edaaa3 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1551 microversion: 2.26 time: 0.413532 Sep 19 14:53:11.606876 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1496/2964] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:11 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1551 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:11.611460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde2a9ca280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1201970355", "public_key": " "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:11.613162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:11.616052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:11.630334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.638450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:11.639460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.640116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.641047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.641684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.642284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.645043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for user 5678b26305e54e7d9ad09f0f405ccd71 and project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:11.668587 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 95 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1201970355", "public_key": " "}} Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: exception: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1201970355', 'public_key': ' '}}} Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.671665 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:11.676811 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.682536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:11.682536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a9b9068-1c18-49e7-b942-63f3f1fac124 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.098092 Sep 19 14:53:11.682536 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1469/2965] 10.222.0.81 () {60 vars in 1158 bytes} [Mon Sep 19 14:53:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:11.687402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:11.689429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:11.698641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:11.700680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.701441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.702131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.702999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.703872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.704714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.843123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.863360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98b9c1fc-8047-4472-b2a4-8caab26faf0b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1273 microversion: 2.1 time: 0.180441 Sep 19 14:53:11.875110 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1470/2966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:11 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:11.885466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc91ebcf-115d-4359-9e69-ee5c85f96ee4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde29d70550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp/p6Wwq0KyIfIvu/ZIsqeYELZwWv9z57o2b2k1XMVVs85Gi6vZkrrrIzF9hPkhlxGnsZJXzl71/nXnNxbbTov7VQCwYBq1IlTBWxWg1AnODkHOiOtsX/Gx129jEgWlEg=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc91ebcf-115d-4359-9e69-ee5c85f96ee4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 507 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp/p6Wwq0KyIfIvu/ZIsqeYELZwWv9z57o2b2k1XMVVs85Gi6vZkrrrIzF9hPkhlxGnsZJXzl71/nXnNxbbTov7VQCwYBq1IlTBWxWg1AnODkHOiOtsX/Gx129jEgWlEg=="}} Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp/p6Wwq0KyIfIvu/ZIsqeYELZwWv9z57o2b2k1XMVVs85Gi6vZkrrrIzF9hPkhlxGnsZJXzl71/nXnNxbbTov7VQCwYBq1IlTBWxWg1AnODkHOiOtsX/Gx129jEgWlEg=='}}} Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 19 14:53:11.894629 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc91ebcf-115d-4359-9e69-ee5c85f96ee4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:11.897975 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc91ebcf-115d-4359-9e69-ee5c85f96ee4 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.029890 Sep 19 14:53:11.903454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1471/2967] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:11 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:53:11.911439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a9437a6d-1d92-4a42-bac2-9f56305c375e req-9d00f1a3-c83c-42fc-9ded-032c702122d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f39fde9-0849-49b0-b4da-ac029be93c8c", "tag": "00c3b49a-36e7-4e45-a1b2-9e197967cf85"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:11.930333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9437a6d-1d92-4a42-bac2-9f56305c375e req-9d00f1a3-c83c-42fc-9ded-032c702122d0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.931967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9437a6d-1d92-4a42-bac2-9f56305c375e req-9d00f1a3-c83c-42fc-9ded-032c702122d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.932862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9437a6d-1d92-4a42-bac2-9f56305c375e req-9d00f1a3-c83c-42fc-9ded-032c702122d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.955074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a9437a6d-1d92-4a42-bac2-9f56305c375e req-9d00f1a3-c83c-42fc-9ded-032c702122d0 service nova] Creating event network-changed:00c3b49a-36e7-4e45-a1b2-9e197967cf85 for instance 9f39fde9-0849-49b0-b4da-ac029be93c8c on n-h1-858384-1 Sep 19 14:53:11.965089 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a9437a6d-1d92-4a42-bac2-9f56305c375e req-9d00f1a3-c83c-42fc-9ded-032c702122d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062913 Sep 19 14:53:11.966618 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1472/2968] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:11.974213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Action: 'create', calling method: .version_select at 0x7fde29dcf3a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-928262447", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:12.005406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:12.017056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Getting quotas for user 5678b26305e54e7d9ad09f0f405ccd71 and project e724701219b449329cddfc2f50dd2fd1. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:12.041082 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 117 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-928262447", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: exception: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-928262447', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Sep 19 14:53:12.043782 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 19 14:53:12.050988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.057083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:12.057972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.059080 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a48b8f1e-a1de-4e8c-9187-98a43d0a1a1a tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.090825 Sep 19 14:53:12.060090 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1473/2969] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:12.073965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3cb0051-4068-4579-ac84-6b23a4f2cd34 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Calling method '.version_select at 0x7fde299f5790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.074946 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0cad7ea-d5c1-4c1f-a449-496e84fb1f85 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1508 microversion: 2.1 time: 0.466448 Sep 19 14:53:12.075969 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1497/2970] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:11 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1508 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:12.100899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.101519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.106858 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c3cb0051-4068-4579-ac84-6b23a4f2cd34 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-71701884 not found for user 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3cb0051-4068-4579-ac84-6b23a4f2cd34 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Request method failure captured: Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-71701884 HTTP/1.1 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJRodUXR00NEH6NTVJcadjAP-7U4MX6d9g_o_lKV5Se0lRupAEG4ZeSsEvQX2PD8kA6NBtjv-6EoK-KX4pJHeQDushco7d_CVZdE002hOiJemFhRubRXXVezaSU67HrpH3IAnxfiuDl8DLTI0RQgj9QqUwbxiopVSUT_JdXIDDX5s4 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e724701219b449329cddfc2f50dd2fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e724701219b449329cddfc2f50dd2fd1"}]}] Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e724701219b449329cddfc2f50dd2fd1 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2126510432 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2126510432-project Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: exception: Keypair tempest-keypair-non-existent-71701884 not found for user 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'tempest-keypair-non-existent-71701884'} Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6871, in delete_key_pair Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6892, in get_key_pair Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-71701884 not found for user 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.114725 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-71701884 not found for user 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-71701884 not found for user 5678b26305e54e7d9ad09f0f405ccd71 Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3cb0051-4068-4579-ac84-6b23a4f2cd34 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] Returning 404 to user: Keypair tempest-keypair-non-existent-71701884 not found for user 5678b26305e54e7d9ad09f0f405ccd71 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3cb0051-4068-4579-ac84-6b23a4f2cd34 tempest-KeyPairsNegativeTestJSON-2126510432 tempest-KeyPairsNegativeTestJSON-2126510432-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-71701884" status: 404 len: 143 microversion: 2.1 time: 0.051171 Sep 19 14:53:12.121669 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1474/2971] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 14:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-71701884 => generated 143 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:12.142195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.147138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.147863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.148777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.154325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.155191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.182699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.183529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.194934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.203561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.204295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.205280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.205920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.206539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.243013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:12.383433 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e2f62d6e-d34d-4213-8855-49bba12774e6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 204 len: 0 microversion: 2.1 time: 0.286174 Sep 19 14:53:12.386427 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1498/2972] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:12 2022] DELETE /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:53:12.402316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.405896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.414151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.414945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.415999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.418077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.418901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.419684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.455440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:12.519559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:DELETE=2,nova_cell1:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:12.524300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Instance is already in deleting state, ignoring this request Sep 19 14:53:12.525514 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5919e02-d929-4991-bab9-5fde9c0c1e79 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 204 len: 0 microversion: 2.1 time: 0.133040 Sep 19 14:53:12.530269 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1499/2973] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:12 2022] DELETE /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:53:12.537010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.538404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.548564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.549347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.550007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.551205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.552164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.552911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.692743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.701604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5cb314cc-570e-4b20-9ded-93f26ad465a3 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 0.523398 Sep 19 14:53:12.715062 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1475/2974] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:12.722641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.722641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.734900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.735538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.736265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.737147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.737885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.738424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.097782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.107838 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26f197c1-277d-4db0-bc7b-4b4ff87fec80 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1514 microversion: 2.1 time: 0.575855 Sep 19 14:53:13.109183 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1500/2975] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:13.114260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.115202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.122262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.123197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.123879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.124819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.125737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.126414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.243099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.255367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9f00cd3-f9e9-43f6-88af-121ac118585e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.547051 Sep 19 14:53:13.257673 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1476/2976] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:13.265990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.266987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.286593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.287389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.288195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.289569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.290259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.291944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.449610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.461277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.476143 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-950a7168-c684-41b5-9331-835f74d81709 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1273 microversion: 2.1 time: 0.215554 Sep 19 14:53:13.476768 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1477/2977] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:13 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:13.477361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.480370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.482055 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c8323b9-ca4d-40e9-9c90-7b403d22b0f9 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1551 microversion: 2.26 time: 0.371528 Sep 19 14:53:13.482916 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1501/2978] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:13 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1551 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:13.730783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.731674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.745246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.746667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.748629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.750268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.750984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.752231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.138274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:14.138929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:14.145520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.146023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.146457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.147199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.147658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.148081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.994279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.005152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a6414de9-dafd-46fc-8371-f88bcb2ef382 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1514 microversion: 2.1 time: 0.872698 Sep 19 14:53:15.022215 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1502/2979] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:14 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1514 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:15.034968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:15.036331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:15.048230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.049148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.049959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.051146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.053008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.053323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.054339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.066561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4aaaf30e-e70a-43de-84fd-962f302f945e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 1.336867 Sep 19 14:53:15.067805 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1478/2980] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:13 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:15.088491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:15.089485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:15.098118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.109799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.110498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.111977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.112622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.113222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.831308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.843288 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6c190e4-b567-4956-856b-3180d162d803 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1507 microversion: 2.1 time: 0.816792 Sep 19 14:53:15.855881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1503/2981] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:15 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:15.862021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.868054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:15.869668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:15.872342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-339bac69-0166-4212-9a03-362314f306d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1315 microversion: 2.1 time: 0.799960 Sep 19 14:53:15.876670 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1479/2982] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:15 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:15.877458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.878132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.878730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.879709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.880437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.881448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.893192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-53a37038-a102-4557-a434-6bbaf2c88d2d req-d899a211-b6aa-4e1f-b675-9e8ef6127a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d91de0-7a79-46bf-8643-602219f0e987", "tag": "595de7c3-b970-459e-adf8-876a1a016ca3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:15.919446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-53a37038-a102-4557-a434-6bbaf2c88d2d req-d899a211-b6aa-4e1f-b675-9e8ef6127a65 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.921510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-53a37038-a102-4557-a434-6bbaf2c88d2d req-d899a211-b6aa-4e1f-b675-9e8ef6127a65 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.922523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-53a37038-a102-4557-a434-6bbaf2c88d2d req-d899a211-b6aa-4e1f-b675-9e8ef6127a65 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.926569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.927460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.928209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.929004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lazy-loading 'fault' on Instance uuid f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:15.956276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-53a37038-a102-4557-a434-6bbaf2c88d2d req-d899a211-b6aa-4e1f-b675-9e8ef6127a65 service nova] Creating event network-changed:595de7c3-b970-459e-adf8-876a1a016ca3 for instance 51d91de0-7a79-46bf-8643-602219f0e987 on n-h2-858384-1 Sep 19 14:53:15.969931 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-53a37038-a102-4557-a434-6bbaf2c88d2d req-d899a211-b6aa-4e1f-b675-9e8ef6127a65 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091842 Sep 19 14:53:15.971975 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1480/2983] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:16.035605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.053233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.055375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a895a93d8dac4699adc352b43f09abb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88691d3462d64061ac749bd7a33d201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.057684 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-05d5c2c9-d1a3-4497-9aa1-2ff39e85c135 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 200 len: 1352 microversion: 2.26 time: 0.200298 Sep 19 14:53:16.059373 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1504/2984] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:15 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 1352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:16.336211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ba0dc65c-235a-425a-81a5-3f3d07b4b558 req-df9efc08-e18d-42d5-8dc3-fff3470477a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f302a7cc-4dc3-4c3e-a4f0-ff86038040a9", "name": "network-vif-deleted", "tag": "556be746-ff32-4417-a1e6-d6a840641e9a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:16.378451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ba0dc65c-235a-425a-81a5-3f3d07b4b558 req-df9efc08-e18d-42d5-8dc3-fff3470477a6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.381102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ba0dc65c-235a-425a-81a5-3f3d07b4b558 req-df9efc08-e18d-42d5-8dc3-fff3470477a6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.382645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ba0dc65c-235a-425a-81a5-3f3d07b4b558 req-df9efc08-e18d-42d5-8dc3-fff3470477a6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.417976 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ba0dc65c-235a-425a-81a5-3f3d07b4b558 req-df9efc08-e18d-42d5-8dc3-fff3470477a6 service nova] Creating event network-vif-deleted:556be746-ff32-4417-a1e6-d6a840641e9a for instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 on n-h2-858384-1 Sep 19 14:53:16.438634 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ba0dc65c-235a-425a-81a5-3f3d07b4b558 req-df9efc08-e18d-42d5-8dc3-fff3470477a6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.461732 Sep 19 14:53:16.443312 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1481/2985] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:16.461887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.469015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.494955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.508495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.508972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.511432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.511921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.515090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.608764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-45afe8e3-a2e1-47da-ae59-8e34490eed27 req-d7b00cfa-455f-4fed-8f41-e5458a0af01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abd8475-c423-4c22-9504-869890eb5eaa", "name": "network-vif-unplugged", "status": "completed", "tag": "5c6276fe-94b2-4b19-aeda-efc82ce07632"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:16.629930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-45afe8e3-a2e1-47da-ae59-8e34490eed27 req-d7b00cfa-455f-4fed-8f41-e5458a0af01a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.630413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-45afe8e3-a2e1-47da-ae59-8e34490eed27 req-d7b00cfa-455f-4fed-8f41-e5458a0af01a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.635402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-45afe8e3-a2e1-47da-ae59-8e34490eed27 req-d7b00cfa-455f-4fed-8f41-e5458a0af01a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.671641 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-45afe8e3-a2e1-47da-ae59-8e34490eed27 req-d7b00cfa-455f-4fed-8f41-e5458a0af01a service nova] Creating event network-vif-unplugged:5c6276fe-94b2-4b19-aeda-efc82ce07632 for instance 2abd8475-c423-4c22-9504-869890eb5eaa on n-h2-858384-1 Sep 19 14:53:16.687371 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-45afe8e3-a2e1-47da-ae59-8e34490eed27 req-d7b00cfa-455f-4fed-8f41-e5458a0af01a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.623997 Sep 19 14:53:16.690149 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1505/2986] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:16.704089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.709555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.728926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.729729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.730180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.730967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.731429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.731861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.842186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9aaa40522843a6970973bca5afc70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515789b03a84eef85950bd0724ae183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.850923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd554ae1-95e1-4183-af3b-177b16cc35f6 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 200 len: 1472 microversion: 2.1 time: 0.406050 Sep 19 14:53:16.851504 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1482/2987] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:16.874340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.875059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.885632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.886274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.886734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.888934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.889500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.890235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.686111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.701791 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26f3e196-e4e8-4864-add7-64c4b59277e4 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 1.007942 Sep 19 14:53:17.718145 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1506/2988] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:17.724044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.725112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.734321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.735211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.735857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.736798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.737474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.738152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.866864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.883134 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ee52427-62aa-4c97-8c67-4334d6408e8a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1487 microversion: 2.1 time: 1.016127 Sep 19 14:53:17.891144 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1483/2989] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1487 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:17.897105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.897712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] [instance: f302a7cc-4dc3-4c3e-a4f0-ff86038040a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.922290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.923423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.924116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.925280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.926025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.926673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.957707 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] HTTP exception thrown: Instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 could not be found. Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Request method failure captured: Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 HTTP/1.1 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIIn8yJ-D7_aWlOLYjlw-3ZnDFRjFmoqnxJTnfVwg2t3A4-mfhGZ1Jc-tSSDuTkMaXRZynxYgUGe7e2stA4xBTrkrJmr9uETaJqt1unTA36rcNw_AA4ELhVChGUJP_gwemPk2EktB5g34UQ-HNfuLAX-YGNj5Xe6JYWP7mPANiQQuRI Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.26 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 88691d3462d64061ac749bd7a33d201f Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerTagsTestJSON-1611178880 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_88691d3462d64061ac749bd7a33d201f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/88691d3462d64061ac749bd7a33d201f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/88691d3462d64061ac749bd7a33d201f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/88691d3462d64061ac749bd7a33d201f"}]}] Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerTagsTestJSON-1611178880 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 88691d3462d64061ac749bd7a33d201f Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerTagsTestJSON-1611178880 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerTagsTestJSON-1611178880-project Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a895a93d8dac4699adc352b43f09abb8 Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerTagsTestJSON-1611178880-project Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 could not be found. Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'f302a7cc-4dc3-4c3e-a4f0-ff86038040a9'} Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 could not be found. Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 could not be found. Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:17.960172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 could not be found. Sep 19 14:53:17.966125 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:17.969184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] Returning 404 to user: Instance f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:17.971100 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-933ca622-269d-4e8e-a097-9e83b2a7d869 tempest-ServerTagsTestJSON-1611178880 tempest-ServerTagsTestJSON-1611178880-project] 10.222.0.81 "GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9" status: 404 len: 111 microversion: 2.26 time: 0.082173 Sep 19 14:53:17.973293 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1484/2990] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/f302a7cc-4dc3-4c3e-a4f0-ff86038040a9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:53:17.981837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.986055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 2abd8475-c423-4c22-9504-869890eb5eaa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.995441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.996563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.997714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.999033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.004682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.006320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.030454 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] HTTP exception thrown: Instance 2abd8475-c423-4c22-9504-869890eb5eaa could not be found. Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Request method failure captured: Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa HTTP/1.1 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIG0PoiR09S9z4zdshFEFFa0g2bT1nHIk3im2vMnZlzk6SftagapSt4IYObeYR70yjbb6q9XU3BysWyxCfbE6m2tQ7lpIZibAcg9RlWiCoD4yHM0X4X4aKmdq-LSplqfIuW2J8BXnlg6F_iXg-aC-acw56fPxkHefZprxAl9AjBJ0qA Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1515789b03a84eef85950bd0724ae183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1515789b03a84eef85950bd0724ae183"}]}] Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 7d9aaa40522843a6970973bca5afc70e Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 2abd8475-c423-4c22-9504-869890eb5eaa could not be found. Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2abd8475-c423-4c22-9504-869890eb5eaa'} Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abd8475-c423-4c22-9504-869890eb5eaa could not be found. Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abd8475-c423-4c22-9504-869890eb5eaa could not be found. Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.034387 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abd8475-c423-4c22-9504-869890eb5eaa could not be found. Sep 19 14:53:18.038779 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.043382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Returning 404 to user: Instance 2abd8475-c423-4c22-9504-869890eb5eaa could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:18.046358 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86c541f3-c4a7-4baf-bf06-c476c86411eb tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa" status: 404 len: 111 microversion: 2.1 time: 0.071769 Sep 19 14:53:18.048450 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1485/2991] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/2abd8475-c423-4c22-9504-869890eb5eaa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:18.074115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.077131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.100029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.104151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.105199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.105876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.107018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.109088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.161723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] HTTP exception thrown: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Request method failure captured: Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d HTTP/1.1 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIG0PoiR09S9z4zdshFEFFa0g2bT1nHIk3im2vMnZlzk6SftagapSt4IYObeYR70yjbb6q9XU3BysWyxCfbE6m2tQ7lpIZibAcg9RlWiCoD4yHM0X4X4aKmdq-LSplqfIuW2J8BXnlg6F_iXg-aC-acw56fPxkHefZprxAl9AjBJ0qA Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1515789b03a84eef85950bd0724ae183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1515789b03a84eef85950bd0724ae183"}]}] Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 7d9aaa40522843a6970973bca5afc70e Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1b37c941-abc2-43d2-939f-dfe8bb75987d'} Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:18.171440 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.178682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Returning 404 to user: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:18.180181 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed7f6973-aeeb-4406-a63c-5e0dd027ec76 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 404 len: 111 microversion: 2.1 time: 0.121617 Sep 19 14:53:18.182295 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1486/2992] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:18 2022] DELETE /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:18.194719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-168290543", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:18.213056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:18.288785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] validate_networks() for [('df72bf36-05bf-4553-9191-d4a4e19a956a', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:53:18.460734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:18.481783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7fcddde0-81b6-4a63-a40f-b7e60579c85d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1315 microversion: 2.1 time: 0.761937 Sep 19 14:53:18.494965 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1507/2993] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:18.499817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.500722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: 1b37c941-abc2-43d2-939f-dfe8bb75987d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.516641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.517268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.517816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.518646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.519246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.519776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.549609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] HTTP exception thrown: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Request method failure captured: Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d HTTP/1.1 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIG0PoiR09S9z4zdshFEFFa0g2bT1nHIk3im2vMnZlzk6SftagapSt4IYObeYR70yjbb6q9XU3BysWyxCfbE6m2tQ7lpIZibAcg9RlWiCoD4yHM0X4X4aKmdq-LSplqfIuW2J8BXnlg6F_iXg-aC-acw56fPxkHefZprxAl9AjBJ0qA Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1515789b03a84eef85950bd0724ae183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1515789b03a84eef85950bd0724ae183"}]}] Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 7d9aaa40522843a6970973bca5afc70e Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1b37c941-abc2-43d2-939f-dfe8bb75987d'} Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.554514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. Sep 19 14:53:18.560514 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.561431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Returning 404 to user: Instance 1b37c941-abc2-43d2-939f-dfe8bb75987d could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:18.563540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0019ed1d-fcc2-4daa-a4e9-f242338830e3 tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d" status: 404 len: 111 microversion: 2.1 time: 0.079513 Sep 19 14:53:18.578273 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1508/2994] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:18 2022] GET /compute/v2.1/servers/1b37c941-abc2-43d2-939f-dfe8bb75987d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:18.582466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d259ca5c-e161-4d0a-aa75-0cdaae93327e req-a77a644e-037b-4f8c-a16a-ac0a82cf7e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abd8475-c423-4c22-9504-869890eb5eaa", "name": "network-vif-deleted", "tag": "5c6276fe-94b2-4b19-aeda-efc82ce07632"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:18.600793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d259ca5c-e161-4d0a-aa75-0cdaae93327e req-a77a644e-037b-4f8c-a16a-ac0a82cf7e8b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.601418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d259ca5c-e161-4d0a-aa75-0cdaae93327e req-a77a644e-037b-4f8c-a16a-ac0a82cf7e8b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.601968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d259ca5c-e161-4d0a-aa75-0cdaae93327e req-a77a644e-037b-4f8c-a16a-ac0a82cf7e8b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.632320 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d259ca5c-e161-4d0a-aa75-0cdaae93327e req-a77a644e-037b-4f8c-a16a-ac0a82cf7e8b service nova] Creating event network-vif-deleted:5c6276fe-94b2-4b19-aeda-efc82ce07632 for instance 2abd8475-c423-4c22-9504-869890eb5eaa on n-h2-858384-1 Sep 19 14:53:18.642647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d259ca5c-e161-4d0a-aa75-0cdaae93327e req-a77a644e-037b-4f8c-a16a-ac0a82cf7e8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065735 Sep 19 14:53:18.644963 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1509/2995] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:18.656917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.657810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.677832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.678653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.680311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.683069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.684287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.685653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.713184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] HTTP exception thrown: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Request method failure captured: Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 HTTP/1.1 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIG0PoiR09S9z4zdshFEFFa0g2bT1nHIk3im2vMnZlzk6SftagapSt4IYObeYR70yjbb6q9XU3BysWyxCfbE6m2tQ7lpIZibAcg9RlWiCoD4yHM0X4X4aKmdq-LSplqfIuW2J8BXnlg6F_iXg-aC-acw56fPxkHefZprxAl9AjBJ0qA Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1515789b03a84eef85950bd0724ae183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1515789b03a84eef85950bd0724ae183"}]}] Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 7d9aaa40522843a6970973bca5afc70e Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'd78a464e-7f62-4a1b-9923-ac635f8f7a90'} Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:18.716448 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:18.721695 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:18.736144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Returning 404 to user: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:18.738694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c04d6256-194e-4dcf-b3c1-1ecee454ea8b tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 404 len: 111 microversion: 2.1 time: 0.090947 Sep 19 14:53:18.745716 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1510/2996] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:18 2022] DELETE /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:18.767942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.768591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.780964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.781831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.783071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.784109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.784763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.788852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.374108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.418310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04265148-d3e0-4e71-8736-f705a844c22f tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 0.670798 Sep 19 14:53:19.443276 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1511/2997] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:18 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:19.450720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:19.451743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] [instance: d78a464e-7f62-4a1b-9923-ac635f8f7a90] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:19.459300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.460114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.460801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.461882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.463197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.464101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.482308 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] HTTP exception thrown: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Request method failure captured: Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 HTTP/1.1 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIG0PoiR09S9z4zdshFEFFa0g2bT1nHIk3im2vMnZlzk6SftagapSt4IYObeYR70yjbb6q9XU3BysWyxCfbE6m2tQ7lpIZibAcg9RlWiCoD4yHM0X4X4aKmdq-LSplqfIuW2J8BXnlg6F_iXg-aC-acw56fPxkHefZprxAl9AjBJ0qA Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1515789b03a84eef85950bd0724ae183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1515789b03a84eef85950bd0724ae183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1515789b03a84eef85950bd0724ae183"}]}] Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1515789b03a84eef85950bd0724ae183 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630585744 Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 7d9aaa40522843a6970973bca5afc70e Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiskConfigTestJSON-630585744-project Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'd78a464e-7f62-4a1b-9923-ac635f8f7a90'} Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:19.484095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] Returning 404 to user: Instance d78a464e-7f62-4a1b-9923-ac635f8f7a90 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1ca3b44-a0ae-43d3-b565-8e8350ec760f tempest-ServerDiskConfigTestJSON-630585744 tempest-ServerDiskConfigTestJSON-630585744-project] 10.222.0.81 "GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90" status: 404 len: 111 microversion: 2.1 time: 0.041019 Sep 19 14:53:19.489242 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1512/2998] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:19 2022] GET /compute/v2.1/servers/d78a464e-7f62-4a1b-9923-ac635f8f7a90 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:19.509980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:19.511000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:19.519258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.520119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.520777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.521672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.522313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.523416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.225877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=13 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:20.627891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:53:20.630070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:53:20.630941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:53:20.631573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:53:20.632863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:53:20.651352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.652989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.654018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.666216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.670038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.670793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.705432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Getting quotas for project a245ad65a629467e8cb341a4045aa529. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:20.713369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Getting quotas for user 2f16b23334a84b8880c4955c0b7ed71d and project a245ad65a629467e8cb341a4045aa529. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:20.721585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:20.733860 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89bad063-63c7-450f-9140-71dd9b20fbf8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1315 microversion: 2.1 time: 1.229701 Sep 19 14:53:20.734671 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1513/2999] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:19 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1315 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:20.758268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c3f2fb00-0588-40d3-ab64-871e1cf423a1 req-a0c2fb2e-8433-44e2-9bfb-bb83493a5437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d91de0-7a79-46bf-8643-602219f0e987", "name": "network-vif-plugged", "status": "completed", "tag": "595de7c3-b970-459e-adf8-876a1a016ca3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:20.775691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:53:20.778198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:53:20.807599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c3f2fb00-0588-40d3-ab64-871e1cf423a1 req-a0c2fb2e-8433-44e2-9bfb-bb83493a5437 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.808085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c3f2fb00-0588-40d3-ab64-871e1cf423a1 req-a0c2fb2e-8433-44e2-9bfb-bb83493a5437 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.808737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c3f2fb00-0588-40d3-ab64-871e1cf423a1 req-a0c2fb2e-8433-44e2-9bfb-bb83493a5437 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.840513 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c3f2fb00-0588-40d3-ab64-871e1cf423a1 req-a0c2fb2e-8433-44e2-9bfb-bb83493a5437 service nova] Creating event network-vif-plugged:595de7c3-b970-459e-adf8-876a1a016ca3 for instance 51d91de0-7a79-46bf-8643-602219f0e987 on n-h2-858384-1 Sep 19 14:53:20.854406 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c3f2fb00-0588-40d3-ab64-871e1cf423a1 req-a0c2fb2e-8433-44e2-9bfb-bb83493a5437 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117684 Sep 19 14:53:20.855338 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1514/3000] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:20.878886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:20.880005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:20.904141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.910885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.915305 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a7d1d80-9767-4e83-a9c3-681c5a3bf45b tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.726884 Sep 19 14:53:20.925368 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1487/3001] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:53:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:53:20.929558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.933560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.936788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.936788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.943553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-024a0673-3b9c-4e6d-b2bb-b9b0cfa8af73 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:20.944551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-024a0673-3b9c-4e6d-b2bb-b9b0cfa8af73 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:21.209878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-024a0673-3b9c-4e6d-b2bb-b9b0cfa8af73 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.222726 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-024a0673-3b9c-4e6d-b2bb-b9b0cfa8af73 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1213 microversion: 2.1 time: 0.295756 Sep 19 14:53:21.223655 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1488/3002] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:20 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1213 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:21.763064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:21.763970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:21.782998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.785197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.787112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.790256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.792240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.794083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.377739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.389206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2bdd884a-4185-4a6b-beb4-ac48897e4f94 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 1.532406 Sep 19 14:53:22.393079 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1515/3003] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:20 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:22.419766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:22.426410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:22.460373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.463713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.464378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.465368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.471560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.472376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.666478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.676022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.679983 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc008cb4-4632-4d8b-a3b6-ef9a2af18a88 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1315 microversion: 2.1 time: 0.920580 Sep 19 14:53:22.685456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-da9f030c-1035-413f-ade0-055e5dddc119 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1265 microversion: 2.1 time: 0.280295 Sep 19 14:53:22.687897 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1516/3004] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:22 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:22.691651 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1489/3005] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:21 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:23.078514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f39fde9-0849-49b0-b4da-ac029be93c8c", "name": "network-vif-plugged", "status": "completed", "tag": "3b58fa49-8d4e-40c3-b3aa-eb9700d0db05"}, {"server_uuid": "9f39fde9-0849-49b0-b4da-ac029be93c8c", "name": "network-vif-plugged", "status": "completed", "tag": "00c3b49a-36e7-4e45-a1b2-9e197967cf85"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:23.111782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.113185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.113975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:23.131726 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] Creating event network-vif-plugged:3b58fa49-8d4e-40c3-b3aa-eb9700d0db05 for instance 9f39fde9-0849-49b0-b4da-ac029be93c8c on n-h1-858384-1 Sep 19 14:53:23.132686 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] Creating event network-vif-plugged:00c3b49a-36e7-4e45-a1b2-9e197967cf85 for instance 9f39fde9-0849-49b0-b4da-ac029be93c8c on n-h1-858384-1 Sep 19 14:53:23.142420 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8525d9b4-55f0-42b0-af97-223672d2626d req-34c0cb3b-b437-4ff4-b561-cd4f2725a78a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073142 Sep 19 14:53:23.144125 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1517/3006] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:23.424200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:23.426934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:23.466174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.472240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.475998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:23.479374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.481815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.483851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:23.705306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:23.706663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:23.716458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.717247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.717874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:23.718791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.719417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.720010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.459688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:24.473373 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f06eb7c3-4e1d-40aa-a9d2-346508e05c3d tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1334 microversion: 2.1 time: 1.058152 Sep 19 14:53:24.475626 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1490/3007] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:23 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1334 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:24.485414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:24.488107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:24.510090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.519514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.520391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.521562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.522251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.522951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.666723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:24.681290 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0d2c30d3-5add-4619-a1e0-7c5162f5af59 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1502 microversion: 2.1 time: 0.980459 Sep 19 14:53:24.697381 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1518/3008] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:23 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1502 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:24.767541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:24.783545 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6dc3febf-7828-483e-ab9e-21158c4d22a3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1271 microversion: 2.1 time: 0.303605 Sep 19 14:53:24.799423 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1491/3009] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:24 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:25.500605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:25.501225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:25.514344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.514880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.515326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.516041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.516502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.516933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.815172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:25.817162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:25.834940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.839369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.843673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.849993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.850639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.851305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.855564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:26.123791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:26.134859 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09e8ed87-9c96-4331-a1a3-e0c9bcbc5fbd tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1271 microversion: 2.1 time: 0.328591 Sep 19 14:53:26.135487 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1492/3010] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:25 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1271 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:26.642885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:26.660377 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f15476c0-59f6-492d-944c-7865c9e93b08 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1671 microversion: 2.1 time: 1.163363 Sep 19 14:53:26.683165 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1519/3011] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:25 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1671 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:26.695422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:26.695916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:26.703163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:26.703870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:26.704468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:26.705501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:26.706109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:26.706695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:26.779438 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-37191fa2-5e58-4450-a7d1-e9d39a576201 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c/ips" status: 200 len: 181 microversion: 2.1 time: 0.089418 Sep 19 14:53:26.790170 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1493/3012] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 14:53:26 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c/ips => generated 181 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:26.795966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:26.796475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:26.815172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:26.815972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:26.816578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:26.817470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:26.818098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:26.819388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:26.887527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:26.907516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:27.060050 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1326e314-58f3-423f-9c8f-78bf5afac223 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 204 len: 0 microversion: 2.1 time: 0.269302 Sep 19 14:53:27.060661 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1520/3013] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:26 2022] DELETE /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:53:27.071134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:27.074804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:27.084626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.088463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.089768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:27.090515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.093773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.094268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:27.161354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:27.162324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:27.180922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.182958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.185108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:27.186847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.191635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.192667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:29.017399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:29.034127 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23d473ec-601d-4b74-9c55-627edb0bbacd tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1677 microversion: 2.1 time: 1.968867 Sep 19 14:53:29.039086 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1494/3014] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:27 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1677 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:29.045470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c1b7d6d-1a7d-4dbd-a87a-a2ae1703204c"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:29.060206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:29.075935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:29.078080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:29.078642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:29.080640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:29.088243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:29.088866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:29.140128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:29.149073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-344f93ac-b328-446a-9a60-d088497be59f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 1.992600 Sep 19 14:53:29.150423 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1521/3015] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:27 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:29.606666 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b570d8c-89a0-44b5-8213-ca51ea6d8c3f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.565213 Sep 19 14:53:29.608024 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1495/3016] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 14:53:29 2022] POST /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987/os-volume_attachments => generated 194 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:30.066721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:30.067375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:30.082083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:30.082588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:30.083056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:30.083771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:30.084419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:30.095557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:30.180019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:30.184688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:30.197585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:30.200636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:30.202205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:30.204002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:30.208338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:30.209028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:30.691553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:30.870204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:30.888689 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-548b7224-ae4e-4d64-ad16-fbdcf236d72e tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1677 microversion: 2.1 time: 0.820569 Sep 19 14:53:30.904931 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1522/3017] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:30 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1677 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:31.216862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=20 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:31.878224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-74c5972c-6542-4628-ba38-147c4851b9b9 req-09be9117-e288-4e22-b46a-c22444cfa092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f39fde9-0849-49b0-b4da-ac029be93c8c", "name": "network-vif-deleted", "tag": "3b58fa49-8d4e-40c3-b3aa-eb9700d0db05"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:31.893837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:31.919747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-74c5972c-6542-4628-ba38-147c4851b9b9 req-09be9117-e288-4e22-b46a-c22444cfa092 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:31.922876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-74c5972c-6542-4628-ba38-147c4851b9b9 req-09be9117-e288-4e22-b46a-c22444cfa092 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:31.923827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-74c5972c-6542-4628-ba38-147c4851b9b9 req-09be9117-e288-4e22-b46a-c22444cfa092 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:31.967561 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-74c5972c-6542-4628-ba38-147c4851b9b9 req-09be9117-e288-4e22-b46a-c22444cfa092 service nova] Creating event network-vif-deleted:3b58fa49-8d4e-40c3-b3aa-eb9700d0db05 for instance 9f39fde9-0849-49b0-b4da-ac029be93c8c on n-h1-858384-1 Sep 19 14:53:31.981351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-74c5972c-6542-4628-ba38-147c4851b9b9 req-09be9117-e288-4e22-b46a-c22444cfa092 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104918 Sep 19 14:53:31.982038 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1523/3018] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:31.998316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:32.001508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:32.021548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:32.023487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:32.027015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:32.031298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:32.031880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:32.032526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:32.143198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:32.156730 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-451d39b6-3ecb-42de-8f7b-fd04d4b01d65 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 1.985214 Sep 19 14:53:32.161700 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1496/3019] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:30 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:32.350111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:32.384932 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb52ad7b-0aa3-4767-9ae4-9b26487d9033 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1497 microversion: 2.1 time: 0.394220 Sep 19 14:53:32.393771 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1524/3020] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:31 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:32.830273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9bfd7a91-211d-4a0b-b2c7-ed8441ed368d req-92717c4b-7fc7-4e59-8e88-9c23aad0bd28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf", "tag": "d2c5c016-3091-46d4-bb7c-0dc805cb8e89"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:32.852948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9bfd7a91-211d-4a0b-b2c7-ed8441ed368d req-92717c4b-7fc7-4e59-8e88-9c23aad0bd28 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:32.861630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9bfd7a91-211d-4a0b-b2c7-ed8441ed368d req-92717c4b-7fc7-4e59-8e88-9c23aad0bd28 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:32.862286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9bfd7a91-211d-4a0b-b2c7-ed8441ed368d req-92717c4b-7fc7-4e59-8e88-9c23aad0bd28 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:32.895468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9bfd7a91-211d-4a0b-b2c7-ed8441ed368d req-92717c4b-7fc7-4e59-8e88-9c23aad0bd28 service nova] Creating event network-changed:d2c5c016-3091-46d4-bb7c-0dc805cb8e89 for instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf on n-h2-858384-1 Sep 19 14:53:32.903480 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9bfd7a91-211d-4a0b-b2c7-ed8441ed368d req-92717c4b-7fc7-4e59-8e88-9c23aad0bd28 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077698 Sep 19 14:53:32.909907 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1497/3021] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:33.182588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:33.204142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:33.211378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:33.212731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:33.213700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:33.214611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:33.215294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:33.215896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:33.420314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:33.421397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:33.446778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:33.452960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:33.453518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:33.454287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:33.454775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:33.469476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:33.812029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857828528b349c684b49b9d756d3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330cbd8155454fa38afb8a95b0e4fd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:33.830227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d5670b3-0cf3-48d6-9a25-0551750c44a7 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 200 len: 1455 microversion: 2.1 time: 0.418661 Sep 19 14:53:33.869622 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1498/3022] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:33 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 1455 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:34.104297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-cca11acf-fb89-4db7-889f-09fffc01059f req-45049606-4156-4e6d-815d-90573a197fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f39fde9-0849-49b0-b4da-ac029be93c8c", "name": "network-vif-deleted", "tag": "00c3b49a-36e7-4e45-a1b2-9e197967cf85"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:34.124939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cca11acf-fb89-4db7-889f-09fffc01059f req-45049606-4156-4e6d-815d-90573a197fe5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:34.125735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cca11acf-fb89-4db7-889f-09fffc01059f req-45049606-4156-4e6d-815d-90573a197fe5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:34.126336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cca11acf-fb89-4db7-889f-09fffc01059f req-45049606-4156-4e6d-815d-90573a197fe5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:34.148807 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-cca11acf-fb89-4db7-889f-09fffc01059f req-45049606-4156-4e6d-815d-90573a197fe5 service nova] Creating event network-vif-deleted:00c3b49a-36e7-4e45-a1b2-9e197967cf85 for instance 9f39fde9-0849-49b0-b4da-ac029be93c8c on n-h1-858384-1 Sep 19 14:53:34.161834 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-cca11acf-fb89-4db7-889f-09fffc01059f req-45049606-4156-4e6d-815d-90573a197fe5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062091 Sep 19 14:53:34.163030 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1499/3023] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:53:34.860020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:34.861099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:34.878884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:34.880048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:34.880687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:34.881690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:34.882393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:34.893604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:34.925485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] HTTP exception thrown: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Request method failure captured: Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c HTTP/1.1 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIH19uVgR-ilTo7o_HG7Obtw9pQwOwpigSKi8xWt_DRH3LEngRSxUWC38ACnAI_NdrtmJgeEMWGYQ_YTMzrCYIdJoS7CkrevkOQPLpdmyU5dIXybYdJ3125ALPwG2a-z_sIaeGmjVSpIEkZdfm3iy229Kdi1LCkdVRLTCl_p7B45f0o Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/330cbd8155454fa38afb8a95b0e4fd9f"}]}] Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f857828528b349c684b49b9d756d3868 Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9f39fde9-0849-49b0-b4da-ac029be93c8c'} Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:34.927344 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:34.933599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:34.935678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Returning 404 to user: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:34.936747 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82c23519-aadf-430c-83e6-f65e1c0dfb0b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 404 len: 111 microversion: 2.1 time: 0.082904 Sep 19 14:53:34.937845 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1500/3024] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:34 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:35.157376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:35.169291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27bbe50d-a140-4d3d-a5df-7717ce3b42ba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 1.991192 Sep 19 14:53:35.172079 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1525/3025] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:33 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:36.197080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:36.198575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:36.214053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:36.215035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:36.215682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:36.217245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:36.218624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:36.219910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.386537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:37.412938 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c2b976a-e19c-4b26-bf56-64cc1b16a8e1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 1.220744 Sep 19 14:53:37.414098 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1501/3026] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:36 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:38.449301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:38.454673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:38.470221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:38.475220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:38.475923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:38.478664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:38.486381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:38.487237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:39.593147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:39.601350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e53fc89c-2305-4275-8d38-bfc09be538c1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 1.167910 Sep 19 14:53:39.618639 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1526/3027] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:38 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:40.030491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.031224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.047875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.059514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.060132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.061009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.061994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.061994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.079010 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] HTTP exception thrown: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Request method failure captured: Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c HTTP/1.1 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIH19uVgR-ilTo7o_HG7Obtw9pQwOwpigSKi8xWt_DRH3LEngRSxUWC38ACnAI_NdrtmJgeEMWGYQ_YTMzrCYIdJoS7CkrevkOQPLpdmyU5dIXybYdJ3125ALPwG2a-z_sIaeGmjVSpIEkZdfm3iy229Kdi1LCkdVRLTCl_p7B45f0o Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/330cbd8155454fa38afb8a95b0e4fd9f"}]}] Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f857828528b349c684b49b9d756d3868 Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9f39fde9-0849-49b0-b4da-ac029be93c8c'} Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:40.080763 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.086084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Returning 404 to user: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:40.091748 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-65c195a1-fbf6-4437-a5bd-feca376d53a1 tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 404 len: 111 microversion: 2.1 time: 0.059433 Sep 19 14:53:40.091748 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1502/3028] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:40 2022] DELETE /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:40.097020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.097640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: 9f39fde9-0849-49b0-b4da-ac029be93c8c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.111450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.111964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.112409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.113132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.113594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.114197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.170239 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] HTTP exception thrown: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Request method failure captured: Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c HTTP/1.1 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIH19uVgR-ilTo7o_HG7Obtw9pQwOwpigSKi8xWt_DRH3LEngRSxUWC38ACnAI_NdrtmJgeEMWGYQ_YTMzrCYIdJoS7CkrevkOQPLpdmyU5dIXybYdJ3125ALPwG2a-z_sIaeGmjVSpIEkZdfm3iy229Kdi1LCkdVRLTCl_p7B45f0o Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/330cbd8155454fa38afb8a95b0e4fd9f"}]}] Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f857828528b349c684b49b9d756d3868 Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9f39fde9-0849-49b0-b4da-ac029be93c8c'} Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.173521 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. Sep 19 14:53:40.183622 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.187891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Returning 404 to user: Instance 9f39fde9-0849-49b0-b4da-ac029be93c8c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:40.190445 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5669e97-d469-4f45-81e1-f779f761af8b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c" status: 404 len: 111 microversion: 2.1 time: 0.096901 Sep 19 14:53:40.192372 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1527/3029] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:40 2022] GET /compute/v2.1/servers/9f39fde9-0849-49b0-b4da-ac029be93c8c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:40.201080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.201595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.210366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.210923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.211550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.212396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.212869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.213391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.253720 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] HTTP exception thrown: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Request method failure captured: Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 HTTP/1.1 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIH19uVgR-ilTo7o_HG7Obtw9pQwOwpigSKi8xWt_DRH3LEngRSxUWC38ACnAI_NdrtmJgeEMWGYQ_YTMzrCYIdJoS7CkrevkOQPLpdmyU5dIXybYdJ3125ALPwG2a-z_sIaeGmjVSpIEkZdfm3iy229Kdi1LCkdVRLTCl_p7B45f0o Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/330cbd8155454fa38afb8a95b0e4fd9f"}]}] Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: f857828528b349c684b49b9d756d3868 Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'df32f195-86cf-4e85-9060-49f2cbde0e39'} Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:40.253859 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Returning 404 to user: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:40.260735 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3658a9ef-a526-444f-a32b-663233e0823b tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 404 len: 111 microversion: 2.1 time: 0.058732 Sep 19 14:53:40.266306 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1503/3030] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:40 2022] DELETE /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:40.271702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.272739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] [instance: df32f195-86cf-4e85-9060-49f2cbde0e39] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.291375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.292237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.293143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.296800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.297716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.298420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.317160 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] HTTP exception thrown: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Request method failure captured: Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 HTTP/1.1 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIH19uVgR-ilTo7o_HG7Obtw9pQwOwpigSKi8xWt_DRH3LEngRSxUWC38ACnAI_NdrtmJgeEMWGYQ_YTMzrCYIdJoS7CkrevkOQPLpdmyU5dIXybYdJ3125ALPwG2a-z_sIaeGmjVSpIEkZdfm3iy229Kdi1LCkdVRLTCl_p7B45f0o Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/330cbd8155454fa38afb8a95b0e4fd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/330cbd8155454fa38afb8a95b0e4fd9f"}]}] Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 330cbd8155454fa38afb8a95b0e4fd9f Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestMultiNic-1216875611 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f857828528b349c684b49b9d756d3868 Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestMultiNic-1216875611-project Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'df32f195-86cf-4e85-9060-49f2cbde0e39'} Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:40.319620 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. Sep 19 14:53:40.324568 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:53:40.325780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] Returning 404 to user: Instance df32f195-86cf-4e85-9060-49f2cbde0e39 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:40.326805 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4f22b13-244b-4e47-8e64-1e7b661b18fe tempest-ServersTestMultiNic-1216875611 tempest-ServersTestMultiNic-1216875611-project] 10.222.0.81 "GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39" status: 404 len: 111 microversion: 2.1 time: 0.061095 Sep 19 14:53:40.331350 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1528/3031] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:40 2022] GET /compute/v2.1/servers/df32f195-86cf-4e85-9060-49f2cbde0e39 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:40.625551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.626184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.643213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.643721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.644168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.644891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.645360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.645795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:41.219854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:41.229301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ab8e1f6-0d51-4c0f-bd5c-62e64f21aef1 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 0.607584 Sep 19 14:53:41.236412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1504/3032] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:40 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:42.269458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:42.270733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:42.275489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:42.293225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.294598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.296280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.300942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.301731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.303372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.580466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1130679291", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:42.685441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:53:42.686350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:53:42.686998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:53:42.687686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:53:42.688295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:53:42.720409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.721937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.722410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.723215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.725007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.725641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.763884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Getting quotas for project f8fb92ff4f884457bdf8d9544a53b1e4. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:42.772223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Getting quotas for user e0d451967b7b4db58af131433480ce58 and project f8fb92ff4f884457bdf8d9544a53b1e4. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:42.798140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:53:42.801972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:53:42.921274 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eefe5a75-6636-415e-b664-73211ac0e56f tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.000323 Sep 19 14:53:42.928956 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1529/3033] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:53:42.934839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e713377c-7e38-4fa4-a2b3-7dda4626152d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:42.935469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e713377c-7e38-4fa4-a2b3-7dda4626152d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:43.097907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:43.126961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df20cc2f-4b00-4530-8c38-72f2f23f009c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 0.869007 Sep 19 14:53:43.140903 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1505/3034] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:42 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:43.704800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e713377c-7e38-4fa4-a2b3-7dda4626152d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:43.716952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e713377c-7e38-4fa4-a2b3-7dda4626152d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:43.732586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e713377c-7e38-4fa4-a2b3-7dda4626152d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:43.744366 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e713377c-7e38-4fa4-a2b3-7dda4626152d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1278 microversion: 2.54 time: 0.810739 Sep 19 14:53:43.754928 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1530/3035] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:42 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1278 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:53:44.157061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:44.157061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:44.173333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.174057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.185291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.186346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.191080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.191474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.318591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-853f0d9e-a9a8-4a6f-86e5-0c7c9c89f666 req-d069f6e3-d081-4f99-b6ee-b85658c48482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf", "name": "network-vif-plugged", "status": "completed", "tag": "d2c5c016-3091-46d4-bb7c-0dc805cb8e89"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:44.342289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-853f0d9e-a9a8-4a6f-86e5-0c7c9c89f666 req-d069f6e3-d081-4f99-b6ee-b85658c48482 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.342895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-853f0d9e-a9a8-4a6f-86e5-0c7c9c89f666 req-d069f6e3-d081-4f99-b6ee-b85658c48482 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.349331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-853f0d9e-a9a8-4a6f-86e5-0c7c9c89f666 req-d069f6e3-d081-4f99-b6ee-b85658c48482 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.374529 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-853f0d9e-a9a8-4a6f-86e5-0c7c9c89f666 req-d069f6e3-d081-4f99-b6ee-b85658c48482 service nova] Creating event network-vif-plugged:d2c5c016-3091-46d4-bb7c-0dc805cb8e89 for instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf on n-h2-858384-1 Sep 19 14:53:44.383537 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-853f0d9e-a9a8-4a6f-86e5-0c7c9c89f666 req-d069f6e3-d081-4f99-b6ee-b85658c48482 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069489 Sep 19 14:53:44.388087 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1531/3036] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:44.689384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:44.690300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:44.715555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.725068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.743576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.746174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.746894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.747537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.780778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:44.925998 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-63562698-88a9-4e33-bc2f-bf2c72a315a3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 204 len: 0 microversion: 2.1 time: 0.241246 Sep 19 14:53:44.926828 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1532/3037] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:44 2022] DELETE /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:53:44.933312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:44.934722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:44.942428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.943414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.944144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.945172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:44.946810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:44.947788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.195882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:45.209852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:45.215961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:45.219162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41fefe22-55d6-4d9f-98cc-13ba348f0ce6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1330 microversion: 2.54 time: 0.290318 Sep 19 14:53:45.220964 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1533/3038] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:44 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1330 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:45.240142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:45.242828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:45.264486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.269669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.270507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.271623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.272265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.275282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.808569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:45.816757 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35ec9621-1f1a-4f1c-964f-e848236a4aa2 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 1.666872 Sep 19 14:53:45.817352 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1506/3039] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:44 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:46.257875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:46.259329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:46.276246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.279916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.282590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.283628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.286882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.287518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.339817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:46.360348 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c3da5b7-5ba5-4f4b-a6d8-162fd4eec15a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1554 microversion: 2.1 time: 1.130211 Sep 19 14:53:46.378812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1534/3040] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:45 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1554 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:46.485089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:46.496949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:46.499466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:46.501603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1bbbfe03-a7b4-44fd-a78d-18413f4767c9 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1336 microversion: 2.54 time: 0.250850 Sep 19 14:53:46.502740 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1507/3041] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:46 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1336 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:46.843544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:46.844161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:46.851408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.852494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.853267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.853996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.854450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.869312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.427066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-11268b9b-62c2-45e8-8ab0-0b4ac55d0f67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Action: 'create', calling method: .version_select at 0x7fde2a47a820>, body: {"keypair": {"name": "tempest-keypair-1059275378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/h8zZezN507FfilrJAJ3tbT4dR/USvMFaz6Icg60bZcU+3JSDs3SeLwVvwvqcDH5cYQySogypvyhc1BCFstubG+t1jy+pjWc0xigXsUx5kk+abfP41m/NiZ0UaxMQvdQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:47.483173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-11268b9b-62c2-45e8-8ab0-0b4ac55d0f67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Getting quotas for project 4baec5feb1414c92a0e8df948aede321. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:47.498133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:47.507689 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-65bf16e7-0c5f-4fe0-94d3-4ecda6f6b5e6 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1313 microversion: 2.1 time: 0.667965 Sep 19 14:53:47.515604 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1535/3042] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:46 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:47.518960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-11268b9b-62c2-45e8-8ab0-0b4ac55d0f67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Getting quotas for user 6d9c22a17bb146dba6b7a2ad603e33dc and project 4baec5feb1414c92a0e8df948aede321. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:47.548051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:47.549329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:47.564186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.566035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.567398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.569507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.571242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.572760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.581026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-11268b9b-62c2-45e8-8ab0-0b4ac55d0f67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.464179 Sep 19 14:53:47.582572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1508/3043] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:47.593467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:47.594363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:47.611690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.612525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.614430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.616629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.617857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.620726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:48.404077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:48.423992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:48.437107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:48.438413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1882aaa9-3859-4b30-9ed4-638876f17847 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1336 microversion: 2.54 time: 0.854597 Sep 19 14:53:48.439077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1509/3044] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:47 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1336 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:48.544962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:48.545872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:48.559133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:48.561820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:48.565734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:48.569043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:48.571056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:48.571749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.436154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:49.450160 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-02a7eded-490d-4bea-b001-be2bccad268a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1554 microversion: 2.1 time: 1.932564 Sep 19 14:53:49.450699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1536/3045] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:47 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1554 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:49.489144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:49.489751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:49.511699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.512338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.512855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.514978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.515487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.515932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.787827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:49.803479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:49.818798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:49.822336 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-978e7e9e-7c16-4930-9ee8-bd654d699c00 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1357 microversion: 2.54 time: 0.348298 Sep 19 14:53:49.823321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1537/3046] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:49 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:53:49.833040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-47cc3179-5f9b-4415-97c0-43684fb34597 req-31b7b247-36b2-4c3a-a3c1-b2dfb55864bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d91de0-7a79-46bf-8643-602219f0e987", "name": "network-vif-deleted", "tag": "595de7c3-b970-459e-adf8-876a1a016ca3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:49.867921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:49.876655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47cc3179-5f9b-4415-97c0-43684fb34597 req-31b7b247-36b2-4c3a-a3c1-b2dfb55864bd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.877509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47cc3179-5f9b-4415-97c0-43684fb34597 req-31b7b247-36b2-4c3a-a3c1-b2dfb55864bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.878324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47cc3179-5f9b-4415-97c0-43684fb34597 req-31b7b247-36b2-4c3a-a3c1-b2dfb55864bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.884713 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25f5e5fc-633c-4756-bec4-ca68f7ceb084 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1500 microversion: 2.1 time: 1.346653 Sep 19 14:53:49.885316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1510/3047] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:48 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1500 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:49.904278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-611af23b-3183-4c59-94e0-d005d35005c8 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Action: 'create', calling method: .version_select at 0x7fde299f5790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1642496069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0KDIc9XNfF/6cQ1/4oM/eP35nvujsClLOg3Yh+mQqVlPONHm9n7iDNtXlKVQ2KVlpSjFcDDfHtI1MZSWP1HWRFxhZVRIDMS+a/hNMv0u6hadYPZQyMvpeQapoGcQsRbw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:49.915432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-47cc3179-5f9b-4415-97c0-43684fb34597 req-31b7b247-36b2-4c3a-a3c1-b2dfb55864bd service nova] Creating event network-vif-deleted:595de7c3-b970-459e-adf8-876a1a016ca3 for instance 51d91de0-7a79-46bf-8643-602219f0e987 on n-h2-858384-1 Sep 19 14:53:49.929187 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-47cc3179-5f9b-4415-97c0-43684fb34597 req-31b7b247-36b2-4c3a-a3c1-b2dfb55864bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101469 Sep 19 14:53:49.930466 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1538/3048] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:49.948605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:49.957728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:49.971204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-611af23b-3183-4c59-94e0-d005d35005c8 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Getting quotas for project f8fb92ff4f884457bdf8d9544a53b1e4. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:49.976114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.983727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.984526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.985230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-611af23b-3183-4c59-94e0-d005d35005c8 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Getting quotas for user e0d451967b7b4db58af131433480ce58 and project f8fb92ff4f884457bdf8d9544a53b1e4. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:49.985473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.988906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.990081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.012230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:50.047078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-611af23b-3183-4c59-94e0-d005d35005c8 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.147471 Sep 19 14:53:50.051119 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1511/3049] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:53:49 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:53:50.073787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1642496069", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:50.101181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lazy-loading 'flavor' on Instance uuid 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:50.101439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:50.141316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.143229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.143959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.145162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.147674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.151412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.404172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a1ce1ed-4bc2-4a27-993b-beaefbdb609d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "POST /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf/action" status: 200 len: 32 microversion: 2.1 time: 0.462933 Sep 19 14:53:50.421759 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1539/3050] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:53:49 2022] POST /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf/action => generated 32 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:53:50.432420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:50.433427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:50.472764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.473988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.475454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.484805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.488129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.488870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.523343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:53:50.525597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:53:50.529857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:53:50.534605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:53:50.535626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:53:50.594875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:50.816884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:50.844887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.845749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.846724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.855183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.856413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.857369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:51.019461 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f93ba930-4ab9-4eb7-b8e7-bdea4b282f2a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "POST /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d/action" status: 202 len: 1140 microversion: 2.54 time: 0.956763 Sep 19 14:53:51.021283 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1512/3051] 10.222.0.81 () {62 vars in 1320 bytes} [Mon Sep 19 14:53:50 2022] POST /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d/action => generated 1140 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 19 14:53:51.046170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:51.047172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:51.056058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:51.061917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:51.062647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:51.064143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:51.066228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:51.067300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:51.211418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:51.228049 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b5c0ac7-4c21-4432-870a-f30e71891db4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.804530 Sep 19 14:53:51.228842 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1540/3052] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:50 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:51.243112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:51.257117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:51.270309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:51.271368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:51.275091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:51.276166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:51.277017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:51.277851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:51.364589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:51.374452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f75fda94-5790-4fde-b587-c3c0e3964941 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.351840 Sep 19 14:53:51.378980 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1513/3053] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:51 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:51.533751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:51.549450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:51.552012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:51.556755 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee9fd2f9-181c-4e0f-bd7f-6d4552bef7f1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.326749 Sep 19 14:53:51.578845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1541/3054] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:51 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:52.253007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:52.253772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:52.277525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.280247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.280754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.282606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.283118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.285755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.404819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:52.405518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:52.424253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.426059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.426538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.429232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.430328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.433122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.662460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:52.688839 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-72e8c47a-613b-41b1-bd04-2678df603719 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.289030 Sep 19 14:53:52.689834 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1542/3055] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:52 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:52.717480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:52.718651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:52.725609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.726659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.727778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.733939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.735319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.736192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.741838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:52.901808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:52.906562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:52.916978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82919999-91ab-480a-987d-1474c060515d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.668661 Sep 19 14:53:52.920847 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1514/3056] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:52 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:52.941611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:52.948079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:52.955275 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d10246d-0522-46f5-9e6c-05e5b550609d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.257130 Sep 19 14:53:52.963597 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1543/3057] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:52 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:53.728955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:53.729840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:53.742361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:53.742361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:53.746361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:53.747520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:53.751482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:53.752312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:53.913380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:53.923046 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4db9ae5-adb0-4115-b5d4-76518f98c1bf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.205916 Sep 19 14:53:53.935635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1515/3058] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:53 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:53.944600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:53.946489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:53.951163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:53.966031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:53.979402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:53.985011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:53.986032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:53.989772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:53.994374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:53.996165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:53.997630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:53.999574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:54.004147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:54.006178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:54.008324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:54.010463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:54.011485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:54.204198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:54.214057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:54.220965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:54.222363 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a96f8656-1083-4119-9686-607e1ddc9946 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.241372 Sep 19 14:53:54.227633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1516/3059] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:53 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:53:54.467016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:54.476152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab8f24bb-0431-4fe0-8d02-5bbba592293d tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.535705 Sep 19 14:53:54.480598 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1544/3060] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:53 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:54.932477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1240846657", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f80262c3-b3a0-49d8-adb6-5bbb46e84872"}], "security_groups": [{"name": "tempest-securitygroup--219611889"}], "key_name": "tempest-keypair-1059275378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:54.961859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:54.962612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:54.982289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:54.988146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:54.990095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:54.991353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:54.994820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:54.997272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:55.340267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:55.353259 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-734ad513-1e60-4241-8a5d-35a8a2e5a448 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.395912 Sep 19 14:53:55.354249 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1545/3061] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:54 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:55.359346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:55.369339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:55.377995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] validate_networks() for [('f80262c3-b3a0-49d8-adb6-5bbb46e84872', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:53:55.386158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:55.395167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:55.395799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:55.396713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:55.397309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:55.397858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:55.531671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:55.547110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:55.551611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:55.557725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a45a8d3f-952e-4de6-9be2-a448de8fc83d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.202150 Sep 19 14:53:55.570787 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1546/3062] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:55 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:55.576979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:55.576979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:55.594624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:55.595055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:55.595488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:55.596219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:55.599022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:55.600812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:56.000904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:56.034900 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b8a577f-2df2-495d-bea9-8c2a0d462dc8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.472797 Sep 19 14:53:56.039000 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1547/3063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:55 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:56.378935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:56.379909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:56.389530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:56.392900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:56.393688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:56.394690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:56.397158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:56.398616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:56.779240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:56.796444 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95eb75b0-b47f-4036-a878-fa764981de70 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.422116 Sep 19 14:53:56.810862 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1548/3064] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:56 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:56.818391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:56.818391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:56.829865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:56.832629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:56.833211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:56.836072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:56.838334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:56.839959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.098916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:57.112155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:57.116732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:57.134953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Getting quotas for project 4baec5feb1414c92a0e8df948aede321. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:57.136533 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fed8ff16-7973-47ee-ad5a-bfaa4481ebef tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.334741 Sep 19 14:53:57.142166 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1549/3065] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:56 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:57.161894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:57.163001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:57.163355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Getting quotas for user 6d9c22a17bb146dba6b7a2ad603e33dc and project 4baec5feb1414c92a0e8df948aede321. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:57.183654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:57.184172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:57.184618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.186618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:57.188857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:57.189342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.203199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:53:57.206586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:53:57.211346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:53:57.212116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:53:57.212839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:53:57.235341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:57.236337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:57.237039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.238069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:57.238794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:57.241343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.344063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Getting quotas for project 4baec5feb1414c92a0e8df948aede321. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:57.359460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Getting quotas for user 6d9c22a17bb146dba6b7a2ad603e33dc and project 4baec5feb1414c92a0e8df948aede321. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:57.395356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:53:57.401960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:53:57.597120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a49cf8bb-b4a2-40a8-875f-8faf34f1c814 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.670569 Sep 19 14:53:57.606378 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1517/3066] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:53:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:53:57.624692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-27f7f918-21a8-4e00-a7f4-87978e25803c tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:57.625908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-27f7f918-21a8-4e00-a7f4-87978e25803c tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:57.983590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-27f7f918-21a8-4e00-a7f4-87978e25803c tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.000413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-27f7f918-21a8-4e00-a7f4-87978e25803c tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1270 microversion: 2.1 time: 0.387855 Sep 19 14:53:58.004459 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1518/3067] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:57 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1270 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:58.030363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:58.031156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:58.052816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:58.053604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:58.054271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:58.055208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:58.057374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:58.060045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:58.343656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.353386 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f62dc281-72cd-4bed-9174-2cc10610c52e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 1.209703 Sep 19 14:53:58.360910 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1550/3068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:57 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:58.366185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:58.369432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:58.387113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:58.392594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:58.393334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:58.394359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:58.395510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:58.396507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:58.448320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.459702 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-149b551a-5951-4323-88ab-8999bc128234 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.453059 Sep 19 14:53:58.460885 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1519/3069] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:58 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:58.584384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.596617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.604751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.606455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9edd19e4-3ad5-4ec5-bbd8-842625a37734 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.244063 Sep 19 14:53:58.607748 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1551/3070] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:58 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:59.028447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:59.029081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:59.044484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.044971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.045412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:59.046126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.046583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.047065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:59.223622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:59.232919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-341cfea1-d614-4e15-acbb-d597ffa05681 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1266 microversion: 2.1 time: 0.208235 Sep 19 14:53:59.249057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1520/3071] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:59 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:59.378288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:59.379283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:59.405791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.409485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.410954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:59.417188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.420471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.422731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:59.557559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:59.560473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:59.613795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.614973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.616459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:59.619078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.619570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.620015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:00.436026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:00.463074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e7a4abb-811e-4b4b-9c0a-2d23936dbf94 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 200 len: 1346 microversion: 2.1 time: 0.980157 Sep 19 14:54:00.463958 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1521/3072] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:59 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 1346 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:00.515809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:00.520837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:00.547849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:00.548734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:00.549401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:00.550332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:00.551426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:00.552560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:00.848008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:00.875599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:00.879532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:00.888257 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1e161149-f170-45c7-9528-53a4181a7aa1 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.388734 Sep 19 14:54:00.890153 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1522/3073] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:00 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:00.900813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:00.931792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-536201bc-c7cf-41f5-adce-04aa38d30fbe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 1.558144 Sep 19 14:54:00.939139 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1552/3074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:59 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:00.947962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:00.948937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:00.989179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:00.989688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:00.994022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:00.998517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:00.999395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.003972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.193977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:01.197042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:01.213007 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae90d78d-3ac9-4e90-a25d-45a0c42372d0 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1328 microversion: 2.1 time: 0.272476 Sep 19 14:54:01.218008 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1553/3075] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:00 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1328 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:01.259425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1840191019", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b44d37fa-1d8f-4837-84e3-b7070b395cb5"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:01.366845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] validate_networks() for [('b44d37fa-1d8f-4837-84e3-b7070b395cb5', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:01.493320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:01.494459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:01.528383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.531178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.531913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.534762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.535466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.536682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.566930 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 HTTP/1.1 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '51d91de0-7a79-46bf-8643-602219f0e987'} Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:01.568838 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.575938 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.577856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:01.578966 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bdcf69d9-53ce-44a5-9df0-48aacf15ecc7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 404 len: 111 microversion: 2.1 time: 0.093603 Sep 19 14:54:01.580134 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1554/3076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:01 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:54:01.730200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:01.732980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:01.745783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.747348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.748282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.750677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.752194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.752752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.790014 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987/os-volume_attachments HTTP/1.1 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': '51d91de0-7a79-46bf-8643-602219f0e987'} Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:01.793145 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1ea8bfe-1ccf-459f-b6a2-6402ff298e7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074012 Sep 19 14:54:01.798761 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1555/3077] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 14:54:01 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987/os-volume_attachments => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:54:01.936850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:01.937760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:01.956158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.962963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.965595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.971669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.972432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.973110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:02.226805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:02.241019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:02.245196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:02.246861 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08d27ec3-3611-4919-968b-d58624bff68b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.331998 Sep 19 14:54:02.248120 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1556/3078] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:01 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:02.255569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:02.256240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:02.265179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:02.266718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:02.267253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:02.268136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:02.268591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:02.269272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:02.269937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.162492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:03.166250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:03.168071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:03.168709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:03.169885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:03.192974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.194119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.195189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.196428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.197388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.198006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.254553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:03.287013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Getting quotas for project 52d85eb6d8c44744b7a5504641416dbb. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:03.299091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bcb33d5b-02de-4026-950b-92709402040a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 1.049059 Sep 19 14:54:03.309797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Getting quotas for user 805d86a347ce4bf7a1597a4c48766db1 and project 52d85eb6d8c44744b7a5504641416dbb. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:03.325468 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1557/3079] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:02 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:03.349463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-806979348", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:03.356190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:03.358597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:03.469035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:03.535186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:03.543961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-072538c5-3405-4305-9266-1edffeff2163 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.651689 Sep 19 14:54:03.546018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1523/3080] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:03.551748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:03.553518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:03.568114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.570258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.572015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.573017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.574077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.574834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:04.514769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:04.562231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef847d4a-e3e8-4d60-8a0c-678810cf2a94 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 1.014684 Sep 19 14:54:04.570435 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1524/3081] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:03 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:04.584105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:04.585724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:04.645696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:04.658577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:04.659314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:04.660260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:04.660903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:04.661501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.078355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:05.087404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:05.089523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:05.092193 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ac52e27-0e41-42cd-bf1b-1fc9392b79e3 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.515278 Sep 19 14:54:05.111153 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1525/3082] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:04 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:05.128015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:05.148541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:05.165115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.165769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.167128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.180005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.180521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.181352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.336382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:05.350049 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd72ee16-77f9-4c03-999e-abd99114fa35 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1277 microversion: 2.1 time: 0.225911 Sep 19 14:54:05.353120 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1526/3083] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:05 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:05.361794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:05.365462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:05.380755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.382846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.384154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.385697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.386995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.388383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.758185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:05.763090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:05.764493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:05.765593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:05.766707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:05.767342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:05.772406 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21131682-939f-4516-807a-0552979da80a tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.413376 Sep 19 14:54:05.778336 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1527/3084] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:05 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:05.787005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:05.792122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:05.803885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.804957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.806011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.807274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.807953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.808570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.809098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.812201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.812976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.813810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.814931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.814931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.923780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:05.944367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:05.968772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:05.972768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:06.087256 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-371c311f-b278-46f5-9a44-f415020e73da tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759894 Sep 19 14:54:06.093937 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1558/3085] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:06.118694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e17996e-127f-402f-af47-a0a5d8812271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:06.119651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e17996e-127f-402f-af47-a0a5d8812271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:06.291608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7e17996e-127f-402f-af47-a0a5d8812271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.302935 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7e17996e-127f-402f-af47-a0a5d8812271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631" status: 200 len: 1214 microversion: 2.1 time: 0.190606 Sep 19 14:54:06.303547 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1559/3086] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:06 2022] GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:06.320884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:06.321534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:06.330973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:06.331486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:06.331936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:06.332673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:06.333145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:06.333589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:06.498762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.516891 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6958e4aa-10b8-461e-bcf7-5549c5e83451 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 0.736941 Sep 19 14:54:06.518004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1528/3087] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:05 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:06.528371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-81e7c91c-f727-434e-b475-bc76d0ebb295 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:06.529436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81e7c91c-f727-434e-b475-bc76d0ebb295 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:06.563923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81e7c91c-f727-434e-b475-bc76d0ebb295 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:06.565678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.574944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.576383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.577586 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d7e9734-7d7c-4237-91ed-fdbff5952ae4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.273072 Sep 19 14:54:06.588672 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1560/3088] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:06 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:06.593458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:06.594074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:06.616174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:06.617660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:06.618460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:06.619448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:06.620125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:06.620790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:06.771209 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-81e7c91c-f727-434e-b475-bc76d0ebb295 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631" status: 204 len: 0 microversion: 2.1 time: 0.247313 Sep 19 14:54:06.773242 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1529/3089] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:54:06 2022] DELETE /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:54:06.780744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.782507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e418959-b5f9-4888-9b6c-a272e00bd930 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:06.783208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e418959-b5f9-4888-9b6c-a272e00bd930 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:06.815852 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1c81abdc-c8f0-4c97-8ec7-ae98923d03cc tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1283 microversion: 2.1 time: 0.226032 Sep 19 14:54:06.817489 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3e418959-b5f9-4888-9b6c-a272e00bd930 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e418959-b5f9-4888-9b6c-a272e00bd930 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 HTTP/1.1 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ef8ac0d4-040a-46c0-9268-11dcbaaf7631'} Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:06.834438 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e418959-b5f9-4888-9b6c-a272e00bd930 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:06.843427 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e418959-b5f9-4888-9b6c-a272e00bd930 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631" status: 404 len: 111 microversion: 2.1 time: 0.059585 Sep 19 14:54:06.849076 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1561/3090] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:06 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:06.849729 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1530/3091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:06 2022] GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:54:06.857513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:06.859350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:06.878288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:06.880066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:06.881739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:06.886111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:06.888056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:06.889548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.039855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1172429751", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:07.193199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:07.544240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:07.556845 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b393985-ba5d-4355-8369-16117f702fc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.714396 Sep 19 14:54:07.559418 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1562/3092] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:06 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:07.571521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c9f2287a-30b1-46f9-bf13-b8b5ff472c0a req-f8541871-6ee5-4c31-b8ef-25863e44a1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4170395-1448-4d17-bc72-be396e6a7eda", "tag": "95fca5f2-2d87-44f4-81b6-b34bb5828558"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:07.613982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c9f2287a-30b1-46f9-bf13-b8b5ff472c0a req-f8541871-6ee5-4c31-b8ef-25863e44a1d3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.624919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c9f2287a-30b1-46f9-bf13-b8b5ff472c0a req-f8541871-6ee5-4c31-b8ef-25863e44a1d3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.625530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c9f2287a-30b1-46f9-bf13-b8b5ff472c0a req-f8541871-6ee5-4c31-b8ef-25863e44a1d3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.672280 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c9f2287a-30b1-46f9-bf13-b8b5ff472c0a req-f8541871-6ee5-4c31-b8ef-25863e44a1d3 service nova] Creating event network-changed:95fca5f2-2d87-44f4-81b6-b34bb5828558 for instance c4170395-1448-4d17-bc72-be396e6a7eda on n-h1-858384-1 Sep 19 14:54:07.691753 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c9f2287a-30b1-46f9-bf13-b8b5ff472c0a req-f8541871-6ee5-4c31-b8ef-25863e44a1d3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129710 Sep 19 14:54:07.695949 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1563/3093] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:07.708152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:07.708965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:07.727904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.728406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.728851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.729566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.730030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.730463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:08.817368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:08.826453 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab5f9d2a-1e89-4b37-a786-8e461331bccb tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 1.129215 Sep 19 14:54:08.842616 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1564/3094] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:07 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:08.848070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:08.849080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:08.856100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:08.856918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:08.857576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:08.858511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:08.859189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:08.859790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:09.403070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:09.426195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:09.427777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:09.429834 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eac76211-80a3-4d63-894c-f59d87e6d21a tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.585076 Sep 19 14:54:09.450945 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1565/3095] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:08 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:09.466259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:09.467337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:09.485211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:09.489162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:09.489881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:09.494938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:09.495749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:09.497082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.351645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:10.352326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:10.352935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:10.353699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:10.354366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:10.375039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.376875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.377425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.384308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.385184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.385871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.424629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:10.442352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:10.480536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:10.483277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:10.605887 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76ba690a-e0dc-471c-8c81-e30f3d9f6271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.574809 Sep 19 14:54:10.608606 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1531/3096] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:10.621574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:10.622493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:10.642563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.643480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.644167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.645161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.647150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.653497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.692684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:11.116334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.129018 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c228e95-4118-44ba-95c1-a9263606f081 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.517536 Sep 19 14:54:11.135712 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1532/3097] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:10 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:11.143862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:11.144735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:11.158669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.162002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.162781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.164007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.166429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.168130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.418684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.436615 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40ae6702-0b3f-452a-ad8b-82a96cf2d45b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 1.978638 Sep 19 14:54:11.464927 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1566/3098] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:09 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:11.479040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:11.483992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:11.503669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.504448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.505075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.509749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.510545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.512377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.715513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.735575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.742312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.744269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a02b06bd-d566-46a0-b067-fe709fa1b29d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.278050 Sep 19 14:54:11.746914 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1567/3099] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:11 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:11.754165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:11.755018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:11.763670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.764184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.764626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.765330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.765966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.766549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.799110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.814434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3b0b84b5-6e05-4680-820d-2ff279fff3e4 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 0.676992 Sep 19 14:54:11.822785 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1533/3100] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:11 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:11.884526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.892911 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-376c2f10-82db-4acc-a3bc-833c1c9b8420 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1219 microversion: 2.1 time: 0.142704 Sep 19 14:54:11.897471 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1568/3101] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:11 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:11.915366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0ef5f743-4360-44ab-ae46-fb204881015e req-a1cd968b-bf1c-47fa-ad23-07bad16d2b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a01a87d-cbc0-4a00-85a1-606afe0c9ce6", "tag": "743faf00-da12-4dee-906f-e563b3958ea2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:11.948444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0ef5f743-4360-44ab-ae46-fb204881015e req-a1cd968b-bf1c-47fa-ad23-07bad16d2b8d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.948951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0ef5f743-4360-44ab-ae46-fb204881015e req-a1cd968b-bf1c-47fa-ad23-07bad16d2b8d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.949401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0ef5f743-4360-44ab-ae46-fb204881015e req-a1cd968b-bf1c-47fa-ad23-07bad16d2b8d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.986579 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0ef5f743-4360-44ab-ae46-fb204881015e req-a1cd968b-bf1c-47fa-ad23-07bad16d2b8d service nova] Creating event network-changed:743faf00-da12-4dee-906f-e563b3958ea2 for instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 on n-h2-858384-1 Sep 19 14:54:12.004824 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0ef5f743-4360-44ab-ae46-fb204881015e req-a1cd968b-bf1c-47fa-ad23-07bad16d2b8d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094215 Sep 19 14:54:12.005830 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1534/3102] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:12.158694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:12.159702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:12.175525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.176260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.181641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.182543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.183136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.183932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.468565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:12.469548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:12.478581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.479375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.479998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.480884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.481518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.482157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.201784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.214788 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac030c02-3885-4a80-b19c-16d25918fc99 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 0.748665 Sep 19 14:54:13.217585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1535/3103] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:12 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:13.228138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:13.230081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:13.244692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.245894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.246973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.250544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.251676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.255080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.580343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.595935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.597582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.606553 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c25aba0-793a-48ac-9e05-df44edd4a2b6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.379986 Sep 19 14:54:13.608883 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1536/3104] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:13 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:13.620938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:13.623814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:13.638101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.642419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.643537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.644639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.649037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.649717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.153838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:14.171097 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d043e27c-7134-4f7f-bb16-2578de1a678f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 2.017528 Sep 19 14:54:14.171990 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1569/3105] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:12 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:14.183231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:14.183863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:14.200463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.208560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.209206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.210196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.224705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.226059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.567067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:14.582092 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7cce3b32-528d-4a36-a230-0620ad62b6b6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1273 microversion: 2.1 time: 0.408813 Sep 19 14:54:14.593053 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1570/3106] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:14 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:14.596172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:14.603921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:14.604895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:14.607478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b0615ae-2d18-41c6-b106-3c6e27e293a1 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 0.996069 Sep 19 14:54:14.613177 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1537/3107] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:13 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:14.635583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.641746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.647043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.648552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.649262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.651529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.754862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70954324-0f06-41af-8f6d-e0c09180a72e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'create', calling method: .version_select at 0x7fde298933a0>, body: {"keypair": {"name": "tempest-keypair-1201064550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNoS7ohKTWkm459CAHVslkT2dl7+7FbZp/oywAkT297yj+jKUuttBNsuA805TJv0GYmqMn9KCsofSGr0rZnC5k72rjbQLeiA/JPed8SoXYrJzDfBbE5EafsnsmW1dxl9g=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:14.807299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=35 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:14.813631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-70954324-0f06-41af-8f6d-e0c09180a72e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for project b5b030a0534946eb96c825f4c9acc526. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:14.836852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-70954324-0f06-41af-8f6d-e0c09180a72e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for user c11d7590aa1f4fa48be57e2efc017a6f and project b5b030a0534946eb96c825f4c9acc526. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:14.897644 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70954324-0f06-41af-8f6d-e0c09180a72e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281936 Sep 19 14:54:14.898566 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1538/3108] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 14:54:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:14.910595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:14.912354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:14.920726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.921230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.921675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.922387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.922878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.923310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.153342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.169494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.172269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.179845 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-01b31f93-2692-450a-a1f9-428785655d60 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.275675 Sep 19 14:54:15.186605 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1539/3109] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:14 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:15.200986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:15.202022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:15.218784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.221208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.221845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.223369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.226442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.228185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.355251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.382351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aeacadf1-1959-4dfe-a6c1-1c0d31893c4a tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 0.782850 Sep 19 14:54:15.386914 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1571/3110] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:14 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:15.623786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:15.624854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:15.640565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.641119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.641760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.642564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.642984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.643413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.857292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:15.908705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.920635 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5f970e3f-96b0-46ae-b893-85a388ff5cb8 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.723753 Sep 19 14:54:15.921236 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1540/3111] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:15 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:15.932092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:15.937456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:15.950332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.951541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.952227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.954154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.956035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.956767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.024638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.050582 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2295db1-7a06-42ea-9521-27d15313ce31 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.430837 Sep 19 14:54:16.053331 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1572/3112] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:15 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:16.218486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:16.219155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:16.233203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.233717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.236610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.239368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.242172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.242685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.248669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.262305 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0bbc8973-aabe-4503-b72e-8ddc772d1dc9 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 0.338328 Sep 19 14:54:16.280180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1541/3113] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:15 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:16.313812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:16.408547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:16.409167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:16.422575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.423117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.423760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.424693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.425326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.425950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.471327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.490072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.497703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.499520 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d7fad90-01e2-4280-9286-3b1cfe9e0698 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.290448 Sep 19 14:54:16.500649 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1573/3114] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:16 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:16.935957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.956775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:16.957629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:16.958471 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-057e31c5-9bc1-4385-b653-20f08fb7a2c8 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 0.553928 Sep 19 14:54:16.961421 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1542/3115] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:16 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:16.972064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.973966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.978028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.979309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.982879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.984586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.004362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:17.080029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:17.080660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:17.098498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.099036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.099775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.101126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.101597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.102038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.519843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.534072 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-80269db4-69cd-4c48-b3fd-919ffcc2ec0c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.458310 Sep 19 14:54:17.535106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1543/3116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:17 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:17.550680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:17.551976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:17.563658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.565645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.568410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.569832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.571081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.573835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.576674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.586877 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97bbc04d-9974-4454-8681-a62c2ee98c56 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.642730 Sep 19 14:54:17.592613 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1574/3117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:16 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:17.597491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:17.598260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:17.619261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.622225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.622673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.623428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.623889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.624316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.843845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.853365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.860532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.861799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8142a88-461e-4d13-9f35-c2b0a002e54b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1409 microversion: 2.54 time: 0.268183 Sep 19 14:54:17.878237 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1575/3118] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:17 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1409 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:17.989700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:17.990228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:18.011490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.012376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.013033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.014987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.016725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.017385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.933833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:18.947288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-49cc1af7-6feb-4ea5-aa67-9223720dd799 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 1.410371 Sep 19 14:54:18.962789 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1544/3119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:17 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:18.964068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-560d05bf-8086-48b9-a5f3-067b42069bc2 req-bfa9e31c-08fa-4821-aff6-3266f41ff718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f716cd6-e84b-403d-8e7c-5e1b72b28623", "tag": "eaffd6af-2f7a-48ec-8e2d-fcf44348aa26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:18.979533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-560d05bf-8086-48b9-a5f3-067b42069bc2 req-bfa9e31c-08fa-4821-aff6-3266f41ff718 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.983880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-560d05bf-8086-48b9-a5f3-067b42069bc2 req-bfa9e31c-08fa-4821-aff6-3266f41ff718 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.986817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-560d05bf-8086-48b9-a5f3-067b42069bc2 req-bfa9e31c-08fa-4821-aff6-3266f41ff718 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.001021 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-560d05bf-8086-48b9-a5f3-067b42069bc2 req-bfa9e31c-08fa-4821-aff6-3266f41ff718 service nova] Creating event network-changed:eaffd6af-2f7a-48ec-8e2d-fcf44348aa26 for instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 on n-h2-858384-1 Sep 19 14:54:19.007384 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-560d05bf-8086-48b9-a5f3-067b42069bc2 req-bfa9e31c-08fa-4821-aff6-3266f41ff718 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057506 Sep 19 14:54:19.008300 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1545/3120] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:19.015847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:19.016760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:19.031701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.032513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.033142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.034542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.035224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.035828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.237064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:19.246677 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ca1df99-8b82-4b01-9f8f-21150ed044b6 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 1.260919 Sep 19 14:54:19.247580 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1576/3121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:17 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:19.261787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:19.267142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:19.280898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.281426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.281880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.288156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.290842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.291666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.750098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:19.762639 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e3c24d53-4977-44d0-9dfc-b4589ecf08c9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.752943 Sep 19 14:54:19.768826 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1546/3122] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:19 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:19.774620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:19.782178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:19.790618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.791581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.792220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.793374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.794049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.794657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.025526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.026116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.044953 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-30ac2c2b-1cd8-467c-b93a-d10d264e209f tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.796588 Sep 19 14:54:20.046512 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1577/3123] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:19 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:20.052098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-df47fbf6-3cf3-4b25-9145-be1d8df96942 req-26d27fa0-3314-4df4-b92f-a4552bf1a730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4170395-1448-4d17-bc72-be396e6a7eda", "name": "network-vif-plugged", "status": "completed", "tag": "95fca5f2-2d87-44f4-81b6-b34bb5828558"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:20.055357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.066043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-df47fbf6-3cf3-4b25-9145-be1d8df96942 req-26d27fa0-3314-4df4-b92f-a4552bf1a730 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.067197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-df47fbf6-3cf3-4b25-9145-be1d8df96942 req-26d27fa0-3314-4df4-b92f-a4552bf1a730 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.067936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-df47fbf6-3cf3-4b25-9145-be1d8df96942 req-26d27fa0-3314-4df4-b92f-a4552bf1a730 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.070945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.076675 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55c13181-e65f-4d3f-809c-7e203d1cc8a6 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1415 microversion: 2.54 time: 0.303734 Sep 19 14:54:20.077333 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1547/3124] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:19 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1415 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:20.095547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:20.096182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:20.099672 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-df47fbf6-3cf3-4b25-9145-be1d8df96942 req-26d27fa0-3314-4df4-b92f-a4552bf1a730 service nova] Creating event network-vif-plugged:95fca5f2-2d87-44f4-81b6-b34bb5828558 for instance c4170395-1448-4d17-bc72-be396e6a7eda on n-h1-858384-1 Sep 19 14:54:20.109570 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-df47fbf6-3cf3-4b25-9145-be1d8df96942 req-26d27fa0-3314-4df4-b92f-a4552bf1a730 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059230 Sep 19 14:54:20.127616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.132068 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1578/3125] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:20.152311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.154121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.158428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.158969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.159466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.276101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1047833077", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57e08ed1-fe03-4626-8d78-fcc627ace18e"}], "security_groups": [{"name": "tempest-securitygroup--1430337576"}], "key_name": "tempest-keypair-1201064550", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:20.403129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:20.729833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] validate_networks() for [('57e08ed1-fe03-4626-8d78-fcc627ace18e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:20.745061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.758239 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-24fdd262-ac88-4941-b360-b8462c7fdde2 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 0.679617 Sep 19 14:54:20.759158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1548/3126] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:20 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:20.779444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:20.780063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:20.786422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.786951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.787388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.788351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.789179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.789799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.009664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.022637 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-58bf8f1e-b1e8-473a-8327-1eec73c5f99b tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 0.246090 Sep 19 14:54:21.025629 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1549/3127] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:20 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:21.035295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.036659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.045141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.046532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.047199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.048140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.048766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.049802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.303041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.312383 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-456cf244-e447-4a4b-941c-c478c0f91dfb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.283931 Sep 19 14:54:21.313264 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1550/3128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:21.318270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.320751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.343544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.352100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.352984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.353614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.354541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.355318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.356264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.410276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.431424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:21.432487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:21.433765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:21.434599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:21.435302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:21.448785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.449650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.450291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.451349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.451995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.452610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.479710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:21.485909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for user c11d7590aa1f4fa48be57e2efc017a6f and project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:21.517893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:21.521577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:21.596389 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0c8c8419-70ba-4b87-9bd5-42e48e495941 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.328189 Sep 19 14:54:21.605043 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1579/3129] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:21.617847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.618481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.631001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.632654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.633144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.633879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.634351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.634808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.659878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.685097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f19ecf20-80eb-47cd-aba5-1f908dfaf69c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.370585 Sep 19 14:54:21.723229 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1551/3130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:21.735622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-610a8817-58c9-4fa0-accf-08e472c90c5c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.736259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-610a8817-58c9-4fa0-accf-08e472c90c5c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.749447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.760910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.764793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.766279 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-99b1e679-4606-4777-9040-841d64235e1d tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1400 microversion: 2.54 time: 0.160150 Sep 19 14:54:21.767890 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1580/3131] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1400 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:21.781547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.782510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.794217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.799621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.800079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.800831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.801293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.801730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.877418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-610a8817-58c9-4fa0-accf-08e472c90c5c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.886627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-610a8817-58c9-4fa0-accf-08e472c90c5c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1239 microversion: 2.1 time: 0.162217 Sep 19 14:54:21.888838 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1552/3132] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1239 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:21.932413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cdbec438-be09-47c7-8bd8-ff91f3772608 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '.version_select at 0x7fde2a9ba280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.006392 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cdbec438-be09-47c7-8bd8-ff91f3772608 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1642496069" status: 204 len: 0 microversion: 2.54 time: 0.095983 Sep 19 14:54:22.009384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1553/3133] 10.222.0.81 () {60 vars in 1319 bytes} [Mon Sep 19 14:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1642496069 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:54:22.033179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.033919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.046789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.049662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.050147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.050951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.051421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.054709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.126724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:22.181328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.193424 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d19425b-6f24-4cd5-8ebb-7767b1f68ae5 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1395 microversion: 2.1 time: 0.415699 Sep 19 14:54:22.197382 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1581/3134] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1395 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:22.207972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.208889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.226670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.228505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.230032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.231011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.233044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.234217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.370485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d87217e8-e77b-41eb-8788-3bf8007bc511 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 204 len: 0 microversion: 2.54 time: 0.348468 Sep 19 14:54:22.372732 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1554/3135] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:54:22 2022] DELETE /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:54:22.384575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-56e293de-220d-4245-8fee-769b04dd4555 req-eda74567-b34b-486a-81e0-97b266baa7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01a87d-cbc0-4a00-85a1-606afe0c9ce6", "name": "network-vif-plugged", "status": "completed", "tag": "743faf00-da12-4dee-906f-e563b3958ea2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:22.425360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56e293de-220d-4245-8fee-769b04dd4555 req-eda74567-b34b-486a-81e0-97b266baa7f0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.425884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56e293de-220d-4245-8fee-769b04dd4555 req-eda74567-b34b-486a-81e0-97b266baa7f0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.429206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56e293de-220d-4245-8fee-769b04dd4555 req-eda74567-b34b-486a-81e0-97b266baa7f0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.464095 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-56e293de-220d-4245-8fee-769b04dd4555 req-eda74567-b34b-486a-81e0-97b266baa7f0 service nova] Creating event network-vif-plugged:743faf00-da12-4dee-906f-e563b3958ea2 for instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 on n-h2-858384-1 Sep 19 14:54:22.473677 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-56e293de-220d-4245-8fee-769b04dd4555 req-eda74567-b34b-486a-81e0-97b266baa7f0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099482 Sep 19 14:54:22.474490 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1555/3136] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:22.507963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.509368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.544826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.545912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.546530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.547464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.548197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.549122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.557924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.567024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46c99f2b-c775-4ea8-abea-e7919ccbb1bf tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 0.368345 Sep 19 14:54:22.568577 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1582/3137] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:22.575252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.576175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.583086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.583940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.584884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.585932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.586633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.587336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.675733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.692527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.697987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.702321 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8343df80-8f0b-4fcc-a318-c895028cca1b tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1406 microversion: 2.54 time: 0.132348 Sep 19 14:54:22.703386 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1583/3138] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:22.733154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.733869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.743084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.743592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.744129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.744917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.745977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.746453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.867322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.888302 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b6423b1-231e-4f0d-826b-5ff6c44ee4de tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.401300 Sep 19 14:54:22.890321 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1556/3139] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:22.914691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.915424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.927523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.928021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.928761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.929617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.929931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.930359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.045133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.059165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f81c673e-209f-4a92-8c05-22930f6bbb95 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1243 microversion: 2.1 time: 0.149235 Sep 19 14:54:23.077668 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1557/3140] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1243 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:23.101273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.121277 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d15c9476-20d7-496b-b3c9-886f2a56a534 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.400673 Sep 19 14:54:23.122303 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1584/3141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:23.227989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:23.228875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.236590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.237080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.237519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.238227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.238684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.239150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.403365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.417158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e93e0515-3ec6-4a4d-9e60-776495984934 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1577 microversion: 2.1 time: 0.197028 Sep 19 14:54:23.418303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1558/3142] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:23.442089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:23.442692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.449691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.450399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.450970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.452065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.452694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.453221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.596246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:23.596862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.606153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.607110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.607110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.607984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.608598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.609038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.633208 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-15070030-864e-4fb4-a6a4-c5da4d693828 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195234 Sep 19 14:54:23.634158 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1585/3143] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:23.736994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:23.739134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.751485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.752372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.753072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.753908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.755391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.756780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.962724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.983471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.992357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.997078 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d820f33-ed76-4dc9-8543-f2ef3f90804e tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1406 microversion: 2.54 time: 0.261192 Sep 19 14:54:23.998637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1586/3144] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:24.004408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.005300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.014327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.014870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.015320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.016080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.016544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.016982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.046286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.056182 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f277388-1868-41bf-a430-acec080ee7f1 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1325 microversion: 2.1 time: 0.463700 Sep 19 14:54:24.056774 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1559/3145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:24.085510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.086265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.116170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.120695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.120695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.120695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.121370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.122353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.231075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.270596 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-514933a4-8f66-4d2a-ace7-78132d91c1f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1291 microversion: 2.1 time: 0.189139 Sep 19 14:54:24.286784 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1560/3146] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:24 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1291 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:24.286784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.287164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.287297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.296446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cf6d02d-be80-45e2-8e28-3cec67706167 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.295998 Sep 19 14:54:24.299557 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1587/3147] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:24.313230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.314302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.314774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.315946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.316903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.317499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.571036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c562281d-2aef-492d-ba24-e12f5e5fc013 req-c1ec0861-dc55-4aef-9c1a-4b37b5393a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f716cd6-e84b-403d-8e7c-5e1b72b28623", "name": "network-vif-plugged", "status": "completed", "tag": "eaffd6af-2f7a-48ec-8e2d-fcf44348aa26"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:24.595732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c562281d-2aef-492d-ba24-e12f5e5fc013 req-c1ec0861-dc55-4aef-9c1a-4b37b5393a15 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.599326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c562281d-2aef-492d-ba24-e12f5e5fc013 req-c1ec0861-dc55-4aef-9c1a-4b37b5393a15 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.600500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c562281d-2aef-492d-ba24-e12f5e5fc013 req-c1ec0861-dc55-4aef-9c1a-4b37b5393a15 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.627322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c562281d-2aef-492d-ba24-e12f5e5fc013 req-c1ec0861-dc55-4aef-9c1a-4b37b5393a15 service nova] Creating event network-vif-plugged:eaffd6af-2f7a-48ec-8e2d-fcf44348aa26 for instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 on n-h2-858384-1 Sep 19 14:54:24.646887 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c562281d-2aef-492d-ba24-e12f5e5fc013 req-c1ec0861-dc55-4aef-9c1a-4b37b5393a15 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077145 Sep 19 14:54:24.650227 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1588/3148] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:24.687449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.701593 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30bfa181-0a34-4e2e-98de-00f010f5fc3c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.424320 Sep 19 14:54:24.701823 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1561/3149] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:24 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:25.050393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.051203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.060625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.061177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.061621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.062610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.063239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.063763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.080275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.081173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.094903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.097374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.099793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.104484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.105207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.105824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.111328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.112218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.113215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.113906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lazy-loading 'fault' on Instance uuid cb036068-c659-46c7-bb1b-8c36b228220d {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:54:25.198071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.216604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.218948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0d451967b7b4db58af131433480ce58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fb92ff4f884457bdf8d9544a53b1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.221921 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83e0030e-f8a5-44c8-8bc1-cae776eb5410 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 200 len: 1411 microversion: 2.54 time: 0.176165 Sep 19 14:54:25.226120 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1589/3150] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 1411 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:25.302495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.304287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.311199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:25.312833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.313344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.313831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.314948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.315647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.316248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.485141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.496916 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-39dfd811-8fdc-4802-accf-d3305548f0b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1297 microversion: 2.1 time: 0.200872 Sep 19 14:54:25.503293 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1590/3151] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1297 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:25.512740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.515208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.532196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.534096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.536196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.539662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.541106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.543764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.692346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.721171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-72bb252b-7807-47d8-8cfb-b57977beca06 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1522 microversion: 2.1 time: 0.644938 Sep 19 14:54:25.722529 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1562/3152] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:25.727735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.728584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.735210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.736092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.737384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.738272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.738930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.739548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.965056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.978226 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5fca362-c286-4d51-ad16-d0e55d219ea4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1315 microversion: 2.1 time: 0.472414 Sep 19 14:54:25.979620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1591/3153] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:25.986703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.987626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.996963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.998174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.998174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.998979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.999726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.000123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.032746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:26.036998 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] HTTP exception thrown: Action 999 not found Sep 19 14:54:26.046395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Request method failure captured: Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6/os-instance-actions/999 HTTP/1.1 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIKHhRFkpH-3jA1sRQ5v8nZ5XzygNKGiCiHODynnpH_SmPrx_gS0Nws6vGbRkeU0kNu64CtxJN0GekfAvmTOphscEnbqKlkvfep24YTC9xDRPUKE0mdCEr9EdCmF7r7p_gF_fXelbZhb7Ij5GBOjLo7GVF_eTyzIEoqxyJ5HGBUYqjs Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d85eb6d8c44744b7a5504641416dbb Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d85eb6d8c44744b7a5504641416dbb"}]}] Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d85eb6d8c44744b7a5504641416dbb Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-InstanceActionsNegativeTestJSON-752615180-project Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 805d86a347ce4bf7a1597a4c48766db1 Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-752615180-project Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: exception: Action 999 not found Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': '5a01a87d-cbc0-4a00-85a1-606afe0c9ce6', 'id': '999'} Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 19 14:54:26.050433 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.056786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Returning 404 to user: Action 999 not found {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:26.057628 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-957ded7f-9bd5-47e2-aa98-2feafdf131e7 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.076570 Sep 19 14:54:26.058673 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1592/3154] 10.222.0.81 () {58 vars in 1308 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6/os-instance-actions/999 => generated 66 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:54:26.061747 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e86f00da-a91b-40da-b589-0cdb0848dc3e tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.337928 Sep 19 14:54:26.062518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1563/3155] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:26.075809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9fea9511-77eb-4a1f-82ec-c4cccf38b0be tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '.version_select at 0x7fde29ae5af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.075809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9fea9511-77eb-4a1f-82ec-c4cccf38b0be tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: f203b51b-51b9-4ff8-a821-d0285b2b8b3f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.077900 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9fea9511-77eb-4a1f-82ec-c4cccf38b0be tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] HTTP exception thrown: Instance f203b51b-51b9-4ff8-a821-d0285b2b8b3f could not be found. Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9fea9511-77eb-4a1f-82ec-c4cccf38b0be tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Request method failure captured: Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/f203b51b-51b9-4ff8-a821-d0285b2b8b3f/os-instance-actions HTTP/1.1 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIKHhRFkpH-3jA1sRQ5v8nZ5XzygNKGiCiHODynnpH_SmPrx_gS0Nws6vGbRkeU0kNu64CtxJN0GekfAvmTOphscEnbqKlkvfep24YTC9xDRPUKE0mdCEr9EdCmF7r7p_gF_fXelbZhb7Ij5GBOjLo7GVF_eTyzIEoqxyJ5HGBUYqjs Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d85eb6d8c44744b7a5504641416dbb Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d85eb6d8c44744b7a5504641416dbb"}]}] Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d85eb6d8c44744b7a5504641416dbb Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-InstanceActionsNegativeTestJSON-752615180-project Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 805d86a347ce4bf7a1597a4c48766db1 Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-752615180-project Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance f203b51b-51b9-4ff8-a821-d0285b2b8b3f could not be found. Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': 'f203b51b-51b9-4ff8-a821-d0285b2b8b3f'} Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f203b51b-51b9-4ff8-a821-d0285b2b8b3f could not be found. Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:26.086831 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f203b51b-51b9-4ff8-a821-d0285b2b8b3f could not be found. Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f203b51b-51b9-4ff8-a821-d0285b2b8b3f could not be found. Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9fea9511-77eb-4a1f-82ec-c4cccf38b0be tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Returning 404 to user: Instance f203b51b-51b9-4ff8-a821-d0285b2b8b3f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:26.092015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9fea9511-77eb-4a1f-82ec-c4cccf38b0be tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/f203b51b-51b9-4ff8-a821-d0285b2b8b3f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024400 Sep 19 14:54:26.094782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1593/3156] 10.222.0.81 () {58 vars in 1296 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/f203b51b-51b9-4ff8-a821-d0285b2b8b3f/os-instance-actions => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:54:26.102511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.103876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.113276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.115292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.116756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.118885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.119644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.120274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.174218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:26.255412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.256863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] [instance: cb036068-c659-46c7-bb1b-8c36b228220d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.268270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.268862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.269350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.274268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.280879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.281325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.284113 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3b97578a-952c-41e7-a1d0-9f37080a86a0 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 204 len: 0 microversion: 2.1 time: 0.188131 Sep 19 14:54:26.287196 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1564/3157] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:54:26 2022] DELETE /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:54:26.298572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.299369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.308312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.308952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.309888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.310243 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] HTTP exception thrown: Instance cb036068-c659-46c7-bb1b-8c36b228220d could not be found. Sep 19 14:54:26.311291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.312087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.312591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Request method failure captured: Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d HTTP/1.1 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIJ1HJlpRQ3qheYRX_-eGza4dVVR4IfFpWkKTiVEH-59GqJJKQxZT98tjnKM45hGT5RXmAALYYkfZAKLmhfZCnMz1fPm9VdHxGTM0lAJA8jYUVTqf414ODflfTbyaeOo7lMKi90gmUKIYSH-slPwpZU7zgviJLmxUmaHtp7TrswXXGU Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.54 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f8fb92ff4f884457bdf8d9544a53b1e4 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerShowV254Test-289634712 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f8fb92ff4f884457bdf8d9544a53b1e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f8fb92ff4f884457bdf8d9544a53b1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f8fb92ff4f884457bdf8d9544a53b1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f8fb92ff4f884457bdf8d9544a53b1e4"}]}] Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerShowV254Test-289634712 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f8fb92ff4f884457bdf8d9544a53b1e4 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerShowV254Test-289634712 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerShowV254Test-289634712-project Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: e0d451967b7b4db58af131433480ce58 Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerShowV254Test-289634712-project Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance cb036068-c659-46c7-bb1b-8c36b228220d could not be found. Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'cb036068-c659-46c7-bb1b-8c36b228220d'} Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb036068-c659-46c7-bb1b-8c36b228220d could not be found. Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb036068-c659-46c7-bb1b-8c36b228220d could not be found. Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:26.323184 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb036068-c659-46c7-bb1b-8c36b228220d could not be found. Sep 19 14:54:26.330546 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:26.332959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] Returning 404 to user: Instance cb036068-c659-46c7-bb1b-8c36b228220d could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:26.334182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb3d9cb3-998e-4b22-9ce1-457e0fd69ad4 tempest-ServerShowV254Test-289634712 tempest-ServerShowV254Test-289634712-project] 10.222.0.81 "GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d" status: 404 len: 111 microversion: 2.54 time: 0.084375 Sep 19 14:54:26.336346 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1594/3158] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/cb036068-c659-46c7-bb1b-8c36b228220d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:54:26.446263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.446822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.456087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.462137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.465155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.466109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.466733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.467428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.757343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:26.766180 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f71faf8d-b1f9-4f58-bf99-7f38d345d7ff tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1528 microversion: 2.1 time: 0.474269 Sep 19 14:54:26.773102 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1565/3159] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1528 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:26.782322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.784090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.798231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.801408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.802497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.805624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.806435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.808224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.455470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.467394 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ff1694d-43ca-41e4-82ff-3d03537c2ad7 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1577 microversion: 2.1 time: 1.025656 Sep 19 14:54:27.473379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1595/3160] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1577 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:27.488529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-570bf26f-c1a6-496a-870d-b0a871638970 req-53fc40e0-3b05-4c5d-a40f-4bf13450718a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4170395-1448-4d17-bc72-be396e6a7eda", "tag": "95fca5f2-2d87-44f4-81b6-b34bb5828558"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:27.533055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-570bf26f-c1a6-496a-870d-b0a871638970 req-53fc40e0-3b05-4c5d-a40f-4bf13450718a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.533560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-570bf26f-c1a6-496a-870d-b0a871638970 req-53fc40e0-3b05-4c5d-a40f-4bf13450718a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.534001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-570bf26f-c1a6-496a-870d-b0a871638970 req-53fc40e0-3b05-4c5d-a40f-4bf13450718a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.550996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-570bf26f-c1a6-496a-870d-b0a871638970 req-53fc40e0-3b05-4c5d-a40f-4bf13450718a service nova] Creating event network-changed:95fca5f2-2d87-44f4-81b6-b34bb5828558 for instance c4170395-1448-4d17-bc72-be396e6a7eda on n-h1-858384-1 Sep 19 14:54:27.557020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-570bf26f-c1a6-496a-870d-b0a871638970 req-53fc40e0-3b05-4c5d-a40f-4bf13450718a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081754 Sep 19 14:54:27.557994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1596/3161] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:27.567026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:27.567748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:27.574292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.574820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.575274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.575995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.576462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.576897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.661731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.674594 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b5d33e6-92ae-4938-bf66-ce49ad63e4f7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.899947 Sep 19 14:54:27.688661 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1566/3162] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:27.702990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:27.705447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:27.716124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.716575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.718228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.719247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.720266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.720960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.742579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:27.946602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.965297 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-706d59d5-49ba-49a1-abb9-e69edcafb1c6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1502 microversion: 2.1 time: 0.403772 Sep 19 14:54:27.967958 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1597/3163] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:27 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1502 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:27.977683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:27.978317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.001477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.004401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.008341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.010129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.010852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.012656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.060274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.073632 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6a27347b-2afe-4d55-bec0-643d48f6efe4 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1486 microversion: 2.1 time: 0.383506 Sep 19 14:54:28.088006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1567/3164] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:27 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1486 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:28.100376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:28.101458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.108747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.109679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.110373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.111366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.112069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.112733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.210057 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26d10935-1d08-4b86-b239-0331c3fb35c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623/action" status: 202 len: 0 microversion: 2.1 time: 0.119257 Sep 19 14:54:28.211854 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1568/3165] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:54:28 2022] POST /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:54:28.224107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:28.230917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.239357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.241225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.242149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.242821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.243730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.244373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.245005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.261767 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-530781e4-94de-40c8-abfa-ffe5bfd26187 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1528 microversion: 2.1 time: 0.292131 Sep 19 14:54:28.262841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1598/3166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:27 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1528 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:28.274107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:28.277739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.296557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.297064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.297722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.299293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.299924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.300971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.343039 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e94ac438-a3d6-4a4b-bc82-d495fd7ddf05 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "POST /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf/action" status: 202 len: 0 microversion: 2.1 time: 0.124375 Sep 19 14:54:28.343778 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1569/3167] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:54:28 2022] POST /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:54:28.357491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:28.358143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.375614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.376170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.377200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.378740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.379423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.380232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.726589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.739010 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdf2c64b-567a-4a37-8f16-63a9cdddf385 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1507 microversion: 2.1 time: 0.474882 Sep 19 14:54:28.757930 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1599/3168] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:28 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:28.764790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:28.765528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.773424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.773940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.774433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.776105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.776578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.778020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.789198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.804806 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-709122ad-d790-44dd-9652-8d1164b98a8c tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1494 microversion: 2.1 time: 0.454989 Sep 19 14:54:28.807099 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1570/3169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:28 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1494 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:29.031038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:29.042709 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aae7bb72-bb28-4490-8dc6-1c160fd41e2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.283199 Sep 19 14:54:29.043413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1600/3170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:28 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:29.288088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:29.289587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:29.303265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.304482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.305157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.306409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.308056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.308775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.499122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:29.514152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-207619bb-059c-4e23-947f-ae319575fa90 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1528 microversion: 2.1 time: 0.232836 Sep 19 14:54:29.515942 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1571/3171] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:29 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:29.771915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:29.772569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:29.780179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.781831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.782156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.782923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.785017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.786192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.831745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:29.832892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:29.844706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.846851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.847416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.849089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.851034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.851571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.128609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:30.139649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab8c7eb5-1f3d-4dc3-aee6-70a9843a5679 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1487 microversion: 2.1 time: 0.371775 Sep 19 14:54:30.145269 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1601/3172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:29 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1487 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:30.159629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.160422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:30.175355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:30.176071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.177222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.177665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.180876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.181360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.181797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.185930 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e0c1a392-abc2-433d-afd7-6e108984fd54 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1494 microversion: 2.1 time: 0.359315 Sep 19 14:54:30.187097 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1572/3173] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:29 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1494 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:30.205815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.207063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:30.217025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.217801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.219161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.220087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.220719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.221616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.264492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:30.407816 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 204 len: 0 microversion: 2.1 time: 0.219119 Sep 19 14:54:30.408431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:30.414104 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1573/3174] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:54:30 2022] DELETE /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:54:30.414104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.414104 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c10864d0-b931-4969-92e3-429b09c9f078 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001315 Sep 19 14:54:30.414104 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1574/3175] 10.222.0.81 () {56 vars in 886 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 19 14:54:30.425803 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.279145 Sep 19 14:54:30.426719 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1602/3176] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:30.427609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.429219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001941 Sep 19 14:54:30.429735 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1603/3177] 10.222.0.81 () {54 vars in 1035 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 19 14:54:30.437846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.438578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:30.445554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.446596 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 19 14:54:30.454908 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1604/3178] 10.222.0.81 () {54 vars in 1041 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2.1/ => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:30.456113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.457086 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3eecc62b-efe0-45f0-8c1b-3be90b9937ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001322 Sep 19 14:54:30.457664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1605/3179] 10.222.0.81 () {56 vars in 886 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 19 14:54:30.458176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.458675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.460092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.460918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.461403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.461800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.538361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.539241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:30.549426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.553998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.554835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.555771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.560180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.562025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.746268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:30.762937 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b8dd9f32-e56b-4039-9875-f0418ba973c4 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1486 microversion: 2.1 time: 0.229069 Sep 19 14:54:30.764208 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1606/3180] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1486 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:30.769142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-06aa2a56-eb87-4a2c-9aab-704499abc72a req-1dab104b-3e31-482e-9092-5ac0f4e9ee53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01a87d-cbc0-4a00-85a1-606afe0c9ce6", "name": "network-vif-deleted", "tag": "743faf00-da12-4dee-906f-e563b3958ea2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:30.795009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06aa2a56-eb87-4a2c-9aab-704499abc72a req-1dab104b-3e31-482e-9092-5ac0f4e9ee53 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.796927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06aa2a56-eb87-4a2c-9aab-704499abc72a req-1dab104b-3e31-482e-9092-5ac0f4e9ee53 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.797524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06aa2a56-eb87-4a2c-9aab-704499abc72a req-1dab104b-3e31-482e-9092-5ac0f4e9ee53 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.801780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:30.811376 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74f1d3ff-3f4a-428d-8092-def728765bb5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1493 microversion: 2.1 time: 0.389547 Sep 19 14:54:30.811961 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1575/3181] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1493 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:30.836417 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-06aa2a56-eb87-4a2c-9aab-704499abc72a req-1dab104b-3e31-482e-9092-5ac0f4e9ee53 service nova] Creating event network-vif-deleted:743faf00-da12-4dee-906f-e563b3958ea2 for instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 on n-h2-858384-1 Sep 19 14:54:30.842542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-06aa2a56-eb87-4a2c-9aab-704499abc72a req-1dab104b-3e31-482e-9092-5ac0f4e9ee53 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076848 Sep 19 14:54:30.843499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1607/3182] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:31.217614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:31.219242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:31.239952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.240835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.241572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.242518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.243295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.244049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.454844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:31.455957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:31.464523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:31.466493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.467716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.468410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.469849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.470687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.471206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.504808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:31.508193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.525922 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d18e1da1-4f95-4a16-b546-504702631a34 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1494 microversion: 2.1 time: 0.314793 Sep 19 14:54:31.526918 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1576/3183] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:31 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1494 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:31.731374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.742462 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5349a8fc-297a-4899-b2b8-f91224a828ba tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.294069 Sep 19 14:54:31.751644 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1608/3184] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:31 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:31.791456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:31.792084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:31.806208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.806702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.808222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.809014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.809498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.810070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.838432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:31.839075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:31.855476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.858342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.862399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.863348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.863824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.864263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.898396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:31.955275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805d86a347ce4bf7a1597a4c48766db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d85eb6d8c44744b7a5504641416dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.972026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cfc9e706-6048-4c02-bc83-c4d3ffbc9814 tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 200 len: 1310 microversion: 2.1 time: 0.182570 Sep 19 14:54:31.973224 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1577/3185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:31 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:32.103672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:32.112403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b607d98-604a-4f7c-b5bd-300ee0ebd5c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1493 microversion: 2.1 time: 0.278669 Sep 19 14:54:32.124248 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1609/3186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:31 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1493 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:32.551911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:32.552564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:32.562236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.563144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.565406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.566452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.567128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.567799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.769253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:32.770407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:32.779662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.780547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.782311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.783377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.784221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.784947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.983305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:32.997325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73ff164b-783d-49b1-9784-47c358d62bba tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1500 microversion: 2.1 time: 0.450684 Sep 19 14:54:32.998121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1578/3187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:32 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1500 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:33.010462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}, {"server_uuid": "6f716cd6-e84b-403d-8e7c-5e1b72b28623", "name": "network-vif-deleted", "tag": "eaffd6af-2f7a-48ec-8e2d-fcf44348aa26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:33.039640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.040141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.040844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.061363 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] Creating event network-changed:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:54:33.061962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] Creating event network-vif-deleted:eaffd6af-2f7a-48ec-8e2d-fcf44348aa26 for instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 on n-h2-858384-1 Sep 19 14:54:33.073055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3d5e95f9-aa84-4916-b492-f1e30e618798 req-aee80567-dc3a-4101-a06a-ea0beef37ceb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072162 Sep 19 14:54:33.074098 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1579/3188] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:33.079701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:33.081820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] [instance: 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:33.108642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.109648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.110231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.111251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.112556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.113141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.135795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:33.148800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ed8fa4d-86c7-483c-86fb-8d299d81c80a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.384789 Sep 19 14:54:33.151226 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1610/3189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:32 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:33.159054 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] HTTP exception thrown: Instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 could not be found. Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Request method failure captured: Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 HTTP/1.1 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIKHhRFkpH-3jA1sRQ5v8nZ5XzygNKGiCiHODynnpH_SmPrx_gS0Nws6vGbRkeU0kNu64CtxJN0GekfAvmTOphscEnbqKlkvfep24YTC9xDRPUKE0mdCEr9EdCmF7r7p_gF_fXelbZhb7Ij5GBOjLo7GVF_eTyzIEoqxyJ5HGBUYqjs Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d85eb6d8c44744b7a5504641416dbb Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d85eb6d8c44744b7a5504641416dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d85eb6d8c44744b7a5504641416dbb"}]}] Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d85eb6d8c44744b7a5504641416dbb Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-752615180 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-InstanceActionsNegativeTestJSON-752615180-project Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 805d86a347ce4bf7a1597a4c48766db1 Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-752615180-project Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 could not be found. Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '5a01a87d-cbc0-4a00-85a1-606afe0c9ce6'} Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 could not be found. Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 could not be found. Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:33.160869 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 could not be found. Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] Returning 404 to user: Instance 5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4f09b1cf-dacf-41df-aa79-7320d3f9a5ec tempest-InstanceActionsNegativeTestJSON-752615180 tempest-InstanceActionsNegativeTestJSON-752615180-project] 10.222.0.81 "GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6" status: 404 len: 111 microversion: 2.1 time: 0.087053 Sep 19 14:54:33.166460 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1580/3190] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:33 2022] GET /compute/v2.1/servers/5a01a87d-cbc0-4a00-85a1-606afe0c9ce6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:54:33.177443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:33.178522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:33.188044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.188293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:33.188981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.192885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:33.193320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.195399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.196103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.197461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.202427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.202966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.203400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.205559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.208858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.210401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.241218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:33.349168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.349695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.350336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.351112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lazy-loading 'fault' on Instance uuid 6f716cd6-e84b-403d-8e7c-5e1b72b28623 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:54:33.391230 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31b48918-3b31-4bf1-b02a-5af057381bcb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 204 len: 0 microversion: 2.1 time: 0.222265 Sep 19 14:54:33.391844 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1611/3191] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:54:33 2022] DELETE /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:54:33.403673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:33.415129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:33.430556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.431377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.432025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.432926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.433579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.440830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.573286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:33.583696 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f2652f4-1ab7-409e-91df-768959dd180c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 200 len: 1305 microversion: 2.1 time: 0.418585 Sep 19 14:54:33.585183 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1581/3192] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:33 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 1305 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:34.184284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:34.185326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:34.196818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:34.197761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:34.198586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.199845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:34.201646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:34.203224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.227841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:34.234904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:34.241948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d87497f5-d57d-46d3-a28f-516868bf8b52 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.845120 Sep 19 14:54:34.257227 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1612/3193] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:33 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:34.610558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:34.611745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:34.622101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:34.622818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:34.623066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.625310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:34.625769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:34.627772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.668138 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 HTTP/1.1 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6f716cd6-e84b-403d-8e7c-5e1b72b28623'} Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:34.668702 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:54:34.674188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:34.675055 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-44239385-bbdc-4ff4-b700-f4f0168d84c8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 404 len: 111 microversion: 2.1 time: 0.066020 Sep 19 14:54:34.675690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1613/3194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:34 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:54:34.709726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:34.732537 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fed99a20-198e-42ce-a8b7-0884d02c9bfe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.554279 Sep 19 14:54:34.732537 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1582/3195] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:34 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:34.903156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2114759240", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:35.053816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:35.268487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:35.268975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:35.290562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:35.291119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:35.297807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:35.304706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:35.305212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:35.307003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.050119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:36.063650 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b664d35d-9403-4e90-b9dc-b2cf7aaba3cb tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.799104 Sep 19 14:54:36.064399 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1583/3196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:35 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:36.096698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:36.098149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:36.120601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.121882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.123806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.129413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.133217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.139557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.315376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:36.316845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:36.318132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:36.319664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:36.320274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:36.343649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.344363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.344985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.346281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.347015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.347624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.416720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:36.428566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:36.472965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:36.479003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:36.516917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:36.525157 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-950ba407-f7f1-49c9-b4fc-8798ecd2d9db tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.458733 Sep 19 14:54:36.526004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1584/3197] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:36 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:36.556675 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdff486b-f0cc-4609-bcc0-9a3546576818 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657542 Sep 19 14:54:36.557344 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1614/3198] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:54:36.569657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d81365d-226f-4b4e-9288-d2204531ac29 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:36.570323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d81365d-226f-4b4e-9288-d2204531ac29 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:36.793755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d81365d-226f-4b4e-9288-d2204531ac29 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:36.804219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d81365d-226f-4b4e-9288-d2204531ac29 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1215 microversion: 2.1 time: 0.239411 Sep 19 14:54:36.806337 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1585/3199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:36 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:37.090345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:37.092205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:37.107314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.109182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.111977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.113522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.114326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.115267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.141643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:37.556720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:37.557986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:37.573527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.574090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.574542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.578902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.579417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.581007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.757257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:37.773126 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4a7bbbf3-3462-460c-ad70-368dcedb50e3 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1506 microversion: 2.1 time: 0.686682 Sep 19 14:54:37.777307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1615/3200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:37 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:37.833555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:37.835809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:37.848671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.849089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.850231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.851083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.854729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.857432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.040389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:38.055162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-18cc3497-3ed8-4de6-b5e7-c1fcaedb0933 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1267 microversion: 2.1 time: 0.224774 Sep 19 14:54:38.055769 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1616/3201] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:37 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:38.065118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:38.083931 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-753c5e2d-1d5f-400a-b7dd-96439f05de7a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.530785 Sep 19 14:54:38.087166 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1586/3202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:37 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:38.809823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:38.811088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:38.857698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.861494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.862628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.863852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.868235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.869223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.087709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:39.088705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:39.135587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:39.150789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.156407 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-356d2605-c55d-4bdc-b765-a75750e4bbc7 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 200 len: 1464 microversion: 2.1 time: 0.352584 Sep 19 14:54:39.157861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.158441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.162140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.178240 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1617/3203] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:38 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:39.178926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.178926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.186994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-20bbcefe-fd4a-442f-9c56-da3dd013637d req-99bb7a4f-6354-4ae9-b4e0-52b5045d1dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf", "name": "network-vif-deleted", "tag": "d2c5c016-3091-46d4-bb7c-0dc805cb8e89"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:39.267602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-20bbcefe-fd4a-442f-9c56-da3dd013637d req-99bb7a4f-6354-4ae9-b4e0-52b5045d1dc0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.268112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-20bbcefe-fd4a-442f-9c56-da3dd013637d req-99bb7a4f-6354-4ae9-b4e0-52b5045d1dc0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.268551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-20bbcefe-fd4a-442f-9c56-da3dd013637d req-99bb7a4f-6354-4ae9-b4e0-52b5045d1dc0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.298002 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-20bbcefe-fd4a-442f-9c56-da3dd013637d req-99bb7a4f-6354-4ae9-b4e0-52b5045d1dc0 service nova] Creating event network-vif-deleted:d2c5c016-3091-46d4-bb7c-0dc805cb8e89 for instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf on n-h2-858384-1 Sep 19 14:54:39.314956 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-20bbcefe-fd4a-442f-9c56-da3dd013637d req-99bb7a4f-6354-4ae9-b4e0-52b5045d1dc0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144462 Sep 19 14:54:39.316383 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1618/3204] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:39.330126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:39.331593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:39.356337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.360299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.364794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.367254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.367755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.369290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.633511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:39.641660 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41fd08b0-28b4-4431-95ae-91a3923195c0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1273 microversion: 2.1 time: 0.562468 Sep 19 14:54:39.642244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1587/3205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:39 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1273 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:40.194232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:40.195022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:40.209539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.210053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.210503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.211264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.211731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.212161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.247256 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] HTTP exception thrown: Instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf could not be found. Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Request method failure captured: Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf HTTP/1.1 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIIhEkIH4xUzz_20jwNiTp4F_dkF8JpMa4QfyLgsJcoTOcTz1T7DBMaXzVrLuBZTV6Dk5MQSJrqPg9HJq7o7RX9f8y-p6wx6SegrDZaQB9gdSo9kHu5YHqZexuTlrhERlNTU7pcz73IMOpLf68fHQ1TJ4wteRcq7f77cAclsFWUUBKw Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a245ad65a629467e8cb341a4045aa529 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueTestJSON-1150134769 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a245ad65a629467e8cb341a4045aa529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a245ad65a629467e8cb341a4045aa529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a245ad65a629467e8cb341a4045aa529"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a245ad65a629467e8cb341a4045aa529"}]}] Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueTestJSON-1150134769 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a245ad65a629467e8cb341a4045aa529 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueTestJSON-1150134769 Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueTestJSON-1150134769-project Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 2f16b23334a84b8880c4955c0b7ed71d Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueTestJSON-1150134769-project Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf could not be found. Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf'} Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf could not be found. Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf could not be found. Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:40.248849 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf could not be found. Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Returning 404 to user: Instance 1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:40.254851 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-16ed2265-062b-48ee-9356-c71fb6d60590 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf" status: 404 len: 111 microversion: 2.1 time: 0.060609 Sep 19 14:54:40.275109 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1588/3206] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:40 2022] GET /compute/v2.1/servers/1a8c54c3-5d3f-4ffd-8b2a-b236a117f2bf => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:54:40.291928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:40.292808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:40.316695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:40.321253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.323228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.324803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.327941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.329910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.331347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.373781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:40.567361 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d8186c2-f0c8-4d98-903d-6e9a003a7af5 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 204 len: 0 microversion: 2.1 time: 0.281011 Sep 19 14:54:40.570451 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1589/3207] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:54:40 2022] DELETE /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:54:40.581943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:40.587869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:40.603711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.605605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.608611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.609746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.611398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.612085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.998503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.020540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e81faedc-14f6-42fd-9c37-f09199e21830 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 1.702746 Sep 19 14:54:41.047722 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1619/3208] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:39 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:41.064376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:41.067785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:41.108955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.111511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.112519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.115777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.117304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.117763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.390569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.417676 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-447394a2-b89e-40b1-98ef-0eccb0388909 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1273 microversion: 2.1 time: 0.368649 Sep 19 14:54:41.419952 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1620/3209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:41 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:41.459195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5673fe87-450d-4de2-88ba-3bf0a8577d2c req-e174daf7-e68d-41e4-bec9-1cc5b9be524f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-plugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:41.495681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5673fe87-450d-4de2-88ba-3bf0a8577d2c req-e174daf7-e68d-41e4-bec9-1cc5b9be524f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.496331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5673fe87-450d-4de2-88ba-3bf0a8577d2c req-e174daf7-e68d-41e4-bec9-1cc5b9be524f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.499082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5673fe87-450d-4de2-88ba-3bf0a8577d2c req-e174daf7-e68d-41e4-bec9-1cc5b9be524f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.549368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.551029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5673fe87-450d-4de2-88ba-3bf0a8577d2c req-e174daf7-e68d-41e4-bec9-1cc5b9be524f service nova] Creating event network-vif-plugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:54:41.559218 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5673fe87-450d-4de2-88ba-3bf0a8577d2c req-e174daf7-e68d-41e4-bec9-1cc5b9be524f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115880 Sep 19 14:54:41.564786 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b67f8533-4368-4821-89c0-427c3ac98750 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1493 microversion: 2.1 time: 0.989393 Sep 19 14:54:41.565530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1590/3210] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:40 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1493 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:41.565970 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1621/3211] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:42.060702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:42.061651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.073025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.075963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.076422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.077269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.077742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.079314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.462335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:42.463209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.472138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.473143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.475077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.476164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.476903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.478535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.631826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.655197 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-196cd6dc-0ada-4fab-a016-846e6860ce56 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.597955 Sep 19 14:54:42.656517 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1591/3212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:42 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:42.664033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf15abf2-8094-468c-aece-ccebbffe7d77 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Action: 'create', calling method: .version_select at 0x7fde29dcf790>, body: {"keypair": {"name": "tempest-keypair-12524104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1DcmrJxdDV4aUBsVB6B54VUoQYC13YxfMZUl5SCmC/MWtof0mvv6t7+UvIAZkzWeiCGYKVWEIo3VwT7S5PamPDEN6Rw4vYIVMNXBn3LY+V32s3oBRZguyAJrBvsnBxwQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:42.693767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-bf15abf2-8094-468c-aece-ccebbffe7d77 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Getting quotas for project 54c71a7d33bb47a2b56b1e33f9af910f. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:42.701119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-bf15abf2-8094-468c-aece-ccebbffe7d77 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Getting quotas for user 25f8816ea2294e3e90b76601cc37a4ec and project 54c71a7d33bb47a2b56b1e33f9af910f. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:42.741996 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf15abf2-8094-468c-aece-ccebbffe7d77 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.084019 Sep 19 14:54:42.742679 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1592/3213] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:54:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:42.752144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:42.754139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.766964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.768120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.768677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.771051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.772327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.774324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:43.189626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:43.205099 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61a55221-9b11-420d-b29a-4120b6518489 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1315 microversion: 2.1 time: 0.756032 Sep 19 14:54:43.220251 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1622/3214] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:42 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:43.341417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:43.353200 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff9cddb3-81bd-45ea-a1c1-dcd9aa7cd543 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1493 microversion: 2.1 time: 0.609394 Sep 19 14:54:43.360594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1593/3215] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:42 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1493 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:43.684182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:43.685623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:43.704197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:43.706224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:43.707394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:43.708207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:43.712017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:43.713181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.235034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:44.235650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:44.251376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.254549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.255299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.256712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.259324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.260123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.409818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.426397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f614a899-5a52-42cf-9efc-8fd46dfd78ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1365 microversion: 2.1 time: 0.746239 Sep 19 14:54:44.446451 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1623/3216] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:43 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1365 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:44.471710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:44.472719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:44.483338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.484179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.484809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.485722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.486371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.490634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.830577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f16b23334a84b8880c4955c0b7ed71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a245ad65a629467e8cb341a4045aa529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.861578 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d32a95b-b93d-4386-bf98-2ba439414959 tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 200 len: 1451 microversion: 2.1 time: 0.413516 Sep 19 14:54:44.864271 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1624/3217] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:44 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 1451 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:44.892741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6e470a17-9ed0-48a5-8888-ae3071eb74be req-ed0404ad-7187-4217-a2ba-172809b8dbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4335f57-09f8-499b-91c3-6fc75237c0cf", "name": "network-vif-deleted", "tag": "7c6d7337-7915-4073-bd2b-16d6935bb7a5"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:44.923045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6e470a17-9ed0-48a5-8888-ae3071eb74be req-ed0404ad-7187-4217-a2ba-172809b8dbb1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.923633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6e470a17-9ed0-48a5-8888-ae3071eb74be req-ed0404ad-7187-4217-a2ba-172809b8dbb1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.924074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6e470a17-9ed0-48a5-8888-ae3071eb74be req-ed0404ad-7187-4217-a2ba-172809b8dbb1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.952482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6e470a17-9ed0-48a5-8888-ae3071eb74be req-ed0404ad-7187-4217-a2ba-172809b8dbb1 service nova] Creating event network-vif-deleted:7c6d7337-7915-4073-bd2b-16d6935bb7a5 for instance a4335f57-09f8-499b-91c3-6fc75237c0cf on n-h1-858384-1 Sep 19 14:54:44.962530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6e470a17-9ed0-48a5-8888-ae3071eb74be req-ed0404ad-7187-4217-a2ba-172809b8dbb1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095490 Sep 19 14:54:44.963682 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1625/3218] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:44.980153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7ccf7437-b416-4f5f-9dd3-2186d71b023c req-3fc9599e-0733-4402-b91d-a03490ec1c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9199a1b4-97bd-4382-8c8a-c06f417d4233", "tag": "4118ea11-115a-41d1-9211-3709b41cd6ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:45.019088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7ccf7437-b416-4f5f-9dd3-2186d71b023c req-3fc9599e-0733-4402-b91d-a03490ec1c36 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.019775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7ccf7437-b416-4f5f-9dd3-2186d71b023c req-3fc9599e-0733-4402-b91d-a03490ec1c36 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.020369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7ccf7437-b416-4f5f-9dd3-2186d71b023c req-3fc9599e-0733-4402-b91d-a03490ec1c36 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.040638 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7ccf7437-b416-4f5f-9dd3-2186d71b023c req-3fc9599e-0733-4402-b91d-a03490ec1c36 service nova] Creating event network-changed:4118ea11-115a-41d1-9211-3709b41cd6ed for instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 on n-h2-858384-1 Sep 19 14:54:45.060489 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7ccf7437-b416-4f5f-9dd3-2186d71b023c req-3fc9599e-0733-4402-b91d-a03490ec1c36 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091943 Sep 19 14:54:45.061384 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1626/3219] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:45.313945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:45.323062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09feed53-4a56-4a1c-9c16-65cb10912160 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1315 microversion: 2.1 time: 1.092294 Sep 19 14:54:45.323695 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1594/3220] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:44 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:45.452120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:45.452838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:45.468122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.468628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.469064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.469783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.470227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.470653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.885482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:45.891061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:45.891690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] [instance: a4335f57-09f8-499b-91c3-6fc75237c0cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:45.906413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.907872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.908336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.909494 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5c066a5-98dd-4f3f-9a0f-f75d03787bde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1550 microversion: 2.1 time: 0.457860 Sep 19 14:54:45.910867 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1627/3221] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:45 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1550 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:45.916223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.916719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.919356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.940343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:45.940924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:45.952552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.956630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.957464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.957986 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] HTTP exception thrown: Instance a4335f57-09f8-499b-91c3-6fc75237c0cf could not be found. Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Request method failure captured: Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf HTTP/1.1 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIIhEkIH4xUzz_20jwNiTp4F_dkF8JpMa4QfyLgsJcoTOcTz1T7DBMaXzVrLuBZTV6Dk5MQSJrqPg9HJq7o7RX9f8y-p6wx6SegrDZaQB9gdSo9kHu5YHqZexuTlrhERlNTU7pcz73IMOpLf68fHQ1TJ4wteRcq7f77cAclsFWUUBKw Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a245ad65a629467e8cb341a4045aa529 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueTestJSON-1150134769 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a245ad65a629467e8cb341a4045aa529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a245ad65a629467e8cb341a4045aa529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a245ad65a629467e8cb341a4045aa529"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a245ad65a629467e8cb341a4045aa529"}]}] Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueTestJSON-1150134769 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a245ad65a629467e8cb341a4045aa529 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueTestJSON-1150134769 Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueTestJSON-1150134769-project Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 2f16b23334a84b8880c4955c0b7ed71d Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueTestJSON-1150134769-project Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a4335f57-09f8-499b-91c3-6fc75237c0cf could not be found. Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a4335f57-09f8-499b-91c3-6fc75237c0cf'} Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4335f57-09f8-499b-91c3-6fc75237c0cf could not be found. Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4335f57-09f8-499b-91c3-6fc75237c0cf could not be found. Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:45.961148 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4335f57-09f8-499b-91c3-6fc75237c0cf could not be found. Sep 19 14:54:45.965757 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:54:45.966265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.966359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.967380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.968331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] Returning 404 to user: Instance a4335f57-09f8-499b-91c3-6fc75237c0cf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:45.969421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abacb592-c2a6-498e-8d7b-5886968e53fe tempest-ServerRescueTestJSON-1150134769 tempest-ServerRescueTestJSON-1150134769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf" status: 404 len: 111 microversion: 2.1 time: 0.082793 Sep 19 14:54:45.970650 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1595/3222] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:45 2022] GET /compute/v2.1/servers/a4335f57-09f8-499b-91c3-6fc75237c0cf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:54:46.137432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d181ccf3-9523-4799-b8d3-365cba756e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203336 Sep 19 14:54:46.138043 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1628/3223] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 14:54:45 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:46.357654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:46.359250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:46.381751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.382606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.386247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.388466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.389195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.391463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.268587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:47.280240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4ad730a3-6d10-4ea9-822a-a388c6d56d7c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1315 microversion: 2.1 time: 0.932264 Sep 19 14:54:47.296603 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1596/3224] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:46 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:48.308177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:48.309885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:48.316780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:48.320953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:48.325324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.326093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.326902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.327986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.328726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.329327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.632915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1511190575", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b7de2c42-c629-4ebc-9ac3-fab317feff76"}, {"port": "914dde40-c1af-492e-9957-c5c125c07414", "tag": "port-1"}, {"port": "a77e244a-300f-4a14-bf87-f3c421b61828", "tag": "port-2"}, {"uuid": "feeec976-c09b-442e-9d10-87f58cb94bdf", "tag": "net-1"}, {"uuid": "feeec976-c09b-442e-9d10-87f58cb94bdf"}, {"uuid": "a602aab0-2a7b-4873-8130-99223367e11f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a602aab0-2a7b-4873-8130-99223367e11f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "eaff442a-d330-4583-8be9-a8033fb5a3d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "beaaff31-8817-45b3-bbcc-ec9d001ad5e4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "da1778ae-4738-4f15-aa80-00866da72c1b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--600606299"}], "key_name": "tempest-keypair-12524104", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:49.047485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] validate_networks() for [('b7de2c42-c629-4ebc-9ac3-fab317feff76', None, None, None, None, None), (None, None, '914dde40-c1af-492e-9957-c5c125c07414', None, None, None), (None, None, 'a77e244a-300f-4a14-bf87-f3c421b61828', None, None, None), ('feeec976-c09b-442e-9d10-87f58cb94bdf', None, None, None, None, None), ('feeec976-c09b-442e-9d10-87f58cb94bdf', None, None, None, None, None), ('a602aab0-2a7b-4873-8130-99223367e11f', '10.2.2.100', None, None, None, None), ('a602aab0-2a7b-4873-8130-99223367e11f', '10.2.2.200', None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:49.166265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:49.181896 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e7b2336-3acc-484f-bb66-310b17691801 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1315 microversion: 2.1 time: 0.879438 Sep 19 14:54:49.183615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1629/3225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:48 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:49.986087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c3922cd3-fc98-4af5-920e-cd279c400d90 req-8a22243e-5c1a-4c6c-8649-ca55b7248555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9199a1b4-97bd-4382-8c8a-c06f417d4233", "name": "network-vif-plugged", "status": "completed", "tag": "4118ea11-115a-41d1-9211-3709b41cd6ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:50.012287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c3922cd3-fc98-4af5-920e-cd279c400d90 req-8a22243e-5c1a-4c6c-8649-ca55b7248555 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.012793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c3922cd3-fc98-4af5-920e-cd279c400d90 req-8a22243e-5c1a-4c6c-8649-ca55b7248555 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.015460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c3922cd3-fc98-4af5-920e-cd279c400d90 req-8a22243e-5c1a-4c6c-8649-ca55b7248555 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.043408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c3922cd3-fc98-4af5-920e-cd279c400d90 req-8a22243e-5c1a-4c6c-8649-ca55b7248555 service nova] Creating event network-vif-plugged:4118ea11-115a-41d1-9211-3709b41cd6ed for instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 on n-h2-858384-1 Sep 19 14:54:50.049429 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c3922cd3-fc98-4af5-920e-cd279c400d90 req-8a22243e-5c1a-4c6c-8649-ca55b7248555 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067820 Sep 19 14:54:50.050348 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1630/3226] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:50.209116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:50.209833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:50.223859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.226241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.226695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.227453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.227928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.228348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.800822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.818079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8f596b14-1b68-431a-9871-83cb91236017 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1315 microversion: 2.1 time: 0.613871 Sep 19 14:54:50.819732 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1631/3227] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:50 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:50.831203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ba2ee82d-b2a6-473d-ba49-927e703010c9 req-68247455-9023-43a9-aa0a-0c4fd896d272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:50.856713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ba2ee82d-b2a6-473d-ba49-927e703010c9 req-68247455-9023-43a9-aa0a-0c4fd896d272 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.857512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ba2ee82d-b2a6-473d-ba49-927e703010c9 req-68247455-9023-43a9-aa0a-0c4fd896d272 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.858130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ba2ee82d-b2a6-473d-ba49-927e703010c9 req-68247455-9023-43a9-aa0a-0c4fd896d272 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.899146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ba2ee82d-b2a6-473d-ba49-927e703010c9 req-68247455-9023-43a9-aa0a-0c4fd896d272 service nova] Creating event network-changed:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:54:50.920526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ba2ee82d-b2a6-473d-ba49-927e703010c9 req-68247455-9023-43a9-aa0a-0c4fd896d272 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096941 Sep 19 14:54:50.921999 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1632/3228] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:51.842064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:51.842969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:51.846031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:51.857857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.858423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.858914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.859627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.864867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.864867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.443962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:52.459790 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3669eef-858e-4150-8ba7-7cbafd33dc6f tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1501 microversion: 2.1 time: 0.621760 Sep 19 14:54:52.471687 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1633/3229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:51 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1501 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:52.500707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:52.503321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:52.523023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:52.525631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:52.527512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.528811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:52.531706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:52.534033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.592995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lazy-loading 'flavor' on Instance uuid 9199a1b4-97bd-4382-8c8a-c06f417d4233 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:54:52.700191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:52.716621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:53.006801 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ffc992c-5496-48ed-9d13-a4ab2b9450c1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233/action" status: 202 len: 0 microversion: 2.1 time: 0.523668 Sep 19 14:54:53.012407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1634/3230] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:54:52 2022] POST /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:54:53.041861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:53.045026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:53.071348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:53.071880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:53.072325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:53.075454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:53.075958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:53.076400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:54.101235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:54.122299 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fedfdb5-9358-424e-9716-770ca0c72adb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 1.089844 Sep 19 14:54:54.130107 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1635/3231] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:53 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:54.422363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1649205955", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "0c758e6a-cb03-449b-8653-f10b2aca74f6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:54.513476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] validate_networks() for [('0c758e6a-cb03-449b-8653-f10b2aca74f6', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:55.893494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:55.894213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:55.894830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:55.896679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:55.897821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:55.929270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:55.929806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:55.930323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:55.931040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:55.931506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:55.931933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:55.978207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Getting quotas for project deb919abeddc47a189d651c513d1e543. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:55.988910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Getting quotas for user 438ade508fb547f5aadac70380369f4a and project deb919abeddc47a189d651c513d1e543. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:56.023103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:56.026087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:56.126920 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8945dd1a-10bb-47e9-8b8a-3da95a187314 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994829 Sep 19 14:54:56.140903 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1636/3232] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:56.179650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:56.179809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:56.207449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:56.209295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:56.212790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:56.217989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:56.220605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:56.221061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.047386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:57.049368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:57.050065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:57.050667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:57.051293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:57.074035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:57.075361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:57.078459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.079382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:57.079867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:57.085138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.157547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Getting quotas for project 54c71a7d33bb47a2b56b1e33f9af910f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:57.172558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Getting quotas for user 25f8816ea2294e3e90b76601cc37a4ec and project 54c71a7d33bb47a2b56b1e33f9af910f. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:57.198836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:57.223073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f37a816-ce7c-49a2-88bc-ad9726e5b037 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 1.079895 Sep 19 14:54:57.225719 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1637/3233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:56 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:57.236403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-951637074", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "0c758e6a-cb03-449b-8653-f10b2aca74f6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:57.311690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] validate_networks() for [('0c758e6a-cb03-449b-8653-f10b2aca74f6', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:57.495033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:57.498683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='eaff442a-d330-4583-8be9-a8033fb5a3d2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='beaaff31-8817-45b3-bbcc-ec9d001ad5e4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da1778ae-4738-4f15-aa80-00866da72c1b',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:58.045344 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d3f2e989-8590-4c22-b312-8ef4ef719f6e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.418001 Sep 19 14:54:58.049339 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1597/3234] 10.222.0.81 () {62 vars in 1189 bytes} [Mon Sep 19 14:54:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 9423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 14:54:58.064473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f773fe0-9cff-4738-a0bf-f8290bd05ad8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:58.065039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9f773fe0-9cff-4738-a0bf-f8290bd05ad8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:58.213835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f773fe0-9cff-4738-a0bf-f8290bd05ad8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.234238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f773fe0-9cff-4738-a0bf-f8290bd05ad8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.238084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f773fe0-9cff-4738-a0bf-f8290bd05ad8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.239719 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f773fe0-9cff-4738-a0bf-f8290bd05ad8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1284 microversion: 2.32 time: 0.185172 Sep 19 14:54:58.240535 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1598/3235] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:58 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:58.261864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:58.263142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:58.284535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.285517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.286250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.287566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.289546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.294224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.327405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:58.327892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:58.328290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:58.328926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:58.329686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:58.345448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.346168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.346677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.347465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.349465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.350091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.377202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Getting quotas for project deb919abeddc47a189d651c513d1e543. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:58.386652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Getting quotas for user 438ade508fb547f5aadac70380369f4a and project deb919abeddc47a189d651c513d1e543. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:58.405419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:58.422972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:58.533183 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5dc65fa1-1fa0-4d41-8229-2848ba3e42b0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301663 Sep 19 14:54:58.533806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1638/3236] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:58.751270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.763589 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0c5384e-e177-4b6e-ae1a-e5d3eb260e05 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 0.507331 Sep 19 14:54:58.771038 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1599/3237] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:58 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:58.860435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1305287646", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "451", "networks": [{"uuid": "0c758e6a-cb03-449b-8653-f10b2aca74f6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:59.016528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] validate_networks() for [('0c758e6a-cb03-449b-8653-f10b2aca74f6', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:59.270408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2c849ed-4912-4c07-90c0-f6a485507bdd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:59.271990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2c849ed-4912-4c07-90c0-f6a485507bdd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:59.533120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2c849ed-4912-4c07-90c0-f6a485507bdd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.552051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2c849ed-4912-4c07-90c0-f6a485507bdd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.561535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2c849ed-4912-4c07-90c0-f6a485507bdd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.575482 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2c849ed-4912-4c07-90c0-f6a485507bdd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1284 microversion: 2.32 time: 0.309780 Sep 19 14:54:59.581177 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1600/3238] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:59 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:59.800380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:59.804557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:59.831437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:59.832033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:59.832490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:59.839478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:59.840144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:59.843125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.815484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:00.830425 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f1e23c3f-0438-4d64-904f-4bb51d8ec277 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 1.034720 Sep 19 14:55:00.832354 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1601/3239] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:59 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:00.841844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:00.855433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:00.860236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Searching by: {'deleted': False, 'project_id': '4baec5feb1414c92a0e8df948aede321'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:00.869479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.870251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.874082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.876352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.880721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.884282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.940797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:55:00.941265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:55:00.941753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:55:00.942197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:55:00.943870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:55:00.971860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.972357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.972794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.973646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.974615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.982128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:00.984832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.056119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Getting quotas for project deb919abeddc47a189d651c513d1e543. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:55:01.073715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Getting quotas for user 438ade508fb547f5aadac70380369f4a and project deb919abeddc47a189d651c513d1e543. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:55:01.078358 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d6f4f47-3fca-45d3-a89c-a5bdece8885f tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.241798 Sep 19 14:55:01.079001 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1602/3240] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:55:00 2022] GET /compute/v2.1/servers => generated 334 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:01.094595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:01.095873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:01.105677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.107258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.109017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:55:01.109298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.111048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.112128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.113835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.119911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:01.133485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:55:01.306153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-02814dcd-0a21-4cf9-9103-1cebda71075f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.449337 Sep 19 14:55:01.315325 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1639/3241] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:55:01.329707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.331196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:01.349532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.351026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.352262 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa353bce-6fcf-4595-b90d-c8f27cdbcfe2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1518 microversion: 2.32 time: 0.271917 Sep 19 14:55:01.352848 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1603/3242] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:01 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:01.358861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.360874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Searching by: {'deleted': False, 'project_id': '4baec5feb1414c92a0e8df948aede321'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:01.378011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b29da0fa-10d9-4856-91b8-f7a408b2526e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:01.378643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b29da0fa-10d9-4856-91b8-f7a408b2526e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:01.381072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.382057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.382788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.384878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.387188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.390359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.450196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:01.582731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.621053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.622899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b29da0fa-10d9-4856-91b8-f7a408b2526e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.627128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.629394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.630792 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b29da0fa-10d9-4856-91b8-f7a408b2526e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1221 microversion: 2.1 time: 0.276854 Sep 19 14:55:01.642524 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1604/3243] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:01 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:01.860240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:01.861513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:01.880029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.888251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.889006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.890796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.891740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.893753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.282378 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71a524d6-c53c-4b8b-bee7-798cf23afe67 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 1.960413 Sep 19 14:55:03.283610 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1640/3244] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:55:01 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:03.290244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:03.313150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:03.340865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.346168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.348605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.352832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.354845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.357106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.402359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.446173 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-493c8ee7-334f-46ac-8ef5-3f66232de9bb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 1.586419 Sep 19 14:55:03.458782 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1605/3245] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:01 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:03.458782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:03.458782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:03.477570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.487549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.491544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.493660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.497280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.497744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.612494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.634209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.655570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.657705 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7df55e97-d273-4da6-a09a-4d75cf756429 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1592 microversion: 2.32 time: 0.372875 Sep 19 14:55:03.659275 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1641/3246] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:03 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1592 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:03.665080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45aa7098-74ce-4f35-9c3e-93a504abaf47 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:03.678254 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45aa7098-74ce-4f35-9c3e-93a504abaf47 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017563 Sep 19 14:55:03.679716 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1642/3247] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 14:55:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:03.710602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.719382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb4c6f76-1115-4247-aa48-fcf0abe0fa27 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1273 microversion: 2.1 time: 0.270145 Sep 19 14:55:03.719910 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1606/3248] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:03 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:04.010627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:04.012275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:04.043694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.044574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.045240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.046192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.046912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.048079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.160378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:55:04.376287 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09b631c4-6d2c-4f5d-8a73-d1d0b040899a tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 204 len: 0 microversion: 2.1 time: 0.370131 Sep 19 14:55:04.380277 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1643/3249] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:55:04 2022] DELETE /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:55:04.391849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:04.392530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:04.423879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.428229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.432968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.434013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.437192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.437866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.479621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:04.480343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:04.496109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.496932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.497777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.498711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.499397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.500012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:06.300796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:06.328353 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2678bd7a-a2e3-4325-96f6-e34106fa98ff tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 1.851222 Sep 19 14:55:06.329324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1644/3250] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:04 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:06.347975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:06.350685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:06.370901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:06.373538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:06.374845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:06.377102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:06.379998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:06.382239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:06.467300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:06.481684 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1eb5020-e8e0-46e5-b3be-9f3b0dee9953 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1700 microversion: 2.1 time: 2.094347 Sep 19 14:55:06.484422 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1607/3251] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:04 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1700 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:06.511614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:06.512789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:06.537411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:06.541748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:06.543939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:06.544740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:06.545219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:06.549236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.011098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.012812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.027879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.030842 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a18b777d-ab5b-4aae-94ea-229dfd2f9e54 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1279 microversion: 2.1 time: 0.544691 Sep 19 14:55:07.031479 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1608/3252] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:06 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1279 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:07.033661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.038089 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3df6e34a-5d04-4124-8f91-17ed5bb8c479 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1592 microversion: 2.32 time: 0.707559 Sep 19 14:55:07.042873 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1645/3253] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:06 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1592 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:07.354203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:07.354771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:07.365031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.365544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.365996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.366722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.367247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.367682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.513823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:07.514708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:07.529446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.531303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.532700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.538381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.539016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.539531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:08.060200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:08.075429 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dff10438-dded-4286-836b-ba67584a7467 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 0.725404 Sep 19 14:55:08.084650 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1609/3254] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:07 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:08.101158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:08.101715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:08.139830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:08.140436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:08.140910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:08.141799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:08.142341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:08.153910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:09.008610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.024611 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa61b35e-458a-464f-ac48-8aa3643569dd tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1700 microversion: 2.1 time: 1.516153 Sep 19 14:55:09.026448 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1646/3255] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:07 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1700 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:09.047422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:09.056860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:09.084028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:09.085670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:09.086355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:09.087165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:09.087640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:09.100521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:09.402793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.421576 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2405931-bd9b-4866-a3df-39ccb6382484 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1279 microversion: 2.1 time: 1.335400 Sep 19 14:55:09.423394 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1610/3256] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:08 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1279 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:09.454641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:09.456439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:09.478987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:09.479809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:09.481200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:09.482548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:09.487291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:09.488145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:09.821125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.867260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.874188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.879034 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-503dba63-554b-422f-a632-cb8f6f7ced81 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1659 microversion: 2.32 time: 0.849401 Sep 19 14:55:09.880841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1647/3257] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:09 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1659 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:10.049920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:10.051459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:10.065067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:10.065866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:10.066701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:10.068361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:10.069136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:10.069757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:10.477380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:10.487477 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0fa068ca-2a7c-4c33-9c45-be581f663a39 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1633 microversion: 2.1 time: 0.441390 Sep 19 14:55:10.493843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1648/3258] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:10 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1633 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:10.500128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:10.513388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:10.521450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:10.523208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:10.533191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:10.534711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:10.535776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:10.536504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:10.918028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:11.136549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:11.166074 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00050b88-6807-4e85-9013-16f2c4a0ae8e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1279 microversion: 2.1 time: 0.667494 Sep 19 14:55:11.169217 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1649/3259] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:10 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1279 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:11.195754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:11.200419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:11.221858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.222772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.229440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:11.230692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.231526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.232012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.232655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.247964 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fda61c79-0042-4c90-a4ab-51a4d3a64aa1 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 1.808392 Sep 19 14:55:11.250627 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1611/3260] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:09 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:11.270434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-786fefa2-0019-4b74-b5c1-17af9b3428f2 req-30dc3915-838d-4d04-bdb7-e58b59a310de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c383f3-68ef-407c-b7fa-a0173b3e2c59", "tag": "a5be1a8f-1b29-467d-829f-1dd8c9721137"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:11.330053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:11.341605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-786fefa2-0019-4b74-b5c1-17af9b3428f2 req-30dc3915-838d-4d04-bdb7-e58b59a310de service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.342543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-786fefa2-0019-4b74-b5c1-17af9b3428f2 req-30dc3915-838d-4d04-bdb7-e58b59a310de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.343303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-786fefa2-0019-4b74-b5c1-17af9b3428f2 req-30dc3915-838d-4d04-bdb7-e58b59a310de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.386399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-786fefa2-0019-4b74-b5c1-17af9b3428f2 req-30dc3915-838d-4d04-bdb7-e58b59a310de service nova] Creating event network-changed:a5be1a8f-1b29-467d-829f-1dd8c9721137 for instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 on n-h2-858384-1 Sep 19 14:55:11.400337 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-786fefa2-0019-4b74-b5c1-17af9b3428f2 req-30dc3915-838d-4d04-bdb7-e58b59a310de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145411 Sep 19 14:55:11.405997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:11.412944 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1612/3261] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:11.431728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-97f7946e-7b88-4fed-b019-877d378dc738 req-54884351-c686-4308-8284-4ec964ecac25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eaef1d0-edbb-4ded-9e94-0610bb4f2b67", "tag": "95e3787f-59aa-49f8-86c6-a3816d8489d9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:11.462502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-97f7946e-7b88-4fed-b019-877d378dc738 req-54884351-c686-4308-8284-4ec964ecac25 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.463909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-97f7946e-7b88-4fed-b019-877d378dc738 req-54884351-c686-4308-8284-4ec964ecac25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.464762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-97f7946e-7b88-4fed-b019-877d378dc738 req-54884351-c686-4308-8284-4ec964ecac25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.506822 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-97f7946e-7b88-4fed-b019-877d378dc738 req-54884351-c686-4308-8284-4ec964ecac25 service nova] Creating event network-changed:95e3787f-59aa-49f8-86c6-a3816d8489d9 for instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 on n-h2-858384-1 Sep 19 14:55:11.513299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-97f7946e-7b88-4fed-b019-877d378dc738 req-54884351-c686-4308-8284-4ec964ecac25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097902 Sep 19 14:55:11.514339 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1613/3262] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:11.529093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:11.529952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:11.543542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.544331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.545504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.547682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.549263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.550533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.566308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=20 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:11.646041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:12.151477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9c22a17bb146dba6b7a2ad603e33dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baec5feb1414c92a0e8df948aede321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:12.170713 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74feeef9-e011-46fb-bab1-c4fc3bc04720 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 200 len: 1633 microversion: 2.1 time: 0.651217 Sep 19 14:55:12.172051 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1614/3263] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:11 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 1633 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:12.198660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:12.199583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:12.212170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:12.214349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:12.216567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:12.219307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:12.222215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:12.222918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:12.367528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:12.393989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:12.401080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:12.404084 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11590d3d-a5fa-4f34-97ee-b04f704846fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1659 microversion: 2.32 time: 1.231106 Sep 19 14:55:12.419620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1650/3264] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:11 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1659 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:12.433625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:12.469958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:12.490348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:12.491692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:12.492396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:12.493658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:12.507344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:12.508329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:12.558359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:13.811091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:13.847998 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-15346b7d-7459-43cb-a54e-41156c4f0534 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1321 microversion: 2.1 time: 1.646803 Sep 19 14:55:13.850918 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1615/3265] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:12 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1321 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:13.871750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:13.875763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] [instance: c4170395-1448-4d17-bc72-be396e6a7eda] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:13.900007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:13.912308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:13.913080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:13.914098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:13.914820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:13.923430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:13.954667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] HTTP exception thrown: Instance c4170395-1448-4d17-bc72-be396e6a7eda could not be found. Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Request method failure captured: Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda HTTP/1.1 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJ6YaGgDb7oWSW-PNq-yuuki6HzX9jvBZRsFPPSPyzMtZq6krIlByjdM18uTRlEfeKvJh6G2ZuwSQa9wwZJ9gy5CHzW3jb2JBroDxuQ6SyMHBe4m7QWWowmhll-461barRZ5ZL5QIyZ1uNDtReIfJ-xpJ38ssHnf7j9Hu9lKJlTbEg Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 4baec5feb1414c92a0e8df948aede321 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-240500865 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4baec5feb1414c92a0e8df948aede321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4baec5feb1414c92a0e8df948aede321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4baec5feb1414c92a0e8df948aede321"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4baec5feb1414c92a0e8df948aede321"}]}] Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-240500865 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 4baec5feb1414c92a0e8df948aede321 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-240500865 Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-240500865-project Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6d9c22a17bb146dba6b7a2ad603e33dc Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-240500865-project Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c4170395-1448-4d17-bc72-be396e6a7eda could not be found. Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c4170395-1448-4d17-bc72-be396e6a7eda'} Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4170395-1448-4d17-bc72-be396e6a7eda could not be found. Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4170395-1448-4d17-bc72-be396e6a7eda could not be found. Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:55:13.959155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:55:13.964200 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:55:13.964200 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:55:13.964200 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:55:13.964200 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:55:13.964200 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4170395-1448-4d17-bc72-be396e6a7eda could not be found. Sep 19 14:55:13.964200 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:55:13.968389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Returning 404 to user: Instance c4170395-1448-4d17-bc72-be396e6a7eda could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:55:13.969500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03f1d7d6-40c0-45b4-9ad7-a9a8e0d0ba56 tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda" status: 404 len: 111 microversion: 2.1 time: 0.116794 Sep 19 14:55:13.974628 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1616/3266] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:13 2022] GET /compute/v2.1/servers/c4170395-1448-4d17-bc72-be396e6a7eda => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:55:13.984611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:13.989868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:14.008449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:14.009245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:14.011503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:14.014212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:14.016237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:14.019523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:14.780587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:14.796509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1cc98983-0873-4fd6-94d2-1b4c1ca7623b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 2.373030 Sep 19 14:55:14.799411 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1651/3267] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:12 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:14.812011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-44a47033-26eb-4db5-b2b0-4c489eada5a5 req-c833052e-f84a-4e6e-b0e0-167e4c8178a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4170395-1448-4d17-bc72-be396e6a7eda", "name": "network-vif-deleted", "tag": "95fca5f2-2d87-44f4-81b6-b34bb5828558"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:14.842128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-44a47033-26eb-4db5-b2b0-4c489eada5a5 req-c833052e-f84a-4e6e-b0e0-167e4c8178a0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:14.843968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-44a47033-26eb-4db5-b2b0-4c489eada5a5 req-c833052e-f84a-4e6e-b0e0-167e4c8178a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:14.844432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-44a47033-26eb-4db5-b2b0-4c489eada5a5 req-c833052e-f84a-4e6e-b0e0-167e4c8178a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:14.883817 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-44a47033-26eb-4db5-b2b0-4c489eada5a5 req-c833052e-f84a-4e6e-b0e0-167e4c8178a0 service nova] Creating event network-vif-deleted:95fca5f2-2d87-44f4-81b6-b34bb5828558 for instance c4170395-1448-4d17-bc72-be396e6a7eda on n-h1-858384-1 Sep 19 14:55:14.893349 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-44a47033-26eb-4db5-b2b0-4c489eada5a5 req-c833052e-f84a-4e6e-b0e0-167e4c8178a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090387 Sep 19 14:55:14.897933 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1652/3268] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:14.899733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:14.915805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4bb72efa-9f57-4250-8756-ac343265a66d tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] Calling method '.version_select at 0x7fde299ca310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:14.919372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:14.925631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:14.935488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-241fc1b5-7264-4af4-a7dc-dad32c22c215 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1705 microversion: 2.32 time: 0.956366 Sep 19 14:55:14.940425 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1617/3269] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:13 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1705 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:14.960744 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4bb72efa-9f57-4250-8756-ac343265a66d tempest-ServersTestJSON-240500865 tempest-ServersTestJSON-240500865-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059275378" status: 202 len: 0 microversion: 2.1 time: 0.060854 Sep 19 14:55:14.961701 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1653/3270] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 14:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059275378 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:55:14.964297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:14.968856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:15.007809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:15.011491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:15.012173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:15.013391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:15.014085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:15.014683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:15.824002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:15.825634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:15.839670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:15.840574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:15.841364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:15.842854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:15.844050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:15.844856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:16.581961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:16.595924 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3b043ae9-0eeb-4815-9f1e-19fce7797d9b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1321 microversion: 2.1 time: 1.654006 Sep 19 14:55:16.596524 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1618/3271] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:14 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1321 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:16.616729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:16.620130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:16.643837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:16.644386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:16.647114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:16.650734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:16.651742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:16.652097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:16.652565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:16.661180 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-93fc4318-ea24-45c5-954d-33d21549299d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1507 microversion: 2.1 time: 0.842623 Sep 19 14:55:16.669210 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1654/3272] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:15 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:16.959804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8df33a36-8bc8-4b47-90c2-c417791ca8f0 req-325f371b-408e-4327-9f06-ce468497de20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d256ad-2b6c-41cd-9a3c-573b0430445d", "tag": "eeca97aa-3153-4585-9454-3963ab89353f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:17.005543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8df33a36-8bc8-4b47-90c2-c417791ca8f0 req-325f371b-408e-4327-9f06-ce468497de20 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:17.006382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8df33a36-8bc8-4b47-90c2-c417791ca8f0 req-325f371b-408e-4327-9f06-ce468497de20 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:17.009062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8df33a36-8bc8-4b47-90c2-c417791ca8f0 req-325f371b-408e-4327-9f06-ce468497de20 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:17.044300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8df33a36-8bc8-4b47-90c2-c417791ca8f0 req-325f371b-408e-4327-9f06-ce468497de20 service nova] Creating event network-changed:eeca97aa-3153-4585-9454-3963ab89353f for instance e0d256ad-2b6c-41cd-9a3c-573b0430445d on n-h1-858384-1 Sep 19 14:55:17.062990 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8df33a36-8bc8-4b47-90c2-c417791ca8f0 req-325f371b-408e-4327-9f06-ce468497de20 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105318 Sep 19 14:55:17.068321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1655/3273] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:55:17.588631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:17.589855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:17.608022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:17.608544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:17.608995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:17.619792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:17.620678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:17.621346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:17.965843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:17.983811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:17.991323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:17.998364 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cefa2300-f9e4-41bd-8a31-778104e20a67 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1705 microversion: 2.32 time: 1.395118 Sep 19 14:55:18.002482 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1619/3274] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:16 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1705 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:18.019041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:18.021599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:18.042550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.043525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.046617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.049904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.050845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.052205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.507493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:18.520845 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5aeabb70-22d3-4dc8-bb97-e2437f666bae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.935813 Sep 19 14:55:18.522558 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1656/3275] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:17 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:18.534465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:18.535189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:18.553089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:18.555413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.555970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.566129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.567761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.568272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.568703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:19.302459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:19.325231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c824b4c-5892-415e-a388-6e31526f6da1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1321 microversion: 2.1 time: 1.320975 Sep 19 14:55:19.339015 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1620/3276] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:18 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1321 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:19.345298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:19.353079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:19.381587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:19.382465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:19.383233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:19.385292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:19.387736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:19.391195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:20.682912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:20.694240 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89ea41fd-67f8-4792-8770-97b743cf80ac tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1528 microversion: 2.1 time: 2.170582 Sep 19 14:55:20.701478 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1657/3277] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:18 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1528 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:20.721397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:20.722600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:20.737042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:20.739734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:20.744845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:20.747099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:20.751444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:20.752263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:21.798023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.802245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.822339 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c444bc5-eb26-48a7-bfa0-0390ae480e11 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 2.481169 Sep 19 14:55:21.822974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1621/3278] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:19 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:21.827664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.836491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:21.838575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.843497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dfdebb91-a78d-4a4f-859b-72017f52c9e2 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1751 microversion: 2.32 time: 1.139141 Sep 19 14:55:21.846570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:21.847119 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1658/3279] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:20 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1751 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:21.868075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:21.870958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:21.876063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:21.881665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:21.884554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:21.886100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:21.886507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:21.886904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:21.894491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:21.895368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:21.895870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:21.896629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:21.897093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:21.897617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:23.119717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:23.130216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4cd287e-d54f-4cb9-9145-4c9dd36d28e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 1.280324 Sep 19 14:55:23.136389 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1659/3280] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:21 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:23.167764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:23.175013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:23.230625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:23.245791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:23.250277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:23.256186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:23.260927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:23.271726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:23.317591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:23.324346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:23.326627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d4a4ba8-74de-4088-bf7d-0d40d9f275bd tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1321 microversion: 2.1 time: 1.494581 Sep 19 14:55:23.342632 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1622/3281] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:21 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1321 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:23.342632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:23.342632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:23.387023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:23.387672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:23.388131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:23.388889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:23.389357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:23.389794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:25.691070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:25.723811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-087e85ee-ca29-4021-aa35-d47ecf634b2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 2.560032 Sep 19 14:55:25.732927 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1660/3282] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:23 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:25.752087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-421a48af-27a1-479b-b6af-368275f36cf3 req-8123a700-300b-4718-8723-f613dd1990eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c383f3-68ef-407c-b7fa-a0173b3e2c59", "name": "network-vif-plugged", "status": "completed", "tag": "a5be1a8f-1b29-467d-829f-1dd8c9721137"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:25.778790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-421a48af-27a1-479b-b6af-368275f36cf3 req-8123a700-300b-4718-8723-f613dd1990eb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:25.781044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-421a48af-27a1-479b-b6af-368275f36cf3 req-8123a700-300b-4718-8723-f613dd1990eb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:25.781977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-421a48af-27a1-479b-b6af-368275f36cf3 req-8123a700-300b-4718-8723-f613dd1990eb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:25.812963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-421a48af-27a1-479b-b6af-368275f36cf3 req-8123a700-300b-4718-8723-f613dd1990eb service nova] Creating event network-vif-plugged:a5be1a8f-1b29-467d-829f-1dd8c9721137 for instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 on n-h2-858384-1 Sep 19 14:55:25.827772 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-421a48af-27a1-479b-b6af-368275f36cf3 req-8123a700-300b-4718-8723-f613dd1990eb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090185 Sep 19 14:55:25.829380 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1661/3283] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:25.843941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:25.846174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:25.865434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:25.866795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:25.869753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:25.872732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:25.874599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:25.875297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:26.596441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:26.637461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:26.640609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:26.650370 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-479f62ba-1380-4677-81a5-3cafe022825a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1797 microversion: 2.32 time: 3.316936 Sep 19 14:55:26.681793 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1623/3284] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:23 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1797 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:26.708218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:26.711099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:26.745466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:26.746818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:26.747460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:26.748376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:26.749018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:26.749646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:28.339201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:28.377798 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eced2153-bd3a-4f56-bf1f-f912a34dc6a4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 2.545539 Sep 19 14:55:28.381139 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1662/3285] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:25 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:28.399959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1283534878"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:28.405723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:28.431529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:28.432332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:28.433073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:28.434481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:28.434983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:28.438929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:28.651069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:28.667557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c57b2d10-0cd4-4315-9f40-5ab998a0b433 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1321 microversion: 2.1 time: 1.981583 Sep 19 14:55:28.686351 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1624/3286] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:26 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1321 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:28.703935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:28.705860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:28.725012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:28.727833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:28.729518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:28.732348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:28.733728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:28.735285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:28.999414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cbf1c43e-a757-4be4-9b32-c077b2b97e70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.595312 Sep 19 14:55:29.014042 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1663/3287] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:55:28 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 19 14:55:29.052965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d256ad-2b6c-41cd-9a3c-573b0430445d", "name": "network-vif-plugged", "status": "completed", "tag": "eeca97aa-3153-4585-9454-3963ab89353f"}, {"server_uuid": "2eaef1d0-edbb-4ded-9e94-0610bb4f2b67", "name": "network-vif-plugged", "status": "completed", "tag": "95e3787f-59aa-49f8-86c6-a3816d8489d9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:29.122222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:29.123093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:29.124511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:29.185841 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] Creating event network-vif-plugged:eeca97aa-3153-4585-9454-3963ab89353f for instance e0d256ad-2b6c-41cd-9a3c-573b0430445d on n-h1-858384-1 Sep 19 14:55:29.187991 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] Creating event network-vif-plugged:95e3787f-59aa-49f8-86c6-a3816d8489d9 for instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 on n-h2-858384-1 Sep 19 14:55:29.243645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-faf13268-2ab0-4e04-8ae6-31ac032da2ec req-33303860-569e-40b9-a504-508653e86c58 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.220470 Sep 19 14:55:29.247855 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1664/3288] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:29.411688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:29.413446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:29.450017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:29.451297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:29.451959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:29.452907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:29.458058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:29.459121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:30.105721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:30.119214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:30.120683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:30.127962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-003fdd0d-1182-4650-b93e-a45e57fc696a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1797 microversion: 2.32 time: 1.440287 Sep 19 14:55:30.144868 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1625/3289] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:28 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1797 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:30.159628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:30.160862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:30.169359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:30.170280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:30.171163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:30.172334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:30.173031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:30.173722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:31.514982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:31.525033 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f61b4d4f-68c1-408e-a7c2-594ae277f428 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1321 microversion: 2.1 time: 1.378630 Sep 19 14:55:31.530927 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1626/3290] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:30 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1321 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:31.536450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:31.537233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:31.557602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:31.568627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:31.569252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:31.570025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:31.574184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:31.575004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:33.071407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:33.103457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-92851435-05b7-4084-84bd-3437d8131c7d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 3.698191 Sep 19 14:55:33.104069 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1665/3291] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:29 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 3701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:33.143667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0ab1419e-41fb-43dd-ac93-cd66a49811f2 req-9361267c-d58c-4e0a-9464-ac0415f04c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9199a1b4-97bd-4382-8c8a-c06f417d4233", "name": "network-vif-plugged", "status": "completed", "tag": "4118ea11-115a-41d1-9211-3709b41cd6ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:33.248662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ab1419e-41fb-43dd-ac93-cd66a49811f2 req-9361267c-d58c-4e0a-9464-ac0415f04c48 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:33.250363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ab1419e-41fb-43dd-ac93-cd66a49811f2 req-9361267c-d58c-4e0a-9464-ac0415f04c48 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:33.258208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ab1419e-41fb-43dd-ac93-cd66a49811f2 req-9361267c-d58c-4e0a-9464-ac0415f04c48 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:33.320130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0ab1419e-41fb-43dd-ac93-cd66a49811f2 req-9361267c-d58c-4e0a-9464-ac0415f04c48 service nova] Creating event network-vif-plugged:4118ea11-115a-41d1-9211-3709b41cd6ed for instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 on n-h2-858384-1 Sep 19 14:55:33.337010 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0ab1419e-41fb-43dd-ac93-cd66a49811f2 req-9361267c-d58c-4e0a-9464-ac0415f04c48 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226211 Sep 19 14:55:33.340562 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1666/3292] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:33.381017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:33.381925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:33.442927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:33.443349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:33.454846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:33.455810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:33.464535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:33.465117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:33.707587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:33.732108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:33.751410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:33.758907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2782e9b3-e2d7-42e3-8f99-56017ae8700d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1797 microversion: 2.32 time: 2.225909 Sep 19 14:55:33.762192 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1627/3293] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:31 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1797 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:34.134853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:34.135793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:34.157589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:34.158376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:34.159622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:34.163415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:34.164186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:34.166423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.376766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:37.395269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87223d23-b16a-4cdd-80d7-487787ad3cff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1513 microversion: 2.1 time: 4.042283 Sep 19 14:55:37.396444 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1667/3294] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:33 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1513 bytes in 4055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:37.420148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:37.421553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:37.437216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.438053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.438739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.439754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.443033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.443733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.926307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:37.938176 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-432b2d90-da3e-4e35-9d87-acc4a7c57028 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 3.809597 Sep 19 14:55:37.959083 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1628/3295] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:34 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 3835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:37.966810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:37.967808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:37.977634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.978452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.979537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.980765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.981459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.982114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:39.342013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.370274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.372319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.376989 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-43c74813-94c0-4d73-b6bd-e230abe6d5a5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1843 microversion: 2.32 time: 1.963229 Sep 19 14:55:39.379573 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1668/3296] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:37 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1843 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:39.386973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-434d8499-dd54-47df-9234-84d8fcc583ee req-6219f31f-5f0b-4d64-bd37-d962e96ff812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-plugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:39.430214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-434d8499-dd54-47df-9234-84d8fcc583ee req-6219f31f-5f0b-4d64-bd37-d962e96ff812 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:39.444158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-434d8499-dd54-47df-9234-84d8fcc583ee req-6219f31f-5f0b-4d64-bd37-d962e96ff812 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:39.444839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-434d8499-dd54-47df-9234-84d8fcc583ee req-6219f31f-5f0b-4d64-bd37-d962e96ff812 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:39.467889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-434d8499-dd54-47df-9234-84d8fcc583ee req-6219f31f-5f0b-4d64-bd37-d962e96ff812 service nova] Creating event network-vif-plugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:55:39.504084 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-434d8499-dd54-47df-9234-84d8fcc583ee req-6219f31f-5f0b-4d64-bd37-d962e96ff812 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115657 Sep 19 14:55:39.506704 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1669/3297] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:39.531389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:39.534642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:39.572880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:39.575753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:39.579343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:39.580670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:39.582812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:39.584032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.665460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:40.682351 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a97778f9-fe16-47d0-8fcf-173aea3f8036 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1512 microversion: 2.1 time: 2.719041 Sep 19 14:55:40.698795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1629/3298] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:37 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1512 bytes in 2725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:40.698795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:40.700048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:40.723995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:40.728441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.728985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.729441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.732188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.735673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.736985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.739043 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57605cb1-f8cd-4700-8dd4-d84b4a184279 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 1.223537 Sep 19 14:55:40.741893 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1670/3299] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:39 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:40.756696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:40.759792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:40.776335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.776852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.777299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.778030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.778494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.778970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.047725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.064793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.085452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.086865 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1831 microversion: 2.32 time: 2.399493 Sep 19 14:55:43.129854 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1630/3300] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:40 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1831 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:43.131120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:43.132142 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4f39c55-43bc-4b41-b2a4-8972d0cc438d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001364 Sep 19 14:55:43.141743 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1631/3301] 10.222.0.81 () {56 vars in 886 bytes} [Mon Sep 19 14:55:43 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 19 14:55:43.161314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:43.169801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:43.188454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.202111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:43.208349 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e14b6a86-8fd3-4e7c-bcf6-f19296216ee1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 200 len: 1511 microversion: 2.1 time: 2.465059 Sep 19 14:55:43.219111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=38 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:43.221208 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1671/3302] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:40 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 1511 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:43.224079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.225176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.225432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.226311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.229315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.231266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.254811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:43.260691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.268693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:43.305109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.307686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.317621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.318998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.319715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.323482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.686551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:43.940850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.967271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.980009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.983090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:44.938517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:44.994213 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-212e78c8-a014-4811-b352-5f805fc28698 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 1.840976 Sep 19 14:55:44.997901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1632/3303] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:43 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:45.053925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:45.055623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:45.080322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d81dd767-d6dc-4eed-a109-f92042e9072e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 1.830068 Sep 19 14:55:45.082540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1672/3304] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 14:55:43 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:45.089414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.090942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.095607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.097879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.101557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.103669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.128941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:45.154708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:45.179694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1649205955', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:45.216892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.231746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.232790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.234475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.235556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.239239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.802588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:46.121013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:46.140094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.144972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.146827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.465735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:46.482881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:46.484763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:46.490780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-408f0969-72d9-4f71-98d2-b08dbc32e50c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1831 microversion: 2.32 time: 1.475967 Sep 19 14:55:46.492309 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1633/3305] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:45 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1831 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:46.501934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b97f382b-5a82-4873-b9ba-6650a899c457 req-f883d463-23ef-4aee-b66a-81122d0a0c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "95a73885-50f4-4435-8dc5-1e8e276383da"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:46.541506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b97f382b-5a82-4873-b9ba-6650a899c457 req-f883d463-23ef-4aee-b66a-81122d0a0c8b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.546999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b97f382b-5a82-4873-b9ba-6650a899c457 req-f883d463-23ef-4aee-b66a-81122d0a0c8b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.547854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b97f382b-5a82-4873-b9ba-6650a899c457 req-f883d463-23ef-4aee-b66a-81122d0a0c8b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.572197 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b97f382b-5a82-4873-b9ba-6650a899c457 req-f883d463-23ef-4aee-b66a-81122d0a0c8b service nova] Creating event network-changed:95a73885-50f4-4435-8dc5-1e8e276383da for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:55:46.583873 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b97f382b-5a82-4873-b9ba-6650a899c457 req-f883d463-23ef-4aee-b66a-81122d0a0c8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087727 Sep 19 14:55:46.586177 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1634/3306] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:46.600413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:46.601752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:46.616573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.620615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.621883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.624537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.626271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.627681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.935044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9b34206a-eb08-4137-91c1-f349e9d65eb0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1649205955" status: 200 len: 1515 microversion: 2.1 time: 2.815264 Sep 19 14:55:47.935656 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1673/3307] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 14:55:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1649205955 => generated 1515 bytes in 2818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:47.941411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:47.942556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:47.969699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.971195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.974080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.981464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.981982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.991291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:48.473890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:48.482543 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f06f421c-5676-4171-8033-a7e1e8ebcc93 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 1.894759 Sep 19 14:55:48.489406 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1635/3308] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:46 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:48.512994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:48.518205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:48.551653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:48.582210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:48.590933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:48.591565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:48.592505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:48.593093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:48.593734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:48.977691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:49.178813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:49.201452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:49.202231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:49.202975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:49.473426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:49.499700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:49.505834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:49.526427 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de46606a-e5bd-41ac-ad9d-9bee8268ea75 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1852 microversion: 2.32 time: 1.589417 Sep 19 14:55:49.532513 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1674/3309] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:47 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1852 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:49.544905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:49.557116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:49.575015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=42 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:49.588466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:49.588763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:49.589166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:49.589900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:49.590372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:49.619852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.337086 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f494b7a6-ab08-4ee0-a152-7af9057502b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.841057 Sep 19 14:55:50.351355 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1636/3310] 10.222.0.81 () {58 vars in 1173 bytes} [Mon Sep 19 14:55:48 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:50.370289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:50.395117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:50.398574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.servers [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Removing options 'limit' from query {{(pid=128730) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 19 14:55:50.399442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:50.449575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.453370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.454241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.460777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.461822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.462561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.591329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:50.613052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.617905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.618849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.664315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:50.675452 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8158ff8-6f94-453e-b294-0e57304c1f0a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 1.141527 Sep 19 14:55:50.676263 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1675/3311] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:49 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:50.694029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:50.697925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:50.724726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.736805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.738240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.741931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.742792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.743478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:51.617672 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc2ce4da-5ce7-4aae-843e-bab407ccbce1 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 1.251475 Sep 19 14:55:51.631363 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1637/3312] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 14:55:50 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:51.650140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-515008bf-f66b-402c-8f23-e5c87c7addee req-d4cea889-cc58-47ee-8986-644022b3adf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "914dde40-c1af-492e-9957-c5c125c07414"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:51.683883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-515008bf-f66b-402c-8f23-e5c87c7addee req-d4cea889-cc58-47ee-8986-644022b3adf1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:51.707740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-515008bf-f66b-402c-8f23-e5c87c7addee req-d4cea889-cc58-47ee-8986-644022b3adf1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:51.707740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-515008bf-f66b-402c-8f23-e5c87c7addee req-d4cea889-cc58-47ee-8986-644022b3adf1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:51.737015 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-515008bf-f66b-402c-8f23-e5c87c7addee req-d4cea889-cc58-47ee-8986-644022b3adf1 service nova] Creating event network-changed:914dde40-c1af-492e-9957-c5c125c07414 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:55:51.746460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-515008bf-f66b-402c-8f23-e5c87c7addee req-d4cea889-cc58-47ee-8986-644022b3adf1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113674 Sep 19 14:55:51.753573 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1638/3313] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:51.784089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:51.814788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:51.817027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:51.837889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:51.839274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:51.841140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:51.845201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:51.847864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:51.848513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:51.911155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:51.933433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:51.934971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:51.956984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a2592e5-041b-4f1c-9e20-07a7574360a4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1852 microversion: 2.32 time: 1.276438 Sep 19 14:55:51.957636 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1676/3314] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:50 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1852 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:51.983771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:51.985037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:52.005496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.006808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.008204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.016002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.016905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.022711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.217183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:52.434741 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23a08dff-058b-404c-b2c5-4184c2e8abca tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.668553 Sep 19 14:55:52.449667 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1639/3315] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 14:55:51 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:52.461115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:52.473423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:52.479036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.servers [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Removing options 'limit' from query {{(pid=128730) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 19 14:55:52.480658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:52.492015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.494608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.495279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.496231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.499688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.500531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.584673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:52.682049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:52.761609 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a244734-696b-47b0-91e9-de2b908457c9 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.302253 Sep 19 14:55:52.769712 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1640/3316] 10.222.0.81 () {58 vars in 1150 bytes} [Mon Sep 19 14:55:52 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:52.783815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:52.809660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:52.810369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:52.829108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.829598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.833685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.834338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.834826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.838077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.920518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:52.969291 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6ddbdd2e-4fb5-4f24-85ed-73e83fa8396e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.197477 Sep 19 14:55:52.980821 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1641/3317] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:55:52 2022] GET /compute/v2.1/servers => generated 1011 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:52.986663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:52.988178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:52.997370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.998557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.999358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:53.000467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:53.001427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:53.002076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:53.733921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:53.743385 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e4ae89e-97e8-41c2-8fa7-7afe49c3d7bc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1523 microversion: 2.1 time: 1.782006 Sep 19 14:55:53.744875 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1677/3318] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:51 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1523 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:53.751640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:53.764304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:53.765481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:53.786656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:53.809914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:53.812121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:53.813774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:53.814336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:53.816098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:53.817549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:53.818320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:53.818810 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94572215-18d8-4af9-ac2a-acdb7080ce7b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1852 microversion: 2.32 time: 0.835467 Sep 19 14:55:53.819885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:53.831503 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1642/3319] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:52 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1852 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:53.965546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:54.131008 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5f7c425-bdf3-4bff-a7b7-67592aea0c8c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.382963 Sep 19 14:55:54.147067 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1678/3320] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:55:53 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:54.149359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:54.154440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:54.166550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.servers [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Removing options 'limit' from query {{(pid=128730) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 19 14:55:54.168018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:54.183629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.188958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.189713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.193381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.194710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.195350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.270688 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b5845a26-00cf-4939-8593-0d3ae4635a10 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.126914 Sep 19 14:55:54.282094 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1643/3321] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 14:55:54 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:54.286470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:54.294951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:54.297137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1649205955', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:55:54.311904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.313258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.315343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.317784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.319493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.320121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.527461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:55:54.679763 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f52d23c-545d-4899-80a2-19fc31adfae2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1649205955" status: 200 len: 346 microversion: 2.1 time: 0.397709 Sep 19 14:55:54.690888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1679/3322] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 14:55:54 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1649205955 => generated 346 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:54.695251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca73adcd-c34c-42fd-9538-ce3fdcd734f2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:54.709403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca73adcd-c34c-42fd-9538-ce3fdcd734f2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.710516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca73adcd-c34c-42fd-9538-ce3fdcd734f2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.712045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca73adcd-c34c-42fd-9538-ce3fdcd734f2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.772270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:54.772903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:54.779662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.780169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.782184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.783829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.786896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.787360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.938509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca73adcd-c34c-42fd-9538-ce3fdcd734f2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Going to try to stop instance {{(pid=128730) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:55:55.024677 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca73adcd-c34c-42fd-9538-ce3fdcd734f2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "POST /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67/action" status: 202 len: 0 microversion: 2.1 time: 0.333388 Sep 19 14:55:55.029244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1644/3323] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:55:54 2022] POST /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:55:55.039609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:55.040943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:55.050004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.050820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.051483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:55.053335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.054041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.054649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:55.509498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:55.520654 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5c32662-110c-458b-a9f6-12e566d54841 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1505 microversion: 2.1 time: 0.752974 Sep 19 14:55:55.537239 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1680/3324] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:54 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1505 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:55.549155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:55.551076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:55.560742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.561605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.562273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:55.563205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.563899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.564546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:55.611261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:55.623365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:55.625272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:55.626678 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-041cebf5-7045-4802-93c7-3aa929b04b10 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.594927 Sep 19 14:55:55.627454 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1645/3325] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:55 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:55.831458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4e230383-3c1c-403d-a5df-546a512d552c req-5aef5228-8598-435c-914d-bc76074d3e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "a77e244a-300f-4a14-bf87-f3c421b61828"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:55.849800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4e230383-3c1c-403d-a5df-546a512d552c req-5aef5228-8598-435c-914d-bc76074d3e29 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.850289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4e230383-3c1c-403d-a5df-546a512d552c req-5aef5228-8598-435c-914d-bc76074d3e29 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.850715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4e230383-3c1c-403d-a5df-546a512d552c req-5aef5228-8598-435c-914d-bc76074d3e29 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:55.870639 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4e230383-3c1c-403d-a5df-546a512d552c req-5aef5228-8598-435c-914d-bc76074d3e29 service nova] Creating event network-changed:a77e244a-300f-4a14-bf87-f3c421b61828 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:55:55.880386 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4e230383-3c1c-403d-a5df-546a512d552c req-5aef5228-8598-435c-914d-bc76074d3e29 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053796 Sep 19 14:55:55.881406 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1646/3326] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:56.106403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:56.262684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:56.271963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca60fbb7-14b4-48ff-8676-5930040e184d tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1522 microversion: 2.1 time: 0.733274 Sep 19 14:55:56.289461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1681/3327] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:55 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1522 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:56.550132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:56.551515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:56.566009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:56.569668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:56.570317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:56.571260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:56.572891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:56.574569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:56.657058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:56.657809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:56.676685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:56.677212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:56.677681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:56.678482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:56.678837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:56.679270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:57.136359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:57.147986 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b35361b-94b8-4065-8a5f-1d0b164f0cf7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1505 microversion: 2.1 time: 0.602717 Sep 19 14:55:57.148885 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1647/3328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:56 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:57.302493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:57.303443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:57.319486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:57.320230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:57.320873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:57.321957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:57.322578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:57.323198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:57.400395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:57.419031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:57.420898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:57.422303 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a185b7fa-1d31-4f07-b1c5-b42c045ed96e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.770708 Sep 19 14:55:57.443774 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1682/3329] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:56 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:57.600422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e78b3dc2-3baf-4d11-84ad-bef0295386da req-7df4c4d4-5472-4610-a79d-6699e9527a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9199a1b4-97bd-4382-8c8a-c06f417d4233", "name": "network-vif-unplugged", "status": "completed", "tag": "4118ea11-115a-41d1-9211-3709b41cd6ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:57.619726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e78b3dc2-3baf-4d11-84ad-bef0295386da req-7df4c4d4-5472-4610-a79d-6699e9527a83 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:57.627984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e78b3dc2-3baf-4d11-84ad-bef0295386da req-7df4c4d4-5472-4610-a79d-6699e9527a83 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:57.630656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e78b3dc2-3baf-4d11-84ad-bef0295386da req-7df4c4d4-5472-4610-a79d-6699e9527a83 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:57.668440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e78b3dc2-3baf-4d11-84ad-bef0295386da req-7df4c4d4-5472-4610-a79d-6699e9527a83 service nova] Creating event network-vif-unplugged:4118ea11-115a-41d1-9211-3709b41cd6ed for instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 on n-h2-858384-1 Sep 19 14:55:57.687355 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e78b3dc2-3baf-4d11-84ad-bef0295386da req-7df4c4d4-5472-4610-a79d-6699e9527a83 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091361 Sep 19 14:55:57.692651 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1683/3330] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:57.829985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:57.848019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-051b0a79-6645-4282-849b-fe4108085448 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1522 microversion: 2.1 time: 0.549358 Sep 19 14:55:57.860170 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1648/3331] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:57 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:58.177390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:58.178108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:58.192986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:58.193874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:58.194334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:58.195119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:58.199060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:58.199811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:58.471098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:58.472575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:58.480465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:58.480960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:58.481400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:58.493752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:58.494244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:58.498298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:00.398912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:00.418161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:00.426783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:00.428848 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab1f0b80-b479-4474-a24d-89e2a0a55725 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.961611 Sep 19 14:56:00.432192 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1649/3332] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:58 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:00.444247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:00.463824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:00.493768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:00.494457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:00.495989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:00.496883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:00.497424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:00.497918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:00.584647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:00.828793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:00.855548 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8186ecd1-b465-4232-bded-8ec64cce0415 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1505 microversion: 2.1 time: 2.682796 Sep 19 14:56:00.868768 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1684/3333] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:58 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1505 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:01.459990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.460610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.477612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:01.480260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.481848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.483031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.488988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.489732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.490607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.502295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c41a7891-17d9-4528-8852-7a52e0186664 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1522 microversion: 2.1 time: 1.062158 Sep 19 14:56:01.506573 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1650/3334] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:00 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1522 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:01.889323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.889323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.906501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.909160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.909654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.915638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.916455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.918238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.723210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.739699 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8477b0fa-d273-4ab7-9e97-434aad37a6e6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 200 len: 1448 microversion: 2.1 time: 0.857455 Sep 19 14:56:02.741021 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1651/3335] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:01 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 1448 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:02.762480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f7356711-52cd-4e24-98ca-2a9e130086a7 req-89afcc83-542b-4c73-84ec-fdecf30d7580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "375020e1-94f4-4661-8ee8-6df96d799595"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:02.777677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f7356711-52cd-4e24-98ca-2a9e130086a7 req-89afcc83-542b-4c73-84ec-fdecf30d7580 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.779471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f7356711-52cd-4e24-98ca-2a9e130086a7 req-89afcc83-542b-4c73-84ec-fdecf30d7580 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.781121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f7356711-52cd-4e24-98ca-2a9e130086a7 req-89afcc83-542b-4c73-84ec-fdecf30d7580 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.818027 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f7356711-52cd-4e24-98ca-2a9e130086a7 req-89afcc83-542b-4c73-84ec-fdecf30d7580 service nova] Creating event network-changed:375020e1-94f4-4661-8ee8-6df96d799595 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:56:02.833243 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f7356711-52cd-4e24-98ca-2a9e130086a7 req-89afcc83-542b-4c73-84ec-fdecf30d7580 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090672 Sep 19 14:56:02.834518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1652/3336] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:02.853056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:02.854244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:02.869396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.869604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.870311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.871221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.871805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.872312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.897882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.938695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.950493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.954223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b86ba40d-e143-476c-97d5-8fdf0143a024 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.498293 Sep 19 14:56:02.961620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1685/3337] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:01 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:02.975362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:02.978065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:03.002651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.003203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.003656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.004406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.004869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.005304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.123015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:03.140818 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Working on deleting snapshot 1ea9e9a5-8e1b-4ea8-adbd-c9c3501eb93f from shelved instance... Sep 19 14:56:03.988925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:04.024220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e154747c-76c2-476b-b30e-f15c78e72e84 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1522 microversion: 2.1 time: 1.175379 Sep 19 14:56:04.025132 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1653/3338] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:02 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1522 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:04.042682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:04.057044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:04.075533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:04.078018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:04.078479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:04.088281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:04.092506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:04.093183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:04.204828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:04.405767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:04.526783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:04.595233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Doing local delete in cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=128731) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 19 14:56:04.596140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:04.597209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:04.597959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:04.598479 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 19 14:56:04.603589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] deallocate_for_instance() {{(pid=128731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 19 14:56:05.132914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.148608 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ebe4e97-794a-4abf-9fc7-c9b40a0f7e64 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.121997 Sep 19 14:56:05.152915 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1654/3339] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:04 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:05.165935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:05.167381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:05.192092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.196425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.196425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.200151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.204874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.206590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.892463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.909276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.916072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.917891 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e1b72f3-5880-4262-8e04-aca1818d23e8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.763296 Sep 19 14:56:05.931260 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1655/3340] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:05 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:05.935681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:05.936728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:05.955906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.956950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.957478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.961223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.961787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.962435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.558602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:06.576427 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d7b60b9-093d-41e2-a636-8dad73f484b3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1499 microversion: 2.1 time: 0.655501 Sep 19 14:56:06.577045 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1656/3341] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:05 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1499 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:06.595525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-378810395"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:06.599423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:06.613318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.613913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.614358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.615112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.615566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.615985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.680167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:07.131248 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c3fe5f4-a456-4ed8-948a-ff2de3d7d4b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.552586 Sep 19 14:56:07.135861 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1657/3342] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:06 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 19 14:56:07.198106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2412d616-74f6-4fc9-b13b-dc70e2f20343 req-82563faa-6711-4b1c-b6bf-f7b8375a339e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "1136625f-c20a-4c3e-98e9-84b81ba8b47a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:07.271000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2412d616-74f6-4fc9-b13b-dc70e2f20343 req-82563faa-6711-4b1c-b6bf-f7b8375a339e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.271809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2412d616-74f6-4fc9-b13b-dc70e2f20343 req-82563faa-6711-4b1c-b6bf-f7b8375a339e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.272445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2412d616-74f6-4fc9-b13b-dc70e2f20343 req-82563faa-6711-4b1c-b6bf-f7b8375a339e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.323583 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2412d616-74f6-4fc9-b13b-dc70e2f20343 req-82563faa-6711-4b1c-b6bf-f7b8375a339e service nova] Creating event network-changed:1136625f-c20a-4c3e-98e9-84b81ba8b47a for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:56:07.335563 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2412d616-74f6-4fc9-b13b-dc70e2f20343 req-82563faa-6711-4b1c-b6bf-f7b8375a339e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166327 Sep 19 14:56:07.336913 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1658/3343] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:07.365911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:07.374734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:07.375626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:07.426443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.426988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.427431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.432123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.436843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.445960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.501500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:07.545620 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-64e35b1d-72bd-432f-97ef-11ed4e6c4625 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.205946 Sep 19 14:56:07.546490 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1659/3344] 10.222.0.81 () {58 vars in 1154 bytes} [Mon Sep 19 14:56:07 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:07.564097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:07.565556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:07.582888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.583596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.584252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.585575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.586193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.587268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.658617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Updating instance_info_cache with network_info: [] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 14:56:08.246238 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46b00337-37b9-4a63-99a7-2494c09f0d3b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 204 len: 0 microversion: 2.1 time: 5.283244 Sep 19 14:56:08.251732 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1686/3345] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:02 2022] DELETE /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 0 bytes in 5286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:56:08.266659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2eb3a53c-37ae-41a7-9f4f-1a87656d17de req-dd609bbf-5b90-40b8-9a7f-f459764c757e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-unplugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:08.300082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2eb3a53c-37ae-41a7-9f4f-1a87656d17de req-dd609bbf-5b90-40b8-9a7f-f459764c757e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.300972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2eb3a53c-37ae-41a7-9f4f-1a87656d17de req-dd609bbf-5b90-40b8-9a7f-f459764c757e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.303194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2eb3a53c-37ae-41a7-9f4f-1a87656d17de req-dd609bbf-5b90-40b8-9a7f-f459764c757e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.344398 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2eb3a53c-37ae-41a7-9f4f-1a87656d17de req-dd609bbf-5b90-40b8-9a7f-f459764c757e service nova] Creating event network-vif-unplugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:56:08.357809 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2eb3a53c-37ae-41a7-9f4f-1a87656d17de req-dd609bbf-5b90-40b8-9a7f-f459764c757e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101417 Sep 19 14:56:08.363100 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1687/3346] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:08.375300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e0a1730-b8b3-4652-9da4-4ff53c9abee3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:08.396763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0a1730-b8b3-4652-9da4-4ff53c9abee3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.398489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0a1730-b8b3-4652-9da4-4ff53c9abee3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.399158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0a1730-b8b3-4652-9da4-4ff53c9abee3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.459492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e0a1730-b8b3-4652-9da4-4ff53c9abee3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Going to try to start instance {{(pid=128731) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 14:56:08.558151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e0a1730-b8b3-4652-9da4-4ff53c9abee3 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "POST /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67/action" status: 202 len: 0 microversion: 2.1 time: 0.193073 Sep 19 14:56:08.559013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1688/3347] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:08 2022] POST /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:08.576701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:08.580119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:08.606110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.607076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.607737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.609158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.610142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.611014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.638389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:08.652510 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:56:08.654556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 HTTP/1.1 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9199a1b4-97bd-4382-8c8a-c06f417d4233'} Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:08.661538 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:56:08.668316 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:08.669926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:08.673369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3182e645-8a3b-411d-b80d-b8892d2fbdf3 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 404 len: 111 microversion: 2.1 time: 0.112963 Sep 19 14:56:08.675335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:08.679326 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1eda890c-7485-4bf0-8956-c0287dd01400 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.131324 Sep 19 14:56:08.680970 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1689/3348] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:08 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:56:08.687523 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1660/3349] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:07 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:08.717948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:08.718638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:08.730674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.732113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.732812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.733851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.734930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.735559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.037559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-270212158", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:09.147124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:56:10.111376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:10.151938 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0041cc84-4dbd-4450-bec1-d629d3ca7ec8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1508 microversion: 2.1 time: 1.467528 Sep 19 14:56:10.153710 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1690/3350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:08 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1508 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:10.187452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:10.188127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:10.211833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.212684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.213428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.214664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.215474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.216176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.810084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.831768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.834661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.836928 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f68b0eb-1ca5-4d26-8308-0c02922a5c48 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.671581 Sep 19 14:56:11.837892 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1691/3351] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:10 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:11.882919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b15d1e6a-25d7-4731-aa76-e97c9eac9c8b req-1759c2ab-686b-47b9-bbd7-623d6b4a92cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9199a1b4-97bd-4382-8c8a-c06f417d4233", "name": "network-vif-deleted", "tag": "4118ea11-115a-41d1-9211-3709b41cd6ed"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:11.933552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b15d1e6a-25d7-4731-aa76-e97c9eac9c8b req-1759c2ab-686b-47b9-bbd7-623d6b4a92cb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.935987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b15d1e6a-25d7-4731-aa76-e97c9eac9c8b req-1759c2ab-686b-47b9-bbd7-623d6b4a92cb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.936751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b15d1e6a-25d7-4731-aa76-e97c9eac9c8b req-1759c2ab-686b-47b9-bbd7-623d6b4a92cb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.011866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.compute.server_external_events [req-b15d1e6a-25d7-4731-aa76-e97c9eac9c8b req-1759c2ab-686b-47b9-bbd7-623d6b4a92cb service nova] Unable to find a host for instance 9199a1b4-97bd-4382-8c8a-c06f417d4233. Dropping event network-vif-deleted {{(pid=128731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 14:56:12.021029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b15d1e6a-25d7-4731-aa76-e97c9eac9c8b req-1759c2ab-686b-47b9-bbd7-623d6b4a92cb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.181286 Sep 19 14:56:12.029357 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1692/3352] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 191 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 14:56:12.093956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:12.095198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:12.125281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.126140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.140164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.141697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.142517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.144528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.706114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:56:12.707214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:56:12.709090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:56:12.709842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:56:12.710664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:56:12.745925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.746888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.747559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.748856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.749662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.750415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.854911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:12.891527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:12.996748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:56:13.001219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:56:13.177053 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2e4ff8cc-3474-40c9-9268-928c7306173e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.143857 Sep 19 14:56:13.189250 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1661/3353] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:56:13.212009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:13.213130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:13.258980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.262603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.272628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.275927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.283428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.284571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.729776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:13.738682 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-929b9b9d-4417-4f86-a31a-f9e0226cb519 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1508 microversion: 2.1 time: 1.707695 Sep 19 14:56:13.739317 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1693/3354] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:12 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1508 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:13.762547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee24c740-586c-46ba-9e25-db3104929902 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:13.763642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee24c740-586c-46ba-9e25-db3104929902 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:14.075444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee24c740-586c-46ba-9e25-db3104929902 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:14.101482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee24c740-586c-46ba-9e25-db3104929902 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1214 microversion: 2.1 time: 0.355737 Sep 19 14:56:14.103781 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1694/3355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:13 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:14.130726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-04ab842d-6c06-4e75-8c3b-578d6ddd96ad req-e9b64134-d9d5-4811-96ae-04de41bf43b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "07930525-c004-4fe4-8a21-9279e964fae1"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:14.168005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-04ab842d-6c06-4e75-8c3b-578d6ddd96ad req-e9b64134-d9d5-4811-96ae-04de41bf43b2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.170620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-04ab842d-6c06-4e75-8c3b-578d6ddd96ad req-e9b64134-d9d5-4811-96ae-04de41bf43b2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.173203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-04ab842d-6c06-4e75-8c3b-578d6ddd96ad req-e9b64134-d9d5-4811-96ae-04de41bf43b2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.195721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-04ab842d-6c06-4e75-8c3b-578d6ddd96ad req-e9b64134-d9d5-4811-96ae-04de41bf43b2 service nova] Creating event network-changed:07930525-c004-4fe4-8a21-9279e964fae1 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:56:14.227342 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-04ab842d-6c06-4e75-8c3b-578d6ddd96ad req-e9b64134-d9d5-4811-96ae-04de41bf43b2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085749 Sep 19 14:56:14.229737 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1695/3356] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:14.337325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:14.360043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:14.361955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:14.367683 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4505c80b-f318-4f3a-a453-a8426dd712c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.174710 Sep 19 14:56:14.371594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1662/3357] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:13 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:14.766165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:14.766904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:14.800039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.800437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.806787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.809734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.812997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.816844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.085320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-66cb692c-ee3b-4db8-b73a-6b35c1818711 req-701a0efd-0772-4bfb-ac12-a32688929892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-plugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:15.097831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:15.127487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-66cb692c-ee3b-4db8-b73a-6b35c1818711 req-701a0efd-0772-4bfb-ac12-a32688929892 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.128628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-66cb692c-ee3b-4db8-b73a-6b35c1818711 req-701a0efd-0772-4bfb-ac12-a32688929892 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.129869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-66cb692c-ee3b-4db8-b73a-6b35c1818711 req-701a0efd-0772-4bfb-ac12-a32688929892 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.167784 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-66cb692c-ee3b-4db8-b73a-6b35c1818711 req-701a0efd-0772-4bfb-ac12-a32688929892 service nova] Creating event network-vif-plugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:56:15.178900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-66cb692c-ee3b-4db8-b73a-6b35c1818711 req-701a0efd-0772-4bfb-ac12-a32688929892 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099560 Sep 19 14:56:15.186078 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1663/3358] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:15.203316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:15.213535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:15.231158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.231664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.232181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.232907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.233379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.238651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.958477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:15.979166 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a630c7dc-f218-4ddc-b0b9-f294b83eaa76 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1266 microversion: 2.1 time: 0.788638 Sep 19 14:56:15.980241 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1664/3359] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:15 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1266 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:16.016598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:16.018422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:16.039350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.040275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.041572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.043609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.045456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.047308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.221573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.238401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3066d222-e0a8-4884-a53e-9353aafd4395 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1508 microversion: 2.1 time: 1.478691 Sep 19 14:56:16.239034 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1696/3360] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:14 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1508 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:16.765784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.789921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.791842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.796431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d92d28ff-b907-4f64-9100-8d0290e11e16 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.796764 Sep 19 14:56:16.803502 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1665/3361] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:15 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:17.009310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.010285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:17.023674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.026335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.027868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.032106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.033869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.034516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.265492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.271042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:17.287026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:17.297420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.299637 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ffe26fff-6acc-416e-880e-4ce1b20cc3cf tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1272 microversion: 2.1 time: 0.297710 Sep 19 14:56:17.303989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.304657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.305753 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1697/3362] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:17 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:17.306769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.307449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.309690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.840699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.842700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:17.853476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.854301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.855756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.856848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.857503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.858104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:18.906414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:18.926520 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e0ea7cb0-88b8-4472-8b66-d1442b6b5658 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1512 microversion: 2.1 time: 1.664783 Sep 19 14:56:18.936148 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1666/3363] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:17 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1512 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:18.945996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:18.967864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:19.029804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:19.030221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:19.030657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:19.031394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:19.053099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:19.059644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:19.979839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.009072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.014954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.016214 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-72ad8409-2e60-4f25-a21a-26a1b01cb165 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 2.180421 Sep 19 14:56:20.020663 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1698/3364] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:17 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:20.030832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:20.037181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.037897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.compute.servers [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Removing options 'limit' from query {{(pid=128731) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 19 14:56:20.038921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:20.052519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.053219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.053896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.055394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.056156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.056839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.063508 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b87948b7-c717-44a3-adec-2d62fc8abf83 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040966 Sep 19 14:56:20.070881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1699/3365] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 14:56:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:56:20.082922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7ceed97d-4ce5-4194-8689-bfd12a16eb55 req-5275d484-23e4-47ca-80a8-2b5e3f5529ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "201449fa-941f-4331-8159-9877f2e2fa2e"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:20.099326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:20.113720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7ceed97d-4ce5-4194-8689-bfd12a16eb55 req-5275d484-23e4-47ca-80a8-2b5e3f5529ad service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.116815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7ceed97d-4ce5-4194-8689-bfd12a16eb55 req-5275d484-23e4-47ca-80a8-2b5e3f5529ad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.120722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7ceed97d-4ce5-4194-8689-bfd12a16eb55 req-5275d484-23e4-47ca-80a8-2b5e3f5529ad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.146547 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7ceed97d-4ce5-4194-8689-bfd12a16eb55 req-5275d484-23e4-47ca-80a8-2b5e3f5529ad service nova] Creating event network-changed:201449fa-941f-4331-8159-9877f2e2fa2e for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:56:20.160524 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7ceed97d-4ce5-4194-8689-bfd12a16eb55 req-5275d484-23e4-47ca-80a8-2b5e3f5529ad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085165 Sep 19 14:56:20.162438 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1700/3366] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:20.168519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:20.174188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:20.191984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.193600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.194546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.196811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.198383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.199104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.263595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:21.280326 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c125a8d-8066-4ef6-93b4-9fa139933595 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1314 microversion: 2.1 time: 2.342630 Sep 19 14:56:21.285851 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1667/3367] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:18 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1314 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:21.303053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-52b45f92-9552-4217-94ad-f5372d021b79 req-4408ede5-fd8a-488b-b8c7-93e2b2027a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7a8d3e-13e9-4b65-b10f-0de96c9eb168", "tag": "8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:21.333930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52b45f92-9552-4217-94ad-f5372d021b79 req-4408ede5-fd8a-488b-b8c7-93e2b2027a72 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.335972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52b45f92-9552-4217-94ad-f5372d021b79 req-4408ede5-fd8a-488b-b8c7-93e2b2027a72 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.336821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52b45f92-9552-4217-94ad-f5372d021b79 req-4408ede5-fd8a-488b-b8c7-93e2b2027a72 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.351217 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-52b45f92-9552-4217-94ad-f5372d021b79 req-4408ede5-fd8a-488b-b8c7-93e2b2027a72 service nova] Creating event network-changed:8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7 for instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 on n-h1-858384-1 Sep 19 14:56:21.357558 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-52b45f92-9552-4217-94ad-f5372d021b79 req-4408ede5-fd8a-488b-b8c7-93e2b2027a72 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069788 Sep 19 14:56:21.359025 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1668/3368] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:21.365743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:21.366993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:21.375103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.376030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.377538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.383436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.384530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.386075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.497222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:21.506276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:21.513105 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e61028b5-b783-4e61-bad5-1578345f43c8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1512 microversion: 2.1 time: 1.345500 Sep 19 14:56:21.514146 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1701/3369] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:20 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1512 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:21.547893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:21.549493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:21.564569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.568219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.569146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.571804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.573485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.582957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:22.449163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:22.460036 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57f4cf84-fb45-4d04-b5c4-d8db5819fe61 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 200 len: 1511 microversion: 2.1 time: 0.920882 Sep 19 14:56:22.475499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1702/3370] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:21 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 1511 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:22.486506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:22.487640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:22.496175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:22.498575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:22.500425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:22.501423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:22.502996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:22.503682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:22.563138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:22.584742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:22.586993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:22.588667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-85bd5c34-eb00-413c-8f58-f2ccc46e4e52 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.227772 Sep 19 14:56:22.590377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1669/3371] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:21 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:22.596748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:22.597633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:22.605327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:22.606080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:22.606844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:22.607789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:22.608462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:22.609102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:22.811909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:22.960423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:23.299033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:23.314639 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-219ae107-0f2e-427b-9064-63cc4ab3a337 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1314 microversion: 2.1 time: 0.837074 Sep 19 14:56:23.319621 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1703/3372] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:22 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:23.386947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:23.402558 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-429a6d74-6b2a-47eb-abe8-7cc530f84d06 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1513 microversion: 2.1 time: 0.810676 Sep 19 14:56:23.427787 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1670/3373] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:22 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1513 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:23.443906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:23.462888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:23.463689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:23.921772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1230137880", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "8daa41b2-9fdb-4088-934a-17a0d357f30d"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:24.006632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.007158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.007589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.008324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.008775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.009359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.044627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] validate_networks() for [('8daa41b2-9fdb-4088-934a-17a0d357f30d', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:56:24.084990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:24.225980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:24.343840 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8e60bfc-18ab-4210-9a10-85392d2f59ed tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.914469 Sep 19 14:56:24.344732 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1671/3374] 10.222.0.81 () {58 vars in 1154 bytes} [Mon Sep 19 14:56:23 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:24.354972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:24.359359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:24.368865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.370127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.370772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.372425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.373074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.373672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.563118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:26.584533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:26.589308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:26.615295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be328485-86c5-4be6-ae69-f0eb2d42d80f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 2.268788 Sep 19 14:56:26.616433 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1672/3375] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:24 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:26.621415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:26.628983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:26.643550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:26.651948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:26.655288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.657691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:26.660043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:26.663286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.686918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:56:26.688495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:56:26.690272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:56:26.691285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:56:26.691940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:56:26.712444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:26.715414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:26.717303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.718966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:26.720575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:26.722679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.783499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Getting quotas for project e8c74bdcdf46400886daeb2107b4f3c0. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:26.800511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Getting quotas for user 3c5dbf1dce854737a32a1fe9d3e2166f and project e8c74bdcdf46400886daeb2107b4f3c0. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:26.843257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:56:26.856653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:56:26.989131 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c70e354-7aea-4b67-ad9b-d638a846c129 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.667737 Sep 19 14:56:26.991024 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1704/3376] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:56:26.997092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:26.998170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:27.007869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:27.009021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:27.009705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:27.010668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:27.013939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:27.016987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:27.766409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:27.784235 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a351dab-c0db-4014-9b86-1bb4ca5201f2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1314 microversion: 2.1 time: 1.163570 Sep 19 14:56:27.788045 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1673/3377] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:26 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1314 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:27.802297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2adb89e-924b-4642-a653-590f8e0c0ceb tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:27.803005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a2adb89e-924b-4642-a653-590f8e0c0ceb tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.018942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a2adb89e-924b-4642-a653-590f8e0c0ceb tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.030565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a2adb89e-924b-4642-a653-590f8e0c0ceb tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.037937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a2adb89e-924b-4642-a653-590f8e0c0ceb tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.040565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a2adb89e-924b-4642-a653-590f8e0c0ceb tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1259 microversion: 2.21 time: 0.251430 Sep 19 14:56:28.042041 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1674/3378] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:27 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:28.069711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.074480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bf56480d-1bb4-4b99-98ba-215d7f27bc0c req-fabf7914-887f-4892-a158-a0b58bb61d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7a8d3e-13e9-4b65-b10f-0de96c9eb168", "name": "network-vif-plugged", "status": "completed", "tag": "8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:28.080260 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48181aa1-279a-4052-a8c9-1a0a1e17efd0 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1512 microversion: 2.1 time: 1.086617 Sep 19 14:56:28.085706 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1705/3379] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:26 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1512 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:28.098603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bf56480d-1bb4-4b99-98ba-215d7f27bc0c req-fabf7914-887f-4892-a158-a0b58bb61d52 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.100098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bf56480d-1bb4-4b99-98ba-215d7f27bc0c req-fabf7914-887f-4892-a158-a0b58bb61d52 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.100702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bf56480d-1bb4-4b99-98ba-215d7f27bc0c req-fabf7914-887f-4892-a158-a0b58bb61d52 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.113227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bf56480d-1bb4-4b99-98ba-215d7f27bc0c req-fabf7914-887f-4892-a158-a0b58bb61d52 service nova] Creating event network-vif-plugged:8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7 for instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 on n-h1-858384-1 Sep 19 14:56:28.119366 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bf56480d-1bb4-4b99-98ba-215d7f27bc0c req-fabf7914-887f-4892-a158-a0b58bb61d52 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060810 Sep 19 14:56:28.122568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:28.123167 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1675/3380] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:28.131335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.141281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:28.143784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.151653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.151873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.152549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.153122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.153951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.154480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.154637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.155262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.156800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.159804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.160392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.167963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.785851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.788206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:28.800893 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b448154-b9d8-4473-92d2-eb90a3af8cda tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 200 len: 1511 microversion: 2.1 time: 0.676224 Sep 19 14:56:28.802552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1676/3381] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:28 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 1511 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:28.810691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:28.811647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.823541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.824955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.825716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.826946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.829533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.832332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.920062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.930345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.932327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.948413 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c6a501a-accb-44e7-a409-27fd03f9de24 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.859171 Sep 19 14:56:28.948413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1706/3382] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:28 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:28.951915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:28.971703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.977980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.978482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.978957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.979665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.980125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.980552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:29.802452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:29.819412 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a4435ef1-2dd3-4ab5-808c-b264368356d2 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1314 microversion: 2.1 time: 1.012997 Sep 19 14:56:29.822267 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1677/3383] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:28 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:29.845972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:29.848228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:29.867682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:29.868571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:29.869634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:29.870775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:29.871534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:29.872373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.010379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.024705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.028651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.030921 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df486a60-aeda-4433-b73a-5174f141cba0 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1317 microversion: 2.21 time: 0.206777 Sep 19 14:56:30.050195 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1678/3384] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:29 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:30.066953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:30.068662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:30.081301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.082342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.083070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.085331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.086051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.086653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.136610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.148563 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31fd4d6e-062c-46a4-ab46-cae6adc9b71e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1513 microversion: 2.1 time: 1.200400 Sep 19 14:56:30.159605 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1707/3385] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:28 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1513 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:30.173437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:30.178726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.179893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:30.188357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.189121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.189982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.191000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.191759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.192460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.231944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:30.279735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.288596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.289410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.290075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.543715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:31.569559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:31.576882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:31.578092 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-046c1bce-7967-4ee0-b000-e12d897abf4b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.526481 Sep 19 14:56:31.579425 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1679/3386] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:30 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:31.597832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:31.598688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:31.610097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.613576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.617835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.618907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.619199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.619637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.661635 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e2a7ea8-fd20-4e39-91b0-b7b72563d104 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 1.492915 Sep 19 14:56:31.662375 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1708/3387] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 14:56:30 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:31.688580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:31.689790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:31.715102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.715610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.716053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.716773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.717231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.717650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.069514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.077892 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ecd1f74d-e3bf-40ef-950f-47b00662a101 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1500 microversion: 2.1 time: 0.494353 Sep 19 14:56:32.083582 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1680/3388] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:31 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1500 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:32.092704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:32.108208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.110563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:32.249019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.257754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.265451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.272640 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2dda9142-dca1-43da-9c06-19ca77fdea68 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.587999 Sep 19 14:56:32.273231 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1709/3389] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:31 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:32.298387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f582f0e-a9fb-402e-bf9d-a819673ff33c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:32.305479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f582f0e-a9fb-402e-bf9d-a819673ff33c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.306227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f582f0e-a9fb-402e-bf9d-a819673ff33c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.306844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f582f0e-a9fb-402e-bf9d-a819673ff33c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.336497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f582f0e-a9fb-402e-bf9d-a819673ff33c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Going to try to stop instance {{(pid=128731) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:56:32.351174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.352143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.352945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.353794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.354560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.355177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.423793 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f582f0e-a9fb-402e-bf9d-a819673ff33c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168/action" status: 202 len: 0 microversion: 2.1 time: 0.129396 Sep 19 14:56:32.430468 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1710/3390] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:32 2022] POST /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:32.447249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:32.448452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:32.453706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:32.458705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.459535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.460125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.461014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.461725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.462424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.508305 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dea38519-ac78-4553-a88e-9f8358360e6e tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.422230 Sep 19 14:56:32.518471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1681/3391] 10.222.0.81 () {58 vars in 1150 bytes} [Mon Sep 19 14:56:32 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:32.525976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:32.538011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.543650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:32.557586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.564757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.565489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.567534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.568152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.568728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.733177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:32.842739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8261524a-73df-4f59-bf1e-d6c54bae7de5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.322222 Sep 19 14:56:32.857738 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1682/3392] 10.222.0.81 () {58 vars in 1212 bytes} [Mon Sep 19 14:56:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:32.864288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.867505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:32.869026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:32.878284 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-43c529c9-b29b-4962-922d-fa811117d1ae tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.445454 Sep 19 14:56:32.879296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.891513 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1711/3393] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:32 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:32.891513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:32.897369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.903745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.904641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:32.913434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.914220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.914705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.915192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.948629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.949122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.949567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.950302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.950788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.951213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.131511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:33.255303 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d51a6dc2-a990-47d7-b6d6-1993b3a80717 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.372523 Sep 19 14:56:33.260904 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1712/3394] 10.222.0.81 () {58 vars in 1196 bytes} [Mon Sep 19 14:56:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:33.268884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:33.278394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.279123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': '1649205955', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:33.285843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.286355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.287344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.288010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.288718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.289159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.407107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:33.550905 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-241d2252-4670-4294-a23a-852e4f52a8fe tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?name=1649205955" status: 200 len: 346 microversion: 2.1 time: 0.286171 Sep 19 14:56:33.551840 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1713/3395] 10.222.0.81 () {58 vars in 1156 bytes} [Mon Sep 19 14:56:33 2022] GET /compute/v2.1/servers?name=1649205955 => generated 346 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:33.565549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:33.568726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:33.583306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.583848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.589689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.590606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.591151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.592218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.691254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.703601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.710618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.713370 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b903e546-17eb-41ff-a767-bb0005622faa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.854296 Sep 19 14:56:33.716928 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1683/3396] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:32 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:33.725941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:33.734157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.742133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:33.756820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.757659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.760832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.761916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.763302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.770955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.919604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.937097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.943389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.946454 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ddb1c6f-f0ea-410d-885e-becdb0dadc88 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.393543 Sep 19 14:56:33.950219 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1714/3397] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:33 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:33.967506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:33.968598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:33.984362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.985133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.986891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.987692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.988192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.988631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.029014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:34.166008 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc3a0d73-f441-450d-9a94-46b30f170783 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.447703 Sep 19 14:56:34.168960 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1684/3398] 10.222.0.81 () {58 vars in 1154 bytes} [Mon Sep 19 14:56:33 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:34.204042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:34.225542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:34.227337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-164920595', 'deleted': False, 'project_id': 'deb919abeddc47a189d651c513d1e543'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:56:34.237596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.238939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.239974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.241302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.242366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.243213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.366653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:56:34.376798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:34.390700 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9fe3278f-55ab-47dc-85ae-1807265f3704 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.437389 Sep 19 14:56:34.395468 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1715/3399] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:33 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:34.565158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb37762f-4103-43f8-90fe-a4312da630ff tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-164920595" status: 200 len: 346 microversion: 2.1 time: 0.380484 Sep 19 14:56:34.568514 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1685/3400] 10.222.0.81 () {58 vars in 1228 bytes} [Mon Sep 19 14:56:34 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-164920595 => generated 346 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:34.584559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:34.585530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:34.603304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.606277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.607080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.611626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.612827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.614675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.703237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:34.706503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:34.748072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:34.749261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:34.762669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.764262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.765387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.768210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.769191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.772606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.215038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.240313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.245845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.248017 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-252e07ed-7bcb-40e0-aaf9-4e79f4e9f3f5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.504647 Sep 19 14:56:35.258190 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1686/3401] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:34 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:35.285540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:35.287428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:35.312987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.313320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.314431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.315210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.315676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.319894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.601579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a291f72a-4b96-47da-9654-2650768f4ca5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 204 len: 0 microversion: 2.1 time: 1.022693 Sep 19 14:56:35.603712 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1716/3402] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:34 2022] DELETE /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:56:35.627074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:35.630773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:35.649146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.650073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.650692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.651597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.652216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.652884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.835373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.846912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.857742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.859465 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48826daa-9d56-474b-9ee8-977c73e7a05e tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.599998 Sep 19 14:56:35.860807 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1687/3403] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:35 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:35.874236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:35.879477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:35.890474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.893640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.894316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.898218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.898995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.899599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.969672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.985682 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5be1cbbc-65a6-4e11-9f5b-4d46728438b8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.366853 Sep 19 14:56:35.986572 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1717/3404] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:35 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:36.167114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:36.176540 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-afdf4406-7a29-47b5-9072-968a6b3a6ce4 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1519 microversion: 2.1 time: 0.306098 Sep 19 14:56:36.177122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1688/3405] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:35 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:36.271313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2f30904f-fc4e-4588-ba43-48d551d386fd req-fb047b80-be96-4b5f-ae15-ebc293f21072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a36b59b-aae7-40af-b867-87174e49a747", "tag": "4b51d3ab-8031-406d-94a0-7379b4b899f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:36.290025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:36.290931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:36.307586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.309683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.310291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.314784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.321733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.326066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.339712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2f30904f-fc4e-4588-ba43-48d551d386fd req-fb047b80-be96-4b5f-ae15-ebc293f21072 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.340358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2f30904f-fc4e-4588-ba43-48d551d386fd req-fb047b80-be96-4b5f-ae15-ebc293f21072 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.350150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2f30904f-fc4e-4588-ba43-48d551d386fd req-fb047b80-be96-4b5f-ae15-ebc293f21072 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.379871 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2f30904f-fc4e-4588-ba43-48d551d386fd req-fb047b80-be96-4b5f-ae15-ebc293f21072 service nova] Creating event network-changed:4b51d3ab-8031-406d-94a0-7379b4b899f4 for instance 8a36b59b-aae7-40af-b867-87174e49a747 on n-h1-858384-1 Sep 19 14:56:36.393980 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2f30904f-fc4e-4588-ba43-48d551d386fd req-fb047b80-be96-4b5f-ae15-ebc293f21072 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128236 Sep 19 14:56:36.398681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1718/3406] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:36.744761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:36.755799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:36.760145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:36.762255 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a79d49a2-442e-40cd-960b-8f7c8b582709 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.476841 Sep 19 14:56:36.766121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1689/3407] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:36 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:36.890844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:36.891567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:36.904039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.913307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.914338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.916005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.916673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.921468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.011460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:37.012151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:37.020138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.022884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.023542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.026398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.028372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.031119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.466384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:37.481433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:37.482960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:37.484130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-72282f5d-7c57-4535-926d-83ddc2053b9a tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.598404 Sep 19 14:56:37.508413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1719/3408] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:36 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:37.525826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:37.540467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:37.551988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.555745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.556478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.557444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.558100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.559936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.711343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:37.729746 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e5c5aba1-986b-4ca4-aac6-d42fdc84dd65 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.718865 Sep 19 14:56:37.731209 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1690/3409] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:37 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:37.799594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:37.800553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:37.807409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.808150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.808832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.809761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.810429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.814046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.026281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:38.135948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:38.151859 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17c9b55d-452c-4f8a-94b0-bf1cb554c3a8 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1519 microversion: 2.1 time: 0.635398 Sep 19 14:56:38.155490 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1720/3410] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:37 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1519 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:38.219265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:38.232983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:38.236707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:38.237915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2046c61b-7003-47bd-8ede-f0314ec50e44 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.442522 Sep 19 14:56:38.242954 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1691/3411] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:37 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:38.524616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:38.525617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:38.544627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.545087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.545546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.546301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.546799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.547252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.753506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2725206d-70c0-437f-89bd-27df00c1d642 req-fe0e61cf-0ff7-4cd6-89eb-5037b7855626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d256ad-2b6c-41cd-9a3c-573b0430445d", "name": "network-vif-deleted", "tag": "eeca97aa-3153-4585-9454-3963ab89353f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:38.794184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2725206d-70c0-437f-89bd-27df00c1d642 req-fe0e61cf-0ff7-4cd6-89eb-5037b7855626 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.795096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2725206d-70c0-437f-89bd-27df00c1d642 req-fe0e61cf-0ff7-4cd6-89eb-5037b7855626 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.795983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2725206d-70c0-437f-89bd-27df00c1d642 req-fe0e61cf-0ff7-4cd6-89eb-5037b7855626 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.806596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:38.823624 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2725206d-70c0-437f-89bd-27df00c1d642 req-fe0e61cf-0ff7-4cd6-89eb-5037b7855626 service nova] Creating event network-vif-deleted:eeca97aa-3153-4585-9454-3963ab89353f for instance e0d256ad-2b6c-41cd-9a3c-573b0430445d on n-h1-858384-1 Sep 19 14:56:38.830802 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2725206d-70c0-437f-89bd-27df00c1d642 req-fe0e61cf-0ff7-4cd6-89eb-5037b7855626 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081814 Sep 19 14:56:38.831939 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1692/3412] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:38.848366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:38.849300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:38.857360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.858047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.858663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.859779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.871695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.872983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.113447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.132154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.134788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.145356 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df3ddb49-e2ac-4772-aa38-2315e1a10144 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.626027 Sep 19 14:56:39.147832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1721/3413] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:38 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:39.155291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.156160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.165490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.166414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.167555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.168590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.169320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.170185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.214604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.234613 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3cbcc95e-7df9-44bc-b945-5347f59b1a8a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.396984 Sep 19 14:56:39.237275 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1693/3414] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:38 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:39.260567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.261386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.270296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.270832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.271279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.272012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.272474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.272904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.308152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.308677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.309141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.309756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lazy-loading 'fault' on Instance uuid e0d256ad-2b6c-41cd-9a3c-573b0430445d {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:39.401773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.423965 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6733770b-f427-4f33-9930-926a33b1309b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1311 microversion: 2.1 time: 0.184309 Sep 19 14:56:39.425763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1694/3415] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:39.444788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.445457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.452512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.453358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.454126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.456263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.457111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.457712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.471230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.480859 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-309fd7f9-6cde-44f0-a79f-b47f939c1dff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.331668 Sep 19 14:56:39.484961 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1722/3416] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:39.506063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-129743322"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:39.508609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.515039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.515510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.516634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.519097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.519882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.520326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.724569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.734887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.737226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.738367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0ec4039-7ad8-4208-a6e0-d3bf00e319f0 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.311372 Sep 19 14:56:39.751964 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1695/3417] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:39.773688 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4abcd2e9-cf0e-4ffe-8add-e9d23e7774d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.271914 Sep 19 14:56:39.774608 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1723/3418] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:39 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Sep 19 14:56:39.782633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.783464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.790067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.790735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.791590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.792731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.793192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.794178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.968723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.978934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c6685da-ae88-4915-9e8b-afad3f97cd2b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 0.200089 Sep 19 14:56:39.979678 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1696/3419] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:40.177596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.178318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.187141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.189938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.190405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.191181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.191648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.192090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.266787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.266787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.274890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.275390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.275833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.276548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.278199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.278446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:40.280157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.557203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.567299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.575390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd287ba2-5dd4-4ddc-a71a-55bf330c9dad tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.313766 Sep 19 14:56:40.575983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1697/3420] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:40.577780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.583853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.585598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.585838 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ce48067f-1077-490f-8d88-9707cd6b2ab1 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.413426 Sep 19 14:56:40.586218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.602686 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1724/3421] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:40.606281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.607351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.608252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.609382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.610002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.610691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.648571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.649939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.650593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.651457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lazy-loading 'fault' on Instance uuid e0d256ad-2b6c-41cd-9a3c-573b0430445d {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:40.708025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.718733 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7a052ea0-100c-4b34-9f7f-c964b841629b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 200 len: 1311 microversion: 2.1 time: 0.139513 Sep 19 14:56:40.719682 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1698/3422] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:40.765924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.767163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.783627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.786480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.788998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.789781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.790259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.790698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.008639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.009339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.038913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.039592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.040041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.040782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.047470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.048596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.091344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.109023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.115297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.117929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa9d6aa5-56b6-48f9-ab78-c349ad6476d8 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.355888 Sep 19 14:56:41.118474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1725/3423] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:41.123976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-43387958-482a-4768-91bd-f240cd439272 req-ba1e2784-f69e-42a0-b1aa-fe95bd91cc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-unplugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:41.135277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-43387958-482a-4768-91bd-f240cd439272 req-ba1e2784-f69e-42a0-b1aa-fe95bd91cc95 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.136259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-43387958-482a-4768-91bd-f240cd439272 req-ba1e2784-f69e-42a0-b1aa-fe95bd91cc95 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.137285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-43387958-482a-4768-91bd-f240cd439272 req-ba1e2784-f69e-42a0-b1aa-fe95bd91cc95 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.161273 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-43387958-482a-4768-91bd-f240cd439272 req-ba1e2784-f69e-42a0-b1aa-fe95bd91cc95 service nova] Creating event network-vif-unplugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:56:41.166771 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-43387958-482a-4768-91bd-f240cd439272 req-ba1e2784-f69e-42a0-b1aa-fe95bd91cc95 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046915 Sep 19 14:56:41.168231 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1726/3424] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:41.295363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.303719 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f220db21-16a9-4a16-b0a0-fd3ee4381ba2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 0.301045 Sep 19 14:56:41.304305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1699/3425] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:41.603767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.604437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.612454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.613245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.613874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.613992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.614503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.615129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.616051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.616668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.620844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.621553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.622003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.622711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.623342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.623938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.847834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.860125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.863643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.866114 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b4b3f31-d368-41cf-ba05-cffe7f85e6fc tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.257320 Sep 19 14:56:41.867136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.876518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1700/3426] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:41.883299 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7739aeaa-63a5-43a4-a6d1-60dbf1fa81eb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.284733 Sep 19 14:56:41.884152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1727/3427] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:41.889639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.890505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: e0d256ad-2b6c-41cd-9a3c-573b0430445d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.898809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.899587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.900271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.901166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.901804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.902235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.918268 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] HTTP exception thrown: Instance e0d256ad-2b6c-41cd-9a3c-573b0430445d could not be found. Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Request method failure captured: Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d HTTP/1.1 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIK8eW2brUJyvJXT7EVmhCldgU07bOvb7xIyiSZvi93ljWYVswIwBmn10YmraUSRT6_JNlVvDJ8UqF-jbeIq-MqSs3WFVW24IM8l0yzWjQBRcml9uDB56THJXQ2xeuDEqv1yHkwYBaS1bSx2FIKEKiNDU1HbAvMt8fhDNSK88i2jWR0 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: deb919abeddc47a189d651c513d1e543 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_deb919abeddc47a189d651c513d1e543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/deb919abeddc47a189d651c513d1e543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/deb919abeddc47a189d651c513d1e543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/deb919abeddc47a189d651c513d1e543"}]}] Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: deb919abeddc47a189d651c513d1e543 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ListServerFiltersTestJSON-1237788820-project Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 438ade508fb547f5aadac70380369f4a Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ListServerFiltersTestJSON-1237788820-project Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance e0d256ad-2b6c-41cd-9a3c-573b0430445d could not be found. Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e0d256ad-2b6c-41cd-9a3c-573b0430445d'} Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d256ad-2b6c-41cd-9a3c-573b0430445d could not be found. Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d256ad-2b6c-41cd-9a3c-573b0430445d could not be found. Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:41.919993 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d256ad-2b6c-41cd-9a3c-573b0430445d could not be found. Sep 19 14:56:41.924892 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:41.925744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Returning 404 to user: Instance e0d256ad-2b6c-41cd-9a3c-573b0430445d could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:41.926729 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2603b4db-509d-4771-8da9-6b32033fe901 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d" status: 404 len: 111 microversion: 2.1 time: 0.047868 Sep 19 14:56:41.927587 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1701/3428] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/e0d256ad-2b6c-41cd-9a3c-573b0430445d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:56:41.936393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.937007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.946966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.946966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.946966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.946966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.946966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.947345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.978950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:42.076324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-234df87e-3865-49e2-a7fc-8b5a3482da24 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 204 len: 0 microversion: 2.1 time: 0.144133 Sep 19 14:56:42.077745 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1728/3429] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:41 2022] DELETE /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:56:42.087501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.088251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.096606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.097566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.098281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.099142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.099734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.100250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.148192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.149736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.156488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.157236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.158455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.159489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.160238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.160815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.571143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.583449 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7a7cbf5-c830-4c02-a9ca-f42a99b0389c tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 200 len: 1517 microversion: 2.1 time: 0.500611 Sep 19 14:56:42.584337 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1702/3430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 1517 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:42.602266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.603234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.622508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.623389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.623991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.624883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.625492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.626799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.652775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.665376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.670581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.671906 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ed0fe12-67ed-4125-951c-ffc2dfec5b1b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.529158 Sep 19 14:56:42.673989 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1729/3431] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:42.851439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.861889 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d084e5c5-8ebf-498f-ac46-b70c271c1a47 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1686 microversion: 2.1 time: 0.275866 Sep 19 14:56:42.862406 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1703/3432] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1686 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:42.902807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.904157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.912428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.913203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.918883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.920045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.920907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.921883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.922653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.923876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.925201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.925911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.926500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.927396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.929116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.929970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.933956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:43.330897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:43.653258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:43.661932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:43.663723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:43.665472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-43272f6a-a36a-4f78-8d1f-65bfe4521dd7 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.766824 Sep 19 14:56:43.679550 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1730/3433] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:43.691155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:43.691956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:43.703331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.704919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.705957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.706964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.707788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.708376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.730532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:43.743708 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2809a15-fa6e-4472-9d2e-bb8fc97035e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.838814 Sep 19 14:56:43.755795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1704/3434] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:43.767743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:43.768604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:43.775192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.776075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.776748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.777721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.778336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.779417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.277389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=10 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:44.326522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:44.339146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b4b2903f-7deb-4269-9762-ee5eed775fde tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 200 len: 1517 microversion: 2.1 time: 0.658031 Sep 19 14:56:44.354821 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1731/3435] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:43 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 1517 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:44.361671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:44.362910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:44.371623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.372732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.374337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.376381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.377199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.377396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:44.378341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.392679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:44.394993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:44.396589 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e429eaea-60ba-4cb5-83ee-91fc27fe8cfe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.639580 Sep 19 14:56:44.397828 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1705/3436] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:43 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:44.697810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:44.698431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:44.714672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.715229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.715918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.717049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.717839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.723504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.801543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:44.851046 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fe3384c3-6323-43eb-bc7e-b52460f72231 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.504224 Sep 19 14:56:44.852006 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1732/3437] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:44 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:44.862706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:44.887992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:44.912844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.917881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.924356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.926925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.928019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.934995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.308973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:45.325941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:45.333520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:45.340969 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad54c822-7704-4f66-a2cc-2d6ccfc83820 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.649126 Sep 19 14:56:45.342645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1706/3438] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:44 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:45.372069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-359d6dda-a539-4cbf-8aed-f745998ba440 req-58f1e739-31cc-45fc-ad01-efcc0db4e00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c383f3-68ef-407c-b7fa-a0173b3e2c59", "name": "network-vif-deleted", "tag": "a5be1a8f-1b29-467d-829f-1dd8c9721137"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:45.389458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=90 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:45.426714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-359d6dda-a539-4cbf-8aed-f745998ba440 req-58f1e739-31cc-45fc-ad01-efcc0db4e00a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.434384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-359d6dda-a539-4cbf-8aed-f745998ba440 req-58f1e739-31cc-45fc-ad01-efcc0db4e00a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.435453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-359d6dda-a539-4cbf-8aed-f745998ba440 req-58f1e739-31cc-45fc-ad01-efcc0db4e00a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.507764 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-359d6dda-a539-4cbf-8aed-f745998ba440 req-58f1e739-31cc-45fc-ad01-efcc0db4e00a service nova] Creating event network-vif-deleted:a5be1a8f-1b29-467d-829f-1dd8c9721137 for instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 on n-h2-858384-1 Sep 19 14:56:45.528294 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-359d6dda-a539-4cbf-8aed-f745998ba440 req-58f1e739-31cc-45fc-ad01-efcc0db4e00a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175005 Sep 19 14:56:45.534524 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1707/3439] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:45.545577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:45.556524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:45.561984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-60bce718-49f4-43e6-88a0-47a3eb3c4a06 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.708661 Sep 19 14:56:45.570619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:45.571167 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1733/3440] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:44 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:45.587141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:45.589421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.591600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:45.595588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.599520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.604958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.605806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.606474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.609862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.616956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.617752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.618707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.619721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.620355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.756666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.762097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.763881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.765446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lazy-loading 'fault' on Instance uuid a1c383f3-68ef-407c-b7fa-a0173b3e2c59 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:45.883634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:45.893579 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b46755b1-a016-430f-88b1-2e2f1cf7cad5 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 200 len: 1310 microversion: 2.1 time: 0.357452 Sep 19 14:56:45.897523 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1708/3441] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:45 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 1310 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:45.904675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:45.916541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:45.948090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.949882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.950555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.952254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.953031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.955180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.270628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:46.283944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:46.285862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:46.288094 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d28545e8-3366-4c63-a181-f38d6f7f15fe tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.715587 Sep 19 14:56:46.289330 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1734/3442] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:45 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:46.360795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5664de23-525a-4f0d-b70d-7ddf7368abb0 req-27513ac0-fca8-4a41-9a0b-a1f09fcd2fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a36b59b-aae7-40af-b867-87174e49a747", "name": "network-vif-plugged", "status": "completed", "tag": "4b51d3ab-8031-406d-94a0-7379b4b899f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:46.389910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5664de23-525a-4f0d-b70d-7ddf7368abb0 req-27513ac0-fca8-4a41-9a0b-a1f09fcd2fc9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.393039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5664de23-525a-4f0d-b70d-7ddf7368abb0 req-27513ac0-fca8-4a41-9a0b-a1f09fcd2fc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.398614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5664de23-525a-4f0d-b70d-7ddf7368abb0 req-27513ac0-fca8-4a41-9a0b-a1f09fcd2fc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.447276 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5664de23-525a-4f0d-b70d-7ddf7368abb0 req-27513ac0-fca8-4a41-9a0b-a1f09fcd2fc9 service nova] Creating event network-vif-plugged:4b51d3ab-8031-406d-94a0-7379b4b899f4 for instance 8a36b59b-aae7-40af-b867-87174e49a747 on n-h1-858384-1 Sep 19 14:56:46.456040 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5664de23-525a-4f0d-b70d-7ddf7368abb0 req-27513ac0-fca8-4a41-9a0b-a1f09fcd2fc9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101232 Sep 19 14:56:46.463455 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1735/3443] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:46.475097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:46.483070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:46.500425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:46.506110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.506974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.507697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.508847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.509572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.510228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.114973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.140379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.144037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.145635 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0effaf2e-b842-478c-93c9-008e81ad28ab tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1359 microversion: 2.21 time: 0.679443 Sep 19 14:56:47.146736 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1736/3444] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:46 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1359 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:47.152980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.155034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.155589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:47.156238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.166235 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-616d2410-897d-4ecf-b86e-b31e78be9eb1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 1.267294 Sep 19 14:56:47.166871 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1709/3445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:45 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:47.194272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.195914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.197023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: a1c383f3-68ef-407c-b7fa-a0173b3e2c59] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.197804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.198685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.200879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.201532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.202139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.212597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.217275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.218515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.220427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.223645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.224282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.260025 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] HTTP exception thrown: Instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 could not be found. Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Request method failure captured: Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 HTTP/1.1 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIK8eW2brUJyvJXT7EVmhCldgU07bOvb7xIyiSZvi93ljWYVswIwBmn10YmraUSRT6_JNlVvDJ8UqF-jbeIq-MqSs3WFVW24IM8l0yzWjQBRcml9uDB56THJXQ2xeuDEqv1yHkwYBaS1bSx2FIKEKiNDU1HbAvMt8fhDNSK88i2jWR0 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: deb919abeddc47a189d651c513d1e543 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_deb919abeddc47a189d651c513d1e543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/deb919abeddc47a189d651c513d1e543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/deb919abeddc47a189d651c513d1e543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/deb919abeddc47a189d651c513d1e543"}]}] Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: deb919abeddc47a189d651c513d1e543 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ListServerFiltersTestJSON-1237788820-project Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 438ade508fb547f5aadac70380369f4a Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ListServerFiltersTestJSON-1237788820-project Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 could not be found. Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a1c383f3-68ef-407c-b7fa-a0173b3e2c59'} Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 could not be found. Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 could not be found. Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:47.263851 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 could not be found. Sep 19 14:56:47.268405 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:47.270876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Returning 404 to user: Instance a1c383f3-68ef-407c-b7fa-a0173b3e2c59 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:47.271762 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a4109690-a726-412a-aa97-e9420992f396 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59" status: 404 len: 111 microversion: 2.1 time: 0.103666 Sep 19 14:56:47.275180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1710/3446] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:47 2022] GET /compute/v2.1/servers/a1c383f3-68ef-407c-b7fa-a0173b3e2c59 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:56:47.288684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.289250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.296435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.297170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.297994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.298951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.300236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.302839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.401611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:47.550918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.562670 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-683b1b7e-1a84-462c-8f11-5fbb2eff3d83 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.413768 Sep 19 14:56:47.581474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1737/3447] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:47 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:47.593059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.600044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.612075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.613617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.620170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.620640 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90248101-7096-4b0e-8e75-ada9942248c2 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 204 len: 0 microversion: 2.1 time: 0.337745 Sep 19 14:56:47.623373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.630029 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1711/3448] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:47 2022] DELETE /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:56:47.635628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.636999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.639488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.639934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.663488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.664460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.665230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.666258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.666735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.667836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.317754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.330127 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-22e20d96-0474-4dd7-8edd-066cc600a635 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1518 microversion: 2.1 time: 0.695614 Sep 19 14:56:48.333948 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1712/3449] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:47 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1518 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:48.347998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:48.365290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:48.393642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.394234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.394661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.395443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.395974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.396376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.492092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.518877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.536202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.538542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5e5fdd8-f704-44ac-91d7-829eb57700e6 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.955552 Sep 19 14:56:48.578520 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1738/3450] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:47 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:48.587344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:48.590445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:48.606821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.607909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.608897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.611190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.612641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.613845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.893939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.911598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.913965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.916979 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a232e50c-1344-407c-b52e-69f56f4d9b54 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1552 microversion: 2.21 time: 0.579913 Sep 19 14:56:48.921316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1713/3451] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:48 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1552 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:48.942181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:48.943065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:48.966053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.969546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.973081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.981267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.981963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.982433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.992742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:49.007695 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06d2f9f8-fde9-4459-8810-b9c11f6ad59a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.441009 Sep 19 14:56:49.008336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1739/3452] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:48 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:49.034081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b77e4560-6a75-4fef-9ca8-4abdeb4d4229 req-7aa94893-fe27-41b4-8867-2ebae90eb644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-plugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:49.063712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b77e4560-6a75-4fef-9ca8-4abdeb4d4229 req-7aa94893-fe27-41b4-8867-2ebae90eb644 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.067365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b77e4560-6a75-4fef-9ca8-4abdeb4d4229 req-7aa94893-fe27-41b4-8867-2ebae90eb644 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.069329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b77e4560-6a75-4fef-9ca8-4abdeb4d4229 req-7aa94893-fe27-41b4-8867-2ebae90eb644 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.104961 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b77e4560-6a75-4fef-9ca8-4abdeb4d4229 req-7aa94893-fe27-41b4-8867-2ebae90eb644 service nova] Creating event network-vif-plugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:56:49.111091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b77e4560-6a75-4fef-9ca8-4abdeb4d4229 req-7aa94893-fe27-41b4-8867-2ebae90eb644 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094120 Sep 19 14:56:49.117615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1740/3453] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:49.135214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:49.136086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:49.148722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.150589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.152174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.156293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.157165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.158960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.231501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:49.498106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a523326a-00ae-48d7-a65d-4409f5958012 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 204 len: 0 microversion: 2.21 time: 0.378654 Sep 19 14:56:49.499039 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1741/3454] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:56:49 2022] DELETE /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:56:49.507632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:49.508642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:49.522674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.525365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.532884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.534076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.534919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.535533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.546877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:49.566214 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-436ea4aa-3569-49c1-a1ae-cf0b0214aec9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.626782 Sep 19 14:56:49.567292 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1714/3455] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:48 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:49.604522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:49.612754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:49.637740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.638643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.639342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.646551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.647869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.651576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.145096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.165333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b83d16f2-b46d-4b56-9f83-d67af40dde68 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1518 microversion: 2.1 time: 0.664761 Sep 19 14:56:50.166362 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1742/3456] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:49 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1518 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:50.213154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:50.214342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:50.255196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.255747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.256416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.257246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.260294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.261082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.344311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.364786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.369177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.383936 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d10cce02-afc1-4f74-97aa-be05f479b8cf tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1558 microversion: 2.21 time: 0.798377 Sep 19 14:56:50.384873 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1715/3457] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:49 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1558 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:50.402927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:50.406287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:50.434413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.435371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.436055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.437254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.454896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.455741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:51.360620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:51.386362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:51.394262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:51.403008 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d97922f4-f876-42ba-9668-18f27e3efa7c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.220926 Sep 19 14:56:51.423972 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1743/3458] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:50 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:51.440223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:51.456731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:51.473144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:51.475327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:51.479481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:51.480776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:51.483256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:51.490017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:51.825564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:51.843930 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d877710-8ec9-476c-8019-5417d2e92fff tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 1.456921 Sep 19 14:56:51.846116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1716/3459] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:50 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:51.860486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:51.861350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:51.874510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:51.880409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:51.881196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:51.884308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:51.890418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:51.893717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:52.759358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:52.797009 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08958fb9-9ba3-4e43-90f9-96ce25e19018 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 1.372288 Sep 19 14:56:52.801149 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1744/3460] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:51 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:52.828435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:52.830763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:52.832800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:52.846382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b8c1bc5-1257-4145-a29b-1844140b0047 tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1518 microversion: 2.1 time: 0.998718 Sep 19 14:56:52.859730 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1717/3461] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:51 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1518 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:52.865124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:52.872510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:52.874130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:52.882281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:52.888073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:52.889470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:52.889900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:52.892530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:52.898398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:52.901329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:52.902011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:52.902967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:52.903599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:52.904349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.222204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.283352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.286500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.307302 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88bd5635-c9d3-438d-a10b-2ff2fb0fb1b2 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1558 microversion: 2.21 time: 1.504127 Sep 19 14:56:54.308432 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1745/3462] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:52 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1558 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:54.325019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:54.326699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:54.342451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.344353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.345811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.347471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.348613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.349011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.350723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.382788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:54.420455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.459628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.460970 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f73f392f-5d9e-43c4-9f1b-d2703fb328ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.594340 Sep 19 14:56:54.478476 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1718/3463] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:52 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:54.548422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:54.562647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:54.592139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.598215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.599160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.600924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.602291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.603062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.725480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.755775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b0c2cfc-dcda-41ff-ae07-e053dcf01975 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.442512 Sep 19 14:56:54.807107 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1746/3464] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:54 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:54.840345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:54.843016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:54.874164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.879678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.880247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.883251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.886049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.887218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.068811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.070856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.072576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.074678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lazy-loading 'fault' on Instance uuid 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:55.435275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:55.460328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438ade508fb547f5aadac70380369f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb919abeddc47a189d651c513d1e543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:55.467833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-159a7c31-a3ba-40c8-8180-3e049a30aa04 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.987993 Sep 19 14:56:55.483191 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1719/3465] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:54 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:55.487170 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14036a8c-b685-458b-ac9d-96979013949b tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 200 len: 1311 microversion: 2.1 time: 0.676989 Sep 19 14:56:55.490992 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1747/3466] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:54 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 1311 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:55.505769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ecce000e-67c9-4008-b594-de756e8d1283 req-a57c8ab7-3172-4fec-86de-cf1820a1c547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eaef1d0-edbb-4ded-9e94-0610bb4f2b67", "name": "network-vif-deleted", "tag": "95e3787f-59aa-49f8-86c6-a3816d8489d9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:55.514099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ea80b7ef-4b3b-4e68-816e-fd99c61aadea req-f48f45ac-f094-44d2-a842-6500ce116bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a36b59b-aae7-40af-b867-87174e49a747", "name": "network-vif-deleted", "tag": "4b51d3ab-8031-406d-94a0-7379b4b899f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:55.556049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ecce000e-67c9-4008-b594-de756e8d1283 req-a57c8ab7-3172-4fec-86de-cf1820a1c547 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.557512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ecce000e-67c9-4008-b594-de756e8d1283 req-a57c8ab7-3172-4fec-86de-cf1820a1c547 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.560217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ecce000e-67c9-4008-b594-de756e8d1283 req-a57c8ab7-3172-4fec-86de-cf1820a1c547 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.566072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ea80b7ef-4b3b-4e68-816e-fd99c61aadea req-f48f45ac-f094-44d2-a842-6500ce116bd8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.568359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ea80b7ef-4b3b-4e68-816e-fd99c61aadea req-f48f45ac-f094-44d2-a842-6500ce116bd8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.570168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ea80b7ef-4b3b-4e68-816e-fd99c61aadea req-f48f45ac-f094-44d2-a842-6500ce116bd8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.611146 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ecce000e-67c9-4008-b594-de756e8d1283 req-a57c8ab7-3172-4fec-86de-cf1820a1c547 service nova] Creating event network-vif-deleted:95e3787f-59aa-49f8-86c6-a3816d8489d9 for instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 on n-h2-858384-1 Sep 19 14:56:55.620406 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ea80b7ef-4b3b-4e68-816e-fd99c61aadea req-f48f45ac-f094-44d2-a842-6500ce116bd8 service nova] Creating event network-vif-deleted:4b51d3ab-8031-406d-94a0-7379b4b899f4 for instance 8a36b59b-aae7-40af-b867-87174e49a747 on n-h1-858384-1 Sep 19 14:56:55.629712 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ecce000e-67c9-4008-b594-de756e8d1283 req-a57c8ab7-3172-4fec-86de-cf1820a1c547 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140835 Sep 19 14:56:55.630333 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1720/3467] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:55.639153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ea80b7ef-4b3b-4e68-816e-fd99c61aadea req-f48f45ac-f094-44d2-a842-6500ce116bd8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141611 Sep 19 14:56:55.642342 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1748/3468] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:55.659729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:55.661293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:55.670632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:55.675148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:55.696418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.698292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.700896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.701096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.701560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.701894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.702087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.702520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.702707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.705343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.706805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.707268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.880532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.884910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.885458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.885940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lazy-loading 'fault' on Instance uuid 8a36b59b-aae7-40af-b867-87174e49a747 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:56.128840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.158070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.170264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c5dbf1dce854737a32a1fe9d3e2166f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c74bdcdf46400886daeb2107b4f3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.183628 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-153731a0-6386-42c9-8b54-7f713e7b7424 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 200 len: 1349 microversion: 2.21 time: 0.539229 Sep 19 14:56:56.192814 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1749/3469] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:55 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 1349 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:56.211657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:56.218264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:56.251817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.258189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.264172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.273340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.275335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.277610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.501383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.519281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.530121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.535778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-663c20a5-0d30-4ee9-9c37-d88474a63d78 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.889746 Sep 19 14:56:56.538896 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1721/3470] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:55 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:56.552434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:56.553562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] [instance: 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:56.576611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.578166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.579777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.581398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.582876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.586003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.624179 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] HTTP exception thrown: Instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 could not be found. Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Request method failure captured: Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 HTTP/1.1 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIK8eW2brUJyvJXT7EVmhCldgU07bOvb7xIyiSZvi93ljWYVswIwBmn10YmraUSRT6_JNlVvDJ8UqF-jbeIq-MqSs3WFVW24IM8l0yzWjQBRcml9uDB56THJXQ2xeuDEqv1yHkwYBaS1bSx2FIKEKiNDU1HbAvMt8fhDNSK88i2jWR0 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: deb919abeddc47a189d651c513d1e543 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_deb919abeddc47a189d651c513d1e543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/deb919abeddc47a189d651c513d1e543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/deb919abeddc47a189d651c513d1e543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/deb919abeddc47a189d651c513d1e543"}]}] Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: deb919abeddc47a189d651c513d1e543 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1237788820 Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ListServerFiltersTestJSON-1237788820-project Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 438ade508fb547f5aadac70380369f4a Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ListServerFiltersTestJSON-1237788820-project Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 could not be found. Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2eaef1d0-edbb-4ded-9e94-0610bb4f2b67'} Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 could not be found. Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 could not be found. Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:56.628111 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 could not be found. Sep 19 14:56:56.631490 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:56.638077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] Returning 404 to user: Instance 2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:56.643269 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae017e9b-d14a-426b-88be-fdede3ff5c5f tempest-ListServerFiltersTestJSON-1237788820 tempest-ListServerFiltersTestJSON-1237788820-project] 10.222.0.81 "GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67" status: 404 len: 111 microversion: 2.1 time: 0.102730 Sep 19 14:56:56.655561 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1722/3471] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:56 2022] GET /compute/v2.1/servers/2eaef1d0-edbb-4ded-9e94-0610bb4f2b67 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:56:56.662000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:56.670683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:56.697759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.698282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.698726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.699493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.701471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.703400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.178977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:57.191947 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdc1bd51-e000-474d-adee-be23eb2b3d8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.996974 Sep 19 14:56:57.198266 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1750/3472] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:56 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:57.224348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:57.225799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:57.242209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.244039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.247470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.248706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.249368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.256260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.300319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] HTTP exception thrown: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Request method failure captured: Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 HTTP/1.1 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIMWoK0oVAa-tErfi0MtDF3mqxuJ0ylqda-1KApzGxvs2LIGA4kPZREXQlWbtROsjsS6p9ttC9XDmY0iDKQwplvacG6odE0M93KCyD8U91yZWLQD1AN5Xv6eJd17SUsR4Iy6ieVTuO4Ysu0F2_NjptMSMJh9nh1hwYXwupRUz0SoZVo Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.21 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e8c74bdcdf46400886daeb2107b4f3c0 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8c74bdcdf46400886daeb2107b4f3c0"}]}] Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e8c74bdcdf46400886daeb2107b4f3c0 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-InstanceActionsV221TestJSON-1181382082-project Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3c5dbf1dce854737a32a1fe9d3e2166f Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-InstanceActionsV221TestJSON-1181382082-project Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '8a36b59b-aae7-40af-b867-87174e49a747'} Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.303615 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.311284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Returning 404 to user: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:57.319031 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6711b41e-3a52-4cad-b6e3-93a2eb906d30 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 404 len: 111 microversion: 2.21 time: 0.097771 Sep 19 14:56:57.320353 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1751/3473] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:57 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:56:57.331123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '.version_select at 0x7fde290103a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:57.335061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:57.358600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.362719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.364451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.371144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.376234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.377556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.417749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:57.432024 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-334bd966-a9e9-4310-b7eb-e0b8a9aa1f6e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1510 microversion: 2.1 time: 0.774672 Sep 19 14:56:57.435664 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1723/3474] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:56 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:57.573711 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-98399bb8-59b3-4fa2-84b3-64c52fbfa769 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.247933 Sep 19 14:56:57.581628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1752/3475] 10.222.0.81 () {60 vars in 1337 bytes} [Mon Sep 19 14:56:57 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747/os-instance-actions => generated 611 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:56:57.590171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:57.590718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:57.598906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.599418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.605885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:57.606252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:57.609247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.610859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.614803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.617745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.637902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.638432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.638950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.639881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.640485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.640956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.683233 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] HTTP exception thrown: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Request method failure captured: Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 HTTP/1.1 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIMWoK0oVAa-tErfi0MtDF3mqxuJ0ylqda-1KApzGxvs2LIGA4kPZREXQlWbtROsjsS6p9ttC9XDmY0iDKQwplvacG6odE0M93KCyD8U91yZWLQD1AN5Xv6eJd17SUsR4Iy6ieVTuO4Ysu0F2_NjptMSMJh9nh1hwYXwupRUz0SoZVo Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.21 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e8c74bdcdf46400886daeb2107b4f3c0 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8c74bdcdf46400886daeb2107b4f3c0"}]}] Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e8c74bdcdf46400886daeb2107b4f3c0 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-InstanceActionsV221TestJSON-1181382082-project Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3c5dbf1dce854737a32a1fe9d3e2166f Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-InstanceActionsV221TestJSON-1181382082-project Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '8a36b59b-aae7-40af-b867-87174e49a747'} Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:57.685192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.689010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Returning 404 to user: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:57.690972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f1092d5-1614-4a3f-a08c-9542184ef597 tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 404 len: 111 microversion: 2.21 time: 0.100870 Sep 19 14:56:57.695286 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1724/3476] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:56:57 2022] DELETE /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:56:57.710365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:57.711101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] [instance: 8a36b59b-aae7-40af-b867-87174e49a747] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:57.745441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.761985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.761985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.761985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.762205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.762545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.826820 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] HTTP exception thrown: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Request method failure captured: Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 HTTP/1.1 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIMWoK0oVAa-tErfi0MtDF3mqxuJ0ylqda-1KApzGxvs2LIGA4kPZREXQlWbtROsjsS6p9ttC9XDmY0iDKQwplvacG6odE0M93KCyD8U91yZWLQD1AN5Xv6eJd17SUsR4Iy6ieVTuO4Ysu0F2_NjptMSMJh9nh1hwYXwupRUz0SoZVo Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.21 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e8c74bdcdf46400886daeb2107b4f3c0 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8c74bdcdf46400886daeb2107b4f3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8c74bdcdf46400886daeb2107b4f3c0"}]}] Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e8c74bdcdf46400886daeb2107b4f3c0 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1181382082 Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-InstanceActionsV221TestJSON-1181382082-project Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3c5dbf1dce854737a32a1fe9d3e2166f Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-InstanceActionsV221TestJSON-1181382082-project Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '8a36b59b-aae7-40af-b867-87174e49a747'} Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.838088 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. Sep 19 14:56:57.842733 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:56:57.846570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] Returning 404 to user: Instance 8a36b59b-aae7-40af-b867-87174e49a747 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:57.849785 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c7ad5ca-c07d-4af9-a598-e26580a2b2be tempest-InstanceActionsV221TestJSON-1181382082 tempest-InstanceActionsV221TestJSON-1181382082-project] 10.222.0.81 "GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747" status: 404 len: 111 microversion: 2.21 time: 0.153316 Sep 19 14:56:57.856128 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1725/3477] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:57 2022] GET /compute/v2.1/servers/8a36b59b-aae7-40af-b867-87174e49a747 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:56:58.245908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:58.246978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:58.263671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:58.264190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:58.264645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:58.265385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:58.265844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:58.271151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:58.634243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:58.658377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:58.660859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:58.662169 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c7f145dc-00b3-436e-b8ef-3a92f8cfd25c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.060754 Sep 19 14:56:58.662731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1753/3478] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:57 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:58.688737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:58.689549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:58.724608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:58.725206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:58.725780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:58.726624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:58.727190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:58.727876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.198647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:59.223219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed69861d-6c99-4866-aada-589867a9d848 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.978924 Sep 19 14:56:59.226910 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1726/3479] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:58 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:59.528014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:59.595720 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b81de9a7-5189-42aa-b05a-4b299f5f8c53 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1487 microversion: 2.1 time: 0.913656 Sep 19 14:56:59.612177 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1754/3480] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:58 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1487 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:59.659942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:59.660515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:59.673291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:59.673291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:59.673291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.674418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:59.674913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:59.675343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.711199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:59.712119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:59.726974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:59.728106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:59.729771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.731119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:59.733982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:59.737030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.749649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:59.801592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:00.065511 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a406f4b-a21d-48fb-8ecc-e94d35e6224d tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 204 len: 0 microversion: 2.1 time: 0.410184 Sep 19 14:57:00.066874 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1727/3481] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:59 2022] DELETE /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:57:00.084394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:00.085551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:00.108392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:00.111219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:00.111939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:00.112910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:00.113598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:00.114231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:00.640143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.665779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.670081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.678580 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7c35b0fc-66b4-44d4-af5c-5c4546d0605f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.973559 Sep 19 14:57:00.679516 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1755/3482] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:59 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:00.697906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:00.701297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:00.721730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:00.723734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:00.725482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:00.735537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:00.738950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:00.739602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:00.755283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.775492 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0d30588-8599-4cf8-a648-2f718002384a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1493 microversion: 2.1 time: 0.701257 Sep 19 14:57:00.794891 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1728/3483] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:00 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1493 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:01.446789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:01.459660 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdca3a50-abb9-4b15-8df9-299c2828672b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.767560 Sep 19 14:57:01.471351 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1756/3484] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:00 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:01.734166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:01.735582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:01.752891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:01.753409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:01.753859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:01.761778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:01.765719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:01.770926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:01.828160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:01.830441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:01.840932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:01.849604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:01.850552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:01.851210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:01.851684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:01.852115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:03.029122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.057530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83c8156a-e4e1-4d86-94a8-dc86f05e6b24 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1493 microversion: 2.1 time: 1.226599 Sep 19 14:57:03.059817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1757/3485] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:01 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1493 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:03.068940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:03.075123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.079766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:03.096891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.099143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.100676 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c27b498-6f0f-45bc-9d1e-4c4e84182a50 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.370735 Sep 19 14:57:03.101804 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1729/3486] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:01 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:03.105875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:03.106388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:03.106862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:03.107603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:03.108080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:03.108514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:03.449474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.462100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b1ee4d5-98ac-406d-9434-578fcdad50c6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.400338 Sep 19 14:57:03.468675 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1758/3487] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:03 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:04.099022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:04.104500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:04.147746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.156280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.157461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:04.159069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:04.161998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:04.174162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.175075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.175778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:04.191371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.191794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.196244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:04.199514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.201886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.202405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:05.681622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.729244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.742428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.749871 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0cc6d7c2-e58b-4cb6-9e6b-b1ceeb8624d9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.612322 Sep 19 14:57:05.756739 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1759/3488] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:04 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:05.778965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:05.779901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:05.825314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:05.830591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:05.831949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:05.837085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:05.839489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:05.841933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:05.909263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.947543 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-49eaf7e2-2e0f-43f7-955a-2fdb2c5c3119 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1493 microversion: 2.1 time: 1.864583 Sep 19 14:57:05.954386 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1730/3489] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:04 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1493 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:05.992550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8e99789a-16f9-4d9f-a5cb-f217c3e988c7 req-534bbdda-90aa-4763-9320-00072291f732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7a8d3e-13e9-4b65-b10f-0de96c9eb168", "name": "network-vif-unplugged", "status": "completed", "tag": "8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:06.075922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e99789a-16f9-4d9f-a5cb-f217c3e988c7 req-534bbdda-90aa-4763-9320-00072291f732 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.079113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e99789a-16f9-4d9f-a5cb-f217c3e988c7 req-534bbdda-90aa-4763-9320-00072291f732 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.080652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e99789a-16f9-4d9f-a5cb-f217c3e988c7 req-534bbdda-90aa-4763-9320-00072291f732 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.200022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8e99789a-16f9-4d9f-a5cb-f217c3e988c7 req-534bbdda-90aa-4763-9320-00072291f732 service nova] Creating event network-vif-unplugged:8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7 for instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 on n-h1-858384-1 Sep 19 14:57:06.248632 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8e99789a-16f9-4d9f-a5cb-f217c3e988c7 req-534bbdda-90aa-4763-9320-00072291f732 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.289312 Sep 19 14:57:06.255281 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1731/3490] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:06.527828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:06.543499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa75944c-09db-4848-8a98-69ab08b55db5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.781896 Sep 19 14:57:06.548075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1760/3491] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:05 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:06.826734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:06.837292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:06.845415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9952a736-957b-4fe1-a92e-87d85bcf8f4e req-226b117a-2f7a-4d02-8411-141ec68a274c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7a8d3e-13e9-4b65-b10f-0de96c9eb168", "name": "network-vif-deleted", "tag": "8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:06.898965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.899894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.900674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.902088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.926540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.927467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9952a736-957b-4fe1-a92e-87d85bcf8f4e req-226b117a-2f7a-4d02-8411-141ec68a274c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.936484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.936744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9952a736-957b-4fe1-a92e-87d85bcf8f4e req-226b117a-2f7a-4d02-8411-141ec68a274c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.939652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9952a736-957b-4fe1-a92e-87d85bcf8f4e req-226b117a-2f7a-4d02-8411-141ec68a274c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.977237 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9952a736-957b-4fe1-a92e-87d85bcf8f4e req-226b117a-2f7a-4d02-8411-141ec68a274c service nova] Creating event network-vif-deleted:8d98bcaa-a8ff-4b59-a30a-e363fa9d15a7 for instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 on n-h1-858384-1 Sep 19 14:57:06.998050 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9952a736-957b-4fe1-a92e-87d85bcf8f4e req-226b117a-2f7a-4d02-8411-141ec68a274c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190640 Sep 19 14:57:07.002591 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1732/3492] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:07.026941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:07.030887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:07.054097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:07.055574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:07.056027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:07.062116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:07.063006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:07.070781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:07.182068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:07.190537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:07.191968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:07.195970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lazy-loading 'fault' on Instance uuid dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:07.772313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:07.784037 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-24c1ea3c-f40e-4dbf-a0d9-7e31a51d4e80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 200 len: 1304 microversion: 2.1 time: 0.779746 Sep 19 14:57:07.789119 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1733/3493] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:07 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 1304 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:07.794912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:07.795791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:07.810233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:07.811013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:07.811828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:07.813405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:07.817457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:07.826401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:08.252835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:08.280840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:08.287250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:08.296369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78769ba8-7404-46ba-a4f8-77be2f8faf7f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.470495 Sep 19 14:57:08.297798 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1761/3494] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:06 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:08.815202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:08.815832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:08.841367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:08.847066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:08.847815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:08.848621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:08.851846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:08.853344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:08.910060 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 HTTP/1.1 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dd7a8d3e-13e9-4b65-b10f-0de96c9eb168'} Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:08.913968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:08.917889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12f9f3b2-1aff-443c-af33-e10915fec086 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 404 len: 111 microversion: 2.1 time: 0.108731 Sep 19 14:57:08.938547 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1762/3495] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:08 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:09.357411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:09.362795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:09.381486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:09.383479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:09.384148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:09.388406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:09.389303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:09.392105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:09.495711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:09.548451 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-db186a70-8c73-4bdb-afe8-2497d9fa45c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 1.757536 Sep 19 14:57:09.569609 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1734/3496] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:07 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:09.742648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1697188179", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a3860800-0239-4ff7-9fa5-44e4404f99fd"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:09.988232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:10.038832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] validate_networks() for [('a3860800-0239-4ff7-9fa5-44e4404f99fd', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:57:10.041784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:10.055205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:10.056567 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-727263cd-ace4-4758-81d4-3cb7e375d760 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.703761 Sep 19 14:57:10.069267 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1763/3497] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:09 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:10.601011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:10.602969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:10.621089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:10.622033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:10.622840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:10.628589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:10.633101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:10.634164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:10.675043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:12.421336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:12.449287 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ee001ac-3cc3-4391-b27f-a86b81803ef7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 1.854736 Sep 19 14:57:12.477257 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1764/3498] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:10 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:12.492126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:12.493029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:12.536122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:12.537082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:12.542114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:12.543857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:12.545266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:12.545931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:12.763084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:57:12.763084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:57:12.763084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:57:12.763084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:57:12.763084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:57:12.780746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:12.781923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:12.782713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:12.789039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:12.801622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:12.804463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:12.873666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:12.888278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Getting quotas for user b11c9d1fbd13473cae53ad6a0bd88a16 and project 105493fbe2db422182705ff49783bd47. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:12.947483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:57:12.954698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:57:13.101477 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-29a2ed29-2858-43d3-831f-fa80be6937f6 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.365875 Sep 19 14:57:13.108912 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1735/3499] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:57:13.115403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ebb47faa-62e4-4cf3-bbbf-0789188c30d7 req-4bdbc829-855f-4c84-b9ce-9584439bb1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "a77e244a-300f-4a14-bf87-f3c421b61828"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:13.136837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ebb47faa-62e4-4cf3-bbbf-0789188c30d7 req-4bdbc829-855f-4c84-b9ce-9584439bb1ca service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:13.137979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ebb47faa-62e4-4cf3-bbbf-0789188c30d7 req-4bdbc829-855f-4c84-b9ce-9584439bb1ca service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:13.138989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ebb47faa-62e4-4cf3-bbbf-0789188c30d7 req-4bdbc829-855f-4c84-b9ce-9584439bb1ca service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:13.173288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ebb47faa-62e4-4cf3-bbbf-0789188c30d7 req-4bdbc829-855f-4c84-b9ce-9584439bb1ca service nova] Creating event network-vif-plugged:a77e244a-300f-4a14-bf87-f3c421b61828 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:13.188872 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ebb47faa-62e4-4cf3-bbbf-0789188c30d7 req-4bdbc829-855f-4c84-b9ce-9584439bb1ca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076484 Sep 19 14:57:13.192127 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1736/3500] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:13.204574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-246d8ce7-c27f-432a-bcdc-5ac0223232fb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:13.207179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-246d8ce7-c27f-432a-bcdc-5ac0223232fb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:14.191605 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 14:57:14.192299 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 14:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 (ip 10.222.0.81) !!! Sep 19 14:57:14.379996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:14.451219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:14.470476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:14.484524 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cd639fff-7efd-400d-9211-eeb097dc609c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.997028 Sep 19 14:57:14.500946 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1765/3501] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:12 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:14.547499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:14.552053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:14.590003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:14.592693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:14.595275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:14.598931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:14.600526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:14.602974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:14.743120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-246d8ce7-c27f-432a-bcdc-5ac0223232fb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:14.763673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-246d8ce7-c27f-432a-bcdc-5ac0223232fb tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1215 microversion: 2.1 time: 1.569116 Sep 19 14:57:14.764657 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1737/3502] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:13 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1215 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:15.271289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:15.284861 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-63ca1c9c-0fc2-420d-9bf0-8ae5215e7c49 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.778357 Sep 19 14:57:15.288628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1766/3503] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:14 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:15.524080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:15.525667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:15.531619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:15.541437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:15.542797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:15.543469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:15.544613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:15.545800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:15.546509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:15.599483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "1136625f-c20a-4c3e-98e9-84b81ba8b47a"}, {"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "201449fa-941f-4331-8159-9877f2e2fa2e"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:15.629355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:15.630172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:15.630858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:15.672719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] Creating event network-vif-plugged:1136625f-c20a-4c3e-98e9-84b81ba8b47a for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:15.676979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] Creating event network-vif-plugged:201449fa-941f-4331-8159-9877f2e2fa2e for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:15.694196 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d5fd74c8-fb80-4e0f-9dbe-7222bd2eb44b req-8ac5a683-042d-4aa5-9945-203436b476e5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098670 Sep 19 14:57:15.697134 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1767/3504] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:15.820157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:15.821474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:15.861103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:15.867488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:15.868461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:15.869406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:15.871324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:15.872062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:15.984742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:16.011996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:16.021456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:16.023671 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f50cb0f2-f572-4761-bc81-9ab4190e51ac tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.505137 Sep 19 14:57:16.029659 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1738/3505] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:15 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:16.338724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:16.339273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:16.356635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:16.357297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:16.357964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:16.359388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:16.360741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:16.361390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:17.001921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:17.058244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b5b52dc-6072-4d3c-a349-2c3441e5b713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 0.711948 Sep 19 14:57:17.059330 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1739/3506] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:16 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:17.074797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:17.079606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:17.100260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:17.101302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:17.102473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:17.103487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:17.104160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:17.105127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:17.614410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:17.629565 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6352e3cf-5777-42a1-9c4c-d0360f5ad0dc tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1267 microversion: 2.1 time: 1.814052 Sep 19 14:57:17.650008 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1768/3507] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:15 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1267 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:17.904069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:17.933760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f348ebc6-9276-464a-bb57-6dc702cb69f2 req-2434abb3-0801-4504-b6a5-f2cc1ab5cc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "914dde40-c1af-492e-9957-c5c125c07414"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:17.979725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:17.984860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:17.994641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:17.995688 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f4faf97-a0c5-4d08-a8f2-3d225f947320 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.923571 Sep 19 14:57:18.014798 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1740/3508] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:17 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:18.028196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f348ebc6-9276-464a-bb57-6dc702cb69f2 req-2434abb3-0801-4504-b6a5-f2cc1ab5cc06 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.039474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f348ebc6-9276-464a-bb57-6dc702cb69f2 req-2434abb3-0801-4504-b6a5-f2cc1ab5cc06 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.044350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f348ebc6-9276-464a-bb57-6dc702cb69f2 req-2434abb3-0801-4504-b6a5-f2cc1ab5cc06 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:18.121084 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f348ebc6-9276-464a-bb57-6dc702cb69f2 req-2434abb3-0801-4504-b6a5-f2cc1ab5cc06 service nova] Creating event network-vif-plugged:914dde40-c1af-492e-9957-c5c125c07414 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:18.129616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:18.135922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:18.159409 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f348ebc6-9276-464a-bb57-6dc702cb69f2 req-2434abb3-0801-4504-b6a5-f2cc1ab5cc06 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235070 Sep 19 14:57:18.160288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.161519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.162598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:18.165056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.166247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.167858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:18.170545 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1769/3509] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:18.690795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:18.695469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:18.720658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.724527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.725130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:18.726023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.726628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.728064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:19.412627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:19.430048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-acd486ce-81fb-4c6b-bb91-3239018915d9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1273 microversion: 2.1 time: 0.759043 Sep 19 14:57:19.447493 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1770/3510] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:18 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1273 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:19.458340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:19.465357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:19.474327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:19.475276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:19.475981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:19.476975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:19.477998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:19.478681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:20.207326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:20.226284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:20.240659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:20.250612 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ebb1120-4017-4537-8d8c-95caa610e349 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 0.800751 Sep 19 14:57:20.251652 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1771/3511] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:19 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:20.262583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e3a38bee-7ee2-4320-b2da-765198ade54e req-a55efd94-7a9f-4358-b0fa-a320c67aee06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "95a73885-50f4-4435-8dc5-1e8e276383da"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:20.283446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e3a38bee-7ee2-4320-b2da-765198ade54e req-a55efd94-7a9f-4358-b0fa-a320c67aee06 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:20.284140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e3a38bee-7ee2-4320-b2da-765198ade54e req-a55efd94-7a9f-4358-b0fa-a320c67aee06 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:20.284761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e3a38bee-7ee2-4320-b2da-765198ade54e req-a55efd94-7a9f-4358-b0fa-a320c67aee06 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:20.308560 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e3a38bee-7ee2-4320-b2da-765198ade54e req-a55efd94-7a9f-4358-b0fa-a320c67aee06 service nova] Creating event network-vif-plugged:95a73885-50f4-4435-8dc5-1e8e276383da for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:20.320295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:20.326697 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e3a38bee-7ee2-4320-b2da-765198ade54e req-a55efd94-7a9f-4358-b0fa-a320c67aee06 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069774 Sep 19 14:57:20.334397 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1772/3512] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:20.349858 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cabaf6cf-cbef-418a-88ad-7ea1ccca8e10 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1681 microversion: 2.1 time: 2.224746 Sep 19 14:57:20.353471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1741/3513] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:18 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1681 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:20.463480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:20.464675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:20.488521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:20.489490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:20.492738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:20.494343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:20.495240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:20.496113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:20.660695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:20.677528 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f998c45-2984-48bc-8c8d-dc86f0376c6c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1273 microversion: 2.1 time: 0.218483 Sep 19 14:57:20.696223 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1773/3514] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:20 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:21.309162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:21.310090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:21.335618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:21.338208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:21.341008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:21.345319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:21.349633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:21.350596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:21.409593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:21.410231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:21.435922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:21.436686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:21.445103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:21.446176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:21.446919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:21.447579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.341597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:22.401432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:22.411120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:22.418933 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03a0e9b7-a436-4130-aab0-3f95dde6b305 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.114016 Sep 19 14:57:22.431693 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1742/3515] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:21 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:22.449834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:22.451014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:22.461936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.462934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.464231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.465297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.466087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.466740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.623730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:22.640699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57fd1c2a-726a-480f-ae36-0661d4e88283 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.238455 Sep 19 14:57:22.644945 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1774/3516] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:21 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:22.660152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ed78bfe0-20a6-4f4c-8481-e8dbe0d42a4a req-2e91e580-ae91-4515-aa94-81702a7e42a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "375020e1-94f4-4661-8ee8-6df96d799595"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:22.708493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:22.717901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed78bfe0-20a6-4f4c-8481-e8dbe0d42a4a req-2e91e580-ae91-4515-aa94-81702a7e42a2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.719198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed78bfe0-20a6-4f4c-8481-e8dbe0d42a4a req-2e91e580-ae91-4515-aa94-81702a7e42a2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.719810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed78bfe0-20a6-4f4c-8481-e8dbe0d42a4a req-2e91e580-ae91-4515-aa94-81702a7e42a2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.735628 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-790b425f-23de-4694-8405-9ec616e6032b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1273 microversion: 2.1 time: 0.301850 Sep 19 14:57:22.739827 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1743/3517] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:22 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:22.773688 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ed78bfe0-20a6-4f4c-8481-e8dbe0d42a4a req-2e91e580-ae91-4515-aa94-81702a7e42a2 service nova] Creating event network-vif-plugged:375020e1-94f4-4661-8ee8-6df96d799595 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:22.803007 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ed78bfe0-20a6-4f4c-8481-e8dbe0d42a4a req-2e91e580-ae91-4515-aa94-81702a7e42a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151024 Sep 19 14:57:22.806413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1775/3518] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:22.836971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:22.838737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:22.851307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:22.868266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.868786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.869237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.870005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.870488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.882649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:23.458089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:23.459294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:23.470455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:23.471381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:23.473209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:23.475490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:23.476224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:23.477158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:23.898029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:23.912052 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fcca635c-29de-42f4-91a3-976e8bf1729a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.081659 Sep 19 14:57:23.913600 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1744/3519] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:22 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:23.922502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:23.923728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:23.970474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:23.971801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:23.972845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:23.974434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:23.975951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:23.977562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:24.751529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:24.792113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:24.794305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:24.817442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:24.826402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:24.835516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee8ed94d-b125-4e34-84c5-edef724588e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.384198 Sep 19 14:57:24.850816 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1776/3520] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:23 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:24.851025 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82ba061d-f03d-4b3b-b013-5e114c1e74e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 0.931584 Sep 19 14:57:24.851025 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1745/3521] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:23 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:24.905795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-72bfd35e-c7eb-4686-beca-81b77f7dbd2e req-73ce1985-c3a4-4fe5-b975-fdf5de5afb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-plugged", "status": "completed", "tag": "07930525-c004-4fe4-8a21-9279e964fae1"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:24.943942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-72bfd35e-c7eb-4686-beca-81b77f7dbd2e req-73ce1985-c3a4-4fe5-b975-fdf5de5afb6b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:24.947272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-72bfd35e-c7eb-4686-beca-81b77f7dbd2e req-73ce1985-c3a4-4fe5-b975-fdf5de5afb6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:24.949385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-72bfd35e-c7eb-4686-beca-81b77f7dbd2e req-73ce1985-c3a4-4fe5-b975-fdf5de5afb6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:25.010471 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-72bfd35e-c7eb-4686-beca-81b77f7dbd2e req-73ce1985-c3a4-4fe5-b975-fdf5de5afb6b service nova] Creating event network-vif-plugged:07930525-c004-4fe4-8a21-9279e964fae1 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:25.045064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-72bfd35e-c7eb-4686-beca-81b77f7dbd2e req-73ce1985-c3a4-4fe5-b975-fdf5de5afb6b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142114 Sep 19 14:57:25.048920 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1777/3522] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:25.895341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:25.900310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:25.902839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:25.909393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:25.986416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:25.988641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:25.989026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:25.990845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:25.994536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:25.995005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:25.995510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:25.996315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.001773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.007521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.009104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.010252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.072460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:26.817507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:26.832850 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c880a967-9f5e-47b2-b2ad-4302fa7f556c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 0.958227 Sep 19 14:57:26.851162 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1778/3523] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:25 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:26.906119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:26.950298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:26.954421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:26.957437 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c30805fd-da49-45d0-8a0f-b4c78d89ac76 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1873 microversion: 2.32 time: 1.091280 Sep 19 14:57:26.959417 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1746/3524] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:25 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1873 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:27.229907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-574182f9-b312-435a-9d33-b745291a46c6 req-7035fe07-1fff-43fa-843b-dbe2e3eeddbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-unplugged", "status": "completed", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:27.260935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-574182f9-b312-435a-9d33-b745291a46c6 req-7035fe07-1fff-43fa-843b-dbe2e3eeddbc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.261602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-574182f9-b312-435a-9d33-b745291a46c6 req-7035fe07-1fff-43fa-843b-dbe2e3eeddbc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.261847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-574182f9-b312-435a-9d33-b745291a46c6 req-7035fe07-1fff-43fa-843b-dbe2e3eeddbc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.309471 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-574182f9-b312-435a-9d33-b745291a46c6 req-7035fe07-1fff-43fa-843b-dbe2e3eeddbc service nova] Creating event network-vif-unplugged:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 14:57:27.320623 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-574182f9-b312-435a-9d33-b745291a46c6 req-7035fe07-1fff-43fa-843b-dbe2e3eeddbc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094821 Sep 19 14:57:27.323093 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1779/3525] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:27.445927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:27.447586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:27.461699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.462586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.463436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.464606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.465397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.466054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.877529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:27.880094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:27.915916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.915916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.916402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.917539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.938586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.944237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:28.507870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:28.524095 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4ee97478-a8f5-4579-bdce-e2df9a9b623d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.095844 Sep 19 14:57:28.525158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1747/3526] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:27 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:28.542901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:28.544254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:28.567356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:28.568719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:28.570153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:28.571434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:28.572299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:28.573072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.520053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:29.547411 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c817a19a-1797-48be-ba43-a73868afd5d8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 1.688400 Sep 19 14:57:29.561200 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1780/3527] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:27 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:29.576183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7774ce5f-00fa-49b1-a7af-455d69e40139 req-a8a7b14f-050a-4e3e-835c-a7c7cc1f24b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "356c0374-4d1e-407c-87df-29da71fb81a2", "tag": "ccd16ff8-d51b-4cf5-9198-f6f8b3b97dce"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:29.638104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7774ce5f-00fa-49b1-a7af-455d69e40139 req-a8a7b14f-050a-4e3e-835c-a7c7cc1f24b7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.641097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7774ce5f-00fa-49b1-a7af-455d69e40139 req-a8a7b14f-050a-4e3e-835c-a7c7cc1f24b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.643279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7774ce5f-00fa-49b1-a7af-455d69e40139 req-a8a7b14f-050a-4e3e-835c-a7c7cc1f24b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.690158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7774ce5f-00fa-49b1-a7af-455d69e40139 req-a8a7b14f-050a-4e3e-835c-a7c7cc1f24b7 service nova] Creating event network-changed:ccd16ff8-d51b-4cf5-9198-f6f8b3b97dce for instance 356c0374-4d1e-407c-87df-29da71fb81a2 on n-h1-858384-1 Sep 19 14:57:29.710419 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7774ce5f-00fa-49b1-a7af-455d69e40139 req-a8a7b14f-050a-4e3e-835c-a7c7cc1f24b7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145654 Sep 19 14:57:29.713941 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1781/3528] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:29.732858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:29.735765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:29.751312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.753613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.755419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.758439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.760344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.761897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:30.493325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:30.523580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:30.530187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:30.536947 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f3ebdc4-7051-4519-abee-27d95fe3d12a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2825 microversion: 2.32 time: 2.010575 Sep 19 14:57:30.571004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1748/3529] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:28 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2825 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:30.595174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:30.602172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:30.634028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:30.635482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:30.636628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:30.642043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:30.649927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:30.651145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.057962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:31.075460 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a00121c-e1e6-4ec4-a4a6-f12a2304b38b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.358596 Sep 19 14:57:31.079814 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1782/3530] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:29 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:31.085908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:31.086830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:31.094422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.096286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.097556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.098905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.099949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.101270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.849133 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e5c8702-8118-4407-983c-2e9719b7fd5f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.767451 Sep 19 14:57:31.850671 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1783/3531] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 14:57:31 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9/os-interface => generated 1831 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:57:31.869476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:31.870696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:31.902357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.909890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.910920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.912415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.914660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.917635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.297771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:33.326502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20458a1a-e5b3-4dfb-8f00-709a579e2613 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 2.752979 Sep 19 14:57:33.329601 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1749/3532] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:30 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:33.739536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:33.769667 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f9c3c3a4-8575-4950-a8c3-8e13c04be8b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.916188 Sep 19 14:57:33.771723 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1784/3533] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:31 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:33.801561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:33.804181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:33.831777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:33.832288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:33.832742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.833497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:33.833956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:33.834588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.978540 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-49f0cf21-cb87-4d39-9fcb-8c102549f54f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.182707 Sep 19 14:57:33.991393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:33.992589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:33.996007 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1750/3534] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:57:33 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:57:34.005273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.006269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.007367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:34.008505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.009357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.010162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:34.372870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:34.382083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:34.416535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.419011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.420938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:34.423920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.426014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.428471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:35.556428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:35.613970 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7cbffcc1-ab8f-41a5-9421-5ae44b9cbc2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1670 microversion: 2.1 time: 1.627682 Sep 19 14:57:35.623163 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1785/3535] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:33 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1670 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:35.819405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:35.855804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a325d851-e261-4584-a228-fc88abf5cde0 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 1.491417 Sep 19 14:57:35.862723 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1751/3536] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:34 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:36.661611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:36.668701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:36.721188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:36.730616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:36.733233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:36.736676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:36.743966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:36.753475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:36.770608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:36.898486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:36.899544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:36.912725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:36.913107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:36.913561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:36.914303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:36.914795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:36.915241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:38.398517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:38.442490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b702b39a-ab54-470f-ac83-280371246099 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1675 microversion: 2.1 time: 1.787135 Sep 19 14:57:38.451046 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1786/3537] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:36 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1675 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:38.456513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-41fc9824-121a-47cb-b95c-f1c3786cde07 req-59d83cb9-3a1a-466a-a402-c21323c9f501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356c0374-4d1e-407c-87df-29da71fb81a2", "name": "network-vif-plugged", "status": "completed", "tag": "ccd16ff8-d51b-4cf5-9198-f6f8b3b97dce"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:38.466563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:38.482006 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eef189ad-7d63-4921-ae3c-3dab18bda7e8 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 1.587791 Sep 19 14:57:38.490283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-41fc9824-121a-47cb-b95c-f1c3786cde07 req-59d83cb9-3a1a-466a-a402-c21323c9f501 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:38.491394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-41fc9824-121a-47cb-b95c-f1c3786cde07 req-59d83cb9-3a1a-466a-a402-c21323c9f501 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:38.492205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-41fc9824-121a-47cb-b95c-f1c3786cde07 req-59d83cb9-3a1a-466a-a402-c21323c9f501 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:38.508593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1752/3538] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:36 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:38.509721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-41fc9824-121a-47cb-b95c-f1c3786cde07 req-59d83cb9-3a1a-466a-a402-c21323c9f501 service nova] Creating event network-vif-plugged:ccd16ff8-d51b-4cf5-9198-f6f8b3b97dce for instance 356c0374-4d1e-407c-87df-29da71fb81a2 on n-h1-858384-1 Sep 19 14:57:38.519855 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-41fc9824-121a-47cb-b95c-f1c3786cde07 req-59d83cb9-3a1a-466a-a402-c21323c9f501 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074086 Sep 19 14:57:38.521292 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1787/3539] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:39.476705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:39.480823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:39.513777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.515462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.516294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.520263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:39.521112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:39.522632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.523931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.524748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.547369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.548414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.549130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.551685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.552505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.553310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:40.712507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:40.726712 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ace0dfc6-d07e-4620-adb2-725f5a8c4271 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1315 microversion: 2.1 time: 1.213634 Sep 19 14:57:40.727374 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1788/3540] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:39 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1315 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:40.742583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e9350a78-37fa-4012-ae88-e717a8d5f2b3 req-bb96dc40-ba04-4350-9d23-068ef8081b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "tag": "95a73885-50f4-4435-8dc5-1e8e276383da"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:40.780148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9350a78-37fa-4012-ae88-e717a8d5f2b3 req-bb96dc40-ba04-4350-9d23-068ef8081b3e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:40.785620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9350a78-37fa-4012-ae88-e717a8d5f2b3 req-bb96dc40-ba04-4350-9d23-068ef8081b3e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:40.786393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9350a78-37fa-4012-ae88-e717a8d5f2b3 req-bb96dc40-ba04-4350-9d23-068ef8081b3e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:40.802945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e9350a78-37fa-4012-ae88-e717a8d5f2b3 req-bb96dc40-ba04-4350-9d23-068ef8081b3e service nova] Creating event network-changed:95a73885-50f4-4435-8dc5-1e8e276383da for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 14:57:40.843392 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e9350a78-37fa-4012-ae88-e717a8d5f2b3 req-bb96dc40-ba04-4350-9d23-068ef8081b3e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075690 Sep 19 14:57:40.845469 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1789/3541] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:40.892175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:40.946106 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-574d87ab-b165-48a4-b7e9-0dc6e06854ca tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.480791 Sep 19 14:57:40.947235 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1753/3542] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:39 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:40.990233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:41.020900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:41.067343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.068278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.069072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.096084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.097753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.099102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.197503 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-595eb8ff-35dc-4bec-8a97-ace72e1ec43e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 200 len: 322 microversion: 2.1 time: 0.215415 Sep 19 14:57:41.199056 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1790/3543] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:57:40 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:41.220067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:41.229303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:41.267211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.279860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.281137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.282938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.287355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.288605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.776339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:41.777399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:41.795805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.798255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.798987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.802189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.802990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.806451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.309164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:42.336814 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2361e730-0a3c-45c4-a2cc-ef9115fef364 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.127726 Sep 19 14:57:42.339845 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1754/3544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:41 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:42.356148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:42.372831 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-326e1e19-b613-46d0-9a84-cbffc443634c tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1501 microversion: 2.1 time: 0.601897 Sep 19 14:57:42.374607 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1791/3545] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:41 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1501 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:42.384685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:42.386566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:42.404334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:42.407194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:42.408659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.411598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:42.416295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:42.417001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.807236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1155114532", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "705f02db-9033-4575-94f9-a92f3927aacb"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:43.033419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] validate_networks() for [('705f02db-9033-4575-94f9-a92f3927aacb', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:57:44.183387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:44.206701 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a32c50a2-2fd0-49a2-801c-c272a24b13b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.830166 Sep 19 14:57:44.208145 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1792/3546] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:42 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:44.456263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:44.456823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:44.470638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.471819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.472499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.473524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.474357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.475113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.508805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lazy-loading 'flavor' on Instance uuid 356c0374-4d1e-407c-87df-29da71fb81a2 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:44.602070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-697322cb-ad35-4bbf-a483-0fbecc3abf12 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "POST /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2/action" status: 202 len: 0 microversion: 2.1 time: 0.391481 Sep 19 14:57:44.606652 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1793/3547] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:57:44 2022] POST /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:57:44.633959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:44.636302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:44.648112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.649067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.649881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.651018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.652836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.653620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:45.348403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:45.389049 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d9aaced-2666-4d4d-8ae1-09608d162064 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.767617 Sep 19 14:57:45.394123 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1794/3548] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:44 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:45.413521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:45.415715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:45.438316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:45.440011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:45.443568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:45.448312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:45.449301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:45.450179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.130331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:46.179979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-403f2c90-6538-473c-821d-534b11451f54 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1492 microversion: 2.1 time: 0.782390 Sep 19 14:57:46.182721 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1795/3549] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:45 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1492 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:46.200751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:46.202716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:46.226786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.228366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.229405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.231009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.234690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.237584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.370246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:57:46.371209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:57:46.371899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:57:46.372475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:57:46.373079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:57:46.382139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:46.407364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.408823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.409624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.410669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.411462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.413953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.439087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Getting quotas for project 98e1478ff2bf4dcf8993940c0f8af807. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:46.449067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Getting quotas for user c75f9ee1ad0a455b9bdf127393a1240d and project 98e1478ff2bf4dcf8993940c0f8af807. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:46.476596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:57:46.484827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:57:46.569252 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9ca78535-d403-4ed1-b1c7-0927306d7474 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.221331 Sep 19 14:57:46.577922 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1755/3550] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:57:46.704253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1ac6ade-3f66-4c23-854b-2b68a448e920 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'create', calling method: .version_select at 0x7fde29a24820>, body: {"keypair": {"name": "tempest-keypair-299163499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW2Nmk51uLye3H+rz5JJxuTPwEy5VWv5zd4NMmEzm9B6pslhBSK4W4UzSt3mdF/mHiOXMu8RiGG+FDeW7HloviNnqp9DCQFeVE1f/f5gN7057NKAsPvVbfXQNc20bJhpw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:46.744999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:46.769358 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e3f9eb53-c7c2-4ace-b3a6-967cb67cfcde tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.582987 Sep 19 14:57:46.772200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d1ac6ade-3f66-4c23-854b-2b68a448e920 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:46.779393 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1796/3551] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:46 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:46.788412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-d1ac6ade-3f66-4c23-854b-2b68a448e920 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for user c4210519c4b84d258d456dc84406b72f and project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:46.796636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:46.798112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:46.816398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.817181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.818431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.819889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.821895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.822630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.899665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:57:46.901376 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1ac6ade-3f66-4c23-854b-2b68a448e920 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.321927 Sep 19 14:57:46.931318 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1756/3552] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 14:57:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 353 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:57:46.951573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00645a79-802f-42fe-9c29-89da072ec6e3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:46.953405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00645a79-802f-42fe-9c29-89da072ec6e3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:47.273968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-585edd03-b8e7-4e28-b45d-a6321fde49d7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 204 len: 0 microversion: 2.1 time: 0.490010 Sep 19 14:57:47.274668 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1797/3553] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:46 2022] DELETE /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:57:47.296364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-217686866", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "57e08ed1-fe03-4626-8d78-fcc627ace18e"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:47.319258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00645a79-802f-42fe-9c29-89da072ec6e3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:47.330712 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00645a79-802f-42fe-9c29-89da072ec6e3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1225 microversion: 2.1 time: 0.398132 Sep 19 14:57:47.334501 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1757/3554] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:46 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1225 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:47.352596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:47.353615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:47.370947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:47.371661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:47.388772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:47.392023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:47.394625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:47.396926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:47.558165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] validate_networks() for [('57e08ed1-fe03-4626-8d78-fcc627ace18e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:57:48.718815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:48.736850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9aa82a3-f5c8-4f25-bb89-d2086c1bd39e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1498 microversion: 2.1 time: 1.398972 Sep 19 14:57:48.737981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1758/3555] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:47 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1498 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:48.750867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:48.751846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:48.768806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:48.769576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:48.770189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:48.773125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:48.773839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:48.774526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:49.039789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:49.057301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-edd5e715-84fb-4424-b8ec-addd377c11b0 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1277 microversion: 2.1 time: 0.317979 Sep 19 14:57:49.071873 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1759/3556] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:48 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1277 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:49.768156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:49.768850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:49.791208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:49.791860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:49.792753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:49.793726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:49.794334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:49.810968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.804902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:57:50.805875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:57:50.805875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:57:50.806298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:57:50.807014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:57:50.810605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:50.844770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:50.845569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:50.846100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.847177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:50.848792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:50.849617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.877770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:50.898376 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54401555-8b7e-4603-94a6-c3f96746aa7e tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1498 microversion: 2.1 time: 1.134389 Sep 19 14:57:50.901341 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1760/3557] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:49 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1498 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:50.906414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:50.916393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:50.918432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:50.943026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for user c11d7590aa1f4fa48be57e2efc017a6f and project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:50.950936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:50.954917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:50.956418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.959436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:50.961030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:50.961492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.997185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:57:51.016195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:57:51.109626 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5ff38a9-4e71-4c23-958b-48107a0947eb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.831732 Sep 19 14:57:51.111352 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1798/3558] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:57:51.123249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-989ac803-4ec1-4b3c-b993-d2d57d643620 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:51.124757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-989ac803-4ec1-4b3c-b993-d2d57d643620 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:51.192326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:51.224934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca0c251c-466f-489e-ba50-0404dc8519b3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1283 microversion: 2.1 time: 0.320774 Sep 19 14:57:51.225909 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1761/3559] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:50 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1283 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:51.382363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-989ac803-4ec1-4b3c-b993-d2d57d643620 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:51.400400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-989ac803-4ec1-4b3c-b993-d2d57d643620 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1214 microversion: 2.1 time: 0.281416 Sep 19 14:57:51.418248 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1799/3560] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:51 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:51.582596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4a956598-f53b-47bb-a420-c3ea71f77307 req-c438e922-883b-4e55-86f9-e64e62010840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356c0374-4d1e-407c-87df-29da71fb81a2", "name": "network-vif-deleted", "tag": "ccd16ff8-d51b-4cf5-9198-f6f8b3b97dce"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:51.607265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4a956598-f53b-47bb-a420-c3ea71f77307 req-c438e922-883b-4e55-86f9-e64e62010840 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:51.607755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4a956598-f53b-47bb-a420-c3ea71f77307 req-c438e922-883b-4e55-86f9-e64e62010840 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:51.608753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4a956598-f53b-47bb-a420-c3ea71f77307 req-c438e922-883b-4e55-86f9-e64e62010840 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:51.672294 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4a956598-f53b-47bb-a420-c3ea71f77307 req-c438e922-883b-4e55-86f9-e64e62010840 service nova] Creating event network-vif-deleted:ccd16ff8-d51b-4cf5-9198-f6f8b3b97dce for instance 356c0374-4d1e-407c-87df-29da71fb81a2 on n-h1-858384-1 Sep 19 14:57:51.698323 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4a956598-f53b-47bb-a420-c3ea71f77307 req-c438e922-883b-4e55-86f9-e64e62010840 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119265 Sep 19 14:57:51.704197 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1762/3561] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:51.947544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:51.948270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:51.972419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:51.974186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:51.974876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:51.977721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:51.979243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:51.984651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.116715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.121224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.121831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.122406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lazy-loading 'fault' on Instance uuid 356c0374-4d1e-407c-87df-29da71fb81a2 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:52.254508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:52.256043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:52.274047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.274558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.283431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.284475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.284942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.285375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.315365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11c9d1fbd13473cae53ad6a0bd88a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105493fbe2db422182705ff49783bd47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:52.335217 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-798c48ad-092a-4c1c-9207-864367d61f1b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 200 len: 1305 microversion: 2.1 time: 0.390838 Sep 19 14:57:52.368278 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1800/3562] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:51 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 1305 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:52.434611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:52.435593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:52.466933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.469654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.470516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.471182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.471668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.472461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.731502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:52.748367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9001c7a1-876b-4325-9379-139b2fe232c7 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1283 microversion: 2.1 time: 0.499922 Sep 19 14:57:52.762504 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1763/3563] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:52 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1283 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:52.799786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:52.832655 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e29b17db-d1d3-495f-9712-82aa985ca80b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1218 microversion: 2.1 time: 0.403483 Sep 19 14:57:52.833480 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1801/3564] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:52 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1218 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:53.369433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.370318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.394195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.396183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.406372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.407450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.408920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.409793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.457692 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 HTTP/1.1 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '356c0374-4d1e-407c-87df-29da71fb81a2'} Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.463069 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.466953 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.473430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:53.474473 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d80c9c3a-441d-4386-ba50-bbd8099af13a tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 404 len: 111 microversion: 2.1 time: 0.108948 Sep 19 14:57:53.475173 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1764/3565] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:53 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:53.486630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.487763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.500570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.504184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.504944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.507413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.508626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.509268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.557701 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 HTTP/1.1 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '356c0374-4d1e-407c-87df-29da71fb81a2'} Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:53.559946 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.567440 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.576207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:53.578467 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b709eac3-e1bf-42f7-bd70-e950da63540b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 404 len: 111 microversion: 2.1 time: 0.097239 Sep 19 14:57:53.581495 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1802/3566] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:53 2022] DELETE /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:53.590215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.590879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 356c0374-4d1e-407c-87df-29da71fb81a2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.600853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.601367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.601821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.602729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.603512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.603821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.641406 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 HTTP/1.1 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '356c0374-4d1e-407c-87df-29da71fb81a2'} Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.649468 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. Sep 19 14:57:53.653910 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.656110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 356c0374-4d1e-407c-87df-29da71fb81a2 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:53.657238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d34225a5-558d-4460-96ac-99ca8139e0a9 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2" status: 404 len: 111 microversion: 2.1 time: 0.071218 Sep 19 14:57:53.658004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1765/3567] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:53 2022] GET /compute/v2.1/servers/356c0374-4d1e-407c-87df-29da71fb81a2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:53.672653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.674689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.694833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.695711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.696383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.697387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.698096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.698843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.715997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:53.718271 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 HTTP/1.1 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dd7a8d3e-13e9-4b65-b10f-0de96c9eb168'} Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:53.720201 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.725566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.729986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:53.731947 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-360dc937-0e40-4587-ae79-2e9628ae6d80 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 404 len: 111 microversion: 2.1 time: 0.068258 Sep 19 14:57:53.738084 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1803/3568] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:53 2022] DELETE /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:53.746707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.747515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: dd7a8d3e-13e9-4b65-b10f-0de96c9eb168] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.757507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.764236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.768699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.769566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.770138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.771548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.776251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.777132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.786725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.793133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.793974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.795074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.796523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.797182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.813907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 HTTP/1.1 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'dd7a8d3e-13e9-4b65-b10f-0de96c9eb168'} Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.818040 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.823226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:53.825772 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-671022c1-c368-4ecb-9fbf-f8ea6468d517 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168" status: 404 len: 111 microversion: 2.1 time: 0.083112 Sep 19 14:57:53.831643 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1766/3569] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:53 2022] GET /compute/v2.1/servers/dd7a8d3e-13e9-4b65-b10f-0de96c9eb168 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:53.843595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.844858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.857354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.859607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.863212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.864329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.865065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.865715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.897014 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 HTTP/1.1 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9199a1b4-97bd-4382-8c8a-c06f417d4233'} Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:53.903679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc01ca8a-7bd3-4711-99c9-0c328ac555ce tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 404 len: 111 microversion: 2.1 time: 0.075348 Sep 19 14:57:53.915802 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1767/3570] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:53 2022] DELETE /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:53.930544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.931390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.961684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.962317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.962934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.965627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.966222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.968185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.980395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:54.229518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:54.240059 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e409b64c-1566-49c6-b126-3a748961ded2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1272 microversion: 2.1 time: 0.321090 Sep 19 14:57:54.251967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1768/3571] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:53 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:54.258184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:54.259153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 9199a1b4-97bd-4382-8c8a-c06f417d4233] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.270923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.271881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.275293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.277110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.277886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.278494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.302563 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 HTTP/1.1 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9199a1b4-97bd-4382-8c8a-c06f417d4233'} Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.304559 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. Sep 19 14:57:54.308287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.310576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 9199a1b4-97bd-4382-8c8a-c06f417d4233 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:54.312424 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-42550ed5-98fd-43f9-ab61-a41b9582c71b tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233" status: 404 len: 111 microversion: 2.1 time: 0.059191 Sep 19 14:57:54.317143 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1769/3572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:54 2022] GET /compute/v2.1/servers/9199a1b4-97bd-4382-8c8a-c06f417d4233 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:54.325720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:54.327354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.339999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.340894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.342720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.344541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.347462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.348309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.390185 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 HTTP/1.1 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6f716cd6-e84b-403d-8e7c-5e1b72b28623'} Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:54.396418 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.403041 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.407146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:54.408833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41b1dd83-6ccb-4232-955c-75e278b4e707 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 404 len: 111 microversion: 2.1 time: 0.089861 Sep 19 14:57:54.415619 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1770/3573] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:54 2022] DELETE /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:54.431663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:54.432719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 6f716cd6-e84b-403d-8e7c-5e1b72b28623] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.458264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.465247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.466611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.470246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.471834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.474146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.533068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 HTTP/1.1 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6f716cd6-e84b-403d-8e7c-5e1b72b28623'} Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.541484 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. Sep 19 14:57:54.546596 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.549734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 6f716cd6-e84b-403d-8e7c-5e1b72b28623 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:54.555013 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14cf6b9e-629f-45a5-bf34-72f7dec99f39 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623" status: 404 len: 111 microversion: 2.1 time: 0.131227 Sep 19 14:57:54.556722 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1771/3574] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:54 2022] GET /compute/v2.1/servers/6f716cd6-e84b-403d-8e7c-5e1b72b28623 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:54.578387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2200550-de46-4bd7-9cff-a2a4c5b0a9e7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:54.579531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2200550-de46-4bd7-9cff-a2a4c5b0a9e7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.591720 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b2200550-de46-4bd7-9cff-a2a4c5b0a9e7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2200550-de46-4bd7-9cff-a2a4c5b0a9e7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 HTTP/1.1 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ef8ac0d4-040a-46c0-9268-11dcbaaf7631'} Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.595523 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2200550-de46-4bd7-9cff-a2a4c5b0a9e7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2200550-de46-4bd7-9cff-a2a4c5b0a9e7 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631" status: 404 len: 111 microversion: 2.1 time: 0.033258 Sep 19 14:57:54.599457 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1772/3575] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:54 2022] DELETE /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:54.633546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccd6ba16-0542-4b09-84a1-4ee9359cadc4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:54.640872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ccd6ba16-0542-4b09-84a1-4ee9359cadc4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: ef8ac0d4-040a-46c0-9268-11dcbaaf7631] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.700269 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ccd6ba16-0542-4b09-84a1-4ee9359cadc4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccd6ba16-0542-4b09-84a1-4ee9359cadc4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 HTTP/1.1 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ef8ac0d4-040a-46c0-9268-11dcbaaf7631'} Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:54.711283 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:54.724184 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:54.724184 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:54.724184 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:54.724184 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. Sep 19 14:57:54.724184 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:57:54.733267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccd6ba16-0542-4b09-84a1-4ee9359cadc4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance ef8ac0d4-040a-46c0-9268-11dcbaaf7631 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:54.738822 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ccd6ba16-0542-4b09-84a1-4ee9359cadc4 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631" status: 404 len: 111 microversion: 2.1 time: 0.131569 Sep 19 14:57:54.743697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1773/3576] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:54 2022] GET /compute/v2.1/servers/ef8ac0d4-040a-46c0-9268-11dcbaaf7631 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:57:55.113146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:55.130903 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23c9cd88-fc19-48f6-8489-91dce4aac709 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 1.356150 Sep 19 14:57:55.147160 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1804/3577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:53 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:55.307335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:55.312604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:55.365585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:55.366361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:55.371006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:55.373284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:55.375795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:55.378826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.159494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:56.183803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:56.212473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:56.220119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:56.224023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.225341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:56.230703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:56.231639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.428021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:56.458650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:56.473984 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffbaedeb-d249-4bd1-97d1-76a9a0498951 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1314 microversion: 2.1 time: 1.181874 Sep 19 14:57:56.482601 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1774/3578] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:55 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1314 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:57.329284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1925108374", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb969539-440e-4219-9eef-4adc88740309"}], "security_groups": [{"name": "tempest-securitygroup--507167746"}], "key_name": "tempest-keypair-299163499", "user_data": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:57.364675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:57.496496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:57.510333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1ff09a1-252a-4a51-9bc5-1b496c53c941 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 1.358308 Sep 19 14:57:57.518449 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1805/3579] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:56 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:57.542306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:57.545225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:57.591150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:57.593871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:57.600292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:57.604840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:57.607440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:57.609035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:58.320913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] validate_networks() for [('eb969539-440e-4219-9eef-4adc88740309', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:57:58.739229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:58.759891 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e7c2599-5b84-4518-a102-a3023738ea32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1314 microversion: 2.1 time: 1.235584 Sep 19 14:57:58.760529 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1806/3580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:57 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1314 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:58.768143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d565378c-8754-4d01-8b28-aa180d9d2f40 req-6ee835c0-111b-44a6-8fcb-3a720d25db40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d09fd9-0bd7-404f-931b-1373fd292449", "tag": "d012f3cf-0fd8-40bb-9953-e1f54986479a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:58.789179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d565378c-8754-4d01-8b28-aa180d9d2f40 req-6ee835c0-111b-44a6-8fcb-3a720d25db40 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:58.789891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d565378c-8754-4d01-8b28-aa180d9d2f40 req-6ee835c0-111b-44a6-8fcb-3a720d25db40 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:58.790482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d565378c-8754-4d01-8b28-aa180d9d2f40 req-6ee835c0-111b-44a6-8fcb-3a720d25db40 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:58.809186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d565378c-8754-4d01-8b28-aa180d9d2f40 req-6ee835c0-111b-44a6-8fcb-3a720d25db40 service nova] Creating event network-changed:d012f3cf-0fd8-40bb-9953-e1f54986479a for instance 40d09fd9-0bd7-404f-931b-1373fd292449 on n-h1-858384-1 Sep 19 14:57:58.824858 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d565378c-8754-4d01-8b28-aa180d9d2f40 req-6ee835c0-111b-44a6-8fcb-3a720d25db40 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058869 Sep 19 14:57:58.828753 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1807/3581] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:58.837185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:58.839059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:58.853836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:58.854882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:58.855669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:58.856769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:58.857468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:58.858484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.231451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:59.241542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b67696a2-f001-4796-ad4c-0b5f1f7fa11b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 0.410421 Sep 19 14:57:59.243111 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1808/3582] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:58 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:59.646368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:57:59.647445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:57:59.648792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:57:59.660679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d99df600-e66c-4cac-8a61-645be10063c4 req-57da37ab-096c-4a31-8b6d-fc082349e6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9ae175-af43-4adb-b8ab-cdf23c4844b8", "tag": "13e6bc73-de84-4650-a288-a070978d96f3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:59.669479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:57:59.676573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:57:59.697605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.698277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.698879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.700068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.700863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.703096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.707566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d99df600-e66c-4cac-8a61-645be10063c4 req-57da37ab-096c-4a31-8b6d-fc082349e6c5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.709536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d99df600-e66c-4cac-8a61-645be10063c4 req-57da37ab-096c-4a31-8b6d-fc082349e6c5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.710379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d99df600-e66c-4cac-8a61-645be10063c4 req-57da37ab-096c-4a31-8b6d-fc082349e6c5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.756041 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d99df600-e66c-4cac-8a61-645be10063c4 req-57da37ab-096c-4a31-8b6d-fc082349e6c5 service nova] Creating event network-changed:13e6bc73-de84-4650-a288-a070978d96f3 for instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 on n-h2-858384-1 Sep 19 14:57:59.759105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:59.769080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for user c4210519c4b84d258d456dc84406b72f and project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:59.774643 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d99df600-e66c-4cac-8a61-645be10063c4 req-57da37ab-096c-4a31-8b6d-fc082349e6c5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136239 Sep 19 14:57:59.776517 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1809/3583] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:59.789110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:57:59.791954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:57:59.801582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:59.803573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:59.855041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.856470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.857710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.859366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.862606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.864292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.870793 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c40c946c-027e-4d80-b275-965c9e76ff52 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.546774 Sep 19 14:57:59.872040 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1775/3584] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:57:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:57:59.888724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f895d659-03c7-4633-a7c5-d47cb6c4a490 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:59.895310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f895d659-03c7-4633-a7c5-d47cb6c4a490 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:00.174508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f895d659-03c7-4633-a7c5-d47cb6c4a490 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:00.193275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f895d659-03c7-4633-a7c5-d47cb6c4a490 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:00.195476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f895d659-03c7-4633-a7c5-d47cb6c4a490 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:00.200706 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f895d659-03c7-4633-a7c5-d47cb6c4a490 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1281 microversion: 2.20 time: 0.320397 Sep 19 14:58:00.205485 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1776/3585] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:59 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:00.271511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:00.272201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:00.292201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:00.294817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:00.297163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:00.298039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:00.298532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:00.299016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:00.870331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:01.315382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.329125 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1a16010-fe9d-4833-b921-e85f462cc9b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1314 microversion: 2.1 time: 1.541296 Sep 19 14:58:01.345070 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1810/3586] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:59 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1314 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:01.356814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:01.358314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:01.362191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.367131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:01.367980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:01.368615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:01.369730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:01.370407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:01.371222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:01.378396 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-10536e8c-00e2-421f-b3b4-ba151ebb4fd6 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 1.111715 Sep 19 14:58:01.383614 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1777/3587] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:00 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:01.388802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:01.583016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.601155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.603722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.605382 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c71c6367-165a-4dae-997a-660ada3e9948 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1285 microversion: 2.20 time: 0.258828 Sep 19 14:58:01.608530 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1811/3588] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:01 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1285 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:01.968755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:01.969679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:01.989657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:01.990610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:01.991364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:01.992415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:01.993128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:01.993894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.032088 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 HTTP/1.1 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '51d91de0-7a79-46bf-8643-602219f0e987'} Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:02.035909 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.043142 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.051600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:02.054654 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1caabb74-fe7e-466d-a728-e96f5efa02b5 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 404 len: 111 microversion: 2.1 time: 0.091677 Sep 19 14:58:02.057202 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1778/3589] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:58:01 2022] DELETE /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:02.070433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.072425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 51d91de0-7a79-46bf-8643-602219f0e987] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.087573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.089377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.090481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.094038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.098035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.098524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.149344 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 HTTP/1.1 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '51d91de0-7a79-46bf-8643-602219f0e987'} Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.156193 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. Sep 19 14:58:02.160647 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.164724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 51d91de0-7a79-46bf-8643-602219f0e987 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:02.168068 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fac782f2-d77e-4547-a49d-16839dcc1749 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987" status: 404 len: 111 microversion: 2.1 time: 0.103175 Sep 19 14:58:02.171135 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1812/3590] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/servers/51d91de0-7a79-46bf-8643-602219f0e987 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:02.182188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.183342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.201939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.209224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.214655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.219353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.223534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.224422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.332571 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf HTTP/1.1 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '55da8d7b-72af-408b-b106-083426af6edf'} Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:02.340016 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a77eadac-4d14-4333-8d4e-6e1c854f8b98 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 404 len: 111 microversion: 2.1 time: 0.177230 Sep 19 14:58:02.366175 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1779/3591] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:58:02 2022] DELETE /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:02.371412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.371412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.371918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.371918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] [instance: 55da8d7b-72af-408b-b106-083426af6edf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.381947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.384283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.385390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.389628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.390930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.393258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.418617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.419164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.419620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.421132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.421736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.462571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.519830 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] HTTP exception thrown: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Request method failure captured: Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf HTTP/1.1 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKII6jkuFCP-0Fp3wz6R_bNK91WdkpjELTRTtblb_x2hApFLFl3Q_UAVedtNnxVvfkjqHi9Vu7mz1KPJA0or0oMVtC9tkLWJUE-InKVtgzHzb8AWAyJomgfu1iffCXaxFA3chWZi-RbyFqIcmrFFUgE-QchY4zf2ry5j8FAs1-FIrf7Y Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_105493fbe2db422182705ff49783bd47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/105493fbe2db422182705ff49783bd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/105493fbe2db422182705ff49783bd47"}]}] Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 105493fbe2db422182705ff49783bd47 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-687267308 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b11c9d1fbd13473cae53ad6a0bd88a16 Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-687267308-project Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '55da8d7b-72af-408b-b106-083426af6edf'} Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.526036 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. Sep 19 14:58:02.530342 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.536532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] Returning 404 to user: Instance 55da8d7b-72af-408b-b106-083426af6edf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:02.543639 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c2088631-4d22-49dc-b1a7-95001cb9ed14 tempest-DeleteServersTestJSON-687267308 tempest-DeleteServersTestJSON-687267308-project] 10.222.0.81 "GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf" status: 404 len: 111 microversion: 2.1 time: 0.181303 Sep 19 14:58:02.545169 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1780/3592] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/servers/55da8d7b-72af-408b-b106-083426af6edf => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:02.553277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.563070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.581392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.584941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.587872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.588731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.589322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.596909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.169458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:03.184979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-39ce6b77-9215-4414-aff8-bc453bb7b413 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1314 microversion: 2.1 time: 0.827241 Sep 19 14:58:03.187489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1813/3593] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:03.206412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:03.220421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:03.260757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.261462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.261928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.262692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.270796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.271275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:04.122837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.133358 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff281c20-74a1-4717-824e-6745aebd937e tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 1.586272 Sep 19 14:58:04.174481 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1781/3594] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:04.242823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:04.243860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:04.266226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:04.267019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:04.267574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:04.268750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:04.271532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:04.272105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:04.299981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.319463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.321752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.333158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8e73686-88a2-466a-bde4-580decfd6d75 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1351 microversion: 2.20 time: 1.141596 Sep 19 14:58:04.337078 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1814/3595] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:03 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1351 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:04.890204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.901260 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9fa58fd9-e568-47df-9c2c-0b2c5290bd8c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1314 microversion: 2.1 time: 0.662885 Sep 19 14:58:04.901888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1782/3596] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:04 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:05.176167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:05.177134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:05.213362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:05.215454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:05.218639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:05.224753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:05.229924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:05.231278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:05.371388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:05.373196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:05.415392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:05.418812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:05.419903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:05.424555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:05.425406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:05.428572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.094382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:06.128322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:06.133744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:06.137203 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b28b535-35fc-45af-9ecd-d500aae918de tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1339 microversion: 2.20 time: 0.770684 Sep 19 14:58:06.141586 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1783/3597] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:05 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1339 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:06.177392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c30556f2-ee50-4608-a0b8-ff28cd86b4e2 req-97c35d48-cc72-48d0-bc48-a2042fa52bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d09fd9-0bd7-404f-931b-1373fd292449", "name": "network-vif-plugged", "status": "completed", "tag": "d012f3cf-0fd8-40bb-9953-e1f54986479a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:06.203849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:06.210029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c30556f2-ee50-4608-a0b8-ff28cd86b4e2 req-97c35d48-cc72-48d0-bc48-a2042fa52bb4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.210953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c30556f2-ee50-4608-a0b8-ff28cd86b4e2 req-97c35d48-cc72-48d0-bc48-a2042fa52bb4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.212415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c30556f2-ee50-4608-a0b8-ff28cd86b4e2 req-97c35d48-cc72-48d0-bc48-a2042fa52bb4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.252961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c30556f2-ee50-4608-a0b8-ff28cd86b4e2 req-97c35d48-cc72-48d0-bc48-a2042fa52bb4 service nova] Creating event network-vif-plugged:d012f3cf-0fd8-40bb-9953-e1f54986479a for instance 40d09fd9-0bd7-404f-931b-1373fd292449 on n-h1-858384-1 Sep 19 14:58:06.269998 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c30556f2-ee50-4608-a0b8-ff28cd86b4e2 req-97c35d48-cc72-48d0-bc48-a2042fa52bb4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124113 Sep 19 14:58:06.277357 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1784/3598] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:06.293344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:06.296534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:06.334206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.336271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.336921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.338788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.339398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.340021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.620194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:06.630908 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8d5c3ca-4d83-4654-ad79-d19eb9f700ee tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 1.460963 Sep 19 14:58:06.631827 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1815/3599] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:05 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:06.832780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:06.869450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78c21cf7-1b51-4070-aed7-05afd9114703 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1314 microversion: 2.1 time: 0.588099 Sep 19 14:58:06.870070 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1785/3600] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:06 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:07.175431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:07.175431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:07.217314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:07.218277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:07.219001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:07.220195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:07.221077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:07.222082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:07.660560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:07.662390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:07.693498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:07.697500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:07.698304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:07.700051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:07.706898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:07.708309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:08.189279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:08.230993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:08.242551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:08.251897 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82451df6-33e4-424b-a729-b37ec2c566db tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 1.083299 Sep 19 14:58:08.255483 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1816/3601] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:07 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:08.275215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:08.290482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:08.339965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:08.340894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:08.352383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:08.356063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:08.381399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:08.385131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:08.993607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:09.030080 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-46dfb1f2-45a4-4c85-9977-b7f6733414f3 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 1.377069 Sep 19 14:58:09.037282 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1786/3602] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:07 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:09.056185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a31be490-6cba-4ea0-bcaa-4237b4708a01 req-f553962f-72d6-46dd-bc7d-cedf8bfd4959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9ae175-af43-4adb-b8ab-cdf23c4844b8", "name": "network-vif-plugged", "status": "completed", "tag": "13e6bc73-de84-4650-a288-a070978d96f3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:09.095912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a31be490-6cba-4ea0-bcaa-4237b4708a01 req-f553962f-72d6-46dd-bc7d-cedf8bfd4959 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:09.096774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a31be490-6cba-4ea0-bcaa-4237b4708a01 req-f553962f-72d6-46dd-bc7d-cedf8bfd4959 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:09.100457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a31be490-6cba-4ea0-bcaa-4237b4708a01 req-f553962f-72d6-46dd-bc7d-cedf8bfd4959 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:09.164295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a31be490-6cba-4ea0-bcaa-4237b4708a01 req-f553962f-72d6-46dd-bc7d-cedf8bfd4959 service nova] Creating event network-vif-plugged:13e6bc73-de84-4650-a288-a070978d96f3 for instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 on n-h2-858384-1 Sep 19 14:58:09.171913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a31be490-6cba-4ea0-bcaa-4237b4708a01 req-f553962f-72d6-46dd-bc7d-cedf8bfd4959 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132031 Sep 19 14:58:09.172943 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1787/3603] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:09.290533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:09.291597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:09.314917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:09.315668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:09.316298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:09.317190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:09.317808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:09.318396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:09.728122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:10.172836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:10.182959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:10.184942 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d541d665-1b8a-4757-95aa-2df692c61952 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1499 microversion: 2.1 time: 1.925363 Sep 19 14:58:10.189023 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1817/3604] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:08 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1499 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:10.555519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:10.570387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:10.572391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:10.573658 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aae843e7-3f20-4a46-842e-12e63ff40585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 1.287834 Sep 19 14:58:10.587196 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1788/3605] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:09 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:10.593311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:10.594200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:10.606586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:10.607140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:10.607808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:10.608706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:10.609188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:10.610736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:10.646735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d4499ce9-366e-408e-b081-0930529e4de8 req-98720f89-e173-435e-8d72-11e72d233584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:10.660297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4499ce9-366e-408e-b081-0930529e4de8 req-98720f89-e173-435e-8d72-11e72d233584 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:10.661082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4499ce9-366e-408e-b081-0930529e4de8 req-98720f89-e173-435e-8d72-11e72d233584 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:10.662061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4499ce9-366e-408e-b081-0930529e4de8 req-98720f89-e173-435e-8d72-11e72d233584 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:10.684286 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d4499ce9-366e-408e-b081-0930529e4de8 req-98720f89-e173-435e-8d72-11e72d233584 service nova] Creating event network-changed:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 14:58:10.697443 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d4499ce9-366e-408e-b081-0930529e4de8 req-98720f89-e173-435e-8d72-11e72d233584 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506686 Sep 19 14:58:10.698390 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1818/3606] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:10.706300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5dda5593-5449-4cd2-a1a7-6b662c38d862 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:10.714128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dda5593-5449-4cd2-a1a7-6b662c38d862 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:10.714923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dda5593-5449-4cd2-a1a7-6b662c38d862 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:10.716268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5dda5593-5449-4cd2-a1a7-6b662c38d862 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:10.757175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5dda5593-5449-4cd2-a1a7-6b662c38d862 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Going to try to stop instance {{(pid=128731) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:58:10.920843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5dda5593-5449-4cd2-a1a7-6b662c38d862 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449/action" status: 202 len: 0 microversion: 2.1 time: 0.209645 Sep 19 14:58:10.927911 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1819/3607] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:58:10 2022] POST /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:58:10.940435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:10.941289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:10.962406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:10.962979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:10.963419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:10.968458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:10.969210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:10.969815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:11.477927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:11.535321 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-adaeccd8-a3b0-4925-9d9a-3f8fe569abcf tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1325 microversion: 2.1 time: 0.945355 Sep 19 14:58:11.541431 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1789/3608] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:10 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1325 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:11.620305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:11.624559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:11.653573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:11.656361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:11.661805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:11.663772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:11.666258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:11.669384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:11.868766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:11.888502 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-006433c3-75cd-48db-80ca-edb0164b6760 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.955013 Sep 19 14:58:11.904685 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1820/3609] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:10 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:12.575309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:12.581000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:12.617721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:12.620702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:12.622528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:12.629181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:12.630787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:12.633487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:13.743001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:13.786890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:13.790909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:13.795722 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da06bcd4-8ef9-432f-925c-f7630541d4e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 2.192641 Sep 19 14:58:13.798121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1790/3610] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:11 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:13.808423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:13.812114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:13.830334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:13.832375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:13.833499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:13.835387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:13.838517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:13.839359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.297504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.342438 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-317672b1-b2e7-43f1-940a-d81affff119f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1522 microversion: 2.1 time: 1.771385 Sep 19 14:58:14.346256 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1821/3611] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:12 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1522 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:14.364294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:14.365643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:14.382521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.384062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.385249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.387099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.389174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.390264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.400670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:14.798330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.817557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.819069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.824734 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97ef8887-5e40-4a93-aa93-e1fc5e5f07ec tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2944 microversion: 2.32 time: 1.023627 Sep 19 14:58:14.842702 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1791/3612] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:13 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2944 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:14.858449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:14.860196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:14.868391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.869172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.869987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.871134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.871788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.872382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.906408 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] HTTP exception thrown: Instance is not a member of specified network Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Request method failure captured: Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8/ips/invalid HTTP/1.1 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKINl8Zwh067-wXmGpv7e0VfTueUXYYnUFIvquaw92RdCmyUvBQdxLeprQLF3LKjCU7eyTR7Fbw1xb3zRwl7Z2tMUdTUJLYf_1hvGvXWy-1cKVVnunTle6tzvIgs58fG-t8Zj36xxvkwrSPuVFhYyyB3NhZ9iSiBve0d3_8NcfeZDFaQ Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 98e1478ff2bf4dcf8993940c0f8af807 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/98e1478ff2bf4dcf8993940c0f8af807"}]}] Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 98e1478ff2bf4dcf8993940c0f8af807 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerAddressesNegativeTestJSON-829005078-project Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c75f9ee1ad0a455b9bdf127393a1240d Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-829005078-project Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance is not a member of specified network Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '6b9ae175-af43-4adb-b8ab-cdf23c4844b8', 'id': 'invalid'} Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 19 14:58:14.915334 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 14:58:14.922226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:14.923666 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51773594-70d8-4d2b-ad69-e0a575dc6af2 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.079581 Sep 19 14:58:14.925678 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1792/3613] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 14:58:14 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8/ips/invalid => generated 91 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:58:14.937569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:14.940136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:14.958064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.958991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.959609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.960575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.961209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.961792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.396793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:15.426397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f9a7a87-b36c-4b21-a7d7-96e51c6371c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 1.071312 Sep 19 14:58:15.431440 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1822/3614] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:14 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:15.479004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:15.481844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:15.495080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.496139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.498073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.499053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.499696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.500318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.795384 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e0aaea0-9564-4b5f-850f-78f2a648a5b7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.360995 Sep 19 14:58:15.796548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1823/3615] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 14:58:15 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9/os-interface => generated 1831 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:15.800380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:15.817121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:15.817777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-821bb578-ae36-462e-8866-4918f9fe5e9b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:15.818298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-821bb578-ae36-462e-8866-4918f9fe5e9b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Failed to fetch instance by id 999 {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 14:58:15.821296 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-821bb578-ae36-462e-8866-4918f9fe5e9b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] HTTP exception thrown: Instance 999 could not be found. Sep 19 14:58:15.822578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-821bb578-ae36-462e-8866-4918f9fe5e9b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Request method failure captured: Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKINl8Zwh067-wXmGpv7e0VfTueUXYYnUFIvquaw92RdCmyUvBQdxLeprQLF3LKjCU7eyTR7Fbw1xb3zRwl7Z2tMUdTUJLYf_1hvGvXWy-1cKVVnunTle6tzvIgs58fG-t8Zj36xxvkwrSPuVFhYyyB3NhZ9iSiBve0d3_8NcfeZDFaQ Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 98e1478ff2bf4dcf8993940c0f8af807 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/98e1478ff2bf4dcf8993940c0f8af807"}]}] Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 98e1478ff2bf4dcf8993940c0f8af807 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerAddressesNegativeTestJSON-829005078-project Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c75f9ee1ad0a455b9bdf127393a1240d Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-829005078-project Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 999 could not be found. Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': '999'} Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 19 14:58:15.823959 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:15.829675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-821bb578-ae36-462e-8866-4918f9fe5e9b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:15.829675 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-821bb578-ae36-462e-8866-4918f9fe5e9b tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.015334 Sep 19 14:58:15.829675 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1824/3616] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 14:58:15 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:58:15.834461 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4238af75-13d2-4100-ad3b-fad7b02d63ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 0.907112 Sep 19 14:58:15.835441 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1793/3617] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:14 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:15.849107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:15.849107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:15.885450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.890774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.891889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.905633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.906198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.907473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.079450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:58:16.369677 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e67db47-dab3-4bde-a6bf-eaa6b5e33b10 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 204 len: 0 microversion: 2.1 time: 0.532108 Sep 19 14:58:16.371157 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1825/3618] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:58:15 2022] DELETE /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:58:16.384583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:16.386356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:16.407731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.409563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.410570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.411604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.417283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.418432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.458481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:16.462214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:16.467610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:16.536761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.537970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.539990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.546120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.549902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.553929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:17.039184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:17.097264 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8e4586a-e509-432f-a45e-d070af5af16c tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1528 microversion: 2.1 time: 0.715327 Sep 19 14:58:17.103872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1794/3619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:16 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1528 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:17.125054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:17.128483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:17.148431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:17.153686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:17.155156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:17.157798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:17.159541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:17.160342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.214729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.239002 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-47ab64f9-7b1d-4e08-9d0c-dd1f19932112 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 1.783934 Sep 19 14:58:18.254346 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1826/3620] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:16 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:18.284498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:18.287484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:18.299089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.300082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.301185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.302522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.303695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.304442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.609790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.625957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.645195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.656154 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aae6b97b-2570-4ab9-9253-948693974909 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 1.546473 Sep 19 14:58:18.666796 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1795/3621] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:17 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:19.291849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:19.292771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:19.311220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.312282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.312922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:19.313920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.315439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.316243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.073842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.102660 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-63c25271-328e-42d2-97fa-c712194c9b73 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1528 microversion: 2.1 time: 1.846602 Sep 19 14:58:20.119454 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1827/3622] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:18 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1528 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:20.125768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:20.126733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:20.133526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:20.134418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:20.135095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.136076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:20.136806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:20.137446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.472915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.482728 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4fe2d1bf-aa6f-4d93-ac6a-28a1e5dbc9a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 1.195628 Sep 19 14:58:20.508212 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1796/3623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:19 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:20.610282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e1dbf457-52bd-46ce-8e64-b486c76e6848 req-dee064e8-f2bc-4b93-a07e-d039a0cc6fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "name": "network-vif-plugged", "status": "completed", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:20.624017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e1dbf457-52bd-46ce-8e64-b486c76e6848 req-dee064e8-f2bc-4b93-a07e-d039a0cc6fdb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:20.624886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e1dbf457-52bd-46ce-8e64-b486c76e6848 req-dee064e8-f2bc-4b93-a07e-d039a0cc6fdb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:20.625695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e1dbf457-52bd-46ce-8e64-b486c76e6848 req-dee064e8-f2bc-4b93-a07e-d039a0cc6fdb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.641450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e1dbf457-52bd-46ce-8e64-b486c76e6848 req-dee064e8-f2bc-4b93-a07e-d039a0cc6fdb service nova] Creating event network-vif-plugged:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 14:58:20.651028 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e1dbf457-52bd-46ce-8e64-b486c76e6848 req-dee064e8-f2bc-4b93-a07e-d039a0cc6fdb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140559 Sep 19 14:58:20.652644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1797/3624] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:20.871905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.885801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.906443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.922881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f59bd7cc-6ee7-44c5-92e1-15eb5d67a1c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 0.787549 Sep 19 14:58:20.926815 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1828/3625] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:20 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:21.127446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:21.128335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:21.135384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.136224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.136857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:21.137802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.139022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.139631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:21.300733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:21.312686 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41dc9724-6e49-4113-969e-5d48889cfc6d tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1486 microversion: 2.1 time: 0.190638 Sep 19 14:58:21.314077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1798/3626] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:21 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1486 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:21.520324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:21.521076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:21.532372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.564973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.566730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.568234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:21.572376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.573441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.574519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:21.950130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4b38d6c4-1750-46e2-b523-943844eb7763 req-72f5f956-d9b6-4b9c-b592-3af0a02c54ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9ae175-af43-4adb-b8ab-cdf23c4844b8", "name": "network-vif-deleted", "tag": "13e6bc73-de84-4650-a288-a070978d96f3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:21.968348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4b38d6c4-1750-46e2-b523-943844eb7763 req-72f5f956-d9b6-4b9c-b592-3af0a02c54ef service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.972565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4b38d6c4-1750-46e2-b523-943844eb7763 req-72f5f956-d9b6-4b9c-b592-3af0a02c54ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.973438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4b38d6c4-1750-46e2-b523-943844eb7763 req-72f5f956-d9b6-4b9c-b592-3af0a02c54ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.000819 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4b38d6c4-1750-46e2-b523-943844eb7763 req-72f5f956-d9b6-4b9c-b592-3af0a02c54ef service nova] Creating event network-vif-deleted:13e6bc73-de84-4650-a288-a070978d96f3 for instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 on n-h2-858384-1 Sep 19 14:58:22.015414 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4b38d6c4-1750-46e2-b523-943844eb7763 req-72f5f956-d9b6-4b9c-b592-3af0a02c54ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372958 Sep 19 14:58:22.019237 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1799/3627] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:22.031639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:22.035892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:22.056335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.061701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.062147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.062977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.063464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.078737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.352599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:22.395216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-651f0bfb-1a71-4172-9fd6-890566a4c11c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.880141 Sep 19 14:58:22.399660 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1829/3628] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:21 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:22.449713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:22.455923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:22.475067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.476283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.477650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.478735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.479507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.480111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.628311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.630816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.632441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.634472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lazy-loading 'fault' on Instance uuid 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:58:22.978826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f9ee1ad0a455b9bdf127393a1240d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1478ff2bf4dcf8993940c0f8af807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:22.984066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:23.003299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:23.004903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:23.007529 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-953416f5-771e-4f14-8514-f59a71a23b3b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1406 microversion: 2.20 time: 0.985630 Sep 19 14:58:23.010977 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1800/3629] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:22 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1406 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:23.021013 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa077186-0506-4346-bc15-4d4907c8b39f tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 200 len: 1315 microversion: 2.1 time: 0.605412 Sep 19 14:58:23.027998 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1830/3630] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:22 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:23.444049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:23.444898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:23.459024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:23.459777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:23.460380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:23.461297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:23.461764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:23.462201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:23.839334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:23.856587 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5cc1b5b9-70cf-420e-af6c-a473391e9377 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.416079 Sep 19 14:58:23.876396 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1801/3631] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:23 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:24.047435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:24.048348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] [instance: 6b9ae175-af43-4adb-b8ab-cdf23c4844b8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:24.064281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:24.066691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.068105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.069919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.070655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:24.072981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.073703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.074224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.094808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.095761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.097132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.099243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.100415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.101740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.128799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] HTTP exception thrown: Instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 could not be found. Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Request method failure captured: Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 HTTP/1.1 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKINl8Zwh067-wXmGpv7e0VfTueUXYYnUFIvquaw92RdCmyUvBQdxLeprQLF3LKjCU7eyTR7Fbw1xb3zRwl7Z2tMUdTUJLYf_1hvGvXWy-1cKVVnunTle6tzvIgs58fG-t8Zj36xxvkwrSPuVFhYyyB3NhZ9iSiBve0d3_8NcfeZDFaQ Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 98e1478ff2bf4dcf8993940c0f8af807 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/98e1478ff2bf4dcf8993940c0f8af807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/98e1478ff2bf4dcf8993940c0f8af807"}]}] Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 98e1478ff2bf4dcf8993940c0f8af807 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-829005078 Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerAddressesNegativeTestJSON-829005078-project Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c75f9ee1ad0a455b9bdf127393a1240d Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-829005078-project Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 could not be found. Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6b9ae175-af43-4adb-b8ab-cdf23c4844b8'} Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 could not be found. Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 could not be found. Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:24.130942 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 could not be found. Sep 19 14:58:24.139429 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:58:24.142783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] Returning 404 to user: Instance 6b9ae175-af43-4adb-b8ab-cdf23c4844b8 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:24.144256 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01d5a199-2e23-4bc6-af07-3ad020ce3267 tempest-ServerAddressesNegativeTestJSON-829005078 tempest-ServerAddressesNegativeTestJSON-829005078-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8" status: 404 len: 111 microversion: 2.1 time: 0.100208 Sep 19 14:58:24.152997 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1831/3632] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:24 2022] GET /compute/v2.1/servers/6b9ae175-af43-4adb-b8ab-cdf23c4844b8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:24.902305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:24.904663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:24.918221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.919321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.921683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.925690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.927845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.929142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.304294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.323981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.328177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.330027 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7403e430-c6b3-4161-b950-00944cc4377c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1597 microversion: 2.20 time: 1.275081 Sep 19 14:58:25.345243 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1802/3633] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:24 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1597 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:25.390840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:25.391699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:25.403380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:25.404450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:25.405140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.406300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:25.407071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:25.408002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.661584 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e20439f-0db4-4844-a382-ee2d1928e34c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.292212 Sep 19 14:58:25.663441 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1803/3634] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 14:58:25 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-interface => generated 284 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:58:25.855498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.875436 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94ccfcd7-ebca-4950-88f9-537bde80d905 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.977963 Sep 19 14:58:25.876681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1832/3635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:24 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:26.903369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:26.904674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:26.922787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:26.925474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:26.926764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:26.929390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:26.933863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:26.937222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:27.475580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:27.489599 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-859eb53d-a0aa-4db7-adf9-9a74e6098e57 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.592163 Sep 19 14:58:27.493262 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1804/3636] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:26 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:28.523969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:28.533757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:28.568526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:28.569599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:28.570406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:28.571720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:28.573182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:28.573909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.158457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:29.173300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-da1e5c51-0c5b-4dc6-acb4-191b815d215d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.658376 Sep 19 14:58:29.174956 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1833/3637] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:28 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:30.220742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:30.222074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:30.230306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.231106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.232381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.233652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.234332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.234973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.611320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:30.649586 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4419f5b-d120-437c-8a21-3897a9229f2e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.433222 Sep 19 14:58:30.651680 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1805/3638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:30 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:31.124132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a9c7bb64-f98b-462f-9838-bdb96be7ea41 req-2f78a6b9-c589-4ef6-a76f-ca0747234d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:31.154724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a9c7bb64-f98b-462f-9838-bdb96be7ea41 req-2f78a6b9-c589-4ef6-a76f-ca0747234d4a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:31.156504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a9c7bb64-f98b-462f-9838-bdb96be7ea41 req-2f78a6b9-c589-4ef6-a76f-ca0747234d4a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:31.157894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a9c7bb64-f98b-462f-9838-bdb96be7ea41 req-2f78a6b9-c589-4ef6-a76f-ca0747234d4a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:31.191799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a9c7bb64-f98b-462f-9838-bdb96be7ea41 req-2f78a6b9-c589-4ef6-a76f-ca0747234d4a service nova] Creating event network-changed:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 14:58:31.206251 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a9c7bb64-f98b-462f-9838-bdb96be7ea41 req-2f78a6b9-c589-4ef6-a76f-ca0747234d4a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091583 Sep 19 14:58:31.209130 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1834/3639] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:31.683521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:31.684732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:31.719393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:31.720224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:31.729478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:31.734775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:31.737251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:31.740750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:32.245135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:32.304511 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e383c7cb-26a4-4afa-a036-77eb0503af0f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 0.631375 Sep 19 14:58:32.306971 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1806/3640] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:31 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:33.359789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:33.360622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:33.384615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:33.386040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:33.387822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:33.395076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:33.396297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:33.399710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:34.458020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:34.470492 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8bb27855-b98b-4332-b5af-e0a7c0f60786 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 1.115091 Sep 19 14:58:34.471162 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1835/3641] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:33 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:35.505394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:35.506560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:35.549201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.549723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.550262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:35.551063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.551547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.551990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:37.243880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:37.296376 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-57019056-1637-43bd-89c4-dd99964cadfd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1509 microversion: 2.1 time: 1.794658 Sep 19 14:58:37.308747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1807/3642] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:35 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1509 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:38.357118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:38.361272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:38.391846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:38.392952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:38.393895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:38.395316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:38.396320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:38.397241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.160895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:39.218565 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2347687-d663-4dc5-b807-4d5e4d1c14bc tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1486 microversion: 2.1 time: 0.872309 Sep 19 14:58:39.223839 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1836/3643] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:38 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1486 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:39.259767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:39.275866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:39.297845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=48 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:39.314150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.334695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.340162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.342219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.347326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.348112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.538385 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9762729d-bd13-4aaa-b2a2-f9d2faebd041 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 200 len: 167 microversion: 2.1 time: 0.286479 Sep 19 14:58:39.540804 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1808/3644] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:58:39 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 167 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:39.556059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:39.556931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:39.585822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.586336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.586816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.587584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.589436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.594695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:40.234642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:40.244594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9055f5b8-43de-419d-a102-a2587ab3bb07 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.696757 Sep 19 14:58:40.245209 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1837/3645] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:39 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:40.283171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:40.283918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:40.292085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:40.292859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:40.293313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:40.295039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:40.295530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:40.295980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:40.890538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:40.904215 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0486de9-35b8-4a8f-a52d-eca5f5e325b3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.625920 Sep 19 14:58:40.910267 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1809/3646] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:40 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:40.939695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:40.941986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:40.986637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:40.991623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:40.992285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:40.993170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:40.994313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:40.995015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.659607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-247772762", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:41.685604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:41.695231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca1c243a-0ad6-4d73-9d2b-1ce7ed5c0e26 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.761345 Sep 19 14:58:41.724731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1838/3647] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:40 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:41.734328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:41.734328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:41.763647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.765176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.768138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.769770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.771702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.772776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.802814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:58:41.803359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:58:41.803867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:58:41.804285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:58:41.804717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:58:41.818949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:41.827158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.827662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.828108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.828990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.829313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.840318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.911813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Getting quotas for project 0870a285a21e44819cfc81dcf3bd6e50. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:58:41.930051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Getting quotas for user 14c36076bb634054b653a94bb3c479e6 and project 0870a285a21e44819cfc81dcf3bd6e50. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:58:41.990289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:58:42.004831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:58:42.131249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eadc1f4c-e182-458d-b372-05459468113e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.823658 Sep 19 14:58:42.132712 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1810/3648] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 14:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:58:42.155542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4691936c-4bc5-4917-8bb5-79d9933b39d1 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:42.158212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4691936c-4bc5-4917-8bb5-79d9933b39d1 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:42.624628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4691936c-4bc5-4917-8bb5-79d9933b39d1 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:42.643187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4691936c-4bc5-4917-8bb5-79d9933b39d1 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:42.644669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4691936c-4bc5-4917-8bb5-79d9933b39d1 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:42.646374 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4691936c-4bc5-4917-8bb5-79d9933b39d1 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1277 microversion: 2.57 time: 0.501933 Sep 19 14:58:42.668015 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1811/3649] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:42 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1277 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:42.763907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:42.774900 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c983192-ff22-4a3a-acff-e24714eb00e0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.047025 Sep 19 14:58:42.780594 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1839/3650] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:41 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:43.128698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-333814394", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "57e08ed1-fe03-4626-8d78-fcc627ace18e"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:43.251888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] validate_networks() for [('57e08ed1-fe03-4626-8d78-fcc627ace18e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:58:43.680080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:43.680761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:43.696975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.697487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.697938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.698691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.699250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.699695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.939776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.005300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.008375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.012234 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-691e3792-b4ff-4a58-8287-fe492772484e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1273 microversion: 2.57 time: 0.336202 Sep 19 14:58:44.014446 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1840/3651] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:43 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:45.050115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:45.050914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:45.065427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.076306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.076883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.077669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.078151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.078591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.337578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:45.351184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:45.356975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:45.364743 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9fd5c320-5d49-4e01-9142-f4acdac709ed tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1335 microversion: 2.57 time: 0.318620 Sep 19 14:58:45.368535 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1841/3652] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:45 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1335 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:45.596337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1781993273", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d825aab1-2456-4dbb-8b6f-a278ed119fab"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:45.692410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] validate_networks() for [('d825aab1-2456-4dbb-8b6f-a278ed119fab', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:58:45.767724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:58:45.768309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:58:45.768623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:58:45.769037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:58:45.769456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:58:45.783695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.790483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.795794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.799560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.800620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.801774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.901955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:58:45.941422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for user c11d7590aa1f4fa48be57e2efc017a6f and project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:58:45.991955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:58:45.995412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:58:46.167530 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-31353dcb-03b7-4d22-bf1d-ad30a7201c80 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.058725 Sep 19 14:58:46.169773 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1812/3653] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:58:46.186329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4436147a-56c3-49a7-a1ad-cd610c9275f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:46.187322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4436147a-56c3-49a7-a1ad-cd610c9275f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:46.573446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4436147a-56c3-49a7-a1ad-cd610c9275f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:46.584953 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4436147a-56c3-49a7-a1ad-cd610c9275f9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1214 microversion: 2.1 time: 0.407098 Sep 19 14:58:46.587623 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1813/3654] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:46 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1214 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:46.600061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:46.609910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:46.634411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.638472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.639475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.643106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.643650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.646480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.661504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=88 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:46.833067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:46.859890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:46.865272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:46.869047 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c67d65c9-24ed-48de-9bc1-5231b6e80e0e tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1335 microversion: 2.57 time: 0.278325 Sep 19 14:58:46.872065 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1814/3655] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:46 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1335 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:47.625494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:47.626658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:47.651167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.655335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.657190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.658335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.660197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.663268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.880279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:47.900095 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c211aba-8f3c-4d96-a4a7-912a443c8fa2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1210 microversion: 2.1 time: 0.287267 Sep 19 14:58:47.904121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1815/3656] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:47 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1210 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:47.915824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:47.916735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:47.946428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.955539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.956033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.959822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.963462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.964209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.092967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:58:48.093517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:58:48.093873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:58:48.094295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:58:48.094719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:58:48.121881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.122467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.123802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.124590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.125069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.125511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.181854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.198554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.204033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.208313 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b410f522-7ded-47fd-89e7-ac7b3495c582 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1356 microversion: 2.57 time: 0.302245 Sep 19 14:58:48.223769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Getting quotas for project d379e03b58204dc09adecef25d911f46. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:58:48.230955 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1816/3657] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:47 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1356 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:48.238613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:48.242399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:48.251716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Getting quotas for user 6d4098eb8b2842c49cb266d93d19d2d1 and project d379e03b58204dc09adecef25d911f46. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:58:48.254900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.256177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.257363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.259027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.260007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.260819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.313636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Going to run 2 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:58:48.326161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 88f5fb48-cb17-4fa0-b3d4-088010d4e332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:58:48.437114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:58:48.437765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:58:48.438295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:58:48.438861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:58:48.439406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:58:48.506855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=88f5fb48-cb17-4fa0-b3d4-088010d4e332,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:58:48.635201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:48.650164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.650953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.656014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.657443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.660121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.660922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.757239 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83fe1d5b-0b60-4072-a1d8-bc530eee3cc6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "POST /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05/action" status: 202 len: 1137 microversion: 2.57 time: 0.522624 Sep 19 14:58:48.761002 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1817/3658] 10.222.0.81 () {62 vars in 1320 bytes} [Mon Sep 19 14:58:48 2022] POST /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05/action => generated 1137 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 19 14:58:48.782490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f822f858-16ec-42de-b9f0-85f9daaed77c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.274008 Sep 19 14:58:48.789591 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1842/3659] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:58:48.791645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:48.793079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:48.797310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:48.803214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.815058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.815984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.816848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Searching by: {'deleted': False, 'project_id': 'd379e03b58204dc09adecef25d911f46'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:58:48.817564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.821114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.821991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.822790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.869196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.869939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.881474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.882660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.885324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.892817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.013151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad9e3ae6-df7c-427d-90b9-8b42f92df123 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.214522 Sep 19 14:58:49.017163 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1843/3660] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:58:48 2022] GET /compute/v2.1/servers => generated 677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:49.035170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:49.035865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:49.055300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.055813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.056264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.057091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.057448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.058293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.117423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.166971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.170060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.173428 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea2e5e68-7888-4558-8576-df5b92c7f6a8 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.394362 Sep 19 14:58:49.182562 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1818/3661] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:48 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:49.191184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-747f5f08-08f2-4760-be01-8af20e9b8b92 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:49.202340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-747f5f08-08f2-4760-be01-8af20e9b8b92 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:49.261677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.281206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-634ad946-6568-444f-901c-1c28a5ec19b0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1272 microversion: 2.1 time: 0.261174 Sep 19 14:58:49.284157 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1844/3662] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:49 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:49.433140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-747f5f08-08f2-4760-be01-8af20e9b8b92 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.455972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-747f5f08-08f2-4760-be01-8af20e9b8b92 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1220 microversion: 2.1 time: 0.272180 Sep 19 14:58:49.456974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1819/3663] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:49 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1220 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:50.210169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:50.211256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:50.229641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.236811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.240348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:50.241407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.245972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.252499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:50.318014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:50.318919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:50.329401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.333086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.337351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:50.338486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.339246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.339928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:50.540209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:50.551969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:50.557218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:50.559784 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0351aa54-bfc2-4001-b6e1-9bc809f17522 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.354382 Sep 19 14:58:50.563672 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1845/3664] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:50 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:50.570478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91ea4aa2-7c6a-4d5b-a387-eae7f4260e7d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:50.574386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-91ea4aa2-7c6a-4d5b-a387-eae7f4260e7d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:50.680559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:50.703594 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6f7f306-86c8-47ba-892c-02c6bec64ab6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1272 microversion: 2.1 time: 0.389508 Sep 19 14:58:50.723889 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1820/3665] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:50 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:50.798600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-91ea4aa2-7c6a-4d5b-a387-eae7f4260e7d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:50.820914 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91ea4aa2-7c6a-4d5b-a387-eae7f4260e7d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1220 microversion: 2.1 time: 0.255439 Sep 19 14:58:50.823338 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1846/3666] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:50 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1220 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:51.612043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:51.612915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:51.632155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.632787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.633321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.634955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.635532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.636046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.728623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:51.729393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:51.741094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:51.742705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.743311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.743860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.744663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.745205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.745715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.856178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.869291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.878077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.879820 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2e60f9ab-0ed6-45ea-9957-3735ecd8c861 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.272189 Sep 19 14:58:51.889795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1821/3667] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:51 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:51.913788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:51.921225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:51.951685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.952750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.963058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.964047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.964589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.965100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:52.320900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:52.333843 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-158b6c9a-ce86-48e9-b85d-520fff591438 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1272 microversion: 2.1 time: 0.440562 Sep 19 14:58:52.335289 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1822/3668] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:51 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1272 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:52.682204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:52.734875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-69a49495-2376-4c56-b8c7-62a4ccd79b3c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 1.008887 Sep 19 14:58:52.737114 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1847/3669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:51 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:52.921157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:52.921792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:52.939207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.943759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.944630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:52.945571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.950443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.954717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.360703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:53.361332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:53.383135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.383642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.384084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.392305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.392853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.393308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.568711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.606903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.616109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.619516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7aa9fa27-721f-46d0-9226-ed15a91daeaf tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.703235 Sep 19 14:58:53.627469 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1823/3670] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:52 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:53.682383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.714787 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5127875e-7b97-48da-adb6-1e5e74bfd970 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1278 microversion: 2.1 time: 0.356963 Sep 19 14:58:53.719529 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1848/3671] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:53 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1278 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:53.760747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:53.761380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:53.777215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.778034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.778285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.779326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.781388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.782055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.276530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:54.311083 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7cd19cf-85d6-41c2-a912-efed033b88e3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 0.554036 Sep 19 14:58:54.320840 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1824/3672] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:53 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:54.664022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:54.665143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:54.706401 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 14:58:54.706665 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 14:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 (ip 10.222.0.81) !!! Sep 19 14:58:54.757021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.760904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.761969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.764733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.765151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:54.765978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.766665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.768592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:54.912029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.921215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.921913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.932294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.933267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.934675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.071516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:55.133067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:55.142516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:55.161713 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0ab196a-9d5b-406a-85dd-618272ace33b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.492621 Sep 19 14:58:55.177955 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1849/3673] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:54 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:55.365441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:55.370248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:55.410774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.410774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.410774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.413104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.413104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.413104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.831516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:55.914529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:55.948596 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa66d04e-abdb-427c-b2e0-2bd94dcfffbc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1278 microversion: 2.1 time: 1.208680 Sep 19 14:58:55.950271 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1825/3674] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:54 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1278 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:55.963072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:55.963072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:55.976100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.977382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.978689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.980568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.981876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.983060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.056052 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c720dcf1-9e51-429c-85a7-403f5f4756e1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/ips" status: 200 len: 151 microversion: 2.20 time: 0.103720 Sep 19 14:58:56.057081 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1826/3675] 10.222.0.81 () {60 vars in 1289 bytes} [Mon Sep 19 14:58:55 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:58:56.206362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:56.212445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:56.228214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:56.237283 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00348188-488f-40f7-be2d-4d4b753532f6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 0.890344 Sep 19 14:58:56.245383 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1850/3676] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:55 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:56.264579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-66290614-6a70-4aac-a169-6e98cbd4a588 req-ec89d171-c735-4155-80db-c555b3e80a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d", "tag": "ea5ba795-598c-460b-bc8b-70817e0b466a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:56.294289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.300853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.302480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.305627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.308629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.310641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.339305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-66290614-6a70-4aac-a169-6e98cbd4a588 req-ec89d171-c735-4155-80db-c555b3e80a20 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.340337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-66290614-6a70-4aac-a169-6e98cbd4a588 req-ec89d171-c735-4155-80db-c555b3e80a20 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.350596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-66290614-6a70-4aac-a169-6e98cbd4a588 req-ec89d171-c735-4155-80db-c555b3e80a20 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.453523 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-66290614-6a70-4aac-a169-6e98cbd4a588 req-ec89d171-c735-4155-80db-c555b3e80a20 service nova] Creating event network-changed:ea5ba795-598c-460b-bc8b-70817e0b466a for instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d on n-h2-858384-1 Sep 19 14:58:56.468721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-66290614-6a70-4aac-a169-6e98cbd4a588 req-ec89d171-c735-4155-80db-c555b3e80a20 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221761 Sep 19 14:58:56.469620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1851/3677] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:56.625196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:56.679674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:56.682649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:56.713554 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bfce49b6-ec6b-49ff-891b-d5ce20b80652 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.513233 Sep 19 14:58:56.796854 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1827/3678] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:56 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:56.990460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:56.991452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:57.019316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.019901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.023036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.024296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.033962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.036433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.294362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:57.295353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:57.309929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.316901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.317698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.318909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.320179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.320179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.490810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:57.507599 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ccea76d6-ad9b-4a6c-911d-ca5f276ece80 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.516366 Sep 19 14:58:57.509134 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1852/3679] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:56 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:57.808184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:57.809558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:57.822156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.828616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.829253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.830232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.830981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.831582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.847122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:57.863400 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1e409cd-f2fc-4cc2-a9b6-c486ba8fe511 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 0.570514 Sep 19 14:58:57.864095 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1828/3680] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:57 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:58.241691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:58.251374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:58.263573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:58.265324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c43a2e58-f487-4b2f-92c8-8dcef3962703 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.461207 Sep 19 14:58:58.266507 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1853/3681] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:57 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:58.536623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:58.540402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:58.571218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.573129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.573831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.576100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.577588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.579621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.887847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:58.889282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:58.913667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.919796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.920165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.920958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.921436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.921876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.988669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:59.344971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:59.363110 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0107735-47ef-4a88-8a58-d6f7c016999f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.831285 Sep 19 14:58:59.375518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1829/3682] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:58 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:59.385379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:59.386040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:59.399552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:59.404793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:59.412459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:59.412459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:59.417284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:59.419028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:59.442152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:59.481879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=18 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:59.633653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:59.662894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:59.667392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:59.672129 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2a35d33-14f0-4c40-9f68-e822903cde9b tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.294442 Sep 19 14:58:59.674307 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1830/3683] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:59 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:59.709921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:59.732674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0277b9d5-606a-41f9-912a-d09be59d2057 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 0.849848 Sep 19 14:58:59.744298 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1854/3684] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:58 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:59.747688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:59.748770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:59.771423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:59.771993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:59.773137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:59.775249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:59.776425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:59.776892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:59.823890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lazy-loading 'flavor' on Instance uuid 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:58:59.849008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-31ece0bf-ec7d-4c16-80f4-79fd04e00726 req-5ffcaaa6-bc50-4d0d-a8a3-36e52d43c96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f5fb48-cb17-4fa0-b3d4-088010d4e332", "tag": "ced1a037-e0a0-4545-b8a7-1c87853f8c43"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:59.881973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-31ece0bf-ec7d-4c16-80f4-79fd04e00726 req-5ffcaaa6-bc50-4d0d-a8a3-36e52d43c96e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:59.883663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-31ece0bf-ec7d-4c16-80f4-79fd04e00726 req-5ffcaaa6-bc50-4d0d-a8a3-36e52d43c96e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:59.884953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-31ece0bf-ec7d-4c16-80f4-79fd04e00726 req-5ffcaaa6-bc50-4d0d-a8a3-36e52d43c96e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:59.944292 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-31ece0bf-ec7d-4c16-80f4-79fd04e00726 req-5ffcaaa6-bc50-4d0d-a8a3-36e52d43c96e service nova] Creating event network-changed:ced1a037-e0a0-4545-b8a7-1c87853f8c43 for instance 88f5fb48-cb17-4fa0-b3d4-088010d4e332 on n-h1-858384-1 Sep 19 14:58:59.955761 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-31ece0bf-ec7d-4c16-80f4-79fd04e00726 req-5ffcaaa6-bc50-4d0d-a8a3-36e52d43c96e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116995 Sep 19 14:58:59.957273 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1855/3685] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:00.155618 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ddc632d8-c9b1-4b46-8a0f-9860ea06b40e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/action" status: 202 len: 0 microversion: 2.20 time: 0.416736 Sep 19 14:59:00.168315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.169498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.173703 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1831/3686] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 14:58:59 2022] POST /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:59:00.178975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.179781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.180395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.181767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.182410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.183056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.397267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.397987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.411419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.411925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.412472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.413101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.413574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.414010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.804450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:00.855412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:00.863695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:00.883495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-77cac4a8-5468-4fb4-a2dd-f0c2f9364b4a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.490547 Sep 19 14:59:00.895304 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1832/3687] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:00 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:00.898902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:00.900676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:00.905160 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e0d817c6-72ce-4c42-803c-ec7d92ca3037 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.741695 Sep 19 14:59:00.905802 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1856/3688] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:00 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:00.907253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.908694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.925601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.926479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.930134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.931221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.931806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.936039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.973647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.974472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.996096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.996649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.997254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.997751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.998225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.998660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:01.164327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:01.190076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:01.195146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:01.197984 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd0629bb-92ba-42da-9f0f-692f9c5d124a tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.300731 Sep 19 14:59:01.200133 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1833/3689] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:00 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:01.920539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:01.922057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:01.938562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:01.939750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:01.940462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:01.942258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:01.943041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:01.943753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:01.965810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:01.982125 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-236a1ae1-1cf2-44e1-91a5-836e5255410e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 1.028875 Sep 19 14:59:01.983339 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1857/3690] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:00 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:01.998716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:01.999914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.016316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.016713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.020365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.021358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.023392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.026407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.452684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.466534 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a324fb46-14f1-4542-aa1d-f68ae213b9ca tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.555557 Sep 19 14:59:02.467847 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1834/3691] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:01 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:02.474454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:02.475376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.484232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.486813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.488499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.489360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.490324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.491005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.491618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.502993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.504489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.505741 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a0bf8f22-abda-4f8c-b35c-700c0068a450 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.521404 Sep 19 14:59:02.506327 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1858/3692] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:01 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:02.511439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-db8471d0-a4a3-4039-a79a-727978269b0c req-5ea8552f-b254-47cc-a497-9d3e40913f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72103558-20ae-49e3-a461-ef56cfbd51e2", "tag": "e97f7a7d-37bb-45eb-b342-085dbeeddfa3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:02.545217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db8471d0-a4a3-4039-a79a-727978269b0c req-5ea8552f-b254-47cc-a497-9d3e40913f1f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.546043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db8471d0-a4a3-4039-a79a-727978269b0c req-5ea8552f-b254-47cc-a497-9d3e40913f1f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.546488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db8471d0-a4a3-4039-a79a-727978269b0c req-5ea8552f-b254-47cc-a497-9d3e40913f1f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.569922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-db8471d0-a4a3-4039-a79a-727978269b0c req-5ea8552f-b254-47cc-a497-9d3e40913f1f service nova] Creating event network-changed:e97f7a7d-37bb-45eb-b342-085dbeeddfa3 for instance 72103558-20ae-49e3-a461-ef56cfbd51e2 on n-h2-858384-1 Sep 19 14:59:02.577759 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-db8471d0-a4a3-4039-a79a-727978269b0c req-5ea8552f-b254-47cc-a497-9d3e40913f1f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069937 Sep 19 14:59:02.579180 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1859/3693] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:02.610993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.627182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.628697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.630220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3dfc341-6f55-44b3-96f8-5cfc522bc341 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.161135 Sep 19 14:59:02.632138 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1835/3694] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:02 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:02.786295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-792d0f9e-1494-4a1f-b438-32347d10eb93 req-b5352718-8860-4498-a9c3-c1c2b3191f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d", "name": "network-vif-plugged", "status": "completed", "tag": "ea5ba795-598c-460b-bc8b-70817e0b466a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:02.800411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-792d0f9e-1494-4a1f-b438-32347d10eb93 req-b5352718-8860-4498-a9c3-c1c2b3191f04 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.801324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-792d0f9e-1494-4a1f-b438-32347d10eb93 req-b5352718-8860-4498-a9c3-c1c2b3191f04 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.802407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-792d0f9e-1494-4a1f-b438-32347d10eb93 req-b5352718-8860-4498-a9c3-c1c2b3191f04 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.827162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-792d0f9e-1494-4a1f-b438-32347d10eb93 req-b5352718-8860-4498-a9c3-c1c2b3191f04 service nova] Creating event network-vif-plugged:ea5ba795-598c-460b-bc8b-70817e0b466a for instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d on n-h2-858384-1 Sep 19 14:59:02.836331 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-792d0f9e-1494-4a1f-b438-32347d10eb93 req-b5352718-8860-4498-a9c3-c1c2b3191f04 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053915 Sep 19 14:59:02.838263 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1860/3695] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:03.046645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:03.049141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:03.065244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.066447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.067480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.069783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.070590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.071705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.464374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:03.481736 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cff07bdf-39ff-45b6-bb15-c3288121989b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 0.442950 Sep 19 14:59:03.493518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:03.495485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:03.499585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1836/3696] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:03 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:03.512652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.514342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.517943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.519268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.520988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.521879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.544699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:03.545867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:03.561100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.562511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.562853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.564291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.567624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.568506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.582027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:04.111577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.137071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.158655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.162277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.163269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-583cb0fe-f201-4033-bd50-f77cf59c738f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.675487 Sep 19 14:59:04.165088 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1861/3697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:03 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:04.166440 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f622aa8a-8b14-4592-971f-bcd7ec308653 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.631174 Sep 19 14:59:04.185125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:04.188232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:04.213289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:04.215800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:04.217977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:04.220092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:04.221532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:04.222372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:04.226926 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1837/3698] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:03 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:04.461885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.488118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.497404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.499891 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a76120eb-3178-4777-a9ea-36eb212a97d3 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.332978 Sep 19 14:59:04.500859 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1862/3699] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:04 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:04.525508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:04.526832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:04.542653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:04.544421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:04.545104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:04.545858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:04.546574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:04.547156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:04.961967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:04.974289 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c566e6b9-8632-455a-aa1b-f8fc7320fb93 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1314 microversion: 2.1 time: 0.456750 Sep 19 14:59:04.976600 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1838/3700] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:04 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:05.198422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:05.200569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:05.227153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:05.229289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:05.238100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:05.242920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:05.248674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:05.249700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:05.251420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:05.251907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:05.252595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:05.253598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:05.256053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:05.257578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:05.260879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:05.264856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:05.268703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:05.997526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.014468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.015978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.017252 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be7a2db8-23a9-471c-b35e-1527673d745e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.794841 Sep 19 14:59:06.017804 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1839/3701] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:05 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:06.034023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:06.035168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:06.048052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.048796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.049419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.050342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.051239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.051840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.085617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.111957 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-70e98eb3-d480-4f1e-82cf-e75f5ce3e66a tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.919374 Sep 19 14:59:06.113022 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1863/3702] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:05 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:06.118793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:06.119739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:06.128235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.129299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.129998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.130989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.131736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.135513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.189063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.208146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.210124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.211717 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa6252a7-c1c1-4a25-ad2e-15ac438ea813 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.191905 Sep 19 14:59:06.212572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1840/3703] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:06 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:06.218290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-10946ff0-bdb5-4f2a-92c9-7c3013b58ff5 req-1c5577e9-065f-4eae-b4e9-271c3628f2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f5fb48-cb17-4fa0-b3d4-088010d4e332", "name": "network-vif-plugged", "status": "completed", "tag": "ced1a037-e0a0-4545-b8a7-1c87853f8c43"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:06.245719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-10946ff0-bdb5-4f2a-92c9-7c3013b58ff5 req-1c5577e9-065f-4eae-b4e9-271c3628f2c5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.246906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-10946ff0-bdb5-4f2a-92c9-7c3013b58ff5 req-1c5577e9-065f-4eae-b4e9-271c3628f2c5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.250005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-10946ff0-bdb5-4f2a-92c9-7c3013b58ff5 req-1c5577e9-065f-4eae-b4e9-271c3628f2c5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.272579 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-10946ff0-bdb5-4f2a-92c9-7c3013b58ff5 req-1c5577e9-065f-4eae-b4e9-271c3628f2c5 service nova] Creating event network-vif-plugged:ced1a037-e0a0-4545-b8a7-1c87853f8c43 for instance 88f5fb48-cb17-4fa0-b3d4-088010d4e332 on n-h1-858384-1 Sep 19 14:59:06.293030 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-10946ff0-bdb5-4f2a-92c9-7c3013b58ff5 req-1c5577e9-065f-4eae-b4e9-271c3628f2c5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078698 Sep 19 14:59:06.294484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1841/3704] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:06.653516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.676679 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ae92ecc-c282-4402-87b1-d4be0fc12861 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1500 microversion: 2.1 time: 0.560653 Sep 19 14:59:06.682830 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1864/3705] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:06 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1500 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:06.703530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:06.706348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:06.717466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.717983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.718808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.723736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.724298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.724691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.797756 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74e7038d-a19a-4f28-8e8b-b86818a9e4a9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 0.098205 Sep 19 14:59:06.803687 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1842/3706] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:06 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:07.048634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:07.051388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:07.064190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:07.064714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:07.068128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:07.080410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:07.080934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:07.081399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:07.145019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:07.145760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:07.172740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:07.176125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:07.177087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:07.187998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:07.189155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:07.190939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:07.868396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:07.882111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:07.884835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:07.886890 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-50ea8251-434c-4d72-a67d-72c173bc168e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.846664 Sep 19 14:59:07.906448 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1865/3707] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:07 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:07.920302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:07.922955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:07.923943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:07.940529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:07.941938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:07.943891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:07.945406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:07.946092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:07.947065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:07.968598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8418ef8-22b1-4b15-afa5-304e3ff2260e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.829400 Sep 19 14:59:07.978194 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1843/3708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:07 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:08.039530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:08.045914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:08.082940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:08.084146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:08.084665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:08.085122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:08.090827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:08.094120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:08.094426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:08.094965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:08.096876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:08.098475 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae81b38f-dc5e-40eb-aeb9-f4ea216b12fc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.189072 Sep 19 14:59:08.099354 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1866/3709] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:07 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:08.174439 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f35dae76-c85a-40fd-b1ca-f38cad761e9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 0.178473 Sep 19 14:59:08.183567 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1844/3710] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:07 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:08.764982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fec4d497-5980-4855-8adb-ca70447d4e9e req-2cf7b5ea-4d7f-4dac-aace-7b9916e1b6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72103558-20ae-49e3-a461-ef56cfbd51e2", "name": "network-vif-plugged", "status": "completed", "tag": "e97f7a7d-37bb-45eb-b342-085dbeeddfa3"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:08.800141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fec4d497-5980-4855-8adb-ca70447d4e9e req-2cf7b5ea-4d7f-4dac-aace-7b9916e1b6a4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:08.800627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fec4d497-5980-4855-8adb-ca70447d4e9e req-2cf7b5ea-4d7f-4dac-aace-7b9916e1b6a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:08.801259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fec4d497-5980-4855-8adb-ca70447d4e9e req-2cf7b5ea-4d7f-4dac-aace-7b9916e1b6a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:08.845151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fec4d497-5980-4855-8adb-ca70447d4e9e req-2cf7b5ea-4d7f-4dac-aace-7b9916e1b6a4 service nova] Creating event network-vif-plugged:e97f7a7d-37bb-45eb-b342-085dbeeddfa3 for instance 72103558-20ae-49e3-a461-ef56cfbd51e2 on n-h2-858384-1 Sep 19 14:59:08.863593 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fec4d497-5980-4855-8adb-ca70447d4e9e req-2cf7b5ea-4d7f-4dac-aace-7b9916e1b6a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105214 Sep 19 14:59:08.865843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1867/3711] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:08.923007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:08.923857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:08.956650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:08.957417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:08.957893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:08.960174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:08.960680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:08.961136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.022874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:09.024562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:09.047178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:09.052872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:09.053549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.055745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:09.058350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:09.060483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.570865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.595670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.602046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.606232 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f9900ab-830d-4de4-ba0d-56529a5c1072 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.688627 Sep 19 14:59:09.620184 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1845/3712] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:08 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:09.658284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:09.660476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:09.673486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.676293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:09.677696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:09.681166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.683042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:09.685408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:09.686177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.692172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ce5bcde-10f7-4220-9c94-45437f348d2c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1320 microversion: 2.1 time: 0.673322 Sep 19 14:59:09.694740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:09.713401 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1868/3713] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:09 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1320 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:09.743393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:09.749408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:09.763645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:09.765191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:09.766626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.768396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:09.770401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:09.771660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:09.863395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.891619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.893746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:09.895056 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-014f6121-509c-4d4c-8db1-b701a4a198b6 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.272454 Sep 19 14:59:09.900191 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1846/3714] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:09 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:10.225559 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b09f2ef0-f79c-409b-b8bd-aecc5cc1be1f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 0.498190 Sep 19 14:59:10.226235 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1869/3715] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:09 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:10.668556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:10.672131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:10.696346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:10.697833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:10.702247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:10.703423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:10.707414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:10.708670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:10.759151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:10.764164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:10.809232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:10.814069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:10.817982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:10.820228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:10.825352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:10.825936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.310974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.319038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.322035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.323975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.326479 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9607c0b8-76ce-4465-8f9f-b5d9f9c37aef tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.666655 Sep 19 14:59:11.327718 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1847/3716] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:10 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:11.342361 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8da41f80-3ca3-4e48-84f5-cdca3bf10b0f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 200 len: 1508 microversion: 2.1 time: 0.599055 Sep 19 14:59:11.342996 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1870/3717] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:10 2022] GET /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 1508 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:11.343704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:11.344335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:11.348719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:11.351151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.351996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.352655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.353607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.354274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.354391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:11.355035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.370593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.371843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.372547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.373455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.373935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.374371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.469730 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-213e60dd-a1f0-4c88-8042-82d0d2af2dd8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 0.125048 Sep 19 14:59:11.471542 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1871/3718] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:11 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:11.483003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:11.484062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 88f5fb48-cb17-4fa0-b3d4-088010d4e332] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:11.493669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.494432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.494984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.496864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.497949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.498419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.554045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.564604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.566371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.580025 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d0fa77d-85b6-4bb5-8888-de808368c96c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.250903 Sep 19 14:59:11.580846 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1848/3719] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:11 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:11.898098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:11.916236 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c9d5628-009b-4ead-816d-9b1edd91d97e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/88f5fb48-cb17-4fa0-b3d4-088010d4e332" status: 200 len: 1509 microversion: 2.1 time: 0.442845 Sep 19 14:59:11.917615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1872/3720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:11 2022] GET /compute/v2.1/servers/88f5fb48-cb17-4fa0-b3d4-088010d4e332 => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:11.958020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:11.958602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 88f5fb48-cb17-4fa0-b3d4-088010d4e332] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:11.973427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.973938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.974390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:11.975158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:11.975629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:11.980051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:12.051447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 88f5fb48-cb17-4fa0-b3d4-088010d4e332] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:12.246850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-505fecc7-b955-4c2c-a0eb-870563336115 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "DELETE /compute/v2.1/servers/88f5fb48-cb17-4fa0-b3d4-088010d4e332" status: 204 len: 0 microversion: 2.1 time: 0.292632 Sep 19 14:59:12.250574 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1849/3721] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:11 2022] DELETE /compute/v2.1/servers/88f5fb48-cb17-4fa0-b3d4-088010d4e332 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:59:12.260206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:12.260730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:12.280170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:12.280170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:12.280170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:12.280669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:12.283003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:12.283557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:12.357056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 72103558-20ae-49e3-a461-ef56cfbd51e2] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:12.384545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:12.385273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:12.404449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:12.404986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:12.405442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:12.406188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:12.406668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:12.407165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:12.564573 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2458703e-2b8c-4356-9ab8-10b527c4143c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "DELETE /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2" status: 204 len: 0 microversion: 2.1 time: 0.308864 Sep 19 14:59:12.566001 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1873/3722] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:12 2022] DELETE /compute/v2.1/servers/72103558-20ae-49e3-a461-ef56cfbd51e2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:59:12.585362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:12.588224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:12.604395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:12.605261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:12.606537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:12.610263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:12.611323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:12.611991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:13.355638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:13.417445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:13.427353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:13.429301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7a09a3f-da82-4f42-bb0b-2e6b3f317ef5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 1.051092 Sep 19 14:59:13.455976 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1850/3723] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:12 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:59:13.463286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:13.464232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:13.474416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:13.477126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:13.477596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:13.478500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:13.479063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:13.479584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:13.610142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:13.635000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:13.648694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:13.655139 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc6355db-446f-4672-a709-473f862e7915 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1365 microversion: 2.57 time: 0.192037 Sep 19 14:59:13.662898 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1851/3724] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:13 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:13.665410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-781784592", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d825aab1-2456-4dbb-8b6f-a278ed119fab"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:13.672145 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c9571c5-6c92-4290-b5fc-a6658164cb5f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 1.062121 Sep 19 14:59:13.678816 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1874/3725] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:12 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:13.819345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] validate_networks() for [('d825aab1-2456-4dbb-8b6f-a278ed119fab', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:59:14.472204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:14.478121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:14.534358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:14.541777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:14.542397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:14.545154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:14.547608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:14.548222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:15.042368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:15.057122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:15.061207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:15.063868 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bed563f5-832c-4e7c-b1f1-abddb42562f4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 0.603859 Sep 19 14:59:15.073207 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1875/3726] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:14 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:15.283322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:59:15.284174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:59:15.284353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:59:15.284616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:59:15.285298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:59:15.302099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:15.302603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:15.303085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:15.303851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:15.304328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:15.304948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:15.379183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Getting quotas for project d379e03b58204dc09adecef25d911f46. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:59:15.396534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Getting quotas for user 6d4098eb8b2842c49cb266d93d19d2d1 and project d379e03b58204dc09adecef25d911f46. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:59:15.436942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Going to run 2 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:59:15.440543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:59:15.572928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=45d2d963-3530-49fb-98ae-bc8885d0d501,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:59:15.691564 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d6f833f-eaf0-4c64-9d6e-3fb3c3cf8cf4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.032852 Sep 19 14:59:15.697114 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1852/3727] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:59:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 2040 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 19 14:59:15.717917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:15.720855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:15.747032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:15.778528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:15.782042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:15.782739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:15.803820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:15.807413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:15.808469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:15.819952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:15.841446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:15.842390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:15.843239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:15.844588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:15.845424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:15.846222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:16.096520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:16.113557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:16.115190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:16.116495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bea6efef-3e2e-43fa-aaae-6d59499cc950 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1383 microversion: 2.57 time: 0.416851 Sep 19 14:59:16.124747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1853/3728] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:15 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1383 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:16.130061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:16.135405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:16.142243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Searching by: {'deleted': False, 'project_id': 'd379e03b58204dc09adecef25d911f46'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 14:59:16.192402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:16.192925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:16.193383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:16.194678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:16.196090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:16.197735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:16.295068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 14:59:16.391176 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17726982-e8bf-4bbc-9be6-f5c5b2b132e3 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.260790 Sep 19 14:59:16.391881 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1854/3729] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 14:59:16 2022] GET /compute/v2.1/servers => generated 1335 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:16.419236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5f49b68c-62cd-4dce-9312-b9020cf36f48 req-2f03abff-3d07-40ea-9582-002527deb83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72103558-20ae-49e3-a461-ef56cfbd51e2", "name": "network-vif-deleted", "tag": "e97f7a7d-37bb-45eb-b342-085dbeeddfa3"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:16.449500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5f49b68c-62cd-4dce-9312-b9020cf36f48 req-2f03abff-3d07-40ea-9582-002527deb83f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:16.453389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5f49b68c-62cd-4dce-9312-b9020cf36f48 req-2f03abff-3d07-40ea-9582-002527deb83f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:16.453389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5f49b68c-62cd-4dce-9312-b9020cf36f48 req-2f03abff-3d07-40ea-9582-002527deb83f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:16.478417 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5f49b68c-62cd-4dce-9312-b9020cf36f48 req-2f03abff-3d07-40ea-9582-002527deb83f service nova] Creating event network-vif-deleted:e97f7a7d-37bb-45eb-b342-085dbeeddfa3 for instance 72103558-20ae-49e3-a461-ef56cfbd51e2 on n-h2-858384-1 Sep 19 14:59:16.498723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5f49b68c-62cd-4dce-9312-b9020cf36f48 req-2f03abff-3d07-40ea-9582-002527deb83f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104877 Sep 19 14:59:16.499993 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1855/3730] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:16.506221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:16.506990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:16.524527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:16.525036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:16.525567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:16.532285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:16.541163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:16.544270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:16.855168 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a794317f-c618-4146-9f57-0ef49947ac9a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 1.787519 Sep 19 14:59:16.857498 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1876/3731] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:15 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:16.896700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-936ee5ac-be4a-452f-8e68-97196fa6601f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:16.904227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-936ee5ac-be4a-452f-8e68-97196fa6601f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:17.481926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:17.494806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:17.501822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:17.505775 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17b4d4d5-3f02-4214-9ab1-33e5fffb935e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1743 microversion: 2.20 time: 1.001793 Sep 19 14:59:17.506863 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1856/3732] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:16 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1743 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:17.547183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:17.550006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:17.572951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:17.576039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:17.576799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:17.578260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:17.580780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:17.581702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:17.677276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-936ee5ac-be4a-452f-8e68-97196fa6601f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:17.750491 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-936ee5ac-be4a-452f-8e68-97196fa6601f tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1217 microversion: 2.1 time: 0.884439 Sep 19 14:59:17.752166 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1877/3733] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:16 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1217 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:17.799540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3916598f-70fb-42fb-a451-2c1927484981 req-a19451ab-d7dc-48ae-ab56-8e24bde47fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f5fb48-cb17-4fa0-b3d4-088010d4e332", "name": "network-vif-deleted", "tag": "ced1a037-e0a0-4545-b8a7-1c87853f8c43"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:17.841666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3916598f-70fb-42fb-a451-2c1927484981 req-a19451ab-d7dc-48ae-ab56-8e24bde47fbf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:17.843384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3916598f-70fb-42fb-a451-2c1927484981 req-a19451ab-d7dc-48ae-ab56-8e24bde47fbf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:17.845346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3916598f-70fb-42fb-a451-2c1927484981 req-a19451ab-d7dc-48ae-ab56-8e24bde47fbf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:17.904206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3916598f-70fb-42fb-a451-2c1927484981 req-a19451ab-d7dc-48ae-ab56-8e24bde47fbf service nova] Creating event network-vif-deleted:ced1a037-e0a0-4545-b8a7-1c87853f8c43 for instance 88f5fb48-cb17-4fa0-b3d4-088010d4e332 on n-h1-858384-1 Sep 19 14:59:17.919132 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3916598f-70fb-42fb-a451-2c1927484981 req-a19451ab-d7dc-48ae-ab56-8e24bde47fbf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158623 Sep 19 14:59:17.923288 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1878/3734] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:17.953859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:17.956648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:17.972369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:17.973189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:17.973789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:17.974704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:17.979368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:17.979828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:18.039379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:18.076174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:18.080870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:18.087674 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09851ef3-4d7f-48ed-94db-5824364d9b24 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1371 microversion: 2.57 time: 0.560696 Sep 19 14:59:18.091825 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1857/3735] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:17 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:18.138933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcfec3eb-29b8-46c3-a486-2deafe130b37 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 14 microversion: 2.1 time: 0.213827 Sep 19 14:59:18.139656 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1879/3736] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:17 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:18.544727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:18.546040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:18.564874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:18.567156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:18.567845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:18.569305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:18.572157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:18.572846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:18.792385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:18.793868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:18.832538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:18.835926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:18.836396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:18.838438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:18.843784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:18.845508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:18.868450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:19.281830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.299693 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-965096ef-fdcd-4385-a167-578fc23a8008 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1213 microversion: 2.1 time: 0.512393 Sep 19 14:59:19.307831 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1880/3737] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:18 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1213 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:19.320395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:19.335723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:19.343858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:19.349104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:19.349756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:19.350888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:19.351658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:19.356002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:19.804769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.826658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.834514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.839822 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a846a28b-a392-4a37-ad0f-60c788492a3c tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1356 microversion: 2.57 time: 0.526622 Sep 19 14:59:19.851545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.868266 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1881/3738] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:19 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1356 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:19.877862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.887648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:19.889615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:19.893256 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca311a15-2414-4125-96b1-14477fddc2d2 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.355872 Sep 19 14:59:19.894736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:19.912450 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1858/3739] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:18 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:19.937056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:19.939647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:19.943404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:19.944777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:19.949283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:19.955456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:19.957107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:19.958658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:19.965637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:19.966493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:19.967985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:19.970783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:19.971616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:19.973280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:20.111936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:20.133579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab3b18ff-1038-4399-ad0d-1f185a1848ac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action" status: 200 len: 16397 microversion: 2.1 time: 0.261137 Sep 19 14:59:20.141645 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1882/3740] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:19 2022] POST /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d/action => generated 16397 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:59:20.158741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:20.160755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:20.184497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:20.185201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:20.185798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:20.186881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:20.187470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:20.188782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:20.486465 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d7c31c6-237e-4617-bf0f-fa8b8f1f8798 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "DELETE /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 204 len: 0 microversion: 2.57 time: 0.569552 Sep 19 14:59:20.490965 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1859/3741] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 14:59:19 2022] DELETE /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 14:59:20.501129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:20.503692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:20.518084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:20.519957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:20.521819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:20.523658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:20.528617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:20.529341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:20.591401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:21.288610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:21.308729 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eac4d89a-2191-4e0a-bc81-655d8e0a2e3b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1269 microversion: 2.1 time: 0.810844 Sep 19 14:59:21.314809 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1860/3742] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:20 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1269 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:21.328999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:21.331018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:21.349948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:21.351867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:21.353753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:21.354537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:21.356941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:21.358844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:21.700343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:21.723224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:21.725346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:21.729819 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f1bd88b0-bca8-4238-a1ca-6829258f4bbc tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1362 microversion: 2.57 time: 0.413753 Sep 19 14:59:21.731344 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1861/3743] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:21 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:21.741456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:21.744512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:21.760371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:21.763845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:21.764609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:21.765581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:21.767388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:21.774066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:21.842111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:21.861786 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-952fec94-983f-4dbe-94e0-93f989f6137d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.717750 Sep 19 14:59:21.864110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1883/3744] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:20 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:21.951418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:21.952505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:21.965089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:21.969731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:21.970718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:21.971480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:21.973414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:21.975002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:21.977210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:22.841805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:22.852505 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff66e76d-582b-4809-bdf2-216eec70b607 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.905426 Sep 19 14:59:22.861290 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1884/3745] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:21 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:22.867323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:22.883473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:22.908716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:22.915034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:22.919588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:22.921124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:22.921863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:22.922562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:23.037841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:23.051721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:23.076773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:23.078550 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6bd3467-1b3b-48b0-8eb6-d61606a4cceb tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.344388 Sep 19 14:59:23.093585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1862/3746] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:21 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:23.103637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e3c39c5f-5a98-409b-970b-f14b14da52eb req-bbabb1f4-742f-4bc1-94b4-e6d04e85ca97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "name": "network-vif-plugged", "status": "completed", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:23.143550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e3c39c5f-5a98-409b-970b-f14b14da52eb req-bbabb1f4-742f-4bc1-94b4-e6d04e85ca97 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:23.150267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e3c39c5f-5a98-409b-970b-f14b14da52eb req-bbabb1f4-742f-4bc1-94b4-e6d04e85ca97 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:23.151180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e3c39c5f-5a98-409b-970b-f14b14da52eb req-bbabb1f4-742f-4bc1-94b4-e6d04e85ca97 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:23.203980 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e3c39c5f-5a98-409b-970b-f14b14da52eb req-bbabb1f4-742f-4bc1-94b4-e6d04e85ca97 service nova] Creating event network-vif-plugged:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 14:59:23.239509 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e3c39c5f-5a98-409b-970b-f14b14da52eb req-bbabb1f4-742f-4bc1-94b4-e6d04e85ca97 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137229 Sep 19 14:59:23.240202 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1863/3747] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:23.266935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:23.270356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:23.288039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:23.288397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:23.288844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:23.296210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:23.300482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:23.302036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:23.417441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:23.423536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:23.424108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:23.428035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lazy-loading 'fault' on Instance uuid 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:59:24.336386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:24.345325 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-177ac481-d2bd-4276-86c9-65aeb9901fcc tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1275 microversion: 2.1 time: 1.481802 Sep 19 14:59:24.351443 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1885/3748] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:22 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1275 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:24.368871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:24.369778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:24.400066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:24.403647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:24.404393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:24.405344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:24.406249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:24.411098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:24.481622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:24.501297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:24.506626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c36076bb634054b653a94bb3c479e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870a285a21e44819cfc81dcf3bd6e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:24.512035 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-27ee98ec-1d52-4729-809c-3733f606f8a0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 200 len: 1367 microversion: 2.57 time: 1.270499 Sep 19 14:59:24.537366 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1864/3749] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:23 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 1367 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:24.556559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:24.565891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:24.588271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:24.596994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:24.599873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:24.603170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:24.606312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:24.606932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.345417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:25.365440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97741fc6-bba6-41ee-baac-9ea8a4fe77d5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.011630 Sep 19 14:59:25.366664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1886/3750] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:24 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:25.412170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:25.419546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:25.425550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:25.455534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.456083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.472894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.475459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.477022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.477646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.721506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:25.745879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:25.751924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:25.755240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12f7ae8f-9e6d-4fc8-b190-93ae7dd8cf7a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.216040 Sep 19 14:59:25.757625 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1865/3751] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:24 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:25.774904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:25.775828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:25.792719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.793982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.794629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.795615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.796250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.796878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.893416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:25.909210 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2daf15a-d84e-4eff-8e64-4bb3539f8eff tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1275 microversion: 2.1 time: 0.500398 Sep 19 14:59:25.925673 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1887/3752] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:25 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1275 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:25.936826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:25.937719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] [instance: 11fb6b89-1b5b-46de-99b6-06b7f5b85b05] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:25.946848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.947652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.948262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.949858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.950531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.951190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.985595 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] HTTP exception thrown: Instance 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 could not be found. Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Request method failure captured: Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 HTTP/1.1 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIOhrkuw2p_ND3nV6oK7t6qzWIty8au4HUOQ5oRuNTLhTyjY7SKGCV_mPkEduxXvvvb2DL55VKZ9iQx-KZKmBfqYPvKVpXpLTgZSyd_Re46DejLwKJcag33Hz7SaGL8JX4f2RIo2E4-ZtM3RnXcgWHGnspOosdBgrIVdZJBS5Yde47w Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.57 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0870a285a21e44819cfc81dcf3bd6e50 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerShowV257Test-636851628 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0870a285a21e44819cfc81dcf3bd6e50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0870a285a21e44819cfc81dcf3bd6e50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0870a285a21e44819cfc81dcf3bd6e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0870a285a21e44819cfc81dcf3bd6e50"}]}] Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerShowV257Test-636851628 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0870a285a21e44819cfc81dcf3bd6e50 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerShowV257Test-636851628 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerShowV257Test-636851628-project Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 14c36076bb634054b653a94bb3c479e6 Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerShowV257Test-636851628-project Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 could not be found. Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '11fb6b89-1b5b-46de-99b6-06b7f5b85b05'} Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 could not be found. Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 could not be found. Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:25.989396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 could not be found. Sep 19 14:59:25.993403 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:25.995074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] Returning 404 to user: Instance 11fb6b89-1b5b-46de-99b6-06b7f5b85b05 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:25.998633 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a693a289-11eb-4a86-b122-8e9462533ba0 tempest-ServerShowV257Test-636851628 tempest-ServerShowV257Test-636851628-project] 10.222.0.81 "GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05" status: 404 len: 111 microversion: 2.57 time: 0.071579 Sep 19 14:59:26.002805 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1888/3753] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:25 2022] GET /compute/v2.1/servers/11fb6b89-1b5b-46de-99b6-06b7f5b85b05 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:59:26.205076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:26.792048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:26.794739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:26.814544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:26.817565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:26.818358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:26.821592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:26.822898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:26.826375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.719509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:27.749886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:27.771778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab629bcc-f4a1-4e93-9618-a2cbc575c2b5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 2.012694 Sep 19 14:59:27.782224 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1866/3754] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:25 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:27.806389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:27.807188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:27.833576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.834094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.842893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.843697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.846130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.847138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:28.322678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.337434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-701698af-2e30-4bb8-9f8c-be01359725c4 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 0.553695 Sep 19 14:59:28.343938 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1867/3755] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:27 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:28.360264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:28.361740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:28.376421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:28.377326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:28.378001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:28.381347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:28.382191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:28.383043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:28.512310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Locking {{(pid=128730) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 19 14:59:28.696009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.702470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eef81d33-6cdd-4a04-9ad5-e57a02ad08d1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.355574 Sep 19 14:59:28.709046 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1868/3756] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:28 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:28.718962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.722536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.725363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4a0cf2e-2391-44d1-a260-b4b84afe7b29 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.939008 Sep 19 14:59:28.725981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:28.726712 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1889/3757] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:26 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:28.738606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:28.771495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:28.773673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:28.774570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:28.775954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:28.777640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:28.778671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.134167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:29.148491 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df4a7007-1789-4920-b691-4da22d594e1b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.438277 Sep 19 14:59:29.155831 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1869/3758] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:28 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:29.184914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:29.202008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.202952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.205110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.293963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] HTTP exception thrown: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 is locked Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Request method failure captured: Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action HTTP/1.1 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 15 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIKW8eDVNw4LEdqVpdCBxh2Qq4Tnz38DXsRJDnV8Vo4iGmvOO6SiPpvncK1LpZrOtmc59fgqG33RJW_PttC8VA_XyUig4Bdmrx3rK2oObQsW-BQK02umlJeR4Dlz7YrgaZ_zRV_AUfvqHRA4ELMlAjpzu8OrvM9k_62FZH8uM6_j-_Q Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5b030a0534946eb96c825f4c9acc526"}]}] Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1000218241 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1000218241-project Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c11d7590aa1f4fa48be57e2efc017a6f Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1000218241-project Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: {"os-stop": {}} Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 is locked Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7d5b990e-c5d3-4ead-83c5-138ba5427808', 'body': {'os-stop': {}}} Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 is locked Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 is locked Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 is locked Sep 19 14:59:29.295961 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 14:59:29.315507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Returning 409 to user: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 is locked {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:29.318389 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aeb96355-06c4-4c4b-bdac-f5ed140ec919 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 409 len: 107 microversion: 2.1 time: 0.140876 Sep 19 14:59:29.319253 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1890/3759] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:29 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 107 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:59:29.342964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:29.343916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:29.366922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.367465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.368089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.369006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.369634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.370308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.392669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:29.394516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:29.432034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.444310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.444885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.445745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.446995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.447586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.482216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Unlocking {{(pid=128730) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 19 14:59:29.635501 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b6c7683-13b8-433a-b578-6003951b6d4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.310159 Sep 19 14:59:29.637608 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1870/3760] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:29 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:29.646030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5bca54dd-9edb-4608-b0e1-3c3d6e21f07f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:29.661048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5bca54dd-9edb-4608-b0e1-3c3d6e21f07f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.661559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5bca54dd-9edb-4608-b0e1-3c3d6e21f07f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.662004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5bca54dd-9edb-4608-b0e1-3c3d6e21f07f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.735171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5bca54dd-9edb-4608-b0e1-3c3d6e21f07f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Going to try to stop instance {{(pid=128730) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:59:29.804586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=4,nova_cell1:UPDATE=9 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:29.866626 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5bca54dd-9edb-4608-b0e1-3c3d6e21f07f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.224279 Sep 19 14:59:29.884121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1871/3761] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:29 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:29.901029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:29.902227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:29.945173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.946995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.952990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.965572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.966155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.966607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:30.677649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:30.694440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfe3e968-be85-4bc6-835b-38db10d4dd8d tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 1.310311 Sep 19 14:59:30.711708 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1891/3762] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:29 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:30.723012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:30.723942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:30.734471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:30.735314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:30.736096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:30.737063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:30.737808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:30.738538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:31.545409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:31.565080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:31.572631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:31.589603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d60854d1-7c02-4ecf-9ce6-76c0e5144a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.697470 Sep 19 14:59:31.592126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1872/3763] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:29 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:31.601531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b8947af2-b95a-462d-8edb-aa086ff174d7 req-8debe5c0-0e4c-49b5-8c57-28017cb6bb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d2d963-3530-49fb-98ae-bc8885d0d501", "tag": "dcf2a073-a371-4880-bdf2-3ee05985dd0d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:31.647159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:31.656227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b8947af2-b95a-462d-8edb-aa086ff174d7 req-8debe5c0-0e4c-49b5-8c57-28017cb6bb25 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:31.657499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b8947af2-b95a-462d-8edb-aa086ff174d7 req-8debe5c0-0e4c-49b5-8c57-28017cb6bb25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:31.661794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b8947af2-b95a-462d-8edb-aa086ff174d7 req-8debe5c0-0e4c-49b5-8c57-28017cb6bb25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:31.715794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b8947af2-b95a-462d-8edb-aa086ff174d7 req-8debe5c0-0e4c-49b5-8c57-28017cb6bb25 service nova] Creating event network-changed:dcf2a073-a371-4880-bdf2-3ee05985dd0d for instance 45d2d963-3530-49fb-98ae-bc8885d0d501 on n-h1-858384-1 Sep 19 14:59:31.741555 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b8947af2-b95a-462d-8edb-aa086ff174d7 req-8debe5c0-0e4c-49b5-8c57-28017cb6bb25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140807 Sep 19 14:59:31.745298 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1873/3764] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:31.755645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:31.757181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:31.772750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:31.773485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:31.775401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:31.776409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:31.778424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:31.779251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.323082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:33.354216 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ef4c251-fdc9-4da9-8d61-c064195b6fbd tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 1.605269 Sep 19 14:59:33.358724 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1874/3765] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:31 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:33.374303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:33.375629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:33.406197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:33.410534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:33.416253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.420346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:33.424027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:33.425691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.515895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:33.547094 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-496f65f0-67cc-4622-84c9-4cbb22eb86fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 2.833426 Sep 19 14:59:33.580560 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1892/3766] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:30 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 2868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:34.381826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:34.382463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:34.423038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:34.432159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:34.445224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:34.448031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:34.450138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:34.451702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:34.856205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:34.879243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:34.881858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:34.883986 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-42b8ca52-5493-4d92-bf68-27fdba5136c3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.520647 Sep 19 14:59:34.885045 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1875/3767] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:33 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:34.912057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:34.931065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:34.946990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:34.947986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:34.948985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:34.950503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:34.951739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:34.952668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:36.108285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:36.137311 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4817d03-6bc0-4156-bc10-82dfe17182df tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 1.759595 Sep 19 14:59:36.144126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:36.155420 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1893/3768] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:34 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:36.157459 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f539998-ceb1-45e8-a138-827f8e26acc2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 1.268782 Sep 19 14:59:36.158303 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1876/3769] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:34 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:36.165110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:36.171755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:36.183321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:36.188474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:36.191251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:36.192516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:36.198044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:36.199786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:36.351523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7539fdc1-2ab4-4108-ad7d-4867fb4c3e17 req-65a8c3e4-68a1-4a33-a564-ed9201b314c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cadef41-00fa-4f2a-ad67-647ae278d200", "tag": "54b7b8a1-623a-43f0-8515-46cb7d0341ae"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:36.377293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7539fdc1-2ab4-4108-ad7d-4867fb4c3e17 req-65a8c3e4-68a1-4a33-a564-ed9201b314c8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:36.380827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7539fdc1-2ab4-4108-ad7d-4867fb4c3e17 req-65a8c3e4-68a1-4a33-a564-ed9201b314c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:36.390309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7539fdc1-2ab4-4108-ad7d-4867fb4c3e17 req-65a8c3e4-68a1-4a33-a564-ed9201b314c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:36.451022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7539fdc1-2ab4-4108-ad7d-4867fb4c3e17 req-65a8c3e4-68a1-4a33-a564-ed9201b314c8 service nova] Creating event network-changed:54b7b8a1-623a-43f0-8515-46cb7d0341ae for instance 1cadef41-00fa-4f2a-ad67-647ae278d200 on n-h1-858384-1 Sep 19 14:59:36.461751 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7539fdc1-2ab4-4108-ad7d-4867fb4c3e17 req-65a8c3e4-68a1-4a33-a564-ed9201b314c8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119292 Sep 19 14:59:36.463106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1877/3770] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:37.192855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:37.195011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:37.223211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:37.227159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:37.230205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:37.231476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:37.232459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:37.233284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:37.881851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:37.942630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:37.944827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:37.975936 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ea2b28c-0725-4e2c-a425-79d852fdff24 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.789484 Sep 19 14:59:37.984219 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1894/3771] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:36 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:38.016624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:38.022354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:38.072329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:38.078535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:38.085098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:38.088311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:38.092472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:38.101051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:39.852661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:39.893071 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-141ee0d0-c267-45be-a740-a2cbf4675d6c tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 2.705724 Sep 19 14:59:39.893867 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1878/3772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:37 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 2708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:39.915508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:39.920286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:39.939033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:39.951974 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0bf2f08d-a747-44bf-a54b-3724e33c3efd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 1.965740 Sep 19 14:59:39.952588 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1895/3773] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:37 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:39.957230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:39.957991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:39.958607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:39.959368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:39.960028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:39.960647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:40.929058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:40.933431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:40.976952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:40.978680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:40.979465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:40.994686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:40.997754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:40.998303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:41.093520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:41.119015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:41.123709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:41.127670 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be5a91fd-fdc4-4460-9f6d-75bc88a7483f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.215516 Sep 19 14:59:41.135571 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1879/3774] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:39 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:41.141864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:41.142844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:41.151435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:41.152559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:41.153228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:41.154337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:41.155033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:41.156188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:42.148494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:42.172661 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab443367-4c00-48ce-b36a-6d54d0b6a472 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1655 microversion: 2.1 time: 1.034515 Sep 19 14:59:42.179979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1880/3775] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:41 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1655 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:42.208889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:42.215512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-47b9ab4f-2b0c-423d-a659-f36b46a60944 req-442f05f9-7000-4dcc-abc2-fde3cd129a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d2d963-3530-49fb-98ae-bc8885d0d501", "name": "network-vif-plugged", "status": "completed", "tag": "dcf2a073-a371-4880-bdf2-3ee05985dd0d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:42.240313 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fc32d670-d2f9-473b-b9d2-b822c522f1c8 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 1.320819 Sep 19 14:59:42.247907 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1896/3776] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:40 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:42.265836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:42.271128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:42.278532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-47b9ab4f-2b0c-423d-a659-f36b46a60944 req-442f05f9-7000-4dcc-abc2-fde3cd129a8d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:42.279918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-47b9ab4f-2b0c-423d-a659-f36b46a60944 req-442f05f9-7000-4dcc-abc2-fde3cd129a8d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:42.287181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-47b9ab4f-2b0c-423d-a659-f36b46a60944 req-442f05f9-7000-4dcc-abc2-fde3cd129a8d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:42.297116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:42.304435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:42.304965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:42.309550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:42.311299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:42.311766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:42.321139 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-47b9ab4f-2b0c-423d-a659-f36b46a60944 req-442f05f9-7000-4dcc-abc2-fde3cd129a8d service nova] Creating event network-vif-plugged:dcf2a073-a371-4880-bdf2-3ee05985dd0d for instance 45d2d963-3530-49fb-98ae-bc8885d0d501 on n-h1-858384-1 Sep 19 14:59:42.335196 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-47b9ab4f-2b0c-423d-a659-f36b46a60944 req-442f05f9-7000-4dcc-abc2-fde3cd129a8d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151964 Sep 19 14:59:42.336733 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1881/3777] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:42.363216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6767c46b-cb68-4929-83f7-2e6b37b6bb38 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:42.399340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6767c46b-cb68-4929-83f7-2e6b37b6bb38 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:42.400659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6767c46b-cb68-4929-83f7-2e6b37b6bb38 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:42.401725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6767c46b-cb68-4929-83f7-2e6b37b6bb38 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:42.504497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6767c46b-cb68-4929-83f7-2e6b37b6bb38 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Going to try to start instance {{(pid=128730) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 14:59:42.632638 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6767c46b-cb68-4929-83f7-2e6b37b6bb38 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.293216 Sep 19 14:59:42.633643 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1882/3778] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:42 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:42.652521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:42.653975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:42.669903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:42.673316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:42.677845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:42.678798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:42.679408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:42.680024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.733680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:43.751669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:43.769075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:43.770847 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03c12542-dae9-4051-9358-8be861db1e13 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.521363 Sep 19 14:59:43.775881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1897/3779] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:42 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:43.795293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:43.796577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:43.814442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.819540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.820254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.826534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.827735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.829979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.841577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:44.120272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:44.135374 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-44105949-4fae-4f39-9e74-6df0221dcebe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1664 microversion: 2.1 time: 1.496746 Sep 19 14:59:44.150949 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1883/3780] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:42 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1664 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:44.455813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:44.475364 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-72e68f2a-ad2f-42bd-a828-5eeb8bcaa9da tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 0.689656 Sep 19 14:59:44.478128 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1898/3781] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:43 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:44.804481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.806020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:44.849031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:44.849928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:44.850821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:44.851811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:44.852485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:44.853112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.190072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:45.200840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:45.228520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.229408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.230434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.233410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.234428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.238839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.827480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:45.848963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:45.857092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:45.862568 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d73bd54-3f5a-46b4-867c-ab1df8bf5113 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.059116 Sep 19 14:59:45.865781 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1884/3782] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:45.911761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:45.912818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:45.937570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.939984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.940949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.942342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.943954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.945410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.181659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:46.195670 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e0d1ee59-b317-41bc-82ed-4e2746c16743 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1664 microversion: 2.1 time: 1.009398 Sep 19 14:59:46.219049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1899/3783] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:45 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1664 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:46.904498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:46.905454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:46.922966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.926433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.927158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.928083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.931411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.932239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:47.861784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:47.886283 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5fef4110-961d-4f67-94fb-8e2f76d0bc44 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 1.986616 Sep 19 14:59:47.890086 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1885/3784] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:45 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:47.898376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:47.898376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:47.915604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:47.916123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:47.916567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:47.924976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:47.925664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:47.926275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.112885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:48.136050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:48.141484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:48.144579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61bcbc7a-2999-4997-8e19-c2160190e848 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1738 microversion: 2.20 time: 1.244797 Sep 19 14:59:48.181561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1900/3785] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:46 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1738 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:59:48.594783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0f6e3660-13fb-4c1f-bb68-0594a13aa868 req-675874e6-2d3d-4a89-a9be-18af34b3995e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cadef41-00fa-4f2a-ad67-647ae278d200", "name": "network-vif-plugged", "status": "completed", "tag": "54b7b8a1-623a-43f0-8515-46cb7d0341ae"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:48.627165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0f6e3660-13fb-4c1f-bb68-0594a13aa868 req-675874e6-2d3d-4a89-a9be-18af34b3995e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.628870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0f6e3660-13fb-4c1f-bb68-0594a13aa868 req-675874e6-2d3d-4a89-a9be-18af34b3995e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.630625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0f6e3660-13fb-4c1f-bb68-0594a13aa868 req-675874e6-2d3d-4a89-a9be-18af34b3995e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.690207 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0f6e3660-13fb-4c1f-bb68-0594a13aa868 req-675874e6-2d3d-4a89-a9be-18af34b3995e service nova] Creating event network-vif-plugged:54b7b8a1-623a-43f0-8515-46cb7d0341ae for instance 1cadef41-00fa-4f2a-ad67-647ae278d200 on n-h1-858384-1 Sep 19 14:59:48.705675 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0f6e3660-13fb-4c1f-bb68-0594a13aa868 req-675874e6-2d3d-4a89-a9be-18af34b3995e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117568 Sep 19 14:59:48.709001 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1901/3786] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:48.859086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:48.872644 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-31a20808-c27b-4678-871c-3bafbbc0b0d9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.981381 Sep 19 14:59:48.892150 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1886/3787] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:47 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:48.931579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:48.932869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:48.943127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:48.943885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:48.945735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.949303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.949956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.950735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.959371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.960039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.961629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.962152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.962627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.964346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.964828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.965836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.224965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:50.233785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:50.240568 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b72e163d-5a7c-4c08-8e38-1004ee8f2b40 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1317 microversion: 2.1 time: 1.312867 Sep 19 14:59:50.245788 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e11d2a9-27d2-49c7-84f1-25692846ac44 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.322227 Sep 19 14:59:50.251006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1887/3788] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:48 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1317 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:50.251731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1902/3789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:48 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:50.274564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:50.275469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:50.277488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:50.279240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:50.284886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.285166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.285635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.286393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.290676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.290961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.291342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.294614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.295478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.296515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.297828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.299156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.383718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Unlocking {{(pid=128731) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 19 14:59:50.500622 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-101e1a9f-5878-49ed-b326-9991038eedae tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.228520 Sep 19 14:59:50.508721 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1903/3790] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:50 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:50.542643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:50.547833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:50.578281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.582780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.585603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.589833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.591560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.593072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.911279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:50.942821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:50.946932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:50.949804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9503ca57-9462-423d-84bf-ae59f57fc470 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1720 microversion: 2.20 time: 0.685328 Sep 19 14:59:50.985979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1888/3791] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:50 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1720 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:51.193674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:51.213598 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-701fc881-eb2c-4987-8283-640eacf0b577 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.692503 Sep 19 14:59:51.214649 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1904/3792] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:50 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:51.247530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:51.248682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:51.288996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:51.291620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:51.305568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.318070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.320115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.332209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.332768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.333500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.334236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.334930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.337537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.339701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.343635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.344103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.354085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:51.865038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:51.876845 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0430aadc-2ffc-4e0d-9ffd-1366d1d7900b tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 200 len: 1505 microversion: 2.1 time: 0.602822 Sep 19 14:59:51.888804 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1905/3793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:51 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:51.890524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:51.911952 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ee65cecd-19df-4f83-853f-163286fbd5c2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.673273 Sep 19 14:59:51.913136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:51.913800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:51.915711 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1889/3794] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:51 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:51.922037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.922540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.927514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.929426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.930138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.932528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.946574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:51.947323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:51.990424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.991491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.992126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.993258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.993992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.994696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.535571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:52.544927 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78d2aa27-568c-400f-82ad-becb69ba7db1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501" status: 200 len: 1506 microversion: 2.1 time: 0.642222 Sep 19 14:59:52.550731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1906/3795] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:51 2022] GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:52.569312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:52.570559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:52.579825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=46 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:52.582042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.585090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.587170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.588211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.591958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:52.601320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7702464a-a724-464b-bbc2-72733effc184 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.658652 Sep 19 14:59:52.602195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.603545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.610478 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1890/3796] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:51 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:52.626778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6655dc72-bb38-49e7-b135-5f4b7f9477a0 req-86979593-4194-4c49-a1c6-7cba20bc579c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "name": "network-vif-unplugged", "status": "completed", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:52.663646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6655dc72-bb38-49e7-b135-5f4b7f9477a0 req-86979593-4194-4c49-a1c6-7cba20bc579c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.672250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6655dc72-bb38-49e7-b135-5f4b7f9477a0 req-86979593-4194-4c49-a1c6-7cba20bc579c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.672847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6655dc72-bb38-49e7-b135-5f4b7f9477a0 req-86979593-4194-4c49-a1c6-7cba20bc579c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.705520 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6655dc72-bb38-49e7-b135-5f4b7f9477a0 req-86979593-4194-4c49-a1c6-7cba20bc579c service nova] Creating event network-vif-unplugged:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 14:59:52.733752 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6655dc72-bb38-49e7-b135-5f4b7f9477a0 req-86979593-4194-4c49-a1c6-7cba20bc579c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117105 Sep 19 14:59:52.735002 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1891/3797] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:52.744091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:52.745445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:52.762638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.763320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.763868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.764712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.771163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.771783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.838953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:53.025554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:53.046587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:53.053251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:53.056338 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d396e959-2107-46bb-bb20-af03d9907478 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1720 microversion: 2.20 time: 0.504102 Sep 19 14:59:53.059814 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f38d40a3-b64d-4b81-b59b-04686b017b1e tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "DELETE /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501" status: 204 len: 0 microversion: 2.1 time: 0.323266 Sep 19 14:59:53.067479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1907/3798] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:52 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1720 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:53.074020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:53.077409 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1892/3799] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:52 2022] DELETE /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:59:53.082612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:53.097757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.098364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.098922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.099773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.105750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.106321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.259792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d5ff7c3-cd75-4b06-a3db-535d873b1713 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.189897 Sep 19 14:59:53.261842 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1908/3800] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 14:59:53 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:53.274235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:53.275399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:53.286142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.287348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.288551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.290473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.292913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.294566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.353295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:53.525581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-865112189", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:53.554096 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-07ec7317-cc9f-4ac2-9c4d-a89f78489ad1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 204 len: 0 microversion: 2.1 time: 0.289630 Sep 19 14:59:53.558889 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1909/3801] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:53 2022] DELETE /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:59:53.573944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:53.576930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:53.594510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.596900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.599099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.600803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.602159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.604731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.618541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:53.665431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] validate_networks() for [('becbe19b-7264-4a9a-a233-6761770cd2c6', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:59:54.121910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:54.140102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf2a4b3c-acef-4bb3-8455-60afcd5656fd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1673 microversion: 2.1 time: 0.578853 Sep 19 14:59:54.141008 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1910/3802] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:53 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1673 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:54.146835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:54.147681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:54.160680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.164336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.164966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.165892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.166356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.176004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.486808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:54.496191 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9df07c7a-0a69-41bd-89d5-8aa3dc3577b1 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501" status: 200 len: 1512 microversion: 2.1 time: 0.353931 Sep 19 14:59:54.516517 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1911/3803] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:54 2022] GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:54.521929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:54.527632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:54.540530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.541308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.542478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.543804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.544493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.545111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.015393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:55.033680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:55.035889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:55.037678 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8537219c-8972-4687-95ae-3b6bae301316 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1720 microversion: 2.20 time: 0.519775 Sep 19 14:59:55.038467 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1912/3804] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:54 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1720 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:55.165621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:55.167166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:55.175214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.175930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.176692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.177438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.177905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.178334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.449089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:59:55.449758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:59:55.450319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:59:55.451144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:59:55.451681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:59:55.486524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.490033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.491118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.492075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.500378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.501109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.546474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Getting quotas for project f41eff4a51f84522bd0a289ed00bb41d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:59:55.553917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Getting quotas for user 161efee238a84f78b6771e71701eda05 and project f41eff4a51f84522bd0a289ed00bb41d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:59:55.576722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:59:55.580308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:59:55.669072 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c60ebfe5-6636-42bf-bda5-4402b09846a5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.592878 Sep 19 14:59:55.674684 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1893/3805] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 14:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:59:55.705303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:55.721744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:55.744167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.749329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.752522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.753368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.755942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.756917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.950739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:55.965397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c737fac6-933d-4bf3-985b-8dcdc24395aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1673 microversion: 2.1 time: 0.803462 Sep 19 14:59:55.973719 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1913/3806] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:55 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1673 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:55.987471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bc220203-e1ad-4334-b25a-85fb3f534571 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:55.988598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bc220203-e1ad-4334-b25a-85fb3f534571 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:57.135024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bc220203-e1ad-4334-b25a-85fb3f534571 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:57.152487 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bc220203-e1ad-4334-b25a-85fb3f534571 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1216 microversion: 2.1 time: 1.175131 Sep 19 14:59:57.155898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1914/3807] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:55 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1216 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:57.179274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:57.181299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:57.217529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.220862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.224787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:57.231447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.233391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.234195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:57.483098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:57.525622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aaa9961a-bb64-4dc7-b8d4-f3ccb757c679 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501" status: 200 len: 1512 microversion: 2.1 time: 1.844756 Sep 19 14:59:57.529018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1894/3808] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:55 2022] GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 => generated 1512 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:57.578946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:57.580256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:57.611144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.612084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.612981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:57.615477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.616542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.617213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.688731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:59.718464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eefd96d1-79ef-405c-8e81-3c21a0a87287 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1653 microversion: 2.1 time: 2.172280 Sep 19 14:59:59.719483 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1895/3809] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:57 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1653 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:59.740025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-013a4a96-4b0d-42b4-9978-b2f9af79fe76 req-d73c7dad-ee84-4154-9abf-140326f32abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cadef41-00fa-4f2a-ad67-647ae278d200", "name": "network-vif-deleted", "tag": "54b7b8a1-623a-43f0-8515-46cb7d0341ae"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:59.763057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-013a4a96-4b0d-42b4-9978-b2f9af79fe76 req-d73c7dad-ee84-4154-9abf-140326f32abb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.763867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-013a4a96-4b0d-42b4-9978-b2f9af79fe76 req-d73c7dad-ee84-4154-9abf-140326f32abb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.764534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-013a4a96-4b0d-42b4-9978-b2f9af79fe76 req-d73c7dad-ee84-4154-9abf-140326f32abb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.798556 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-013a4a96-4b0d-42b4-9978-b2f9af79fe76 req-d73c7dad-ee84-4154-9abf-140326f32abb service nova] Creating event network-vif-deleted:54b7b8a1-623a-43f0-8515-46cb7d0341ae for instance 1cadef41-00fa-4f2a-ad67-647ae278d200 on n-h1-858384-1 Sep 19 14:59:59.800098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:59.809555 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-013a4a96-4b0d-42b4-9978-b2f9af79fe76 req-d73c7dad-ee84-4154-9abf-140326f32abb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087770 Sep 19 14:59:59.815105 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1896/3810] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:59.828202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:59.831827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:59.842999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:59.847767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.850968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.851562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.852879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.855212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.855534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:59.856070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.867559 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23f63636-fce8-4691-b520-8563532d3809 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1663 microversion: 2.20 time: 2.700213 Sep 19 14:59:59.869146 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1915/3811] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:57 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1663 bytes in 2711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:59:59.896212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:59.898520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:59.925806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.930789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.933977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.934963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.935461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.938426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.163933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:00.201565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-067cee77-f734-4b5e-92df-728fd245988b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1274 microversion: 2.1 time: 0.383782 Sep 19 15:00:00.202374 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1897/3812] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:59 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1274 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:00.241245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:00.242542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:00.254668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.255744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.256570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.257971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.258918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.260645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.282640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4098eb8b2842c49cb266d93d19d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379e03b58204dc09adecef25d911f46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:00.304546 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d2a9e847-5000-41ed-940c-a8cd3feb88bb tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501" status: 200 len: 1470 microversion: 2.1 time: 0.430111 Sep 19 15:00:00.306252 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1916/3813] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:59 2022] GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 => generated 1470 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:00.333873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35a4b911-5811-4424-aa1b-85978e3ac353"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:00.366626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:00.405774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.407415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.411872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.427753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.429660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.430722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.560334 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-295153e0-27a8-4b33-a572-77bab077dc8b tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.308446 Sep 19 15:00:00.567409 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1898/3814] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:00:00 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:00:00.596617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a0faa1f5-f530-4341-979f-3e13113b4205 req-08728c82-95e9-431b-bc6b-e66a52082658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d2d963-3530-49fb-98ae-bc8885d0d501", "name": "network-vif-deleted", "tag": "dcf2a073-a371-4880-bdf2-3ee05985dd0d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:00.634377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a0faa1f5-f530-4341-979f-3e13113b4205 req-08728c82-95e9-431b-bc6b-e66a52082658 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.635813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a0faa1f5-f530-4341-979f-3e13113b4205 req-08728c82-95e9-431b-bc6b-e66a52082658 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.636864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a0faa1f5-f530-4341-979f-3e13113b4205 req-08728c82-95e9-431b-bc6b-e66a52082658 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.666798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a0faa1f5-f530-4341-979f-3e13113b4205 req-08728c82-95e9-431b-bc6b-e66a52082658 service nova] Creating event network-vif-deleted:dcf2a073-a371-4880-bdf2-3ee05985dd0d for instance 45d2d963-3530-49fb-98ae-bc8885d0d501 on n-h1-858384-1 Sep 19 15:00:00.700493 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a0faa1f5-f530-4341-979f-3e13113b4205 req-08728c82-95e9-431b-bc6b-e66a52082658 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124354 Sep 19 15:00:00.702309 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1899/3815] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:00.744460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:00.745049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:00.781451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.782218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.784307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.798283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.799903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.803190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.322161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:01.367170 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f34a06b5-a212-4ba8-ac93-9ca5cc8f0723 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1660 microversion: 2.1 time: 0.658885 Sep 19 15:00:01.367879 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1900/3816] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:00 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1660 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:01.387094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:01.388139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:01.404047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.404588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.405089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.405845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.408077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.410203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.487763 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3d7564c8-3269-46df-b539-1cd622157722 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.166459 Sep 19 15:00:01.489271 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1917/3817] 10.222.0.81 () {62 vars in 1364 bytes} [Mon Sep 19 15:00:00 2022] POST /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 188 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:00:01.504110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:01.505587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 45d2d963-3530-49fb-98ae-bc8885d0d501] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:01.519742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.520653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.521545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.522975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.524019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.524822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.580856 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] HTTP exception thrown: Instance 45d2d963-3530-49fb-98ae-bc8885d0d501 could not be found. Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Request method failure captured: Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 HTTP/1.1 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIOlcfHOMf8JmbthRSoLT-Bubug1jsqMfRh_kV0i3kbgdWHFDoC1bhgt-sQanMNKsuZxyeYBuvTNsaVHY4woarhTcoc_xJfoS4Ymo0kB-At6eEM2UTgHY4tigLluKNjzugeE5EM-zQn3Yb7NW5JycTDYrQGwQPmj8p_VmKCYu4tIv64 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d379e03b58204dc09adecef25d911f46 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MultipleCreateTestJSON-384719428 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d379e03b58204dc09adecef25d911f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d379e03b58204dc09adecef25d911f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d379e03b58204dc09adecef25d911f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d379e03b58204dc09adecef25d911f46"}]}] Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MultipleCreateTestJSON-384719428 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d379e03b58204dc09adecef25d911f46 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MultipleCreateTestJSON-384719428 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MultipleCreateTestJSON-384719428-project Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6d4098eb8b2842c49cb266d93d19d2d1 Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MultipleCreateTestJSON-384719428-project Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 45d2d963-3530-49fb-98ae-bc8885d0d501 could not be found. Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '45d2d963-3530-49fb-98ae-bc8885d0d501'} Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d2d963-3530-49fb-98ae-bc8885d0d501 could not be found. Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d2d963-3530-49fb-98ae-bc8885d0d501 could not be found. Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:01.586890 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d2d963-3530-49fb-98ae-bc8885d0d501 could not be found. Sep 19 15:00:01.591858 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.593209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Returning 404 to user: Instance 45d2d963-3530-49fb-98ae-bc8885d0d501 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:00:01.596845 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8213343-2eb0-4b6e-8500-9ef5f32355a9 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501" status: 404 len: 111 microversion: 2.1 time: 0.103971 Sep 19 15:00:01.599550 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1918/3818] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:01 2022] GET /compute/v2.1/servers/45d2d963-3530-49fb-98ae-bc8885d0d501 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:00:01.613289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:01.614289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] [instance: 1cadef41-00fa-4f2a-ad67-647ae278d200] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:01.630586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.631204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.631660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.632694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.633404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.633909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.673273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:01.673510 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] HTTP exception thrown: Instance 1cadef41-00fa-4f2a-ad67-647ae278d200 could not be found. Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Request method failure captured: Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 HTTP/1.1 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIOlcfHOMf8JmbthRSoLT-Bubug1jsqMfRh_kV0i3kbgdWHFDoC1bhgt-sQanMNKsuZxyeYBuvTNsaVHY4woarhTcoc_xJfoS4Ymo0kB-At6eEM2UTgHY4tigLluKNjzugeE5EM-zQn3Yb7NW5JycTDYrQGwQPmj8p_VmKCYu4tIv64 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d379e03b58204dc09adecef25d911f46 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-MultipleCreateTestJSON-384719428 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d379e03b58204dc09adecef25d911f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d379e03b58204dc09adecef25d911f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d379e03b58204dc09adecef25d911f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d379e03b58204dc09adecef25d911f46"}]}] Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-MultipleCreateTestJSON-384719428 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d379e03b58204dc09adecef25d911f46 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-MultipleCreateTestJSON-384719428 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-MultipleCreateTestJSON-384719428-project Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6d4098eb8b2842c49cb266d93d19d2d1 Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-MultipleCreateTestJSON-384719428-project Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1cadef41-00fa-4f2a-ad67-647ae278d200 could not be found. Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1cadef41-00fa-4f2a-ad67-647ae278d200'} Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cadef41-00fa-4f2a-ad67-647ae278d200 could not be found. Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cadef41-00fa-4f2a-ad67-647ae278d200 could not be found. Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:01.676821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cadef41-00fa-4f2a-ad67-647ae278d200 could not be found. Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] Returning 404 to user: Instance 1cadef41-00fa-4f2a-ad67-647ae278d200 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:00:01.681770 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-659f64d8-1b79-4dc4-b73a-0fd20964dae2 tempest-MultipleCreateTestJSON-384719428 tempest-MultipleCreateTestJSON-384719428-project] 10.222.0.81 "GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200" status: 404 len: 111 microversion: 2.1 time: 0.072973 Sep 19 15:00:01.689106 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1919/3819] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:01 2022] GET /compute/v2.1/servers/1cadef41-00fa-4f2a-ad67-647ae278d200 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:00:01.699950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:01.701030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:01.724210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.725288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.726111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.727779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.728659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.730442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.737791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8a3864b-71f9-43a0-b316-698229da0fb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1274 microversion: 2.1 time: 0.353149 Sep 19 15:00:01.744278 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1901/3820] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:01 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:02.105808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128731) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 15:00:02.305310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-02c5e695-1319-4bcd-8666-2514b95d27b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/action" status: 202 len: 0 microversion: 2.20 time: 0.614078 Sep 19 15:00:02.313469 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1920/3821] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 15:00:01 2022] POST /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:00:02.321307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:02.323140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:02.327014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:02.343429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:02.343950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:02.344402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:02.345150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:02.357150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:02.357619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:02.427242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:02.428379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:02.467051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:02.472813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:02.473619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:02.475804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:02.476622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:02.477411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:03.826135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:03.857273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:03.865415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:03.870854 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c312a95-9b35-43e1-9311-b0a5d8f9fc1e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1749 microversion: 2.20 time: 1.554280 Sep 19 15:00:03.873566 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1902/3822] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:02 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1749 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:03.901501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:03.903475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:03.921107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:03.922626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:03.924937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:03.926556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:03.927937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:03.929103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:04.052705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:04.100857 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ef4200f-2198-46ae-ae92-b1536d894c7f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.682241 Sep 19 15:00:04.115401 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1921/3823] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:02 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:04.160672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:04.161793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:04.188303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:04.189191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:04.189998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:04.191367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:04.192383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:04.195109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.424459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:05.445462 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e48cd54c-b378-4de6-abfa-6812957c4b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.290342 Sep 19 15:00:05.466081 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1922/3824] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:04 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:05.480747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:05.482166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:05.513660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.514583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.515305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.516255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.516937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.517616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.536729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:05.550701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:05.562613 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2063b01-9379-435a-bcaa-ae4be42ab4a8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 1.687041 Sep 19 15:00:05.564444 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1903/3825] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:03 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:05.580586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:05.585367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:05.596309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:05.632638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.633554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.634326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.635321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.637080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.639244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:06.539280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:06.553107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:06.554898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:06.556162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e597d80-eb9e-4a1f-992c-e1ab14f1e36c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1751 microversion: 2.20 time: 1.088310 Sep 19 15:00:06.567667 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1923/3826] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:05 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1751 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:06.593336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:06.594258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:06.606254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:06.607190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:06.608394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:06.609389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:06.610035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:06.611428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:06.832174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:06.852197 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-088023ff-49cb-45bb-9d34-d53fd003e754 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.283318 Sep 19 15:00:06.852842 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1904/3827] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:05 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:06.886914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:06.888015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:06.908207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:06.909029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:06.909676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:06.910637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:06.911373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:06.912059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:07.148794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:08.621950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:08.657716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ce603a0-057f-4c69-9eea-17ff0ef33b8b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 2.070292 Sep 19 15:00:08.662448 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1924/3828] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:06 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:08.685039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:08.704361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:08.722249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:08.747271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:08.749941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:08.750810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:08.753524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:08.755643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:08.756364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:08.757417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:08.781086 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06039b84-576f-4731-a2e1-366af0a7a6d4 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.898624 Sep 19 15:00:08.792068 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1905/3829] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:06 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:08.825356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:08.842020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:08.843719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:08.871426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:08.872910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:08.873975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:08.875569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:08.876729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:08.877838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:09.999481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:10.015735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:10.025086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:10.028325 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed20d66a-621b-4188-8bc8-8aff1192c846 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1751 microversion: 2.20 time: 1.362873 Sep 19 15:00:10.032243 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1925/3830] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:08 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1751 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:10.046616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:10.047898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:10.068335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:10.071257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:10.072427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:10.076074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:10.076745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:10.081001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:10.082881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:10.110935 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-703e349b-613c-445b-a235-833bbf00e488 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.279470 Sep 19 15:00:10.112906 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1906/3831] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:08 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:10.161263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:10.162953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:10.196616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:10.198090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:10.199722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:10.204246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:10.205629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:10.208720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:10.495937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:10.508849 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78b8e3c8-81f4-41cc-aecc-95b11f0c2baa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 0.474849 Sep 19 15:00:10.509475 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1926/3832] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:10 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:11.089061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:11.089988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:11.101996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:11.102849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:11.103557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:11.104479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:11.105113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:11.111560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:11.851652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:11.877154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:11.883504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:11.888616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-496426c2-af7d-4aa8-8432-19b50cedc218 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1751 microversion: 2.20 time: 0.803771 Sep 19 15:00:11.907124 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1927/3833] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:11 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1751 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:11.912658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-26599225-31c7-4092-92be-bb81a101365a req-c7bde086-13fa-4e79-b571-1e4b365f8ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad076e-097f-4d69-b3ed-fede15ad5ffa", "tag": "2b72fda7-5524-461e-bc6f-b19724ef1f7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:11.927051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:11.947024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-26599225-31c7-4092-92be-bb81a101365a req-c7bde086-13fa-4e79-b571-1e4b365f8ddc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:11.948909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-26599225-31c7-4092-92be-bb81a101365a req-c7bde086-13fa-4e79-b571-1e4b365f8ddc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:11.949504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-26599225-31c7-4092-92be-bb81a101365a req-c7bde086-13fa-4e79-b571-1e4b365f8ddc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:11.971449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-26599225-31c7-4092-92be-bb81a101365a req-c7bde086-13fa-4e79-b571-1e4b365f8ddc service nova] Creating event network-changed:2b72fda7-5524-461e-bc6f-b19724ef1f7c for instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa on n-h2-858384-1 Sep 19 15:00:11.977324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-26599225-31c7-4092-92be-bb81a101365a req-c7bde086-13fa-4e79-b571-1e4b365f8ddc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068199 Sep 19 15:00:11.980397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec7afb2c-793c-4b81-8cbb-49788d3a5788 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.822126 Sep 19 15:00:11.981065 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1928/3834] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:11.985238 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1907/3835] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:10 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:11.989380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:11.995424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:12.004795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:12.006449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:12.007215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:12.012339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:12.012857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:12.013306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:12.607986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:12.625276 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17bb890f-98c7-40d5-af2b-d3693b32b582 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 0.642637 Sep 19 15:00:12.626787 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1929/3836] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:11 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:12.933338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:12.950612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:12.987399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:12.997697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:12.998985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:13.000715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:13.005454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:13.007677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:13.672609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:13.674170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:13.678344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:13.690495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:13.700322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:13.702025 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82ad1a0c-f428-4260-aa00-dff3a0148c17 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1751 microversion: 2.20 time: 0.782187 Sep 19 15:00:13.703215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:13.704492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:13.705407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:13.705845 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1908/3837] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:12 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1751 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:13.708172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:13.709424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:13.711236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:14.638603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:14.656645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eca6c03e-d935-4674-a694-b68727cd31aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 0.995038 Sep 19 15:00:14.660479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1930/3838] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:13 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:14.755710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:14.756877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:14.820823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:14.821931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:14.831385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:14.841437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:14.842568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:14.847234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:15.679518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:15.706052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:15.710002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:15.714706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:15.723626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:15.731341 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e099127-d4c9-4311-bef7-e32115e5c619 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1751 microversion: 2.20 time: 0.977939 Sep 19 15:00:15.733782 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1909/3839] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:14 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1751 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:15.741293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:15.765039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:15.774019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:15.782059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:15.784635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:15.787349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:16.773791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:16.788972 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48cfa1e1-18a2-4f2d-b37a-48e30653a3e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 1.089834 Sep 19 15:00:16.789989 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1931/3840] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:15 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:16.799112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:16.801472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:16.865459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:16.866809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:16.867757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:16.880663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:16.881944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:16.891643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:17.835076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:17.836490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:17.853906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:17.854077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:17.854392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:17.857254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:17.857740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:17.858702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:19.100151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:19.112256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:19.122455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:19.130326 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f428c3b8-6a7f-4198-8d26-6a4d13fa79f6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1751 microversion: 2.20 time: 2.341039 Sep 19 15:00:19.131179 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1910/3841] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:16 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1751 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:19.265354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:19.304151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0671b869-4e51-4adf-9190-7c0ed5279254 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 1.471567 Sep 19 15:00:19.307676 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1932/3842] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:17 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:20.178893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:20.179950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:20.225069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.226412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.227490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:20.229162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.230575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.236155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:20.352923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:20.354609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:20.399239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.400200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.401614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:20.416961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.422109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.422885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:21.116541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:21.131788 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e619e516-030d-4864-a840-7c9694e6f3e4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 0.785872 Sep 19 15:00:21.142801 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1933/3843] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:20 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:21.282700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:21.323147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:21.326314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:21.348777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eb319e22-783a-4147-8c92-3abb60a98db4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 1.156919 Sep 19 15:00:21.350033 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1911/3844] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:20 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:22.045735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1b47633f-e4bd-473d-a430-1f524490422c req-1d4554dd-b5c2-424e-8c21-56b73dec8ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad076e-097f-4d69-b3ed-fede15ad5ffa", "name": "network-vif-plugged", "status": "completed", "tag": "2b72fda7-5524-461e-bc6f-b19724ef1f7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:22.073633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1b47633f-e4bd-473d-a430-1f524490422c req-1d4554dd-b5c2-424e-8c21-56b73dec8ac7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:22.074134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1b47633f-e4bd-473d-a430-1f524490422c req-1d4554dd-b5c2-424e-8c21-56b73dec8ac7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:22.074581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1b47633f-e4bd-473d-a430-1f524490422c req-1d4554dd-b5c2-424e-8c21-56b73dec8ac7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:22.142885 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1b47633f-e4bd-473d-a430-1f524490422c req-1d4554dd-b5c2-424e-8c21-56b73dec8ac7 service nova] Creating event network-vif-plugged:2b72fda7-5524-461e-bc6f-b19724ef1f7c for instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa on n-h2-858384-1 Sep 19 15:00:22.169049 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1b47633f-e4bd-473d-a430-1f524490422c req-1d4554dd-b5c2-424e-8c21-56b73dec8ac7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122410 Sep 19 15:00:22.180015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:22.181032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:22.188789 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1934/3845] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:22.197671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:22.209840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:22.219666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:22.222644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:22.223511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:22.224448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:22.925802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:22.926666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:22.938317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:22.943062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:22.943651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:22.945864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:22.946633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:22.955125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:22.955735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:23.046100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:00:23.140051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.154917 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-45cdeae4-f6fb-413e-bca5-27599804d903 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 0.978755 Sep 19 15:00:23.155447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1912/3846] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:22 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:23.160829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:23.161465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:23.184688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:23.185338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:23.185793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:23.186555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:23.192538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:23.193502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:23.259120 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c94520d3-081f-4b17-b432-3b7ef7f8dc37 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 204 len: 0 microversion: 2.32 time: 0.848849 Sep 19 15:00:23.261139 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1935/3847] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:00:22 2022] DELETE /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 15:00:23.270413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:23.271597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:23.286111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:23.287027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:23.287655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:23.288624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:23.289285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:23.289879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:23.719252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.741454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.743418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.746002 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-deb46853-85de-4eef-b22c-e9f51a9bec0c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.589561 Sep 19 15:00:23.748182 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1913/3848] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:23 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:23.861906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.876516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.882561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:23.889971 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ecd0734c-8440-484f-9258-a1eeab35bf35 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2950 microversion: 2.32 time: 0.624021 Sep 19 15:00:23.906794 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1936/3849] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:23 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2950 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:24.201131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:24.205158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:24.240651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:24.242295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:24.243056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:24.245877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:24.247085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:24.247528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:24.806283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:24.807618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:24.825984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:24.826509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:24.827049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:24.831988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:24.832593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:24.834796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:25.021908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:25.046657 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6f7ecc6-1ad9-462a-8f05-debff350f977 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 0.854491 Sep 19 15:00:25.050982 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1914/3850] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:24 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:25.061360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:25.063116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:25.069280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:25.070218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:25.071259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:25.072442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:25.076981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:25.077926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:25.732002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:25.769982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:25.782483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:25.787724 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-90f6e408-ce75-483a-b8c7-bb7964c07d86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.986642 Sep 19 15:00:25.806169 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1937/3851] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:24 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:26.106091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:26.108820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:26.151598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:26.155677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:26.157159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:26.162075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:26.164692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:26.167120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:27.175238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:27.216454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:27.225945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:27.229694 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f1bd861-6112-4a9d-94d6-4524cc1fe6e5 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2950 microversion: 2.32 time: 2.174562 Sep 19 15:00:27.263754 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1915/3852] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:25 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2950 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:27.303443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:27.316200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:27.348068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:27.349709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:27.354503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:27.356408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:27.361434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:27.364837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:27.472845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:27.486858 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b40eadad-4d26-4bdf-a15c-cd3c48fad4aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1316 microversion: 2.1 time: 1.415225 Sep 19 15:00:27.487825 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1938/3853] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:26 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1316 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:27.493177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:27.542225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:27.563309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:27.564018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:27.564548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:27.565468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:27.565974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:27.566529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:27.649552 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3858f161-8593-4ca5-9648-d817f571e3d6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.382728 Sep 19 15:00:27.651505 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1916/3854] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:00:27 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:00:27.668871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:27.670001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:27.687941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:27.692038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:27.692955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:27.694154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:27.695366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:27.700103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:29.273964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:29.296108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:29.303212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:29.304620 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11d9ce22-f677-4726-a20e-65197957d555 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 1.815580 Sep 19 15:00:29.305797 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1939/3855] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:27 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:29.336425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:29.337424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:29.354893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:29.355682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:29.356421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:29.357416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:29.359869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:29.360656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:29.695123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:29.719245 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41590876-77f5-4950-8255-f10a9a69e6c8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1670 microversion: 2.1 time: 2.061945 Sep 19 15:00:29.720466 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1917/3856] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:27 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1670 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:29.733179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:29.734078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:29.751661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:29.752723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:29.753456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:29.754610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:29.755288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:29.756131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:31.119681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:31.151770 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c87c8d8-0c01-426f-97be-2bfaa6000e66 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.429627 Sep 19 15:00:31.175845 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1918/3857] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:29 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:31.226994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4d6d8984-24e3-4017-a4bf-c12c5fd8f8af req-57f62afa-3eaf-4b21-aad5-855e3974d22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "a77e244a-300f-4a14-bf87-f3c421b61828"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:31.257868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:31.268719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4d6d8984-24e3-4017-a4bf-c12c5fd8f8af req-57f62afa-3eaf-4b21-aad5-855e3974d22f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:31.274377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4d6d8984-24e3-4017-a4bf-c12c5fd8f8af req-57f62afa-3eaf-4b21-aad5-855e3974d22f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:31.277517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4d6d8984-24e3-4017-a4bf-c12c5fd8f8af req-57f62afa-3eaf-4b21-aad5-855e3974d22f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:31.288466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:31.293656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:31.299056 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a1c7efa-3ec8-4d72-b588-7a2301b8c626 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2950 microversion: 2.32 time: 1.991678 Sep 19 15:00:31.337225 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1940/3858] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:29 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2950 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:31.339397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4d6d8984-24e3-4017-a4bf-c12c5fd8f8af req-57f62afa-3eaf-4b21-aad5-855e3974d22f service nova] Creating event network-vif-unplugged:a77e244a-300f-4a14-bf87-f3c421b61828 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:31.356648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4d6d8984-24e3-4017-a4bf-c12c5fd8f8af req-57f62afa-3eaf-4b21-aad5-855e3974d22f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154138 Sep 19 15:00:31.357451 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1919/3859] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:31.359927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:31.367034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:31.369232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:31.377769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:31.388326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:31.395453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:31.396750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:31.397214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:31.398259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:31.402561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:31.403297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:31.410888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:31.414283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:31.420684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:31.421771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:31.422434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:32.237088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:32.286062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-782c9644-7472-40c3-a536-e88fc53f5b6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1670 microversion: 2.1 time: 0.921903 Sep 19 15:00:32.291247 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1920/3860] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:31 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1670 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:32.309982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1910192982", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:32.406212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:32.433637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:32.461757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:32.473553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:32.479269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c7e7545-fb80-4d17-9fc4-aa27725ac557 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 1.137274 Sep 19 15:00:32.480516 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1941/3861] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:31 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:32.503450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:32.504266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:32.511520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] validate_networks() for [('becbe19b-7264-4a9a-a233-6761770cd2c6', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:00:32.523219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:32.527317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:32.529725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:32.532567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:32.535487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:32.538696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:34.237708 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:00:34.239318 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! Sep 19 15:00:34.365842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:34.400992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:34.403041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:34.404432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12d39111-fb97-46dd-a687-002545d601ce tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2929 microversion: 2.32 time: 1.919291 Sep 19 15:00:34.405028 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1942/3862] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:32 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2929 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:34.448484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:34.449126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:34.468013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:34.468524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:34.468974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:34.469808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:34.470462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:34.471080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:36.342975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:36.376102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fe778965-a3ad-485c-8417-941fa14cccc7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.939175 Sep 19 15:00:36.391350 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1943/3863] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:34 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:36.405172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:36.411835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:36.427047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:36.427862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:36.428541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:36.429548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:36.435774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:36.437363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:37.711350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:37.757498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:37.785276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:37.788088 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a5fd3d89-f966-4b22-aee3-c8c35960e142 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 1.394391 Sep 19 15:00:37.789091 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1944/3864] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:36 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:37.815037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "1136625f-c20a-4c3e-98e9-84b81ba8b47a"}, {"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "201449fa-941f-4331-8159-9877f2e2fa2e"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:37.872636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:37.896161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:37.897460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:37.943448 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] Creating event network-vif-unplugged:1136625f-c20a-4c3e-98e9-84b81ba8b47a for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:37.956150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] Creating event network-vif-unplugged:201449fa-941f-4331-8159-9877f2e2fa2e for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:37.980263 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-84adbf0c-2cb0-4134-9b2a-256e4d4f8b4b req-f3caaa37-cbe4-49f9-96d7-575b9dedd581 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.182284 Sep 19 15:00:37.982621 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1945/3865] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:38.010723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:38.013547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:38.040451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:38.051286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:38.052855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:38.055077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:38.057106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:38.058036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:38.603665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:00:38.605684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:00:38.607000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:00:38.608062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:00:38.608988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:00:38.613941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=40 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:38.670202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:38.678485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:38.686389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:38.691357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:38.691895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:38.692358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:38.786107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Getting quotas for project f41eff4a51f84522bd0a289ed00bb41d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:00:38.820808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Getting quotas for user 161efee238a84f78b6771e71701eda05 and project f41eff4a51f84522bd0a289ed00bb41d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:00:38.897592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:00:38.920927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:00:39.080363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:39.113129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:39.131310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:39.135359 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f475cf50-3c99-407d-9bf4-4aed4e9b22fd tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2908 microversion: 2.32 time: 1.150222 Sep 19 15:00:39.136343 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1946/3866] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:37 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2908 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:39.230912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:39.230912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:39.262039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:39.262459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:39.262971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:39.263773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:39.264284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:39.282170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:39.320883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25a983ca-bd82-456f-ba69-2a2a2346f931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.009504 Sep 19 15:00:39.332695 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1921/3867] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 7039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:00:39.392184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d29e1fb4-d8c2-47d8-bd70-0ae51c60556d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:39.393682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d29e1fb4-d8c2-47d8-bd70-0ae51c60556d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:40.959844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d29e1fb4-d8c2-47d8-bd70-0ae51c60556d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:41.076335 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d29e1fb4-d8c2-47d8-bd70-0ae51c60556d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1217 microversion: 2.1 time: 1.735544 Sep 19 15:00:41.078571 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1922/3868] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:39 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1217 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:41.467179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:41.540477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:41.555460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:41.564422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0d967c0-02ee-41d7-ad86-c00df17e22b1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 2.386189 Sep 19 15:00:41.566885 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1947/3869] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:39 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:41.584364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:41.585789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:41.641104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:41.645990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:41.647968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:41.652636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:41.657458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:41.661433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:41.763548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-13133002", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "06d46e9c-9fd9-40ce-b678-cdad19cbacd7"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:41.965207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] validate_networks() for [('06d46e9c-9fd9-40ce-b678-cdad19cbacd7', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:00:42.372674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:42.397448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:42.401019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:42.406497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48b97ee7-d4c0-455b-993d-c59ffad76fcc tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2862 microversion: 2.32 time: 0.835482 Sep 19 15:00:42.436017 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1948/3870] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:41 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2862 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:42.446318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "95a73885-50f4-4435-8dc5-1e8e276383da"}, {"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "375020e1-94f4-4661-8ee8-6df96d799595"}, {"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "07930525-c004-4fe4-8a21-9279e964fae1"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:42.477456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:42.483930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:42.489326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:42.552977 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Creating event network-vif-unplugged:95a73885-50f4-4435-8dc5-1e8e276383da for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:42.554673 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Creating event network-vif-unplugged:375020e1-94f4-4661-8ee8-6df96d799595 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:42.556572 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] Creating event network-vif-unplugged:07930525-c004-4fe4-8a21-9279e964fae1 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:42.574091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-904992d9-91ea-42d2-b75b-c4c810ff29ff req-6888ed76-dcea-439a-9d23-422747ba88a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.135684 Sep 19 15:00:42.576462 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1949/3871] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:42.593522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e8b53d5a-356a-4a91-a0ef-8d7447015b46 req-787bdae5-d3f4-431a-a613-4a9a460b2334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-deleted", "tag": "1136625f-c20a-4c3e-98e9-84b81ba8b47a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:42.617402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e8b53d5a-356a-4a91-a0ef-8d7447015b46 req-787bdae5-d3f4-431a-a613-4a9a460b2334 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:42.619916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e8b53d5a-356a-4a91-a0ef-8d7447015b46 req-787bdae5-d3f4-431a-a613-4a9a460b2334 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:42.622979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e8b53d5a-356a-4a91-a0ef-8d7447015b46 req-787bdae5-d3f4-431a-a613-4a9a460b2334 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:42.690648 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e8b53d5a-356a-4a91-a0ef-8d7447015b46 req-787bdae5-d3f4-431a-a613-4a9a460b2334 service nova] Creating event network-vif-deleted:1136625f-c20a-4c3e-98e9-84b81ba8b47a for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:42.702387 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e8b53d5a-356a-4a91-a0ef-8d7447015b46 req-787bdae5-d3f4-431a-a613-4a9a460b2334 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120722 Sep 19 15:00:42.706176 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1950/3872] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:42.751682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:42.779294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:42.818980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:42.820462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:42.822030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:42.823314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:42.824061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:42.824903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:43.081499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:43.108097 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-65fc1e67-81be-482a-b141-fda079b12b16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1269 microversion: 2.1 time: 0.397676 Sep 19 15:00:43.136821 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1951/3873] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:42 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1269 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:43.149966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:43.159646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:43.197316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:43.201139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:43.210581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:43.215503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:43.224064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:43.231905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:43.941531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:43.966702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:43.973966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:43.982465 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3eb13982-1b0c-41f2-a715-7ffe2be33232 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.840242 Sep 19 15:00:43.985722 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1952/3874] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:43 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:43.999832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:44.003087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:44.019976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.020776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.021386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:44.022298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.023026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.023659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:44.560855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:00:44.562967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:00:44.564196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:00:44.568840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:00:44.570375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:00:44.608222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.610057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.613061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:44.615887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.620285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.622858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:44.661604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:44.739953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Getting quotas for project b098a328d1bc4260a13a7d21e0b03aab. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:00:44.754543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Getting quotas for user 1a700581adaa42519bf60dcafcb5b6b1 and project b098a328d1bc4260a13a7d21e0b03aab. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:00:44.794991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:00:44.800231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:00:44.827358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:44.862562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:44.866138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:44.871351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79fe5459-7af8-4418-bde1-fd9b09b9181d tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2702 microversion: 2.32 time: 0.882316 Sep 19 15:00:44.873257 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1953/3875] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:43 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2702 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:44.882898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:44.886242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:44.904999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.906585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.908198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:44.909961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.912840 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4532baa6-c64a-4044-b986-4f7d2729aaad tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.830839 Sep 19 15:00:44.913451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.913806 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1923/3876] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:00:44.915580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:44.948365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c9006511-fda6-4e7b-99a5-da59abd5eebb req-e7d810e1-38b2-44f5-827b-84f6fbf8a57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-deleted", "tag": "375020e1-94f4-4661-8ee8-6df96d799595"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:44.977380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c9006511-fda6-4e7b-99a5-da59abd5eebb req-e7d810e1-38b2-44f5-827b-84f6fbf8a57a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:44.979286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c9006511-fda6-4e7b-99a5-da59abd5eebb req-e7d810e1-38b2-44f5-827b-84f6fbf8a57a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:44.979507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c9006511-fda6-4e7b-99a5-da59abd5eebb req-e7d810e1-38b2-44f5-827b-84f6fbf8a57a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:45.020010 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c9006511-fda6-4e7b-99a5-da59abd5eebb req-e7d810e1-38b2-44f5-827b-84f6fbf8a57a service nova] Creating event network-vif-deleted:375020e1-94f4-4661-8ee8-6df96d799595 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:45.037210 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c9006511-fda6-4e7b-99a5-da59abd5eebb req-e7d810e1-38b2-44f5-827b-84f6fbf8a57a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121819 Sep 19 15:00:45.039187 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1924/3877] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:45.091810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43ddc22f-38dc-40cd-811e-6cf5565f87e2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:45.098238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43ddc22f-38dc-40cd-811e-6cf5565f87e2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:45.669897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43ddc22f-38dc-40cd-811e-6cf5565f87e2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:45.679096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:45.688544 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94d70085-478c-4ebe-ab11-03c03a8ecccb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1275 microversion: 2.1 time: 0.813406 Sep 19 15:00:45.689946 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1954/3878] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:44 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1275 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:45.692008 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43ddc22f-38dc-40cd-811e-6cf5565f87e2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1214 microversion: 2.1 time: 0.647496 Sep 19 15:00:45.697658 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1925/3879] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:45 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1214 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:45.701463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:45.706395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:45.724961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:45.725835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:45.726517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:45.727577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:45.729857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:45.730632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:45.976880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:45.979229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:45.996471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:45.997950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:45.999168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:46.000870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:46.002062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:46.003920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:47.112399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.147710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.154929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.156700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e609cc20-17a4-431e-a704-9a04475d3847 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2589 microversion: 2.32 time: 1.232070 Sep 19 15:00:47.158336 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1926/3880] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:45 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2589 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:47.178485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.186035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:47.187989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:47.196734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.198408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.210261 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7af5da90-36ac-4afb-9ced-c9914786c825 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 1.506492 Sep 19 15:00:47.211405 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1955/3881] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:45 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:47.214527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:47.215340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:47.216178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:47.217264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:47.218061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:47.218852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:47.228700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:47.229459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:47.255097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:47.260367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:47.261265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:47.262333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:47.262844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:47.263305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:47.502516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:47.515004 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ad16dbb-30b8-411f-aeac-9736d70874ec tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1274 microversion: 2.1 time: 0.300645 Sep 19 15:00:47.528506 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1956/3882] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:47 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1274 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:48.202310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:48.205138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:48.232078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:48.234573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:48.235585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:48.236849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:48.238386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:48.244520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:48.367934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.380538 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fbee15ab-01b5-464e-9151-f911f8c585c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 1.219805 Sep 19 15:00:48.382060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1927/3883] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:47 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:48.387936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:48.388927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:48.395687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:48.396490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:48.397150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:48.397910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:48.398464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:48.399102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:48.841253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.860581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.864343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.867498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5a433a6-14d7-423e-86f5-5a64bb687e80 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2543 microversion: 2.32 time: 0.681875 Sep 19 15:00:48.869880 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1957/3884] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:48 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2543 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:48.879336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:48.881028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:48.893586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:48.894908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:48.896082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:48.900389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:48.900389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:48.900389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:48.926308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.950570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.955525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:48.959087 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8c444a64-dca1-4611-b489-07a4f5a9c47b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.575284 Sep 19 15:00:48.973826 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1928/3885] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:48 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:49.079047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2a453b94-aee6-4d5a-b274-0e0d69f6679b req-a9f545d1-9a7d-4892-a9f3-cbf28cd48ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-deleted", "tag": "95a73885-50f4-4435-8dc5-1e8e276383da"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:49.093153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a453b94-aee6-4d5a-b274-0e0d69f6679b req-a9f545d1-9a7d-4892-a9f3-cbf28cd48ade service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:49.093153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a453b94-aee6-4d5a-b274-0e0d69f6679b req-a9f545d1-9a7d-4892-a9f3-cbf28cd48ade service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:49.093153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a453b94-aee6-4d5a-b274-0e0d69f6679b req-a9f545d1-9a7d-4892-a9f3-cbf28cd48ade service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:49.109655 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2a453b94-aee6-4d5a-b274-0e0d69f6679b req-a9f545d1-9a7d-4892-a9f3-cbf28cd48ade service nova] Creating event network-vif-deleted:95a73885-50f4-4435-8dc5-1e8e276383da for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:49.122437 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2a453b94-aee6-4d5a-b274-0e0d69f6679b req-a9f545d1-9a7d-4892-a9f3-cbf28cd48ade service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046636 Sep 19 15:00:49.131317 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1929/3886] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:49.163850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fc9f59c8-bc40-4cb7-b71b-8779812f6948 req-a0a55732-45f9-45b6-a493-73ec03162015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10aa93bf-e81c-4424-a09d-5783ba44edce", "tag": "ae6dcefd-38e4-4272-8105-625ae908d017"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:49.213616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc9f59c8-bc40-4cb7-b71b-8779812f6948 req-a0a55732-45f9-45b6-a493-73ec03162015 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:49.218599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc9f59c8-bc40-4cb7-b71b-8779812f6948 req-a0a55732-45f9-45b6-a493-73ec03162015 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:49.220014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc9f59c8-bc40-4cb7-b71b-8779812f6948 req-a0a55732-45f9-45b6-a493-73ec03162015 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:49.256301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fc9f59c8-bc40-4cb7-b71b-8779812f6948 req-a0a55732-45f9-45b6-a493-73ec03162015 service nova] Creating event network-changed:ae6dcefd-38e4-4272-8105-625ae908d017 for instance 10aa93bf-e81c-4424-a09d-5783ba44edce on n-h1-858384-1 Sep 19 15:00:49.279181 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fc9f59c8-bc40-4cb7-b71b-8779812f6948 req-a0a55732-45f9-45b6-a493-73ec03162015 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124930 Sep 19 15:00:49.281143 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1930/3887] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:00:49.309595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:49.322399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6725ac1e-9dee-4df7-b82a-fcd08b8b7825 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1272 microversion: 2.1 time: 0.449611 Sep 19 15:00:49.326052 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1958/3888] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:48 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:49.411962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:49.413647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:49.431891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:49.432929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:49.433571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:49.443911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:49.445561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:49.453585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:49.905666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:49.908301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:49.934910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:49.936188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:49.937335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:49.939440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:49.940689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:49.941797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:49.998364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.014079 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-60613b7f-0810-4a74-b45a-a6ea8755a312 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.612500 Sep 19 15:00:50.016703 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1931/3889] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:49 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:50.044829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:50.045799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:50.073374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:50.074563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:50.079337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:50.083530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:50.084341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:50.085208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:50.808115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.835924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.837527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.843491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.846917 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-271b6d5a-68ef-4387-8b48-50d1e248a413 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.828278 Sep 19 15:00:50.848218 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1932/3890] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:50 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:50.861614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:50.864333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:50.867233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.869829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:50.871359 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-67e1fc0b-018f-4163-8624-193e2cf2d2e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2256 microversion: 2.32 time: 0.975019 Sep 19 15:00:50.872521 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1959/3891] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:49 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2256 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:50.897917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:50.899651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:50.900940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:50.903719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:50.905070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:50.906233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.043752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:51.044938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:51.069095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.069972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.071969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.073810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.074822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.075809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.116337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:51.719592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:51.729250 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-750a9ed8-14ac-4000-b2f0-ed1750a9721b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.878730 Sep 19 15:00:51.730339 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1933/3892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:50 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:51.735295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-97e8952d-d4e0-4eff-aede-e595d17146f6 req-d629fb29-2417-48d2-91aa-dbe225cc0da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-deleted", "tag": "201449fa-941f-4331-8159-9877f2e2fa2e"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:51.759331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-97e8952d-d4e0-4eff-aede-e595d17146f6 req-d629fb29-2417-48d2-91aa-dbe225cc0da7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.760162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-97e8952d-d4e0-4eff-aede-e595d17146f6 req-d629fb29-2417-48d2-91aa-dbe225cc0da7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.760680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-97e8952d-d4e0-4eff-aede-e595d17146f6 req-d629fb29-2417-48d2-91aa-dbe225cc0da7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.775327 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-97e8952d-d4e0-4eff-aede-e595d17146f6 req-d629fb29-2417-48d2-91aa-dbe225cc0da7 service nova] Creating event network-vif-deleted:201449fa-941f-4331-8159-9877f2e2fa2e for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:51.781513 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-97e8952d-d4e0-4eff-aede-e595d17146f6 req-d629fb29-2417-48d2-91aa-dbe225cc0da7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049620 Sep 19 15:00:51.782935 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1934/3893] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:51.834138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:51.846490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-712a3219-7783-4513-af53-6bed3a8c4268 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.808675 Sep 19 15:00:51.847858 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1960/3894] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:51 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:51.905511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:51.906396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:51.911215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:51.913004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:51.923431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.925221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.926145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.927539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.928048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.928498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.935714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.936863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.937525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:51.939544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:51.940664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:51.941879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:52.758351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:52.770005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:52.778471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:52.780186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:52.781699 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0a3b683-27e9-4781-af41-8666614bdee6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.880402 Sep 19 15:00:52.782654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1935/3895] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:51 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:52.791535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:52.796070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:52.800269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59a9dc94-2e4b-4ffd-95bc-91598b71f223 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2096 microversion: 2.32 time: 0.897326 Sep 19 15:00:52.801445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:52.802272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:52.812463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:52.818538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:52.818979 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1961/3896] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:51 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2096 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:52.819913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:52.821938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:52.824672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:52.825389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:52.880540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:52.883288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:52.903573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:52.906695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:52.908377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:52.913142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:52.914827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:52.916736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:53.494471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:53.542622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-63c6a5cb-c3af-4221-b68c-a7fca231dc15 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.755535 Sep 19 15:00:53.545007 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1936/3897] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:52 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:53.629246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:53.673328 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59b66b15-23d1-4e5d-8a7a-4feee6b32931 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.804502 Sep 19 15:00:53.675832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1962/3898] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:52 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:53.848169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:53.849814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:53.849980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:53.850894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:53.854023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:53.863184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:53.868531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:53.869748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:53.870256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:53.870445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:53.871236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:53.872138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:53.872752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:53.873282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:53.876945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:53.879920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:53.881290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:54.394702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:54.427363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:54.433116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:54.437910 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-47cd70bc-d6fa-4d8c-b290-667e361032c4 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 2029 microversion: 2.32 time: 0.592122 Sep 19 15:00:54.443227 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1963/3899] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:53 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 2029 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:54.490290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e28e8adb-2afc-47b5-8d75-b8b139689ce9 req-bbc1d28b-b885-43ce-b6be-a053a2b3202d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4ab801-a114-4fcf-93ef-8173bf5c4fd9", "name": "network-vif-deleted", "tag": "07930525-c004-4fe4-8a21-9279e964fae1"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:54.537597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e28e8adb-2afc-47b5-8d75-b8b139689ce9 req-bbc1d28b-b885-43ce-b6be-a053a2b3202d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:54.538732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e28e8adb-2afc-47b5-8d75-b8b139689ce9 req-bbc1d28b-b885-43ce-b6be-a053a2b3202d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:54.539812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e28e8adb-2afc-47b5-8d75-b8b139689ce9 req-bbc1d28b-b885-43ce-b6be-a053a2b3202d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:54.588151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e28e8adb-2afc-47b5-8d75-b8b139689ce9 req-bbc1d28b-b885-43ce-b6be-a053a2b3202d service nova] Creating event network-vif-deleted:07930525-c004-4fe4-8a21-9279e964fae1 for instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 on n-h2-858384-1 Sep 19 15:00:54.599424 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e28e8adb-2afc-47b5-8d75-b8b139689ce9 req-bbc1d28b-b885-43ce-b6be-a053a2b3202d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114867 Sep 19 15:00:54.601299 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1964/3900] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:00:54.620204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:54.621675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:54.636651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:54.638331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:54.639263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:54.642787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:54.643594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:54.644506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:54.662449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:55.004429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.040707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.045434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.047813 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e80ae6d7-51dc-403a-8a99-158e0ac39291 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 1.216805 Sep 19 15:00:55.048867 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1937/3901] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:53 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:55.112412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:55.119579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:55.143129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:55.144048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:55.144845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:55.146269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:55.159888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:55.161040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:55.320349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.386639 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd933518-e54c-45a3-8262-95a70d96c365 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.778970 Sep 19 15:00:55.388724 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1965/3902] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:54 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:55.399933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5d51cd82-a6f6-4807-ae08-eeac240fea69 req-a8786da6-f75b-4180-a559-3783c6448062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "name": "network-vif-plugged", "status": "completed", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:55.470323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d51cd82-a6f6-4807-ae08-eeac240fea69 req-a8786da6-f75b-4180-a559-3783c6448062 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:55.471501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d51cd82-a6f6-4807-ae08-eeac240fea69 req-a8786da6-f75b-4180-a559-3783c6448062 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:55.472157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d51cd82-a6f6-4807-ae08-eeac240fea69 req-a8786da6-f75b-4180-a559-3783c6448062 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:55.498352 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5d51cd82-a6f6-4807-ae08-eeac240fea69 req-a8786da6-f75b-4180-a559-3783c6448062 service nova] Creating event network-vif-plugged:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 15:00:55.509703 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5d51cd82-a6f6-4807-ae08-eeac240fea69 req-a8786da6-f75b-4180-a559-3783c6448062 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118279 Sep 19 15:00:55.511157 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1966/3903] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:55.536798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:55.538763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:55.560484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:55.561357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:55.561986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:55.563357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:55.564548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:55.565368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:55.675769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=16 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:55.844439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.876591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.886492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.888609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e8de09b-a66e-4369-b823-e02ad5730a25 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.374748 Sep 19 15:00:55.889250 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1967/3904] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:55 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:55.902944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:55.975245 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb5271b8-06ef-4b37-b83a-f1246de95b96 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.879019 Sep 19 15:00:55.980747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1938/3905] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:55 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:56.115344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:56.119186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:56.143556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.145015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.149851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:56.154592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.156061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.157814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:56.454186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:56.462634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:56.483471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.484967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.486873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:56.488201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.489004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.490323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:56.784257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:56.831141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:56.835101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:56.839289 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a7c7964-4f1e-4cc2-88ae-1d02d65e8d27 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.739470 Sep 19 15:00:56.841446 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1968/3906] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:56 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:56.856255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-537a24e4-2180-48d2-880f-c9527c75f4d6 req-c8664882-a45b-45e0-a3f1-f31e7c0d421c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4c9efa-68b4-46e4-a7dd-3f9821094052", "tag": "9bf066f0-027f-494d-832a-94ed97c4bacf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:56.882338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-537a24e4-2180-48d2-880f-c9527c75f4d6 req-c8664882-a45b-45e0-a3f1-f31e7c0d421c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.884357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-537a24e4-2180-48d2-880f-c9527c75f4d6 req-c8664882-a45b-45e0-a3f1-f31e7c0d421c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.885344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-537a24e4-2180-48d2-880f-c9527c75f4d6 req-c8664882-a45b-45e0-a3f1-f31e7c0d421c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:56.909814 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-537a24e4-2180-48d2-880f-c9527c75f4d6 req-c8664882-a45b-45e0-a3f1-f31e7c0d421c service nova] Creating event network-changed:9bf066f0-027f-494d-832a-94ed97c4bacf for instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 on n-h2-858384-1 Sep 19 15:00:56.926084 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-537a24e4-2180-48d2-880f-c9527c75f4d6 req-c8664882-a45b-45e0-a3f1-f31e7c0d421c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081038 Sep 19 15:00:56.928141 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1969/3907] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:56.942176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:56.944576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:56.976324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.978095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.979100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:56.980624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:56.982526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:56.984057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:57.272014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:57.314924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:57.317918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:57.324104 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40e08bdd-3786-406a-b43f-c39ad6fa795f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.389966 Sep 19 15:00:57.325925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1970/3908] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:56 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:00:57.350389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:57.355381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:57.380079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:57.381329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:57.382383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:57.385331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:57.386511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:57.387599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:57.644729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:57.660532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3057cf3f-d632-49fd-860a-e9627542bfde tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 1.239659 Sep 19 15:00:57.661167 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1939/3909] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:56 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:57.895049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:57.895686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:57.906624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:57.906624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:57.907112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:57.907745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:57.908198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:57.911899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:58.206992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.244316 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a846e87-9955-4d46-b44d-5e2212f1eb16 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.905089 Sep 19 15:00:58.245991 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1971/3910] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:57 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:58.380986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:58.391737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:58.417081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:58.417944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:58.419006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:58.432918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:58.433881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:58.434989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:58.533097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.565856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.568145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.570147 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f5ad9e74-fef4-42a1-b8df-ed34d63289e5 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.680038 Sep 19 15:00:58.588948 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1940/3911] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:57 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:58.657961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.681188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.696640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:58.701889 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ad2077e-ae6a-486b-9016-c9f7aba63f3f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.329125 Sep 19 15:00:58.704898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1972/3912] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:58 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:00:58.707678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:58.709726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:58.732804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:58.733301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:58.733947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:58.734875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:58.735508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:58.736106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:59.059254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2317ee0c-3cdb-463a-8462-1bae72868ff9 req-9d05c804-1693-4643-9d2b-b9e2103f2852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10aa93bf-e81c-4424-a09d-5783ba44edce", "name": "network-vif-plugged", "status": "completed", "tag": "ae6dcefd-38e4-4272-8105-625ae908d017"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:59.120344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2317ee0c-3cdb-463a-8462-1bae72868ff9 req-9d05c804-1693-4643-9d2b-b9e2103f2852 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:59.121354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2317ee0c-3cdb-463a-8462-1bae72868ff9 req-9d05c804-1693-4643-9d2b-b9e2103f2852 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:59.122188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2317ee0c-3cdb-463a-8462-1bae72868ff9 req-9d05c804-1693-4643-9d2b-b9e2103f2852 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:59.188016 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2317ee0c-3cdb-463a-8462-1bae72868ff9 req-9d05c804-1693-4643-9d2b-b9e2103f2852 service nova] Creating event network-vif-plugged:ae6dcefd-38e4-4272-8105-625ae908d017 for instance 10aa93bf-e81c-4424-a09d-5783ba44edce on n-h1-858384-1 Sep 19 15:00:59.231015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2317ee0c-3cdb-463a-8462-1bae72868ff9 req-9d05c804-1693-4643-9d2b-b9e2103f2852 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195228 Sep 19 15:00:59.232126 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1973/3913] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:00:59.291932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:59.293273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:59.307540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:59.323995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:59.330580 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-88e8a36b-345d-456b-97e9-a1c47de669ca tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.627677 Sep 19 15:00:59.331170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:59.332239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:59.333283 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1941/3914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:58 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:59.336378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:59.340694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:59.344768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:59.605716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:59.606799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:59.642100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:59.643129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:59.643934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:59.645224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:59.646036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:59.646837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:00.007999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.022800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c144b9b-1575-463f-9ac0-60c7bd8e7c43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.739861 Sep 19 15:01:00.023397 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1974/3915] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:59 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:00.034450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:00.038479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:00.056766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:00.057495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:00.057960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:00.058715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:00.063009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:00.064436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:00.130923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.170237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.180116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.188630 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9067c17-f4f9-4d40-84ab-e85e67731613 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1807 microversion: 2.20 time: 0.590349 Sep 19 15:01:00.190426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1942/3916] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:00:59 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1807 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:01:00.236004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.264324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.267575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.270153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6960e82f-55bb-4de1-8855-e7b338d2818b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.245141 Sep 19 15:01:00.271361 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1975/3917] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:00 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:00.381456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:00.388435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:00.450736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:00.451825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:00.453148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:00.459877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:00.461203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:00.466071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:00.945988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:00.971717 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-28296d0e-5c5f-49b5-938d-884f6de6cdf2 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.603971 Sep 19 15:01:00.978622 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1943/3918] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:00 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:01.070105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:01.070798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:01.084570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:01.085091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:01.085659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:01.086437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:01.087617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:01.088063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:01.243493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:01.250049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:01.275761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:01.278159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:01.284130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:01.285650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:01.287175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:01.289851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:01.315368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:01.403659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.421565 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e807e2ba-cd11-418d-9d68-5d1ca28c15e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1317 microversion: 2.1 time: 0.358694 Sep 19 15:01:01.422886 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1976/3919] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:01 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:01.431078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:01.451398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:01.483487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:01.484007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:01.484460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:01.485217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:01.486305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:01.486305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:01.644935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.702369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.731634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.734788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.737065 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e052b898-b6fb-427a-887c-9fe4637b558b tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.311476 Sep 19 15:01:01.743880 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1977/3920] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:01 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:01.746398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.749821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:01.753020 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bef64b14-1929-4c6e-b151-ae68d3f48696 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1794 microversion: 2.20 time: 0.517136 Sep 19 15:01:01.762812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1944/3921] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:01 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1794 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:02.044308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:02.045523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:02.085687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.087464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.089631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.094075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.095073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.095865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.454721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:02.469298 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb1c28bb-bea4-40e0-a5a6-82582765a1fc tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.448439 Sep 19 15:01:02.470245 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1978/3922] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:02 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:02.486473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:02.489889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:02.533579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.534508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.535332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.538062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.541752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.549098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.768896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:02.769761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:02.770258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:02.778914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.779627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.780202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.781060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.781854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.782606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.817992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b0d2538-ba4b-4e31-a240-d2eb9d8ce219 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1505 microversion: 2.1 time: 0.343800 Sep 19 15:01:02.819527 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1945/3923] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:02 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:02.848295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:02.849514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:02.862208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.863662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.865672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.867353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:02.868958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:02.870005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:02.909695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:01:03.026010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:03.038711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:03.044615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:03.045918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:03.051089 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d0073a3-bbfa-4d72-83e1-a02c1f69a97f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.282735 Sep 19 15:01:03.054398 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1979/3924] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:02 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:03.077565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7776e709-e75c-4ac7-af82-4a1a435bccbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "DELETE /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 204 len: 0 microversion: 2.1 time: 0.236696 Sep 19 15:01:03.078515 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1946/3925] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:01:02 2022] DELETE /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:01:03.094898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:03.095556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:03.105112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:03.105975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:03.106431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:03.107189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:03.108056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:03.109135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:03.497208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:03.497949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:03.512674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:03.515529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:03.515996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:03.518168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:03.518168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:03.522491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:03.809931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:03.828045 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-36f3cf96-2b85-4834-87b7-4de75ee5c1f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1511 microversion: 2.1 time: 0.743297 Sep 19 15:01:03.829980 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1980/3926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:03 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:03.837909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-50ffc03a-d1ad-4cd1-beee-66ff798e71f3 req-a6f8cd8e-198e-4422-b99b-8829dddb85a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4c9efa-68b4-46e4-a7dd-3f9821094052", "name": "network-vif-plugged", "status": "completed", "tag": "9bf066f0-027f-494d-832a-94ed97c4bacf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:03.849437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-50ffc03a-d1ad-4cd1-beee-66ff798e71f3 req-a6f8cd8e-198e-4422-b99b-8829dddb85a0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:03.850211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-50ffc03a-d1ad-4cd1-beee-66ff798e71f3 req-a6f8cd8e-198e-4422-b99b-8829dddb85a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:03.851051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-50ffc03a-d1ad-4cd1-beee-66ff798e71f3 req-a6f8cd8e-198e-4422-b99b-8829dddb85a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:03.875269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-50ffc03a-d1ad-4cd1-beee-66ff798e71f3 req-a6f8cd8e-198e-4422-b99b-8829dddb85a0 service nova] Creating event network-vif-plugged:9bf066f0-027f-494d-832a-94ed97c4bacf for instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 on n-h2-858384-1 Sep 19 15:01:03.897509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-50ffc03a-d1ad-4cd1-beee-66ff798e71f3 req-a6f8cd8e-198e-4422-b99b-8829dddb85a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064196 Sep 19 15:01:03.899061 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1981/3927] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:01:04.087869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:04.088897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:04.103655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:04.104831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:04.107422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:04.109275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:04.112009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:04.113262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:04.195463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:04.214969 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f1d412fe-fa48-4dc2-bbb5-07f04484c197 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.724848 Sep 19 15:01:04.216413 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1947/3928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:03 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:04.316549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:04.349747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:04.357019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:04.361885 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-517bd429-7d49-4bd5-976c-a2c78f7e46e1 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.285011 Sep 19 15:01:04.363832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1982/3929] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:04 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:01:04.874323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:04.875600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:04.885891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:04.886621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:04.887246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:04.888131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:04.889029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:04.889728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:05.127906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:05.140729 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-027c680c-06ef-4d54-9799-d9f06d31bab0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1511 microversion: 2.1 time: 0.270122 Sep 19 15:01:05.155411 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1948/3930] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:04 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:05.247751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:05.248732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:05.261112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:05.262719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:05.268085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:05.271239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:05.272814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:05.272814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:05.413653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:05.414465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:05.453481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:05.454367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:05.455209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:05.460697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:05.466384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:05.471386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:05.752273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:05.776078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:05.777888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:05.801514 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0156233c-4a83-46bb-a189-229e5d4c9413 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.373172 Sep 19 15:01:05.809702 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1949/3931] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:05 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:05.816472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:05.827588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-eddbec10-3630-4d95-9efc-0f7ca91973e4 req-187f82e0-9f5b-4bbe-b730-ff3dec3b0f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10aa93bf-e81c-4424-a09d-5783ba44edce", "name": "network-vif-deleted", "tag": "ae6dcefd-38e4-4272-8105-625ae908d017"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:05.837422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45a03377-e175-402e-bfcd-2880ac8e0c4d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1314 microversion: 2.1 time: 0.596015 Sep 19 15:01:05.853450 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1983/3932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:05 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:05.864873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-eddbec10-3630-4d95-9efc-0f7ca91973e4 req-187f82e0-9f5b-4bbe-b730-ff3dec3b0f8c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:05.865827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-eddbec10-3630-4d95-9efc-0f7ca91973e4 req-187f82e0-9f5b-4bbe-b730-ff3dec3b0f8c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:05.867202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-eddbec10-3630-4d95-9efc-0f7ca91973e4 req-187f82e0-9f5b-4bbe-b730-ff3dec3b0f8c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:05.898184 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-eddbec10-3630-4d95-9efc-0f7ca91973e4 req-187f82e0-9f5b-4bbe-b730-ff3dec3b0f8c service nova] Creating event network-vif-deleted:ae6dcefd-38e4-4272-8105-625ae908d017 for instance 10aa93bf-e81c-4424-a09d-5783ba44edce on n-h1-858384-1 Sep 19 15:01:05.913424 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-eddbec10-3630-4d95-9efc-0f7ca91973e4 req-187f82e0-9f5b-4bbe-b730-ff3dec3b0f8c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100538 Sep 19 15:01:05.918959 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1950/3933] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:01:06.166161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:06.167416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:06.181535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.182574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.183473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.185978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.187004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.187911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.241054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.241864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.243201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.243941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lazy-loading 'fault' on Instance uuid 10aa93bf-e81c-4424-a09d-5783ba44edce {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:01:06.304169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:06.321939 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cacdb2f1-600c-4921-b1a3-853f9d10bd41 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 200 len: 1307 microversion: 2.1 time: 0.159993 Sep 19 15:01:06.323797 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1984/3934] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:06 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:06.835743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:06.837624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:06.845394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.845899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.846345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.847511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.848191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.848933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.868271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:06.869391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:06.891906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.892786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.893558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.894836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.895677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.896406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.931737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:06.944202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:06.948092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:06.949904 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e89763e-8582-40f2-85d0-6150b2b4e46e tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.118978 Sep 19 15:01:06.974621 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1951/3935] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:06 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:07.347379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.348031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.361448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.361973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.362427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.363222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.363698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.364136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.394395 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce HTTP/1.1 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '10aa93bf-e81c-4424-a09d-5783ba44edce'} Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:07.398599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:07.410301 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:07.412973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:07.413769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:07.413769 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-88da13a3-08b8-4ddb-b624-0d581740f532 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 404 len: 111 microversion: 2.1 time: 0.065347 Sep 19 15:01:07.423390 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1952/3936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:07 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:01:07.432788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.433429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.436714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:07.449234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.449748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.450201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.451547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.451905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.452334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.464640 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9adac6cc-ce21-4561-8b11-311a829efd6a tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1502 microversion: 2.1 time: 0.599571 Sep 19 15:01:07.465341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1985/3937] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:06 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1502 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:07.503596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.504400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.519157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.519927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.520650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.521587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.522226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.522857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.720772 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-deb638a6-e934-4015-8417-a01b9bdf7246 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.220768 Sep 19 15:01:07.730078 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1986/3938] 10.222.0.81 () {58 vars in 1296 bytes} [Mon Sep 19 15:01:07 2022] DELETE /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052/os-server-password => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:01:07.742530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.743561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.764016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.764863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:07.765216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.766159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.768019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.771891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.773225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.777091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d88cf1f-46bc-4b2e-a71e-c67bc10873d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.348944 Sep 19 15:01:07.779955 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1953/3939] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:07 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:07.837609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f11a901-e2f0-4b14-8460-7764f01f0b06 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.105502 Sep 19 15:01:07.848165 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1987/3940] 10.222.0.81 () {58 vars in 1293 bytes} [Mon Sep 19 15:01:07 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052/os-server-password => generated 16 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:01:07.853191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.854041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.864696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.869991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.870828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.871990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.872664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.877450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.932423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:01:07.983728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.984349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.992428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:07.993040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:07.993487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:07.994379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.002511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.003177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:08.085772 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ee99afe2-3c98-4345-9030-3680a8306ee5 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 204 len: 0 microversion: 2.1 time: 0.237387 Sep 19 15:01:08.091872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1954/3941] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:01:07 2022] DELETE /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:01:08.104687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61669241-4746-4ba2-a96d-8f3fb3c224a7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61669241-4746-4ba2-a96d-8f3fb3c224a7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 163 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": 12345, "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 12345 Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:08.108368 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61669241-4746-4ba2-a96d-8f3fb3c224a7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61669241-4746-4ba2-a96d-8f3fb3c224a7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015234 Sep 19 15:01:08.117219 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1955/3942] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:08 2022] POST /compute/v2.1/servers => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:08.127963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:08.130280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:08.131712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:08.149923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:08.154120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:08.157130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ef3540a-68c4-4527-a3fe-c2bb4076a84c tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.178358 Sep 19 15:01:08.165776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.167063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.168115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:08.170736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.172425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.173496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:08.176052 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1988/3943] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:07 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:01:08.190840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:08.191800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:08.207820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.208883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.208883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:08.209454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.209911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.210333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.260586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.269154 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c8dceb1-f9a6-4e59-a6db-ae77220d244d tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1508 microversion: 2.1 time: 1.153069 Sep 19 15:01:09.294181 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1956/3944] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:08 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1508 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:09.300491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:09.301522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:09.317052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.317901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.318563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.319571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.321970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.322788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.426974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.446494 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a81246a3-2eb6-4947-a0a6-457b1b75fd10 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.267497 Sep 19 15:01:09.453357 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1989/3945] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:08 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:09.459238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:09.463296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:09.474335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.479623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.480949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.481965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.487065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.488034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.678641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.710064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.712735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.714325 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-55b9d89e-9f33-4657-911c-917c1b6b04aa tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.259859 Sep 19 15:01:09.741906 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1990/3946] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:09 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:09.747664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:09.748599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:09.764612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.773046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.774292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.775303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.775961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.776583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.809994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.827725 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b810c72-904f-4af6-8068-6dc28024e5b9 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.531875 Sep 19 15:01:09.828708 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1957/3947] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:09 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:09.861563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:09.862257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:09.878453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.878992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.879439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.880181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.880653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.881315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.253198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:10.261919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-237fe995-7cc9-4555-9625-a40b87c3c492 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.405238 Sep 19 15:01:10.280924 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1958/3948] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:09 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:10.287152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:10.288042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:10.297352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.298212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.298951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.300068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.300786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.302188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.339333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:10.356707 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c015913d-15f7-4e6e-b5ef-db9ec6595769 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.613053 Sep 19 15:01:10.357665 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1991/3949] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:09 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:10.374933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:10.375570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:10.390770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.391497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.392108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.393026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.393659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.394338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.923857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:10.926649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:10.945564 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a636b25-3953-491d-aa29-f7f878c898fb tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.662624 Sep 19 15:01:10.965924 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1959/3950] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:10 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:10.984240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:10.984880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:10.995262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.996241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.997149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.998045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.998671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.999281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:11.005855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:11.031797 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4bf36ad-e943-4ec4-b219-db9491d64ef3 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1508 microversion: 2.1 time: 0.659643 Sep 19 15:01:11.033325 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1992/3951] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:10 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1508 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:11.051183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:11.052188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:11.086714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:11.091926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:11.093576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:11.096341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:11.098610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:11.103750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:11.147264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:11.162418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:11.168008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:11.173166 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73fccc8e-cb02-42ba-9866-3994d229c1e9 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.206157 Sep 19 15:01:11.174021 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1960/3952] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:10 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:11.312866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-60b39731-905b-47a9-b4db-9a84cc02cbe6 req-12b30374-731d-42af-8321-84dc7156cedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4c9efa-68b4-46e4-a7dd-3f9821094052", "name": "network-vif-deleted", "tag": "9bf066f0-027f-494d-832a-94ed97c4bacf"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:11.337504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-60b39731-905b-47a9-b4db-9a84cc02cbe6 req-12b30374-731d-42af-8321-84dc7156cedd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:11.338858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-60b39731-905b-47a9-b4db-9a84cc02cbe6 req-12b30374-731d-42af-8321-84dc7156cedd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:11.341922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-60b39731-905b-47a9-b4db-9a84cc02cbe6 req-12b30374-731d-42af-8321-84dc7156cedd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:11.384050 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-60b39731-905b-47a9-b4db-9a84cc02cbe6 req-12b30374-731d-42af-8321-84dc7156cedd service nova] Creating event network-vif-deleted:9bf066f0-027f-494d-832a-94ed97c4bacf for instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 on n-h2-858384-1 Sep 19 15:01:11.401892 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-60b39731-905b-47a9-b4db-9a84cc02cbe6 req-12b30374-731d-42af-8321-84dc7156cedd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088168 Sep 19 15:01:11.405875 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1961/3953] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:01:11.734594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:11.767441 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8494148-097a-4951-939c-8f397226792d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.729810 Sep 19 15:01:11.768403 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1993/3954] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:11 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:12.016782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-916465739", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "57e08ed1-fe03-4626-8d78-fcc627ace18e"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:12.063199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:12.064095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:12.095303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:12.096523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:12.097127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:12.098076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:12.100929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:12.101693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:12.138930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] validate_networks() for [('57e08ed1-fe03-4626-8d78-fcc627ace18e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:01:12.186628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:12.193015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:12.197330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:12.199265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lazy-loading 'fault' on Instance uuid 7b4c9efa-68b4-46e4-a7dd-3f9821094052 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:01:12.263946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700581adaa42519bf60dcafcb5b6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b098a328d1bc4260a13a7d21e0b03aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:12.278618 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-441c6e80-61ff-447e-b19e-9461b04cc06b tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 200 len: 1304 microversion: 2.1 time: 0.219413 Sep 19 15:01:12.295231 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1994/3955] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:12 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:12.300634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:12.309649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:12.318702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:12.319518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:12.321621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:12.322721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:12.327219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:12.327883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:12.361501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:12.469323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:12.480958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:12.492144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:12.493983 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a7fd9374-e967-4a29-8089-3abcc54eb920 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.197253 Sep 19 15:01:12.497720 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1995/3956] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:12 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:13.223564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:01:13.224066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:01:13.224456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:01:13.224869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:01:13.225359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:01:13.235271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.235798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.236230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.237145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.237770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.238374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.257818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:01:13.265838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for user c11d7590aa1f4fa48be57e2efc017a6f and project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:01:13.281134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:01:13.284008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:01:13.303223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:13.305703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] [instance: 7b4c9efa-68b4-46e4-a7dd-3f9821094052] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:13.313088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.313934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.316510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.317850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.318661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.319226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.339044 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-986f5da0-25c0-4a61-8c6d-0037d7d91584 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327558 Sep 19 15:01:13.340218 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1962/3957] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:01:13.352474 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] HTTP exception thrown: Instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 could not be found. Sep 19 15:01:13.353790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c1552da-d08a-43b4-998f-a41e9bc0f0a6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Request method failure captured: Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 HTTP/1.1 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIQX3yVtZYJBqfF3FbxOG71YQauxtxAPKIm7wHSUgg6iTaBIGWbf3vFEM2LWmp9nZULbBy-RoCPIXErI5do-VyNwIGBlPPcIvPsdy-mgUZyMcSgz7n6JGgeW7crd0aDglB9Rd1IVqv1cJVyiYss7-9SeFtmsX3bp85bSvPgsRQihzAI Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b098a328d1bc4260a13a7d21e0b03aab Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerPasswordTestJSON-1684471785 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b098a328d1bc4260a13a7d21e0b03aab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b098a328d1bc4260a13a7d21e0b03aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b098a328d1bc4260a13a7d21e0b03aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b098a328d1bc4260a13a7d21e0b03aab"}]}] Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerPasswordTestJSON-1684471785 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b098a328d1bc4260a13a7d21e0b03aab Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1684471785 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerPasswordTestJSON-1684471785-project Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 1a700581adaa42519bf60dcafcb5b6b1 Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerPasswordTestJSON-1684471785-project Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 could not be found. Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7b4c9efa-68b4-46e4-a7dd-3f9821094052'} Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 could not be found. Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 could not be found. Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:13.353940 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 could not be found. Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.360268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] Returning 404 to user: Instance 7b4c9efa-68b4-46e4-a7dd-3f9821094052 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:13.360876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5c1552da-d08a-43b4-998f-a41e9bc0f0a6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:13.369201 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0eb42410-26b4-493e-acba-5ed8778e96c0 tempest-ServerPasswordTestJSON-1684471785 tempest-ServerPasswordTestJSON-1684471785-project] 10.222.0.81 "GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052" status: 404 len: 111 microversion: 2.1 time: 0.064587 Sep 19 15:01:13.370464 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1996/3958] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:13 2022] GET /compute/v2.1/servers/7b4c9efa-68b4-46e4-a7dd-3f9821094052 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:01:13.376568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8640edef-1d6f-497b-a685-cc0be636f60c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1261376057", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "06906ba7-3cd4-4587-8552-69710b26b171", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:13.511156 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-8640edef-1d6f-497b-a685-cc0be636f60c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Block Device 06906ba7-3cd4-4587-8552-69710b26b171 is not bootable. Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8640edef-1d6f-497b-a685-cc0be636f60c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 358 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1261376057", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "06906ba7-3cd4-4587-8552-69710b26b171", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: exception: Block Device 06906ba7-3cd4-4587-8552-69710b26b171 is not bootable. Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1261376057', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '06906ba7-3cd4-4587-8552-69710b26b171'}], 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 06906ba7-3cd4-4587-8552-69710b26b171 is not bootable. Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:13.523267 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 06906ba7-3cd4-4587-8552-69710b26b171 is not bootable. Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 06906ba7-3cd4-4587-8552-69710b26b171 is not bootable. Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8640edef-1d6f-497b-a685-cc0be636f60c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Block Device 06906ba7-3cd4-4587-8552-69710b26b171 is not bootable. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8640edef-1d6f-497b-a685-cc0be636f60c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.154131 Sep 19 15:01:13.529322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1997/3959] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:13.542440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:13.543128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:13.561184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.561693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.562138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.576817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.577788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.578315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.680533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5c1552da-d08a-43b4-998f-a41e9bc0f0a6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:13.687881 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c1552da-d08a-43b4-998f-a41e9bc0f0a6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1214 microversion: 2.1 time: 0.338486 Sep 19 15:01:13.689488 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1963/3960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:13 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1214 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:13.694532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:13.696131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:13.704271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.705007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.705621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.706701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.707328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.707897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.738617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:13.752498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:13.754433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:13.765256 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94e6182d-0c2b-4a9c-81d7-43629a2934ea tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.233509 Sep 19 15:01:13.779239 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1998/3961] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:13 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:14.324575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:14.357193 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4f1bf4f1-0857-47da-afb2-b52ff5b5bcd3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.665013 Sep 19 15:01:14.359374 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1964/3962] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:13 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:14.404417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:14.417269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:14.439941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:14.442991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:14.444582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:14.450050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:14.453167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:14.456288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:14.718417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:14.720407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:14.732876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:14.737155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:14.737866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:14.740086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:14.740795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:14.741456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:15.041037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:15.053630 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-16f19b0f-d611-4d34-accf-becb851b8084 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1266 microversion: 2.1 time: 0.339929 Sep 19 15:01:15.066773 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1965/3963] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:14 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:15.073967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:15.074638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:15.092148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:15.092655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:15.093100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:15.093923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:15.094373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:15.094857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:15.156466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:15.169385 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d67001dd-cd2b-4dba-ab3c-824cd7e5cf0d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.782678 Sep 19 15:01:15.191660 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 1999/3964] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:14 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:15.373070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:15.387161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:15.388762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:15.390194 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fcf2bcbe-489d-4640-b784-96a8415e7a87 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1603 microversion: 2.32 time: 0.329000 Sep 19 15:01:15.398196 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1966/3965] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:15 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1603 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:16.082846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:16.084118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:16.101307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.103418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.104115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.105769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.106573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.107460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.306898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:16.341824 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df14f710-1918-41d9-aa29-fa8108a4ad24 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1272 microversion: 2.1 time: 0.261878 Sep 19 15:01:16.345996 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2000/3966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:16 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:16.433693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:16.437157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:16.460289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.460802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.461915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.462876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.473076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.474849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.576376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.577310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.578795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.579632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lazy-loading 'fault' on Instance uuid fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:01:16.772684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:16.789954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:16.793355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f8816ea2294e3e90b76601cc37a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c71a7d33bb47a2b56b1e33f9af910f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:16.799861 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-431da5e0-1fa4-4140-95a3-0d84b9e1ec3a tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 200 len: 1370 microversion: 2.32 time: 0.372599 Sep 19 15:01:16.804129 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1967/3967] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:16 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:01:17.374597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:17.375873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:17.394344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.394874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.395609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.396541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.397207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.397873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.512650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:17.530699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f2cde71-df6a-460b-95f3-5aa9e68890ea tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1272 microversion: 2.1 time: 0.159948 Sep 19 15:01:17.531375 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2001/3968] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:17 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:17.862635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:17.863374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:17.887647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.893250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.894410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.897653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.898006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.902113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.926527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9201dd4-ccb6-427e-a080-340a29fb8066 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1347884421", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "65e17483-129b-4a3b-97d8-49cd96ae0799", "destination_type": "local"}, {"source_type": "volume", "uuid": "2b357f61-b9fe-48dc-b508-5adcebb9145b", "destination_type": "invalid"}], "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9201dd4-ccb6-427e-a080-340a29fb8066 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 495 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1347884421", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "65e17483-129b-4a3b-97d8-49cd96ae0799", "destination_type": "local"}, {"source_type": "volume", "uuid": "2b357f61-b9fe-48dc-b508-5adcebb9145b", "destination_type": "invalid"}], "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1347884421', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2b357f61-b9fe-48dc-b508-5adcebb9145b', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi 'invalid' Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:17.935945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 19 15:01:17.940451 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.943251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9201dd4-ccb6-427e-a080-340a29fb8066 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:17.945246 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e9201dd4-ccb6-427e-a080-340a29fb8066 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022743 Sep 19 15:01:17.948688 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2002/3969] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:17 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:01:17.957092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:17.957717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:17.959988 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] HTTP exception thrown: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Request method failure captured: Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 HTTP/1.1 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIJmDnNYxXusXzP82wLl5SiQSkJqkJ9bg5N7Li1tDic10YgNG590YxryliYiGXQ9kzbIVo9WtnyJMECr9N7N--yFjc8li45v7k4c7Tt5yBkpsMZow4u6J_1lgdxBwJhOv0vLMyaDoRRSdgLX7VEfEKhdAqeNEx7CqNLg9yYVOQRxIJA Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.32 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 54c71a7d33bb47a2b56b1e33f9af910f Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/54c71a7d33bb47a2b56b1e33f9af910f"}]}] Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 54c71a7d33bb47a2b56b1e33f9af910f Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TaggedBootDevicesTest-1679813454-project Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 25f8816ea2294e3e90b76601cc37a4ec Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TaggedBootDevicesTest-1679813454-project Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'fe4ab801-a114-4fcf-93ef-8173bf5c4fd9'} Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.965321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:17.970207 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:17.975821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Returning 404 to user: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:17.977579 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b04a643d-46cd-427e-a0a0-37443eb1332f tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 404 len: 111 microversion: 2.32 time: 0.122404 Sep 19 15:01:17.978140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.979705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.980169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.980933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.981412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.981852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.983239 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1968/3970] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:17 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:17.998541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f8bdc1c4-4b61-4e57-afea-615c74c903e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '.version_select at 0x7fde2e10b550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:18.036530 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f8bdc1c4-4b61-4e57-afea-615c74c903e7 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12524104" status: 204 len: 0 microversion: 2.32 time: 0.049096 Sep 19 15:01:18.041991 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1969/3971] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12524104 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 15:01:18.451392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:18.465523 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-33005e28-950e-4e8b-b9c9-ae5c616195dd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.513264 Sep 19 15:01:18.466407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2003/3972] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:17 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:18.493048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:18.493804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:18.507522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:18.508634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:18.509373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:18.510566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:18.511276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:18.511883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:18.557499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:18.558726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:18.574491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:18.576796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:18.579392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:18.587428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:18.588672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:18.589534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:19.031177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:19.044927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:19.056402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-820b40b6-b50f-4dff-93d9-f11f0ff6e352 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.568788 Sep 19 15:01:19.057774 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6141767b-9fd4-434d-ad90-5508ec2300a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.505039 Sep 19 15:01:19.058027 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1970/3973] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:18 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:19.059519 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2004/3974] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:18 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:19.140530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97ef373a-7d81-4fb5-831b-6e963c5bfd6b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1559495585", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97ef373a-7d81-4fb5-831b-6e963c5bfd6b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 492 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1559495585", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1559495585', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.154626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 19 15:01:19.160988 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:19.166799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97ef373a-7d81-4fb5-831b-6e963c5bfd6b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:19.167585 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97ef373a-7d81-4fb5-831b-6e963c5bfd6b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.035727 Sep 19 15:01:19.168965 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1971/3975] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:19 2022] POST /compute/v2.1/servers => generated 624 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:19.187270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:19.188474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:19.207789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:19.208943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:19.209661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:19.212308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:19.213601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:19.215354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:19.846524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:19.877808 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0de6655a-9aa2-4867-bff0-17a6bc851fc4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.701451 Sep 19 15:01:19.881736 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2005/3976] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:19 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:19.925189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:19.925807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:19.949159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:19.949677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:19.950088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:19.953748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:19.954485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:19.964186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:20.113302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:20.114236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:20.122292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:20.123124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:20.123824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:20.125722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:20.129566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:20.130080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:20.613467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:20.637281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-386d3f8d-5d67-4aa2-b4fe-410dbd58caf0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.716711 Sep 19 15:01:20.638929 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1972/3977] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:19 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:20.722969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c25c319-34a3-49e5-a928-9e6ead69dc76 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:20.734502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c25c319-34a3-49e5-a928-9e6ead69dc76 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 416 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.744335 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:01:20.748634 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:20.752981 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5a0dc672-54f3-4dc6-b2bb-47deb7a2586e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.640253 Sep 19 15:01:20.754512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c25c319-34a3-49e5-a928-9e6ead69dc76 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:20.759764 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c25c319-34a3-49e5-a928-9e6ead69dc76 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.040538 Sep 19 15:01:20.760935 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1973/3978] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:20 2022] POST /compute/v2.1/servers => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:01:20.763152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2006/3979] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:20 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:20.777889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:20.778852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:20.787448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:20.788291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:20.790156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:20.791201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:20.791902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:20.792561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.251484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a19e1a55-9454-46a6-9d5c-84d73ced109f req-34507a76-20ec-4e9d-b4db-38ee58144281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c33789-be7c-43f3-a822-636103efa378", "tag": "b85f01a8-946f-4846-becb-2728173d0135"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:21.283017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:21.283504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a19e1a55-9454-46a6-9d5c-84d73ced109f req-34507a76-20ec-4e9d-b4db-38ee58144281 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.283640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a19e1a55-9454-46a6-9d5c-84d73ced109f req-34507a76-20ec-4e9d-b4db-38ee58144281 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.284187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a19e1a55-9454-46a6-9d5c-84d73ced109f req-34507a76-20ec-4e9d-b4db-38ee58144281 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.300131 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f2e6755-d8b5-4044-8f00-7e63eaf56867 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.531535 Sep 19 15:01:21.301385 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2007/3980] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:20 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:21.328976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:21.329895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:21.342532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.343382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.343981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.344868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.345496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.348238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.368487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a19e1a55-9454-46a6-9d5c-84d73ced109f req-34507a76-20ec-4e9d-b4db-38ee58144281 service nova] Creating event network-changed:b85f01a8-946f-4846-becb-2728173d0135 for instance 89c33789-be7c-43f3-a822-636103efa378 on n-h1-858384-1 Sep 19 15:01:21.386265 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a19e1a55-9454-46a6-9d5c-84d73ced109f req-34507a76-20ec-4e9d-b4db-38ee58144281 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137715 Sep 19 15:01:21.388936 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1974/3981] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:01:21.775098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:21.777136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:21.787083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.793305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.794202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.795219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.795725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.796161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.797723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:21.813564 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2b5723c-69b2-40c0-9bd1-684b4d30feea tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.487297 Sep 19 15:01:21.814508 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2008/3982] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:21 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:21.941482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51c46140-9faf-420b-9265-17b1b4dcb879 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1441038627", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": -1, "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:21.955626 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-51c46140-9faf-420b-9265-17b1b4dcb879 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Flavor -1 could not be found. Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51c46140-9faf-420b-9265-17b1b4dcb879 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 206 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1441038627", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": -1, "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: exception: Flavor -1 could not be found. Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1441038627', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': -1, 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:21.961534 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 19 15:01:21.966359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:21.968415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51c46140-9faf-420b-9265-17b1b4dcb879 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:21.969434 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-51c46140-9faf-420b-9265-17b1b4dcb879 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032172 Sep 19 15:01:21.970504 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2009/3983] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:21 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:21.991610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:21.993133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:22.001269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:22.002183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:22.003335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:22.004797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:22.005556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:22.006238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:22.377733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:22.403402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-44e1f674-d24c-4ef1-990a-9f8ee681556e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.632611 Sep 19 15:01:22.479324 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1975/3984] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:21 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:22.554336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:22.565150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31a82c7f-763a-402d-bac0-7862228f66b3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.581154 Sep 19 15:01:22.571123 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2010/3985] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:21 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:22.599915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:22.600654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:22.620586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:22.621110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:22.621821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:22.622738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:22.623241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:22.623784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:23.247560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:23.487741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:23.488643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:23.505960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:23.516370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:23.517195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:23.518303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:23.519234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:23.520080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:23.688051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:23.907045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:23.920304 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c2c76e1-c23b-4589-b48c-b19932ac5460 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.325998 Sep 19 15:01:23.934810 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1976/3986] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:22 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:24.171446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:24.182942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ccc35cf-d2ae-4f70-9928-138057a4ac91 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838820411", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ccc35cf-d2ae-4f70-9928-138057a4ac91 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 172 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838820411", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-838820411', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi -1 Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:24.188784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 19 15:01:24.192843 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:24.196174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ccc35cf-d2ae-4f70-9928-138057a4ac91 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:24.197667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4ccc35cf-d2ae-4f70-9928-138057a4ac91 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020382 Sep 19 15:01:24.199936 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1977/3987] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:24 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:24.214854 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d6448fe-6f91-42d9-86e6-2a661e558293 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.730998 Sep 19 15:01:24.215157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:24.215712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:24.215925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2011/3988] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:23 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:24.248747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:24.251565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:24.252251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:24.255912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:24.256926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:24.259357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:24.897653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:24.925229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-af5ac6b2-4f6c-4ca6-910a-789e2a3d4a51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.703880 Sep 19 15:01:24.925229 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1978/3989] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:24 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:24.937591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:24.938090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:24.941193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:24.961828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:24.962655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:24.963488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:24.964426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:24.965092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:24.965702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:25.241970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:25.242605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:25.253323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:25.253323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:25.253323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:25.254415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:25.254615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:25.255080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:25.797439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:25.808392 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2bc75244-5294-4ebe-9062-5b8da336163a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.874950 Sep 19 15:01:25.823145 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2012/3990] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:24 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:25.889280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:25.905804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c8707660-47cc-41e0-8b48-414f2aad2897 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.665555 Sep 19 15:01:25.909894 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1979/3991] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:25 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:26.029400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-247de3aa-cc21-47c3-8d25-577904abcbb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1190101305", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:26.049563 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-247de3aa-cc21-47c3-8d25-577904abcbb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-247de3aa-cc21-47c3-8d25-577904abcbb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 216 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1190101305", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1190101305', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:26.059060 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 19 15:01:26.064787 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:26.066617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-247de3aa-cc21-47c3-8d25-577904abcbb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:26.068811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-247de3aa-cc21-47c3-8d25-577904abcbb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.047641 Sep 19 15:01:26.069997 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2013/3992] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:26 2022] POST /compute/v2.1/servers => generated 123 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:26.082201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:26.083637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:26.095116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:26.096043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:26.096700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:26.097735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:26.098453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:26.099355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:26.508983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:26.517506 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-69c10c51-fd3c-4909-9fdb-bb4305a5a8ad tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.440151 Sep 19 15:01:26.518112 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1980/3993] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:26 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:26.552867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:26.553491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:26.565415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:26.572228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:26.572862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:26.574321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:26.574852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:26.575300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:26.930236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:26.931290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:26.939868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:26.940708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:26.941385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:26.942380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:26.943174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:26.943884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:26.960166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:26.973417 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8dcfac21-d63a-407d-8db3-727a02b505f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.424433 Sep 19 15:01:26.974324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2014/3994] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:26 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:27.058884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-813a9488-1854-4e6e-ae01-2181f126e9c8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1270711452", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-key-2091209426", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:27.152143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-813a9488-1854-4e6e-ae01-2181f126e9c8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] validate_networks() for [('becbe19b-7264-4a9a-a233-6761770cd2c6', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:01:27.575370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:27.585244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ce89482-b219-4fdc-862f-ec52cb46d77d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.659386 Sep 19 15:01:27.589269 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1981/3995] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:26 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:27.964792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-813a9488-1854-4e6e-ae01-2181f126e9c8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Invalid key_name provided. Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-813a9488-1854-4e6e-ae01-2181f126e9c8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 247 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1270711452", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-key-2091209426", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid key_name provided. Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1270711452', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'key_name': 'tempest-key-2091209426', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2091209426 not found for user 161efee238a84f78b6771e71701eda05 Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:27.986206 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-813a9488-1854-4e6e-ae01-2181f126e9c8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid key_name provided. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:27.999708 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-813a9488-1854-4e6e-ae01-2181f126e9c8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.948314 Sep 19 15:01:28.009161 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2015/3996] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:27 2022] POST /compute/v2.1/servers => generated 70 bytes in 953 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:28.009379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:28.011754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:28.030054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:28.030578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:28.031043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:28.031781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:28.032250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:28.032687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:28.411263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:28.436894 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-69444f50-d28b-4b36-9ee0-6f3418c5fffe tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.432702 Sep 19 15:01:28.450944 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1982/3997] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:28 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:28.508789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:28.509773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:28.518738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:28.519747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:28.520434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:28.521374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:28.522091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:28.522929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:28.614405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:28.615299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:28.626805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:28.629824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:28.630679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:28.633799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:28.634613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:28.636029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.028875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:29.040568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dce71a51-3093-4709-9593-3aeb10c4f93b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.535902 Sep 19 15:01:29.042082 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2016/3998] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:28 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:29.112386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:29.127199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:29.166554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5eda375-f153-4465-887e-53385110b6f1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-141897024", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:29.173757 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-95411976-3a00-465a-ba2a-b5f5a9f1be0e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.562896 Sep 19 15:01:29.175128 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1983/3999] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:28 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:29.361910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e7e58f93-49af-42b9-8b5e-1884159478cb req-5a8341e1-5c22-4088-a21f-33ae97423cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c33789-be7c-43f3-a822-636103efa378", "name": "network-vif-plugged", "status": "completed", "tag": "b85f01a8-946f-4846-becb-2728173d0135"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:29.373382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e7e58f93-49af-42b9-8b5e-1884159478cb req-5a8341e1-5c22-4088-a21f-33ae97423cad service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.374188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e7e58f93-49af-42b9-8b5e-1884159478cb req-5a8341e1-5c22-4088-a21f-33ae97423cad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.374851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e7e58f93-49af-42b9-8b5e-1884159478cb req-5a8341e1-5c22-4088-a21f-33ae97423cad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.388962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e7e58f93-49af-42b9-8b5e-1884159478cb req-5a8341e1-5c22-4088-a21f-33ae97423cad service nova] Creating event network-vif-plugged:b85f01a8-946f-4846-becb-2728173d0135 for instance 89c33789-be7c-43f3-a822-636103efa378 on n-h1-858384-1 Sep 19 15:01:29.394698 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e7e58f93-49af-42b9-8b5e-1884159478cb req-5a8341e1-5c22-4088-a21f-33ae97423cad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036771 Sep 19 15:01:29.396329 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1984/4000] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:01:29.423002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.security_group_api [None req-f5eda375-f153-4465-887e-53385110b6f1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Neutron security group does_not_exist not found {{(pid=128731) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 19 15:01:29.423595 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f5eda375-f153-4465-887e-53385110b6f1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5eda375-f153-4465-887e-53385110b6f1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 257 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-141897024", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-141897024', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 19 15:01:29.437741 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 19 15:01:29.441715 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.450163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5eda375-f153-4465-887e-53385110b6f1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:29.450724 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5eda375-f153-4465-887e-53385110b6f1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.289872 Sep 19 15:01:29.451641 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2017/4001] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:29 2022] POST /compute/v2.1/servers => generated 106 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:01:29.461961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:29.472421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:29.500258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.501140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.509056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.510007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.510599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.512059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.548291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:29.548803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:29.562426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.563307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.563935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.564812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.565441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.566033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.603726 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] HTTP exception thrown: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Request method failure captured: Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 HTTP/1.1 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIJmDnNYxXusXzP82wLl5SiQSkJqkJ9bg5N7Li1tDic10YgNG590YxryliYiGXQ9kzbIVo9WtnyJMECr9N7N--yFjc8li45v7k4c7Tt5yBkpsMZow4u6J_1lgdxBwJhOv0vLMyaDoRRSdgLX7VEfEKhdAqeNEx7CqNLg9yYVOQRxIJA Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.32 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 54c71a7d33bb47a2b56b1e33f9af910f Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/54c71a7d33bb47a2b56b1e33f9af910f"}]}] Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 54c71a7d33bb47a2b56b1e33f9af910f Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TaggedBootDevicesTest-1679813454-project Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 25f8816ea2294e3e90b76601cc37a4ec Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TaggedBootDevicesTest-1679813454-project Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'fe4ab801-a114-4fcf-93ef-8173bf5c4fd9'} Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:29.606465 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.611328 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.614659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Returning 404 to user: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:29.616605 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ddb57317-7ca6-4a2e-b20e-f7e1ca9602ad tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 404 len: 111 microversion: 2.32 time: 0.077518 Sep 19 15:01:29.622696 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2018/4002] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:01:29 2022] DELETE /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:01:29.629813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:29.630733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] [instance: fe4ab801-a114-4fcf-93ef-8173bf5c4fd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:29.638259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.640476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.641140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.642087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:29.642735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:29.643382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:29.662158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] HTTP exception thrown: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Request method failure captured: Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 HTTP/1.1 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIJmDnNYxXusXzP82wLl5SiQSkJqkJ9bg5N7Li1tDic10YgNG590YxryliYiGXQ9kzbIVo9WtnyJMECr9N7N--yFjc8li45v7k4c7Tt5yBkpsMZow4u6J_1lgdxBwJhOv0vLMyaDoRRSdgLX7VEfEKhdAqeNEx7CqNLg9yYVOQRxIJA Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.32 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 54c71a7d33bb47a2b56b1e33f9af910f Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/54c71a7d33bb47a2b56b1e33f9af910f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/54c71a7d33bb47a2b56b1e33f9af910f"}]}] Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 54c71a7d33bb47a2b56b1e33f9af910f Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1679813454 Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TaggedBootDevicesTest-1679813454-project Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 25f8816ea2294e3e90b76601cc37a4ec Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TaggedBootDevicesTest-1679813454-project Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'fe4ab801-a114-4fcf-93ef-8173bf5c4fd9'} Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.664675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. Sep 19 15:01:29.669827 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:29.671452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] Returning 404 to user: Instance fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:29.672511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba6333d8-7107-499c-85aa-bffa1c3fbc93 tempest-TaggedBootDevicesTest-1679813454 tempest-TaggedBootDevicesTest-1679813454-project] 10.222.0.81 "GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9" status: 404 len: 111 microversion: 2.32 time: 0.048361 Sep 19 15:01:29.677149 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2019/4003] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:29 2022] GET /compute/v2.1/servers/fe4ab801-a114-4fcf-93ef-8173bf5c4fd9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:30.212946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:30.213730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:30.224749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:30.225587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:30.226829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:30.228325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:30.229025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:30.229626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:30.267218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:30.761988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:30.775557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d594a2f-ae2a-4cf8-a77a-b24bc5c43c0f tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.318066 Sep 19 15:01:30.777434 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1985/4004] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:29 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:30.806520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:30.807773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:30.821952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:30.822872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:30.823559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:30.824507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:30.829297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:30.830197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:31.537885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:31.556224 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40cd0b48-aeec-4edd-b775-8f54e6473157 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 1.347643 Sep 19 15:01:31.573081 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2020/4005] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:30 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:31.868997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:31.884891 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9284c537-166a-4e63-b0ea-9c43d7eae55c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.083591 Sep 19 15:01:31.886032 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1986/4006] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:30 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:31.919983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f22adc33-ff6f-4bea-b7e2-90e6e908868b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:31.920704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f22adc33-ff6f-4bea-b7e2-90e6e908868b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 8d5414dc-b7ba-4a57-9bad-909e537045c4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:31.948810 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f22adc33-ff6f-4bea-b7e2-90e6e908868b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 8d5414dc-b7ba-4a57-9bad-909e537045c4 could not be found. Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f22adc33-ff6f-4bea-b7e2-90e6e908868b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/8d5414dc-b7ba-4a57-9bad-909e537045c4 HTTP/1.1 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 8d5414dc-b7ba-4a57-9bad-909e537045c4 could not be found. Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '8d5414dc-b7ba-4a57-9bad-909e537045c4'} Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5414dc-b7ba-4a57-9bad-909e537045c4 could not be found. Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5414dc-b7ba-4a57-9bad-909e537045c4 could not be found. Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:31.950396 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5414dc-b7ba-4a57-9bad-909e537045c4 could not be found. Sep 19 15:01:31.955353 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:31.957963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f22adc33-ff6f-4bea-b7e2-90e6e908868b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 8d5414dc-b7ba-4a57-9bad-909e537045c4 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:31.959234 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f22adc33-ff6f-4bea-b7e2-90e6e908868b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8d5414dc-b7ba-4a57-9bad-909e537045c4" status: 404 len: 111 microversion: 2.1 time: 0.043459 Sep 19 15:01:31.970943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:31.971577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:31.977084 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2021/4007] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:01:31 2022] DELETE /compute/v2.1/servers/8d5414dc-b7ba-4a57-9bad-909e537045c4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:01:31.984864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:31.986061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:31.989013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:31.990177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:31.993664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:31.994381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:32.436887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:32.458628 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-02ab46e2-02e5-4eb3-a4dd-a67490933651 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.490401 Sep 19 15:01:32.461878 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1987/4008] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:31 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:32.502234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:32.503275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:32.528875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:32.529687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:32.530294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:32.533740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:32.534208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:32.535058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:32.585406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:32.587341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:32.602120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:32.603083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:32.603808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:32.607869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:32.608580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:32.609364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.205383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:33.212338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:33.230108 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c8aaf96e-93c8-49f2-8c15-01514f6f1c89 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.733093 Sep 19 15:01:33.231110 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6051523-5db2-418d-bfa6-b32da272a2fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1314 microversion: 2.1 time: 0.653430 Sep 19 15:01:33.238578 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2022/4009] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:32 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:33.243888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1988/4010] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:32 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:33.248606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:33.261129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:33.275496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc85918c-7ef1-43d2-aa7e-59f8fe98dfb4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:33.276406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc85918c-7ef1-43d2-aa7e-59f8fe98dfb4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 15:01:33.277113 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-cc85918c-7ef1-43d2-aa7e-59f8fe98dfb4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc85918c-7ef1-43d2-aa7e-59f8fe98dfb4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9223372036854775808 could not be found. Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9223372036854775808'} Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:33.279092 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:33.284257 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:33.284257 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:33.284257 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:33.284257 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 19 15:01:33.284257 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:33.284809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:33.285736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:33.286572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc85918c-7ef1-43d2-aa7e-59f8fe98dfb4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:33.287229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.287871 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc85918c-7ef1-43d2-aa7e-59f8fe98dfb4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.019538 Sep 19 15:01:33.288811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:33.291173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:33.291995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.293359 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1989/4011] 10.222.0.81 () {58 vars in 1188 bytes} [Mon Sep 19 15:01:33 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 19 15:01:33.308853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:33.310731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:33.347218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:33.348087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:33.348696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.350187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:33.351736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:33.354015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.372532 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f75fcc27-0d17-406b-9468-49dd3a48508d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments/35a4b911-5811-4424-aa1b-85978e3ac353" status: 200 len: 194 microversion: 2.20 time: 0.132475 Sep 19 15:01:33.377359 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2023/4012] 10.222.0.81 () {60 vars in 1454 bytes} [Mon Sep 19 15:01:33 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments/35a4b911-5811-4424-aa1b-85978e3ac353 => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:33.531744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:33.532252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:33.542492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:33.543089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:33.543722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.554175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:33.555344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:33.566314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:33.890695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lazy-loading 'services' on Instance uuid 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:01:34.088807 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26bb3674-ba54-436e-90b1-6e6e82c4fd01 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments/35a4b911-5811-4424-aa1b-85978e3ac353" status: 202 len: 0 microversion: 2.20 time: 0.560815 Sep 19 15:01:34.091973 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2024/4013] 10.222.0.81 () {60 vars in 1457 bytes} [Mon Sep 19 15:01:33 2022] DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments/35a4b911-5811-4424-aa1b-85978e3ac353 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:01:34.131399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:34.139972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:34.149738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:34.152055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:34.152627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:34.153077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:34.154014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:34.167844 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-724a922b-fea9-4a81-9faa-f3ecdc1fecc2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.868324 Sep 19 15:01:34.183314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:34.185343 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1990/4014] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:33 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:34.191304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:34.203106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:34.204251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:34.219322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:34.220044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:34.221257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:34.222606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:34.224148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:34.224810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:34.284219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d6f64e9b-45b9-4a3f-b1ed-ff71470e1b78 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.171327 Sep 19 15:01:34.290265 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2025/4015] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:34 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:34.296846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:34.302265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:34.325619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:34.326928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:34.327988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:34.329892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:34.332964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:34.334207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:34.879161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:34.921034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:34.929977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f904a875-5199-464b-b1dc-31c51b4a3ac2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.736001 Sep 19 15:01:34.939141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1991/4016] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:34 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:34.942416 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bb7e5ea8-5c1a-4469-9346-5a7b77aea344 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1500 microversion: 2.1 time: 0.650268 Sep 19 15:01:34.956933 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2026/4017] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:34 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1500 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:35.003418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3627bf49-2657-47d6-8b0f-68b78d5af199 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:35.004775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3627bf49-2657-47d6-8b0f-68b78d5af199 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Failed to fetch instance by id -1 {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 19 15:01:35.008160 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3627bf49-2657-47d6-8b0f-68b78d5af199 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance -1 could not be found. Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3627bf49-2657-47d6-8b0f-68b78d5af199 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance -1 could not be found. Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '-1'} Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:35.018198 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:35.037924 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:35.037924 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:35.037924 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 19 15:01:35.037924 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:35.039247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:35.039247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:35.039730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3627bf49-2657-47d6-8b0f-68b78d5af199 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:35.039730 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3627bf49-2657-47d6-8b0f-68b78d5af199 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.070232 Sep 19 15:01:35.041571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:35.042004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:35.042337 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1992/4018] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 15:01:34 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:01:35.042535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:35.043175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:35.055498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:35.055977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:35.069813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:35.071489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:35.088844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:35.097695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:35.105400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:35.107075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:35.108269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:35.109355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:35.869196 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Removing security group 81cf370f-803e-4076-b1bf-4e1c421f69a1 from port b85f01a8-946f-4846-becb-2728173d0135 Sep 19 15:01:35.997839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:36.009597 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f27621f-e45a-4253-9ac7-c1e63955e036 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.960627 Sep 19 15:01:36.013916 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1993/4019] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:35 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:36.027076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:36.033250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:36.052680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:36.053643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:36.055126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:36.061697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:36.063444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:36.067183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:36.167682 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d6435ff-30c5-40b6-868c-84210b8f9bd3 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151864 Sep 19 15:01:36.175579 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1994/4020] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:36 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:36.183433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:36.195342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:36.202658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:36.204899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:36.206987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:36.207438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:36.208880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:36.211350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:36.875013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:36.888066 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0e603564-3289-41c9-b225-ab8fd5e07cfd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.711054 Sep 19 15:01:36.895175 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1995/4021] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:36 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:36.927926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2e00cdc-4a6c-4eb4-a979-117a966a9995 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:36.930639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2e00cdc-4a6c-4eb4-a979-117a966a9995 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: ab7a0d56-798c-414f-bbd4-0a17e5c60d4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:36.943808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:36.955320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b2e00cdc-4a6c-4eb4-a979-117a966a9995 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance ab7a0d56-798c-414f-bbd4-0a17e5c60d4b could not be found. Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2e00cdc-4a6c-4eb4-a979-117a966a9995 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/ab7a0d56-798c-414f-bbd4-0a17e5c60d4b/action HTTP/1.1 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 19 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: {"forceDelete": {}} Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ab7a0d56-798c-414f-bbd4-0a17e5c60d4b could not be found. Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ab7a0d56-798c-414f-bbd4-0a17e5c60d4b', 'body': {'forceDelete': {}}} Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7a0d56-798c-414f-bbd4-0a17e5c60d4b could not be found. Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7a0d56-798c-414f-bbd4-0a17e5c60d4b could not be found. Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:36.968321 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:36.972487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:36.972487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:36.972487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7a0d56-798c-414f-bbd4-0a17e5c60d4b could not be found. Sep 19 15:01:36.972487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:36.974513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2e00cdc-4a6c-4eb4-a979-117a966a9995 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance ab7a0d56-798c-414f-bbd4-0a17e5c60d4b could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:36.975819 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2e00cdc-4a6c-4eb4-a979-117a966a9995 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/ab7a0d56-798c-414f-bbd4-0a17e5c60d4b/action" status: 404 len: 111 microversion: 2.1 time: 0.064918 Sep 19 15:01:36.977105 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1996/4022] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:36 2022] POST /compute/v2.1/servers/ab7a0d56-798c-414f-bbd4-0a17e5c60d4b/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:01:36.985895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:36.989851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:37.010791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:37.012349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:37.014317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:37.019309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:37.020122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:37.020864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:37.593434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:37.612590 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c25c64b1-96d1-4520-81af-6372d2b5bf83 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.627626 Sep 19 15:01:37.614991 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1997/4023] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:36 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:37.622163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:37.626113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:37.674176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:37.680826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:37.682066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:37.684041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:37.690950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:37.692136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:37.825653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-360839d7-d251-4174-b081-fcdfb11d822f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.204925 Sep 19 15:01:37.830992 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1998/4024] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:37 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:37.842281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:37.846709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:37.862231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:37.865086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:37.865561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:37.866338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:37.871101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:37.871895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:38.805519 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb0eab44-2cb2-466d-a2b0-8d33f47accdf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378/action" status: 202 len: 0 microversion: 2.1 time: 3.806213 Sep 19 15:01:38.809799 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2027/4025] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:34 2022] POST /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378/action => generated 0 bytes in 3810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:01:38.828507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:38.832694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:38.872829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:38.873352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:38.873809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:38.874570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:38.876569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:38.877040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.118347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:39.136954 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa106702-4e56-495b-9c1b-277250626c4a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.308773 Sep 19 15:01:39.152338 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 1999/4026] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:37 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:39.175293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:39.183093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:39.188306 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-07734e6f-1182-4498-a2c7-3cabd355f14f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1458 microversion: 2.1 time: 0.376377 Sep 19 15:01:39.191124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:39.192145 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2028/4027] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:38 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1458 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:39.208411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8ec3e119-995f-472a-b483-831dbf27eb24 req-b4a18f59-afca-44a1-bd1e-c53bdd828c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c33789-be7c-43f3-a822-636103efa378", "tag": "b85f01a8-946f-4846-becb-2728173d0135"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:39.233155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ec3e119-995f-472a-b483-831dbf27eb24 req-b4a18f59-afca-44a1-bd1e-c53bdd828c95 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.233657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ec3e119-995f-472a-b483-831dbf27eb24 req-b4a18f59-afca-44a1-bd1e-c53bdd828c95 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.234101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8ec3e119-995f-472a-b483-831dbf27eb24 req-b4a18f59-afca-44a1-bd1e-c53bdd828c95 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.242567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.245428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.246066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.248930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.253299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.253980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.261210 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8ec3e119-995f-472a-b483-831dbf27eb24 req-b4a18f59-afca-44a1-bd1e-c53bdd828c95 service nova] Creating event network-changed:b85f01a8-946f-4846-becb-2728173d0135 for instance 89c33789-be7c-43f3-a822-636103efa378 on n-h1-858384-1 Sep 19 15:01:39.293321 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8ec3e119-995f-472a-b483-831dbf27eb24 req-b4a18f59-afca-44a1-bd1e-c53bdd828c95 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097600 Sep 19 15:01:39.294573 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2029/4028] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:01:39.330025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1c5e223-0117-4659-aa63-e77654ec2eba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:39.333975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c1c5e223-0117-4659-aa63-e77654ec2eba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 6868073f-274b-4692-96f7-b3479008c298] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:39.347186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-c1c5e223-0117-4659-aa63-e77654ec2eba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 6868073f-274b-4692-96f7-b3479008c298 could not be found. Sep 19 15:01:39.356004 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-140af768-89d2-4a73-b914-d73fae718dfd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.202106 Sep 19 15:01:39.357157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2000/4029] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:39 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:39.363608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:39.364699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1c5e223-0117-4659-aa63-e77654ec2eba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/6868073f-274b-4692-96f7-b3479008c298/action HTTP/1.1 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 39 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: {"os-getConsoleOutput": {"length": 10}} Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6868073f-274b-4692-96f7-b3479008c298 could not be found. Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6868073f-274b-4692-96f7-b3479008c298', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6868073f-274b-4692-96f7-b3479008c298 could not be found. Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6868073f-274b-4692-96f7-b3479008c298 could not be found. Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:39.368922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:39.374576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:39.374576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:39.374576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:39.374576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:39.374576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6868073f-274b-4692-96f7-b3479008c298 could not be found. Sep 19 15:01:39.374576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:39.376738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1c5e223-0117-4659-aa63-e77654ec2eba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 6868073f-274b-4692-96f7-b3479008c298 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:39.377560 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1c5e223-0117-4659-aa63-e77654ec2eba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/6868073f-274b-4692-96f7-b3479008c298/action" status: 404 len: 111 microversion: 2.1 time: 0.080464 Sep 19 15:01:39.384214 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2030/4030] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:39 2022] POST /compute/v2.1/servers/6868073f-274b-4692-96f7-b3479008c298/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:01:39.399940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:39.401541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:39.404566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.412625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.414895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.415679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.419774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.420330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.428679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.433380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.435568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:39.436492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:39.439296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:39.439988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:40.090113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:40.103547 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1582619c-b085-4e06-9c04-42675c18ffa6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.745300 Sep 19 15:01:40.106091 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2001/4031] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:39 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:40.128736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:40.144492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:40.145951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:40.157195 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-42092797-ee50-4c5d-8765-4eb92e6ea221 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.770644 Sep 19 15:01:40.159877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:40.160400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:40.160865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:40.161640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:40.166706 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2031/4032] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:39 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:40.169337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:40.169814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:40.203259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:40.219766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:40.240549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:40.244342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:40.245711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:40.246679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:40.248774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:40.252145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:40.967894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:41.001507 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcaba755-f42f-4f8f-9349-13b55d58ee6f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.861062 Sep 19 15:01:41.016887 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2002/4033] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:40 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:41.016887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:41.016887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:41.039664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.041331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.041838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.043685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.045478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:41.046795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.048031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.063415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-34ce0f5f-da68-4f52-8042-17d5d340a6c2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.873468 Sep 19 15:01:41.064995 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2032/4034] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:40 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:41.071462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:41.072103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:41.082777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.087469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.087933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.089714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.090208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.090652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.124250 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8803159-fe55-45f4-ad6e-bd2f1f067f39 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119335 Sep 19 15:01:41.124856 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2003/4035] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:41 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:41.130517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21311e65-ee2c-4340-aa77-487ce336d209 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:41.131262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21311e65-ee2c-4340-aa77-487ce336d209 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 2a835b16-e652-4171-afa8-56262404c614] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:41.139414 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-21311e65-ee2c-4340-aa77-487ce336d209 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 2a835b16-e652-4171-afa8-56262404c614 could not be found. Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21311e65-ee2c-4340-aa77-487ce336d209 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/2a835b16-e652-4171-afa8-56262404c614 HTTP/1.1 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 2a835b16-e652-4171-afa8-56262404c614 could not be found. Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2a835b16-e652-4171-afa8-56262404c614'} Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a835b16-e652-4171-afa8-56262404c614 could not be found. Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a835b16-e652-4171-afa8-56262404c614 could not be found. Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:41.141054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a835b16-e652-4171-afa8-56262404c614 could not be found. Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21311e65-ee2c-4340-aa77-487ce336d209 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 2a835b16-e652-4171-afa8-56262404c614 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21311e65-ee2c-4340-aa77-487ce336d209 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/2a835b16-e652-4171-afa8-56262404c614" status: 404 len: 111 microversion: 2.1 time: 0.016495 Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2004/4036] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:41 2022] GET /compute/v2.1/servers/2a835b16-e652-4171-afa8-56262404c614 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:41.154888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:41.170536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.171496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.183099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.183915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.184605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.185070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.188919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:41.481369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:41.496036 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2eacc018-d627-4111-b2f9-4d7c057bd04b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.348097 Sep 19 15:01:41.501054 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2005/4037] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:41 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:41.526123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:41.526949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:41.530108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:41.547324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.547836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.548284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.551334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.553460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.556237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.567050 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2ee51d25-9102-4c6c-8c3a-ab87d51d4f82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.497527 Sep 19 15:01:41.568168 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2033/4038] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:41 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:41.610222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:41.611935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:41.624513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.625388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.626064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.627140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:41.627896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:41.628557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:41.886427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:41.901900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ddb08187-c7fe-456f-81a6-f78aab373dc6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.380407 Sep 19 15:01:41.903370 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2006/4039] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:41 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:42.031853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8a5714e-2abd-406d-b101-febb2d8cd588 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-979564403", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8a5714e-2abd-406d-b101-febb2d8cd588 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 237 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-979564403", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-979564403', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.060863 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 19 15:01:42.065039 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:42.069957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d8a5714e-2abd-406d-b101-febb2d8cd588 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:42.071659 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d8a5714e-2abd-406d-b101-febb2d8cd588 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.044613 Sep 19 15:01:42.072485 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2007/4040] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:01:42.082698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:42.083662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:42.103714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:42.107513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:42.108204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:42.109137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:42.113000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:42.113819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:42.187495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:42.218425 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d6b7aafc-62a9-4bcd-b2b1-e118665ccfa8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.615263 Sep 19 15:01:42.235109 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2034/4041] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:41 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:42.308458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:42.316195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:42.346494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:42.347010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:42.347461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:42.348183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:42.348654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:42.349086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:42.480626 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21788254-a336-44f0-9d9e-407d0f3a73dc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159728 Sep 19 15:01:42.480626 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2035/4042] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:42 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:42.647405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1461181685", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "57e08ed1-fe03-4626-8d78-fcc627ace18e"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:42.649325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:42.661323 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3b7fe52e-767a-48d9-b6d3-654f3b47204b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.583711 Sep 19 15:01:42.683767 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2008/4043] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:42 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:42.699837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:42.701083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:42.714370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:42.715413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:42.716233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:42.718167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:42.719213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:42.720819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:42.756990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] validate_networks() for [('57e08ed1-fe03-4626-8d78-fcc627ace18e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:01:43.091592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:43.122132 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d5c6a212-b79e-4b02-9e3e-8499711c38bd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.428973 Sep 19 15:01:43.123606 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2009/4044] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:42 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:43.236327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab204e9f-a11c-4d6f-9faa-b62840eba743 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1591420043", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab204e9f-a11c-4d6f-9faa-b62840eba743 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 235 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1591420043", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1591420043', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.241119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 19 15:01:43.247059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:43.249906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab204e9f-a11c-4d6f-9faa-b62840eba743 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:43.251029 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab204e9f-a11c-4d6f-9faa-b62840eba743 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.018744 Sep 19 15:01:43.255482 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2010/4045] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:01:43.261718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:43.262904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:43.273906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.274774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.275421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.276406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.277252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.277870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.601586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:43.615347 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83c59925-b857-4cfb-b099-f327677e57cd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.358339 Sep 19 15:01:43.634777 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2011/4046] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:43 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:43.634777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:43.634777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:43.652409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.653048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.653698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.654579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.656068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.656646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.769518 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09e6048a-bed2-4a94-9678-d2fd3cb32b87 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139103 Sep 19 15:01:43.776836 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2012/4047] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:43 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:01:43.799198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:43.803560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:43.808469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:01:43.809364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:01:43.810620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:01:43.811661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:01:43.813085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:01:43.827041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.829420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.831865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.833569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.835576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.838632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.871106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.871939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.872716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.874068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:43.874908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:43.875673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:43.947676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:01:43.958069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Getting quotas for user c11d7590aa1f4fa48be57e2efc017a6f and project b5b030a0534946eb96c825f4c9acc526. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:01:44.013231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:01:44.022178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:01:44.146968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f20c400-ae17-49de-a094-563a82733bac tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503725 Sep 19 15:01:44.149637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2036/4048] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:01:44.226712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:44.255992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b6107bd2-6076-423e-9a3e-fb78874a84a4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.477657 Sep 19 15:01:44.264058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2013/4049] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:43 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:44.291793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e0d6703-9892-4c04-ad0b-539c695f5c82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:44.299521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e0d6703-9892-4c04-ad0b-539c695f5c82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:44.455036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-377200870", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:44.470685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e0d6703-9892-4c04-ad0b-539c695f5c82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:44.492338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e0d6703-9892-4c04-ad0b-539c695f5c82 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1215 microversion: 2.1 time: 0.211152 Sep 19 15:01:44.493051 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2014/4050] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:44 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:44.498324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74b827da-f684-4efa-9b85-127d4649867e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:44.499325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74b827da-f684-4efa-9b85-127d4649867e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 43c597d4-e7d4-4bb6-a178-e039d968ad3e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:44.512125 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-74b827da-f684-4efa-9b85-127d4649867e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 43c597d4-e7d4-4bb6-a178-e039d968ad3e could not be found. Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74b827da-f684-4efa-9b85-127d4649867e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/43c597d4-e7d4-4bb6-a178-e039d968ad3e/action HTTP/1.1 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 13 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: {"pause": {}} Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 43c597d4-e7d4-4bb6-a178-e039d968ad3e could not be found. Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '43c597d4-e7d4-4bb6-a178-e039d968ad3e', 'body': {'pause': {}}} Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c597d4-e7d4-4bb6-a178-e039d968ad3e could not be found. Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c597d4-e7d4-4bb6-a178-e039d968ad3e could not be found. Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:44.524396 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:44.528618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:44.528618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:44.528618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c597d4-e7d4-4bb6-a178-e039d968ad3e could not be found. Sep 19 15:01:44.528618 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:44.530426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74b827da-f684-4efa-9b85-127d4649867e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 43c597d4-e7d4-4bb6-a178-e039d968ad3e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:44.531632 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74b827da-f684-4efa-9b85-127d4649867e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/43c597d4-e7d4-4bb6-a178-e039d968ad3e/action" status: 404 len: 111 microversion: 2.1 time: 0.037354 Sep 19 15:01:44.532494 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2015/4051] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:44 2022] POST /compute/v2.1/servers/43c597d4-e7d4-4bb6-a178-e039d968ad3e/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:01:44.542917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:44.544934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:44.567850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:44.571295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:44.573428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:44.575429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:44.576489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:44.577207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:44.589905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:01:44.985993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:44.996617 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-748d8ade-91a7-499e-b897-e2e1cff1afd4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.457947 Sep 19 15:01:45.021847 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2016/4052] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:44 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:45.039807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:45.064882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:45.081727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.083860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.087039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.089318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.091484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.093705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.185488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94243c57-02a4-4abe-9d05-0e8ad1f1678c tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.158750 Sep 19 15:01:45.187116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2017/4053] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:01:45 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:45.234012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:45.245889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:45.265316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.266285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.270052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.271921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.273522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.275293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.536736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:01:45.537333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:01:45.537670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:01:45.538075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:01:45.539726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:01:45.564422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.565424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.566366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.567715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.568517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.569163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.644263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:01:45.651300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:01:45.676377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:01:45.680367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:01:45.832426 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6dc12857-381d-4cb4-9f84-b39066f3d5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667061 Sep 19 15:01:45.834874 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2037/4054] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:01:45.851149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:45.852803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:45.863631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.864379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.864996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.867095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.868828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.870190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.908538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:45.927652 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4f9338bf-2b83-41be-b044-10eae68f82e5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.737494 Sep 19 15:01:45.931057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2018/4055] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:45 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:45.940211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:01:45.940871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:45.942791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:45.958212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.959348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.961738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:45.963219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:45.964282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:45.966239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:46.066497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:46.150604 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-309ae3f8-a819-4518-ac9d-f481760171d8 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 204 len: 0 microversion: 2.20 time: 0.311249 Sep 19 15:01:46.160341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2038/4056] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:01:45 2022] DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:01:46.174841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1efc742-c16b-41ac-a6ef-79665e7f1b07 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:46.175560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1efc742-c16b-41ac-a6ef-79665e7f1b07 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:46.294836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:46.310500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d2f999e-adef-478a-b3a5-9b48147a5b96 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1267 microversion: 2.1 time: 0.378012 Sep 19 15:01:46.315431 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2019/4057] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:45 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1267 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:46.327305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:46.328146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:46.352790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1efc742-c16b-41ac-a6ef-79665e7f1b07 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:46.377587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:46.386030 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1efc742-c16b-41ac-a6ef-79665e7f1b07 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1192 microversion: 2.1 time: 0.222267 Sep 19 15:01:46.386994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:46.388150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:46.393664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:46.394612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:46.402715 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2039/4058] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:46 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1192 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:46.405927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:46.446686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:46.452472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:46.494415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:46.498259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:46.499101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:46.510526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:46.510526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:46.510788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:46.638739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c6b9e982-040d-4e54-982d-b1b7a7911d05 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.320408 Sep 19 15:01:46.640251 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2020/4059] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:46 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:01:46.663927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:46.665070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:46.673303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:46.681153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:46.682221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:46.684986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:46.687422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:46.688551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:47.521528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:47.540944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6bb2cc7-3549-42d3-9620-236ebee4d423 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1509 microversion: 2.1 time: 0.893290 Sep 19 15:01:47.549587 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2021/4060] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:46 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1509 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:47.564736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:47.565767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:47.576626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:47.583291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:47.584036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:47.587859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:47.591159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:47.591800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:47.684245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:47.701740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:47.715003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:47.725231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9004f4c8-83ed-4209-8c61-2e763d93c237 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 1.318748 Sep 19 15:01:47.726374 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2040/4061] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:46 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:47.750330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:47.762159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:47.804784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:47.805817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:47.806910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:47.807672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:47.808149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:47.818449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:48.060573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:48.074985 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab829c61-6cd1-4cfd-b26a-47fc712a83a1 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1273 microversion: 2.1 time: 0.523376 Sep 19 15:01:48.075924 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2022/4062] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:47 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1273 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:48.226994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:48.263071 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b82a529-061e-49b1-bb1f-43730fa75963 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1244 microversion: 2.1 time: 0.532490 Sep 19 15:01:48.265211 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2041/4063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:47 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1244 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:48.572778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:48.574081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:48.586166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:48.590281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:48.600294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:48.601495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:48.602351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:48.603050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:48.761215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:48.764463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:48.780431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:48.787133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:48.789296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:48.792716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:48.795457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:48.799952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:49.687977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:49.702064 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b8ab64c-8f66-4471-9b0a-e1d9f5409495 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1489 microversion: 2.1 time: 1.135756 Sep 19 15:01:49.704411 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2023/4064] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:48 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1489 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:49.711253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:49.712224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:49.722165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:49.722963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:49.723636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:49.724550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:49.725246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:49.726219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:49.842244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:49.855946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:49.863004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:49.864727 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a81337df-4dc3-4e31-8744-bdb630763199 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 1.112844 Sep 19 15:01:49.866112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2042/4065] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:48 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:49.874427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:49.875511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:49.901468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:49.901962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:49.902414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:49.903178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:49.903648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:49.905638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.055222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:50.060161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:50.078268 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b58fe7b3-0080-4d93-90e6-4323b0464fe2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1273 microversion: 2.1 time: 0.371920 Sep 19 15:01:50.079744 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2024/4066] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:49 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:50.089897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:50.091223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:50.106421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.106950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.107588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.108532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.109183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.109775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.146094 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'pause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state paused Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 13 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: {"pause": {}} Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'pause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state paused Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'pause': {}}} Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state paused. Cannot pause while the instance is in this state. Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state paused Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:50.149692 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:50.154295 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:50.154295 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:50.154295 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:50.154295 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state paused Sep 19 15:01:50.154295 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:50.155966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'pause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state paused {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:50.157033 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0fc0085e-abb3-4abd-9cde-b34867bf2046 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 143 microversion: 2.1 time: 0.075594 Sep 19 15:01:50.158011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:50.158207 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2025/4067] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:50 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 143 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:01:50.168697 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2ed1aa2e-43c7-497f-8629-62f33ba3ebc4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1250 microversion: 2.1 time: 0.300646 Sep 19 15:01:50.170572 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2043/4068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:49 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1250 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:50.182501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:50.182501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:50.202563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.203243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.205504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.207166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.209719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.211773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.379396 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9cc3f877-3dd1-414a-98dc-959b7ebe3d3b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.216266 Sep 19 15:01:50.380573 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2026/4069] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:50 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:01:50.389542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:50.390359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:50.392751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:50.407612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.411982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.412866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.414662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.421797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.422553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.793488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:50.805558 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-265254e8-9144-4fa2-bbe1-6399fb881dc0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1496 microversion: 2.1 time: 0.420037 Sep 19 15:01:50.810592 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2044/4070] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:50 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1496 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:50.896029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:50.896910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:50.909156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.915437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.916060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:50.917049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:50.917664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:50.918208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:51.108986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:51.109823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:51.123007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:51.123686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:51.124240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:51.126079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:51.126675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:51.127278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:51.868803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:51.898257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:51.910869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:51.912657 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30c2c742-b951-42a7-8038-8c6ebbc18903 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1722 microversion: 2.20 time: 1.021211 Sep 19 15:01:51.914157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2027/4071] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:50 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1722 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:51.927263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:51.931230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:51.955286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:51.960049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:51.961482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:51.962447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:51.964726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:51.967871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:52.213022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:52.227153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-80a7ba84-18f9-4aac-a071-e85b9e218bc0 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 1.122539 Sep 19 15:01:52.228348 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2045/4072] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:51 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:52.238353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:52.245293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:52.263192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:52.267384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:52.268071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:52.271027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:52.271748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:52.274462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:53.736281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:53.755117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b65b54b0-9913-4800-976a-a779b8ac2827 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 1.839789 Sep 19 15:01:53.762708 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2028/4073] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:51 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:53.767679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:53.768302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:53.791063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:53.791725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:53.795264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:53.796439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:53.797795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:53.798221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:53.911898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:53.953726 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-86e2fe10-0ff4-4879-af2c-b6f99cb4b2c6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.719428 Sep 19 15:01:53.954454 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2046/4074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:52 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:53.973200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:53.973200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:54.007070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:54.009263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:54.014997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:54.016237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:54.016900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:54.017529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:54.428482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:54.467827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:54.470527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:54.473255 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f364d388-86dc-4ca4-bba0-5908d27fef34 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1655 microversion: 2.20 time: 0.709476 Sep 19 15:01:54.489097 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2029/4075] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:53 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1655 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:54.500646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:54.501520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:54.507951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:54.510331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:54.511897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:54.513038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:54.514012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:54.514663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:54.515285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:55.369444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:55.393936 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b57004c0-8dae-469c-8e56-fbd723c3f58e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 1.438242 Sep 19 15:01:55.396417 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2047/4076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:53 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:55.417059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:55.418233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:55.441152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:55.455750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:55.457326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:55.471286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:55.473844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:55.474633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:55.623510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:56.202729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:56.218976 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7e58dd67-847f-411e-bcb8-efd4ff2191e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.724050 Sep 19 15:01:56.219675 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2030/4077] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:54 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:56.254554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:56.255216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:56.264355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.265126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.265714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.266656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.267401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.268028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.384776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=14 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:56.534905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:56.557303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:56.581228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:56.600168 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f22ca4b1-0ae7-43d1-9d61-569f12d17dcf tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 1.196897 Sep 19 15:01:56.602613 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2048/4078] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:55 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:56.621423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:56.629563 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04490d9a-2b0f-42d2-baa3-658f16e83c4d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 200 len: 1655 microversion: 2.20 time: 0.379624 Sep 19 15:01:56.638142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:56.644973 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2031/4079] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:56 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 1655 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:01:56.681841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:56.682409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:56.692770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:56.707903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.712176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.727490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.739914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.743364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.743620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.744623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.744757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.745432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.746680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.747641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.748388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.784502 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce/action HTTP/1.1 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 28 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: {"reboot": {"type": "SOFT"}} Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '10aa93bf-e81c-4424-a09d-5783ba44edce', 'body': {'reboot': {'type': 'SOFT'}}} Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:56.792476 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:01:56.797683 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:01:56.806490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:56.808186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12b826f1-59b2-463b-9eaa-dd84f727cb47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce/action" status: 404 len: 111 microversion: 2.1 time: 0.203748 Sep 19 15:01:56.810888 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2049/4080] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:01:56 2022] POST /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce/action => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:01:56.831944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d81e4bb9-b3a7-43eb-8555-07eedfea8eff req-93a4510f-a4f0-4f28-ace1-4ed0a08d4a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65", "name": "network-vif-deleted", "tag": "98e37cc7-0edd-4627-ba03-f4b3b7c7d208"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:56.852250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d81e4bb9-b3a7-43eb-8555-07eedfea8eff req-93a4510f-a4f0-4f28-ace1-4ed0a08d4a01 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.853022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d81e4bb9-b3a7-43eb-8555-07eedfea8eff req-93a4510f-a4f0-4f28-ace1-4ed0a08d4a01 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.853623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d81e4bb9-b3a7-43eb-8555-07eedfea8eff req-93a4510f-a4f0-4f28-ace1-4ed0a08d4a01 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.910072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d81e4bb9-b3a7-43eb-8555-07eedfea8eff req-93a4510f-a4f0-4f28-ace1-4ed0a08d4a01 service nova] Creating event network-vif-deleted:98e37cc7-0edd-4627-ba03-f4b3b7c7d208 for instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 on n-h1-858384-1 Sep 19 15:01:56.922450 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d81e4bb9-b3a7-43eb-8555-07eedfea8eff req-93a4510f-a4f0-4f28-ace1-4ed0a08d4a01 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104664 Sep 19 15:01:56.923442 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2050/4081] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:01:56.930565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:56.932070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:56.940244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.941088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.941781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:56.942946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:56.943665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:56.945106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:59.298635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:59.317184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fbaa7afc-581c-4efe-accb-eea00af0a264 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 2.392102 Sep 19 15:01:59.345199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2051/4082] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:56 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:59.353533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:59.356022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:59.369829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:59.371485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:59.372145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:59.373510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:59.374251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:59.374923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:59.528188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:59.558910 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-047033c4-b91a-41a9-9efd-f70145794b4a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 2.912099 Sep 19 15:01:59.560343 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2032/4083] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:56 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 2915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:59.569236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:59.573578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:59.584527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:59.589569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:59.592331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:59.594672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:59.596821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:59.599896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:59.645635 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] HTTP exception thrown: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Request method failure captured: Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 HTTP/1.1 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKINpFsWpu9WkIGaqHvQl15m-jibTXUvAj6MhdtjCfC3tRA3ixVu-Q1wC06AVLkH1w_kjMyneoV6mwZhHGhUzDK4u3GACylkw15wa8A1LSuZZeC3eT9VWw5ai0ZU5H57TdwYz8DHSJYqbL4bfCrWQJ-8_6CT2rThs-6ZPhtb0nGmiYeM Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e43c078348c4279b96e285b4d5a1b11"}]}] Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c4210519c4b84d258d456dc84406b72f Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65'} Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:59.652955 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:01:59.660353 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:01:59.665518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Returning 404 to user: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:01:59.666957 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9894350f-2459-4041-b181-17add89e265f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 404 len: 111 microversion: 2.20 time: 0.105212 Sep 19 15:01:59.668404 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2033/4084] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:01:59 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:01:59.674361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:59.677331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:59.703736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:59.708068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:59.708761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:59.710604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:59.711603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:59.712532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:00.742399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:00.752828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-141266ec-adf9-44a5-bfd0-f3ddeb96e130 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 1.405701 Sep 19 15:02:00.757117 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2052/4085] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:59 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:00.775700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-687de416-fd1e-4084-93fd-6e6e64af6775 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '.version_select at 0x7fde2921b3a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:00.787273 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-687de416-fd1e-4084-93fd-6e6e64af6775 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [51a2263b-92d3-4718-ac86-2e1e88a872e0] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:02:00.824122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:00.833189 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f06913d0-b8e6-4938-93a2-ac2325a41e50 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.162976 Sep 19 15:02:00.833847 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2034/4086] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:59 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:00.839980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-02e42d2e-22e3-4b5d-a361-b02d29d4aed8 req-c5a57c6e-1d9f-4f44-8e4d-040f86490e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ff06e0-7cb4-4c0c-b4cf-8ee962114447", "tag": "e877584e-3c02-49c7-94f4-bd9b4b16da7f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:00.853024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-02e42d2e-22e3-4b5d-a361-b02d29d4aed8 req-c5a57c6e-1d9f-4f44-8e4d-040f86490e85 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:00.857444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-02e42d2e-22e3-4b5d-a361-b02d29d4aed8 req-c5a57c6e-1d9f-4f44-8e4d-040f86490e85 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:00.858168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-02e42d2e-22e3-4b5d-a361-b02d29d4aed8 req-c5a57c6e-1d9f-4f44-8e4d-040f86490e85 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:00.872680 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-02e42d2e-22e3-4b5d-a361-b02d29d4aed8 req-c5a57c6e-1d9f-4f44-8e4d-040f86490e85 service nova] Creating event network-changed:e877584e-3c02-49c7-94f4-bd9b4b16da7f for instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 on n-h2-858384-1 Sep 19 15:02:00.878688 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-02e42d2e-22e3-4b5d-a361-b02d29d4aed8 req-c5a57c6e-1d9f-4f44-8e4d-040f86490e85 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043324 Sep 19 15:02:00.880126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2035/4087] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:00.889387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:00.892447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:00.907940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:00.909324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:00.910792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:00.915432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:00.916737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:00.917652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:01.798782 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [None req-687de416-fd1e-4084-93fd-6e6e64af6775 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [51a2263b-92d3-4718-ac86-2e1e88a872e0] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 34966. Sep 19 15:02:01.839380 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-687de416-fd1e-4084-93fd-6e6e64af6775 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299163499" status: 204 len: 0 microversion: 2.20 time: 1.079400 Sep 19 15:02:01.840717 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2053/4088] 10.222.0.81 () {60 vars in 1259 bytes} [Mon Sep 19 15:02:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299163499 => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:02:01.846675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-447496dd-9cd3-4a64-b525-97d48eb0f51d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:01.849684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-447496dd-9cd3-4a64-b525-97d48eb0f51d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c935ef1b-9721-4932-ab29-7ae816472529] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:01.858227 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-447496dd-9cd3-4a64-b525-97d48eb0f51d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance c935ef1b-9721-4932-ab29-7ae816472529 could not be found. Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-447496dd-9cd3-4a64-b525-97d48eb0f51d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/c935ef1b-9721-4932-ab29-7ae816472529/action HTTP/1.1 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 28 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: {"reboot": {"type": "SOFT"}} Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance c935ef1b-9721-4932-ab29-7ae816472529 could not be found. Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c935ef1b-9721-4932-ab29-7ae816472529', 'body': {'reboot': {'type': 'SOFT'}}} Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c935ef1b-9721-4932-ab29-7ae816472529 could not be found. Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c935ef1b-9721-4932-ab29-7ae816472529 could not be found. Sep 19 15:02:01.860651 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c935ef1b-9721-4932-ab29-7ae816472529 could not be found. Sep 19 15:02:01.865457 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:01.868756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-447496dd-9cd3-4a64-b525-97d48eb0f51d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance c935ef1b-9721-4932-ab29-7ae816472529 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:01.869848 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-447496dd-9cd3-4a64-b525-97d48eb0f51d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c935ef1b-9721-4932-ab29-7ae816472529/action" status: 404 len: 111 microversion: 2.1 time: 0.027830 Sep 19 15:02:01.870788 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2054/4089] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:01 2022] POST /compute/v2.1/servers/c935ef1b-9721-4932-ab29-7ae816472529/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:01.875959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:01.876802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:01.885930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:01.886732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:01.887417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:01.888463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:01.889087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:01.889704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:02.116040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:02.126485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f6e8f185-0c9f-440b-9851-47677b659c15 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 1.244812 Sep 19 15:02:02.134538 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2036/4090] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:00 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:02.140642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:02.141284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:02.159706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:02.160691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:02.164041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:02.168133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:02.168959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:02.169911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:02.923930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:02.937139 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0425afb7-8859-4c51-98a6-31072b71b0c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 1.064657 Sep 19 15:02:02.938808 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2055/4091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:01 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:02.948696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-13ebe90f-faa9-470d-87a4-692305e4e841 req-09c78158-7cde-4ca3-9268-4c2c7966c1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41b03f9-e02f-49a8-bddc-eff40fb91f08", "tag": "b527c2a7-5981-45fb-aaf6-b78bbc1ed937"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:02.962557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13ebe90f-faa9-470d-87a4-692305e4e841 req-09c78158-7cde-4ca3-9268-4c2c7966c1ca service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:02.963103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13ebe90f-faa9-470d-87a4-692305e4e841 req-09c78158-7cde-4ca3-9268-4c2c7966c1ca service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:02.963549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-13ebe90f-faa9-470d-87a4-692305e4e841 req-09c78158-7cde-4ca3-9268-4c2c7966c1ca service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:02.979353 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-13ebe90f-faa9-470d-87a4-692305e4e841 req-09c78158-7cde-4ca3-9268-4c2c7966c1ca service nova] Creating event network-changed:b527c2a7-5981-45fb-aaf6-b78bbc1ed937 for instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 on n-h2-858384-1 Sep 19 15:02:02.993941 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-13ebe90f-faa9-470d-87a4-692305e4e841 req-09c78158-7cde-4ca3-9268-4c2c7966c1ca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052466 Sep 19 15:02:02.995298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:02.996077 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2056/4092] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:03.008738 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1dcfa4c1-0e77-4e47-894f-03d5fefa1cf6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.872929 Sep 19 15:02:03.009526 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2037/4093] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:02 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:03.035735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:03.036774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:03.045402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.046381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.046980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.048001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.048728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.049462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.175374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:03.176622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:03.190142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.191401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.192398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.195744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.198507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.199834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.519277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:03.533211 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e574d4d-ec10-4504-9c26-6e000149a7ab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.501703 Sep 19 15:02:03.547373 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2057/4094] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:03 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:03.561807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:03.573139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:03.588876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.589627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.590314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.591153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.596486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.597404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.624792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce/action HTTP/1.1 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 65 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '10aa93bf-e81c-4424-a09d-5783ba44edce', 'body': {'rebuild': {'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799'}}} Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 19 15:02:03.628688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:02:03.634226 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:03.640135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:03.641161 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-33f7c788-e336-4a87-b3b1-36f9d920ea51 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce/action" status: 404 len: 111 microversion: 2.1 time: 0.083363 Sep 19 15:02:03.642572 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2058/4095] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:03 2022] POST /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:03.661876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:03.662501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:03.672893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.673432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.674904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.675630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.676106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.676536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.725957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:03.746842 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-516babb1-fb8d-4b9d-bb7e-515df4004f3d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 0.579360 Sep 19 15:02:03.747928 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2038/4096] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:03 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:03.971926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:03.972828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:03.991716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.997167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:03.998123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:03.999280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:03.999950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:04.000407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:04.881322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:04.890929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-acee75c9-166e-4732-acc6-7b054c83feb2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.236954 Sep 19 15:02:04.892329 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2059/4097] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:03 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:04.899038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ab757af-ee00-481a-8416-ba2f33b0ad80 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'create', calling method: .version_select at 0x7fde28b8fca0>, body: {"keypair": {"name": "tempest-keypair-1373931122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ0vgCoO1sqWWXVZ8p4+UZ4DPrQduCGre5ZEL+iJlkmj/Nxv5pkiimQ3t0VQBunNX4PoE5hpUyWMAfDKO67GND9vHOSfVLRnFy3oVazUlqDTZ5ptMAGh8Vqer0yjoxt1Q=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:04.922269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0ab757af-ee00-481a-8416-ba2f33b0ad80 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:02:04.930362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0ab757af-ee00-481a-8416-ba2f33b0ad80 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for user c4210519c4b84d258d456dc84406b72f and project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:02:04.958467 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ab757af-ee00-481a-8416-ba2f33b0ad80 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.064813 Sep 19 15:02:04.959097 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2060/4098] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 15:02:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 15:02:04.964583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:04.965266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:04.972056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:04.972555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:04.972988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:04.973692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:04.974146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:04.974800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:05.153106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:05.165452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0eccc411-b3a2-4e2d-9ac7-9aedf08f8f1d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 1.195364 Sep 19 15:02:05.189315 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2039/4099] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:03 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:05.196654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:05.197587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:05.205688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:05.206530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:05.207383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:05.208307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:05.209066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:05.209653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:05.774788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:05.785112 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e32abb8e-433d-4979-85bb-3b41f526b753 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 0.824377 Sep 19 15:02:05.787540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2061/4100] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:04 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:05.943149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:05.954529 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f27b859e-d138-4b78-967e-6cc7d699585c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.762775 Sep 19 15:02:05.954529 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2040/4101] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:05 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:05.976884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b16c6db-8bf0-425a-9dd7-c87d552b2b95 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:05.980736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7b16c6db-8bf0-425a-9dd7-c87d552b2b95 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:05.992152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-7b16c6db-8bf0-425a-9dd7-c87d552b2b95 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac could not be found. Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b16c6db-8bf0-425a-9dd7-c87d552b2b95 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac/action HTTP/1.1 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 65 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac could not be found. Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac', 'body': {'rebuild': {'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799'}}} Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac could not be found. Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 19 15:02:05.994218 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac could not be found. Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac could not be found. Sep 19 15:02:05.998632 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:06.003054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b16c6db-8bf0-425a-9dd7-c87d552b2b95 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:06.004595 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b16c6db-8bf0-425a-9dd7-c87d552b2b95 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac/action" status: 404 len: 111 microversion: 2.1 time: 0.032393 Sep 19 15:02:06.017139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:06.017834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:06.025510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2062/4102] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:05 2022] POST /compute/v2.1/servers/5facbd1e-f7ad-4d8f-a5eb-828d39ff59ac/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:06.030449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:06.031365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:06.032525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:06.033715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:06.034367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:06.035672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:06.202708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:06.203815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:06.217765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:06.219068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:06.219870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:06.223101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:06.223799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:06.225988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:06.244547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:06.737136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:06.749780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f9f6af9-91ff-49f8-9e02-54b51a8c5f7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.737540 Sep 19 15:02:06.750583 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2041/4103] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:06 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:06.789258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:06.789896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:06.799883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:06.800725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:06.801173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:06.801915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:06.802381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:06.802973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:06.830658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.118316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:07.136079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc30cc73-8757-4677-9343-5fcaa72bcae9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 0.938029 Sep 19 15:02:07.144449 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2063/4104] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:06 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:07.150140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:07.159685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:07.166594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:07.167643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:07.168294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:07.171711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:07.172475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:07.173147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:07.842720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:07.853341 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9ca0eb1e-0d15-4569-931d-454ffd80c8d1 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.071311 Sep 19 15:02:07.854628 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2042/4105] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:06 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:07.860250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bde60603-9b6f-4910-af71-26ebc4f56836 req-66b9b57a-e32b-45ba-b8f5-0d80af0dc5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff06e0-7cb4-4c0c-b4cf-8ee962114447", "name": "network-vif-plugged", "status": "completed", "tag": "e877584e-3c02-49c7-94f4-bd9b4b16da7f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:07.865408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=92 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.877175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bde60603-9b6f-4910-af71-26ebc4f56836 req-66b9b57a-e32b-45ba-b8f5-0d80af0dc5fd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:07.877673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bde60603-9b6f-4910-af71-26ebc4f56836 req-66b9b57a-e32b-45ba-b8f5-0d80af0dc5fd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:07.878186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bde60603-9b6f-4910-af71-26ebc4f56836 req-66b9b57a-e32b-45ba-b8f5-0d80af0dc5fd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:07.896744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:07.912426 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bde60603-9b6f-4910-af71-26ebc4f56836 req-66b9b57a-e32b-45ba-b8f5-0d80af0dc5fd service nova] Creating event network-vif-plugged:e877584e-3c02-49c7-94f4-bd9b4b16da7f for instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 on n-h2-858384-1 Sep 19 15:02:07.922220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bde60603-9b6f-4910-af71-26ebc4f56836 req-66b9b57a-e32b-45ba-b8f5-0d80af0dc5fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066777 Sep 19 15:02:07.923490 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2043/4106] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:07.942433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ab08aa3-d14d-4a0f-8a8f-3508944f2908 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:07.944927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ab08aa3-d14d-4a0f-8a8f-3508944f2908 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: e1035998-8fa4-4603-9407-ea42db0f9944] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:07.948602 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ecdcde9-2db2-466a-82e7-bd8c372a0958 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 0.802708 Sep 19 15:02:07.964023 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3ab08aa3-d14d-4a0f-8a8f-3508944f2908 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance e1035998-8fa4-4603-9407-ea42db0f9944 could not be found. Sep 19 15:02:07.966101 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2064/4107] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:07 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ab08aa3-d14d-4a0f-8a8f-3508944f2908 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/e1035998-8fa4-4603-9407-ea42db0f9944/action HTTP/1.1 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: {"restore": {}} Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance e1035998-8fa4-4603-9407-ea42db0f9944 could not be found. Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e1035998-8fa4-4603-9407-ea42db0f9944', 'body': {'restore': {}}} Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1035998-8fa4-4603-9407-ea42db0f9944 could not be found. Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1035998-8fa4-4603-9407-ea42db0f9944 could not be found. Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:07.973355 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:07.978172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:07.978172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:07.978172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1035998-8fa4-4603-9407-ea42db0f9944 could not be found. Sep 19 15:02:07.978172 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:07.978172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ab08aa3-d14d-4a0f-8a8f-3508944f2908 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance e1035998-8fa4-4603-9407-ea42db0f9944 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:07.985476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ab08aa3-d14d-4a0f-8a8f-3508944f2908 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/e1035998-8fa4-4603-9407-ea42db0f9944/action" status: 404 len: 111 microversion: 2.1 time: 0.060501 Sep 19 15:02:07.988316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2044/4108] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:07 2022] POST /compute/v2.1/servers/e1035998-8fa4-4603-9407-ea42db0f9944/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:08.004099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:08.005007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:08.015268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.015809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:08.016233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:08.018191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.018662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:08.019126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:08.151502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-323502885", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb969539-440e-4219-9eef-4adc88740309"}], "security_groups": [{"name": "tempest-securitygroup--1080911238"}], "key_name": "tempest-keypair-1373931122", "user_data": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:08.587798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] validate_networks() for [('eb969539-440e-4219-9eef-4adc88740309', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:02:08.636510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:08.650674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e072d68-b110-40fb-9b3d-49bc20ad84b8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.653588 Sep 19 15:02:08.651647 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2065/4109] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:07 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:08.658533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:08.664912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:08.683260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.684455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:08.685110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:08.686039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.687040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:08.687537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:08.948875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:08.968117 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ebe4898-121a-407a-8da3-4c3391f9e1dc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 0.315058 Sep 19 15:02:08.968716 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2066/4110] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:08 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:08.975801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:08.976932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:08.996608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.999997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.004850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.008523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.009519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.010143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.491406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:02:09.492727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:02:09.493330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:02:09.495230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:02:09.498131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:02:09.534393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.537747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.538569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.540658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.541145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.545841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.588097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:09.598157 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27db1b2b-87c3-461c-acb5-94632abbd630 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.628130 Sep 19 15:02:09.599622 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2067/4111] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:08 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:09.602094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:02:09.605328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:09.606362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:09.613979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.615004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.616398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.617412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.618138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.618827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.632684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Getting quotas for user c4210519c4b84d258d456dc84406b72f and project 6e43c078348c4279b96e285b4d5a1b11. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:02:09.665055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:02:09.668675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:02:09.801179 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68de4ef0-d9b4-4349-96ff-15ee8727c6ae tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.655236 Sep 19 15:02:09.802518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2045/4112] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 15:02:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 15:02:09.808354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:09.809505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:09.816734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.817561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.818193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.819949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.821015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.821649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.832805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:09.845036 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1f4567de-6dcf-473b-bbf9-0550f7e53fa5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1315 microversion: 2.1 time: 0.243945 Sep 19 15:02:09.863618 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2068/4113] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:09 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:09.883063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ab89837a-76b9-45e2-abe4-f1db7e2188b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:09.883737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ab89837a-76b9-45e2-abe4-f1db7e2188b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:09.886302 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'restore' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: {"restore": {}} Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'restore' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'restore': {}}} Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state active. Cannot restore while the instance is in this state. Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:09.888206 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:09.892202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:09.892202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:09.892202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:09.892202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:09.892202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:09.894293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'restore' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:09.895442 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-02dd801a-6fb8-4e2f-a5b0-4a7ee824b16b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 145 microversion: 2.1 time: 0.091084 Sep 19 15:02:09.896595 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2046/4114] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:09 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:02:09.905532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:09.906484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:09.922202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.924407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.925753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.929312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.930428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.931138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.961549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab89837a-76b9-45e2-abe4-f1db7e2188b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:09.980619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab89837a-76b9-45e2-abe4-f1db7e2188b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:09.982386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ab89837a-76b9-45e2-abe4-f1db7e2188b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:09.983987 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ab89837a-76b9-45e2-abe4-f1db7e2188b4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1281 microversion: 2.20 time: 0.116696 Sep 19 15:02:09.984740 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2069/4115] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:09 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:10.023628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:10.028936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:10.040427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.040941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.041389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.042115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.042580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.047777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.382380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:10.393187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3b893ef-98cf-4f5c-9258-3bd4d65edd93 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.491855 Sep 19 15:02:10.394058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2047/4116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:09 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:10.419836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:10.421673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:10.428419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.429828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.430461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.431536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.432376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.433033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.465186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:10.485612 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7479e48b-b039-439c-b48e-642dca70025d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 0.490137 Sep 19 15:02:10.498847 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2070/4117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:09 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:10.774291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:10.783510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9da2321-7bfd-497e-b81b-9edf581d9a30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.367579 Sep 19 15:02:10.784104 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2048/4118] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:10 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:10.813618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82a59307-b496-4f65-839d-058bef3e4ca5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:10.814331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82a59307-b496-4f65-839d-058bef3e4ca5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 4c3368c6-2fe2-4529-b075-c2c249d69ea7] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:10.832121 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-82a59307-b496-4f65-839d-058bef3e4ca5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 4c3368c6-2fe2-4529-b075-c2c249d69ea7 could not be found. Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82a59307-b496-4f65-839d-058bef3e4ca5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/4c3368c6-2fe2-4529-b075-c2c249d69ea7/action HTTP/1.1 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 14 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: {"resume": {}} Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4c3368c6-2fe2-4529-b075-c2c249d69ea7 could not be found. Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4c3368c6-2fe2-4529-b075-c2c249d69ea7', 'body': {'resume': {}}} Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3368c6-2fe2-4529-b075-c2c249d69ea7 could not be found. Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3368c6-2fe2-4529-b075-c2c249d69ea7 could not be found. Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:10.844053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:10.848769 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:10.848769 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:10.848769 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3368c6-2fe2-4529-b075-c2c249d69ea7 could not be found. Sep 19 15:02:10.848769 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:10.851935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82a59307-b496-4f65-839d-058bef3e4ca5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 4c3368c6-2fe2-4529-b075-c2c249d69ea7 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:10.853446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82a59307-b496-4f65-839d-058bef3e4ca5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/4c3368c6-2fe2-4529-b075-c2c249d69ea7/action" status: 404 len: 111 microversion: 2.1 time: 0.046256 Sep 19 15:02:10.854252 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2071/4119] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:10 2022] POST /compute/v2.1/servers/4c3368c6-2fe2-4529-b075-c2c249d69ea7/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:10.866321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:10.867303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:10.868810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:10.871634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:10.877450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.883800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.884547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.885763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.886493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.887652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.908352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.909261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.910064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.911092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:10.914055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:10.914973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.711689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:11.727674 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a5e92a4-047d-49bf-bdae-0b950de33eed tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.866582 Sep 19 15:02:11.743923 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2049/4120] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:10 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:11.750104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:11.754308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:11.755320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:11.759227 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9492ccbe-7d3b-4829-a459-6daeba4cc306 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1500 microversion: 2.1 time: 0.895240 Sep 19 15:02:11.759819 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2072/4121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:10 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1500 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:11.767525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.772414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:11.773175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.773905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.774719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.775296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.775776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.779312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:11.796007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.796761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.797391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.798265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.798924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.799506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.933098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:11.945166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:11.947418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:11.948914 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc5e454a-6079-4fd0-bd81-7d0e14679886 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1351 microversion: 2.20 time: 0.203692 Sep 19 15:02:11.949987 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2050/4122] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:11 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:11.956600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-63fae44a-0d84-4ada-ace1-31024d876e94 req-1c7c323d-1930-491e-a8f3-0fe62fce66a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41b03f9-e02f-49a8-bddc-eff40fb91f08", "name": "network-vif-plugged", "status": "completed", "tag": "b527c2a7-5981-45fb-aaf6-b78bbc1ed937"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:11.971533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-63fae44a-0d84-4ada-ace1-31024d876e94 req-1c7c323d-1930-491e-a8f3-0fe62fce66a0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.972280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-63fae44a-0d84-4ada-ace1-31024d876e94 req-1c7c323d-1930-491e-a8f3-0fe62fce66a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.972883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-63fae44a-0d84-4ada-ace1-31024d876e94 req-1c7c323d-1930-491e-a8f3-0fe62fce66a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.994249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-63fae44a-0d84-4ada-ace1-31024d876e94 req-1c7c323d-1930-491e-a8f3-0fe62fce66a0 service nova] Creating event network-vif-plugged:b527c2a7-5981-45fb-aaf6-b78bbc1ed937 for instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 on n-h2-858384-1 Sep 19 15:02:12.002185 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-63fae44a-0d84-4ada-ace1-31024d876e94 req-1c7c323d-1930-491e-a8f3-0fe62fce66a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050823 Sep 19 15:02:12.003499 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2051/4123] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:12.032911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:12.046932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:12.064520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.068473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.070646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.072997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.073561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.074608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.390345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:12.403050 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3818c8c2-1a29-41bb-a7d6-ff48a6518264 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 0.634491 Sep 19 15:02:12.404101 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2073/4124] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:11 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:12.411313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:12.412177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:12.422439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.423909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.424798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.426641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.427470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.428291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.559638 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37abaa89-9e12-4d8a-bb7f-1b4280f65d83 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447/action" status: 202 len: 0 microversion: 2.1 time: 0.152922 Sep 19 15:02:12.563629 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2074/4125] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:12 2022] POST /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:02:12.579145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:12.582898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:12.599174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.599657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.600723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.601842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.602311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.604616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.657916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:12.671088 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e091c540-783d-41f3-bfbb-b880401ec75d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.665282 Sep 19 15:02:12.679903 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2052/4126] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:12 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:12.711083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:12.712683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:12.723922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.724879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.725377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.726502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.728327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.728941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.762534 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'resume' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 14 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: {"resume": {}} Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'resume' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'resume': {}}} Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state active. Cannot resume while the instance is in this state. Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:12.764815 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:02:12.768850 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:12.771067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'resume' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:12.772532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3801d3d-58d0-41ab-bdbb-34f24a8cced0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 144 microversion: 2.1 time: 0.071741 Sep 19 15:02:12.777197 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2053/4127] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:12 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 144 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:02:12.783732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:12.784586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:12.793763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.795298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.796099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.798209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.798985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.799648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.378230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:13.395647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b4bc7447-cc99-49e7-913c-ed310cbef459 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1505 microversion: 2.1 time: 0.829308 Sep 19 15:02:13.423279 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2075/4128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:12 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1505 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:13.430632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:13.431596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:13.449328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.450107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.450728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.451809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.452433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.453014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.498149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:13.510658 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-881c10e1-6593-40a5-b92f-d706d45164ff tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.732131 Sep 19 15:02:13.512484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2054/4129] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:12 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:13.518351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:13.519624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:13.546737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.550126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.555324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.557441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.558124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.560329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.825612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:13.851965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:13.853958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:13.855651 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-280392d8-f82c-4a71-9380-e59e41b9abc0 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1339 microversion: 2.20 time: 0.430962 Sep 19 15:02:13.856893 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2076/4130] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:13 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1339 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:13.861894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:13.862856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:13.872724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.877883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.878698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.879697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.880356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.882951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:14.675331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:14.706378 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed57b4f4-d753-4b20-9d2e-070948c7588e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1292 microversion: 2.1 time: 1.191228 Sep 19 15:02:14.709833 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2055/4131] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:13 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1292 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:14.725376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:14.725376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:14.753529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:14.753529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:14.754001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:14.754519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:14.755028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:14.755465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:15.078209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:15.093085 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1b126ac-2f33-4d11-909e-2db05ddcabf9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.233685 Sep 19 15:02:15.107688 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2077/4132] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:13 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:15.141641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:15.142639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:15.180152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:15.184616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:15.185619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:15.190598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:15.193405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:15.196612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:15.774438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:15.787254 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-adc70423-eae1-49c5-98bd-d2c062beab12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1485 microversion: 2.1 time: 1.075436 Sep 19 15:02:15.788889 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2056/4133] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:14 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1485 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:15.798225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccf5237e-ee1f-4801-8578-7f6290f1f46b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccf5237e-ee1f-4801-8578-7f6290f1f46b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 160 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "becbe19b-7264-4a9a-a233-6761770cd2c6"}]}} Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'body': {'server': {'name': '', 'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799', 'flavorRef': '452', 'networks': [{'uuid': 'becbe19b-7264-4a9a-a233-6761770cd2c6'}]}}} Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi '' Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:02:15.804502 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 19 15:02:15.809865 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:15.813470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccf5237e-ee1f-4801-8578-7f6290f1f46b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:15.814393 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ccf5237e-ee1f-4801-8578-7f6290f1f46b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024336 Sep 19 15:02:15.817878 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2057/4134] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:02:15 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:02:15.825671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:15.826387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:15.840565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:15.841068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:15.841588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:15.842312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:15.843540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:15.845388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:15.901698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:15.919880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:15.923648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:15.927981 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59b47025-6a23-4f23-990d-87c0fe383b9a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.817780 Sep 19 15:02:15.945635 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2078/4135] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:15 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:15.987165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:15.988621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:16.000430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:16.004332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:16.007044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:16.008810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:16.009938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:16.010993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:16.078792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lazy-loading 'flavor' on Instance uuid 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:02:16.168510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:16.434900 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0bf0fe2b-14d2-4756-aaae-54c9b9ef8991 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447/action" status: 202 len: 0 microversion: 2.1 time: 0.487082 Sep 19 15:02:16.439534 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2079/4136] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:15 2022] POST /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:02:16.451935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:16.456565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:16.477770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:16.478572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:16.479231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:16.483877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:16.484379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:16.485080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:16.485991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:16.493556 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c18ad6e2-f286-4f8f-8c71-d7203834371d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1473 microversion: 2.1 time: 0.673047 Sep 19 15:02:16.515393 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2058/4137] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:15 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1473 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:16.539245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:16.541081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:16.551458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:16.551961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:16.552402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:16.553182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:16.563988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:16.564689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:17.446935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:17.468444 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf8f9802-b8b7-4f44-9588-5789f47939b6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1491 microversion: 2.1 time: 0.951836 Sep 19 15:02:17.479327 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2059/4138] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:16 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1491 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:17.496378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1655495987", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:17.602381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:02:17.643414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:17.659162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7305c4e0-13d6-4e93-b3eb-957cec96f02a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.217991 Sep 19 15:02:17.660149 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2080/4139] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:16 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:17.671482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:17.673913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:17.682243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:17.683172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:17.684175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:17.685144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:17.685889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:17.686550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:18.560077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:18.572879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:18.574633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:18.575856 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4386ff0-407a-41c9-8814-7f7dc2a428cd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.914592 Sep 19 15:02:18.602225 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2081/4140] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:17 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:18.609977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:18.610599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:18.621354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:18.622158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:18.622662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:18.624180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:18.624707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:18.626990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.373844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:19.390015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d9e9d0b0-ae32-4db8-a58c-a06e42397b47 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.786429 Sep 19 15:02:19.394407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2082/4141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:18 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:19.403656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:19.404844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:19.426035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.426852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.427672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.429170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.429795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.430375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.563407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:19.629625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:02:19.630167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:02:19.630654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:02:19.631124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:02:19.631540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:02:19.655018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.655593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.656100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.657045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.657882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.658649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.696846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:02:19.717005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:02:19.746404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:02:19.749973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 7a830087-dda0-40f2-b21d-04a1c6870073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:02:19.826139 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-138a358b-1e4e-4187-b6ad-46033ec2cfff tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.345446 Sep 19 15:02:19.827661 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2060/4142] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:02:19.839165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5b282ed-e702-4f52-a23d-6fbc35176fa7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:19.840426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5b282ed-e702-4f52-a23d-6fbc35176fa7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 4c98a236-8964-4916-af7a-4dedf8684c61] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:19.849004 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c5b282ed-e702-4f52-a23d-6fbc35176fa7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 4c98a236-8964-4916-af7a-4dedf8684c61 could not be found. Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5b282ed-e702-4f52-a23d-6fbc35176fa7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/4c98a236-8964-4916-af7a-4dedf8684c61/action HTTP/1.1 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 14 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: {"shelve": {}} Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4c98a236-8964-4916-af7a-4dedf8684c61 could not be found. Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4c98a236-8964-4916-af7a-4dedf8684c61', 'body': {'shelve': {}}} Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c98a236-8964-4916-af7a-4dedf8684c61 could not be found. Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c98a236-8964-4916-af7a-4dedf8684c61 could not be found. Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:19.867496 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:19.872287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:19.872287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:19.872287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c98a236-8964-4916-af7a-4dedf8684c61 could not be found. Sep 19 15:02:19.872287 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:02:19.876726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5b282ed-e702-4f52-a23d-6fbc35176fa7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 4c98a236-8964-4916-af7a-4dedf8684c61 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:19.878874 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5b282ed-e702-4f52-a23d-6fbc35176fa7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/4c98a236-8964-4916-af7a-4dedf8684c61/action" status: 404 len: 111 microversion: 2.1 time: 0.049823 Sep 19 15:02:19.881901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2061/4143] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:19 2022] POST /compute/v2.1/servers/4c98a236-8964-4916-af7a-4dedf8684c61/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:19.894521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:19.896137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:19.905621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:19.910667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.911398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.911998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.914042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.914786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.914907 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f36759e1-249c-4272-a20f-8eb82171765f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 0.519133 Sep 19 15:02:19.915381 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2083/4144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:19 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:19.916007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.927688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e9302f3-d231-4560-882d-81bc904cd1a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:19.937435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e9302f3-d231-4560-882d-81bc904cd1a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 7a830087-dda0-40f2-b21d-04a1c6870073] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:19.967718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e9302f3-d231-4560-882d-81bc904cd1a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 7a830087-dda0-40f2-b21d-04a1c6870073] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:02:19.970961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:19.988106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:20.352648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:20.366969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:20.369294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:20.376206 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ee9d93e-08cc-46d2-9d4c-c1d0f1271f11 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.492980 Sep 19 15:02:20.377112 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2062/4145] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:19 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:20.387281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:20.388651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:20.403959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:20.409719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:20.410448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:20.411471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:20.412198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:20.413629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:20.574767 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e9302f3-d231-4560-882d-81bc904cd1a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073" status: 204 len: 0 microversion: 2.1 time: 0.650661 Sep 19 15:02:20.576321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2084/4146] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:02:19 2022] DELETE /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:02:20.606434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c9fc86f9-8cca-455a-8c25-951a46f16a21 req-7efa982a-9aec-4898-9e31-a6aec3b91d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:20.645029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c9fc86f9-8cca-455a-8c25-951a46f16a21 req-7efa982a-9aec-4898-9e31-a6aec3b91d02 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:20.645831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c9fc86f9-8cca-455a-8c25-951a46f16a21 req-7efa982a-9aec-4898-9e31-a6aec3b91d02 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:20.647898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c9fc86f9-8cca-455a-8c25-951a46f16a21 req-7efa982a-9aec-4898-9e31-a6aec3b91d02 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:20.700527 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c9fc86f9-8cca-455a-8c25-951a46f16a21 req-7efa982a-9aec-4898-9e31-a6aec3b91d02 service nova] Creating event network-changed:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:02:20.723207 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c9fc86f9-8cca-455a-8c25-951a46f16a21 req-7efa982a-9aec-4898-9e31-a6aec3b91d02 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143668 Sep 19 15:02:20.732662 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2085/4147] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:20.743744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dda8cff5-7114-4fdb-afd2-c3bb5c23eff1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:20.745521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dda8cff5-7114-4fdb-afd2-c3bb5c23eff1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 7a830087-dda0-40f2-b21d-04a1c6870073] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:20.764746 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-dda8cff5-7114-4fdb-afd2-c3bb5c23eff1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dda8cff5-7114-4fdb-afd2-c3bb5c23eff1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 HTTP/1.1 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7a830087-dda0-40f2-b21d-04a1c6870073'} Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:20.773371 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:20.777801 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:20.777801 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:20.777801 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:20.777801 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:02:20.777801 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:02:20.783328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dda8cff5-7114-4fdb-afd2-c3bb5c23eff1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:20.799865 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dda8cff5-7114-4fdb-afd2-c3bb5c23eff1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073" status: 404 len: 111 microversion: 2.1 time: 0.049653 Sep 19 15:02:20.801911 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2086/4148] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:20 2022] GET /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:20.891927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-182004634", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:20.979456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:02:21.115071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:21.130018 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bdd9ab07-aed8-4e6f-9e51-7d969c2cc501 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.751622 Sep 19 15:02:21.148978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2063/4149] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:20 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:21.157476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:21.159690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:21.167646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:21.169926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:21.170556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:21.171755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:21.172437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:21.173285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:22.152658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:22.179607 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bfeef1c5-f961-4f5b-8690-6c046ab549a3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.020823 Sep 19 15:02:22.190812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2064/4150] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:21 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:22.190812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:22.190812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:22.204291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:22.204809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:22.205259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:22.205992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:22.214895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:22.215472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:22.222131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:23.358471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:23.382953 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12131828-b9c2-4715-bd11-59268aafce37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.201057 Sep 19 15:02:23.384001 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2065/4151] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:22 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:23.400131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:23.400924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:23.412212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.413461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.414249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.423980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.424621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.425242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.618837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:02:23.619890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:02:23.620536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:02:23.621279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:02:23.621885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:02:23.633841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.634607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.635340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.636437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.637247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.637889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.675181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:02:23.682079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:02:23.725902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:02:23.729552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:02:23.814295 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9b65ce24-ea8a-4428-bbac-8da36db226ec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.927324 Sep 19 15:02:23.816230 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2087/4152] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:02:23.824303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-32d24fba-bf10-411d-bdc0-9ededb4cdfbf req-e7f459c9-3d2c-43ba-afdd-a238398f230c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff06e0-7cb4-4c0c-b4cf-8ee962114447", "name": "network-vif-plugged", "status": "completed", "tag": "e877584e-3c02-49c7-94f4-bd9b4b16da7f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:23.870615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32d24fba-bf10-411d-bdc0-9ededb4cdfbf req-e7f459c9-3d2c-43ba-afdd-a238398f230c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.873636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32d24fba-bf10-411d-bdc0-9ededb4cdfbf req-e7f459c9-3d2c-43ba-afdd-a238398f230c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.877619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-32d24fba-bf10-411d-bdc0-9ededb4cdfbf req-e7f459c9-3d2c-43ba-afdd-a238398f230c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.897040 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-32d24fba-bf10-411d-bdc0-9ededb4cdfbf req-e7f459c9-3d2c-43ba-afdd-a238398f230c service nova] Creating event network-vif-plugged:e877584e-3c02-49c7-94f4-bd9b4b16da7f for instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 on n-h2-858384-1 Sep 19 15:02:23.918240 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-32d24fba-bf10-411d-bdc0-9ededb4cdfbf req-e7f459c9-3d2c-43ba-afdd-a238398f230c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100409 Sep 19 15:02:23.922315 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2088/4153] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:23.939189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:23.942719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:23.961223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.962052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.963081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.966623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.967251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.967716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:24.117448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:24.162363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:24.171770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:24.176624 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0684f406-2357-4bc5-b88a-eb21527caa96 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.791410 Sep 19 15:02:24.188755 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2066/4154] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:23 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:24.209893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:24.212636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:24.264883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:24.268490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:24.271193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:24.275887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:24.280439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:24.283163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:24.371144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lazy-loading 'flavor' on Instance uuid c3ad076e-097f-4d69-b3ed-fede15ad5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:02:24.591193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:24.608486 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-92522f73-5f2c-426b-81f6-4c1de854c480 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 0.681580 Sep 19 15:02:24.609548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2089/4155] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:23 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:24.616909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78de0be1-4426-4c85-b2e9-b5a83617ec4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:24.618541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78de0be1-4426-4c85-b2e9-b5a83617ec4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:25.027408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78de0be1-4426-4c85-b2e9-b5a83617ec4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:25.047019 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78de0be1-4426-4c85-b2e9-b5a83617ec4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1220 microversion: 2.1 time: 0.433766 Sep 19 15:02:25.047958 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2090/4156] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:24 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1220 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:25.061460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-49c4a88b-7e25-4ec2-80c2-088dc1520868 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.870499 Sep 19 15:02:25.067470 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2067/4157] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:24 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:02:25.074426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:25.075425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:25.084910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.085602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.086201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:25.087154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.087777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.088390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:25.209836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:25.210896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:25.239915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.242179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.244414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:25.249167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.249675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.253376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:25.768844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:25.784825 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca9b0dca-0ccf-4e4c-8b00-46e1832cfdb7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 0.716109 Sep 19 15:02:25.822197 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2091/4158] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:25 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:25.834893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:25.847529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:25.865436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.866338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.871486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:25.876298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.893226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.897206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:26.239141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:26.256080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:26.258305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:26.259549 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eaedc3c1-0b2d-4f79-b8ea-47f6c90f105f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 1.055243 Sep 19 15:02:26.265961 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2068/4159] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:25 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:02:26.272827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:26.274065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:26.309475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:26.313957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:26.316792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:26.319488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:26.321907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:26.323002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:26.534265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:26.551022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6dc721fd-2918-4e92-8804-aa761d881349 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1272 microversion: 2.1 time: 0.282036 Sep 19 15:02:26.555133 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2069/4160] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:26 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:26.630487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:26.649354 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7e7f24b-2cbe-433f-8f63-d7a66666a3bf tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 0.825503 Sep 19 15:02:26.651128 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2092/4161] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:25 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:26.823669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:26.834949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:26.868528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:26.874648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:26.875569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:26.882667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:26.885754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:26.886497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.291286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:27.292303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:27.313060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.316083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.318014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.319234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.325004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.325758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:28.167363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:28.178111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:28.181281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:28.183569 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4d8660c6-4df5-4110-b563-4a8ae37e6b0d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.897302 Sep 19 15:02:28.184989 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2093/4162] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:27 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:02:28.203880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:28.204752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:28.216314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:28.217502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:28.218588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:28.220256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:28.221882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:28.222634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:28.229302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:28.246633 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-964807ce-76c7-4024-8b93-422aa5679068 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 1.433107 Sep 19 15:02:28.263664 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2070/4163] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:26 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:28.285152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:28.286536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:28.302003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:28.324699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:28.327603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:28.328986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:28.331029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:28.335167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:28.849601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:28.877740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5adbc325-bc0d-4b8f-8ce4-154920b6e245 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1278 microversion: 2.1 time: 0.690974 Sep 19 15:02:28.892544 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2094/4164] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:28 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1278 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:29.219326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:29.219955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:29.234516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:29.235072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:29.236845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:29.238964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:29.240813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:29.241291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:29.436491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:29.464111 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c2d757e1-6657-4509-b5ae-cd2ebfde7b91 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.198693 Sep 19 15:02:29.473274 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2071/4165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:28 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:29.483146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:29.511351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:29.520242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:29.528308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:29.531703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:29.533548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:29.540102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:29.546550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:29.680810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:29.734030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:29.991957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:30.003219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3276187d-6348-4286-93b8-120df056f634 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 0.527938 Sep 19 15:02:30.007337 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2072/4166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:29 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:30.019033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3e023342-a53a-49e3-b2e3-d7b58cf600a8 req-07bae5c5-ef71-4d13-88dd-ad136503bbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "name": "network-vif-plugged", "status": "completed", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:30.026803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:30.041950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:30.056544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3e023342-a53a-49e3-b2e3-d7b58cf600a8 req-07bae5c5-ef71-4d13-88dd-ad136503bbba service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:30.059559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3e023342-a53a-49e3-b2e3-d7b58cf600a8 req-07bae5c5-ef71-4d13-88dd-ad136503bbba service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:30.061109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:30.061890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3e023342-a53a-49e3-b2e3-d7b58cf600a8 req-07bae5c5-ef71-4d13-88dd-ad136503bbba service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:30.071046 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9208f709-b7e2-4167-b528-3a001b9b0128 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.851816 Sep 19 15:02:30.074445 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2095/4167] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:29 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:02:30.084154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:30.085162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:30.102067 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3e023342-a53a-49e3-b2e3-d7b58cf600a8 req-07bae5c5-ef71-4d13-88dd-ad136503bbba service nova] Creating event network-vif-plugged:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:02:30.107247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:30.111338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3e023342-a53a-49e3-b2e3-d7b58cf600a8 req-07bae5c5-ef71-4d13-88dd-ad136503bbba service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101092 Sep 19 15:02:30.112383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:30.112738 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2073/4168] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:30.113251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:30.114245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:30.116506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:30.117398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:30.432719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:30.459443 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-339707b9-f427-471f-b49f-324e5a85a52d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1278 microversion: 2.1 time: 0.381130 Sep 19 15:02:30.480075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2096/4169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:30 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1278 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:30.497577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:30.498279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:30.505706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:30.506555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:30.507166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:30.520737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:30.521184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:30.521678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:31.038176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:31.038843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:31.059289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:31.060119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:31.060745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:31.061641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:31.065004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:31.065633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:31.910616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:31.923415 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e3082442-5bb3-4779-9d6c-5381f8d8517d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.430179 Sep 19 15:02:31.924035 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2074/4170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:30 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:31.954289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:31.955559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:31.982101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:31.982618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:31.985284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:31.986263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:31.986779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:31.989394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:32.103262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:32.113363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ab7c56d-39bd-4522-91a3-1e48ac813806 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 1.079665 Sep 19 15:02:32.122358 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2097/4171] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:31 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:32.127725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:32.132352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:32.153412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:32.154184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:32.156933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:32.157961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:32.159958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:32.167580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:32.584546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:32.609114 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-758a90f8-df5e-4579-8e93-1925d602452d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 0.485157 Sep 19 15:02:32.613340 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2098/4172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:32 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:32.713286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:32.739344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:32.742218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:32.749335 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c8e7caa-8a50-4bbf-8916-87a3030ee852 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1407 microversion: 2.20 time: 0.802452 Sep 19 15:02:32.768166 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2075/4173] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:31 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1407 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:32.955083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:32.955260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:32.977525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:32.989880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:32.991995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:32.994193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:32.996048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:33.002331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:33.161092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:33.164048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:33.186260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:33.188889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:33.191365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:33.192355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:33.193298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:33.194771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:33.663491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:34.216551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:34.228560 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-558fdac7-0559-4cbe-a73b-a3549ab33091 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.279585 Sep 19 15:02:34.233879 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2099/4174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:32 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:34.247862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:34.249884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:34.274545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:34.276685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:34.279181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:34.280198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:34.281771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:34.285849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:34.334892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:34.352299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf6b1500-9da8-483d-a67d-436067f7805a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 1.207475 Sep 19 15:02:34.352923 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2076/4175] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:33 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:34.384938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:34.387774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:34.391629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:34.414340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:34.419708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:34.420275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:34.424678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:34.431307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:34.433418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:34.828475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:34.853506 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dd4a32d9-2a58-4d4c-aac7-950edd46c976 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 0.615917 Sep 19 15:02:34.879249 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2100/4176] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:34 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:35.126736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:35.146099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:35.148434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:35.149673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-567d9d77-ff15-4cd2-82c9-283b7192a700 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1599 microversion: 2.20 time: 0.777904 Sep 19 15:02:35.153560 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2077/4177] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:02:34 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1599 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:35.190008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:35.191022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:35.199126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:35.201993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:35.202832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:35.203464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:35.205423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:35.206184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:35.206816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:35.261647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:35.270962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:35.279889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:35.280387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:35.280832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:35.281562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:35.282022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:35.300539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:35.796993 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2febf82d-9cdd-4c0a-ae54-e6c8b52291ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.610926 Sep 19 15:02:35.797559 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2101/4178] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 15:02:35 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-interface => generated 285 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:35.809541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:35.810688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:35.823943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:35.824460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:35.824910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:35.825645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:35.826104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:35.826533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:36.381807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:36.392880 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-238f9df7-df36-4a83-bc07-38a03d94bb29 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.135256 Sep 19 15:02:36.398224 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2078/4179] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:35 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:36.414117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:36.415312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:36.433078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:36.436581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:36.443335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:36.444073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:36.445192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:36.446032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:36.446702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:36.702082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:36.718291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a0978e0-0f4b-4277-a255-b04e854e5fc5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1531 microversion: 2.1 time: 0.919418 Sep 19 15:02:36.722335 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2102/4180] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:35 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1531 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:37.121197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b192e693-ffea-4a4a-97c3-5ddd41f421c7 req-aac91772-0f50-4856-9f57-494ae33ffc9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7dd5bd1-58c0-43fa-af56-0b78c531edd1", "tag": "e40e70f0-a86e-441f-b714-f74d10663386"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:37.164714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b192e693-ffea-4a4a-97c3-5ddd41f421c7 req-aac91772-0f50-4856-9f57-494ae33ffc9c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:37.165901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b192e693-ffea-4a4a-97c3-5ddd41f421c7 req-aac91772-0f50-4856-9f57-494ae33ffc9c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:37.166994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b192e693-ffea-4a4a-97c3-5ddd41f421c7 req-aac91772-0f50-4856-9f57-494ae33ffc9c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:37.223301 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b192e693-ffea-4a4a-97c3-5ddd41f421c7 req-aac91772-0f50-4856-9f57-494ae33ffc9c service nova] Creating event network-changed:e40e70f0-a86e-441f-b714-f74d10663386 for instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 on n-h2-858384-1 Sep 19 15:02:37.254559 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b192e693-ffea-4a4a-97c3-5ddd41f421c7 req-aac91772-0f50-4856-9f57-494ae33ffc9c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132623 Sep 19 15:02:37.259128 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2103/4181] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:37.424282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:37.425549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:37.441076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:37.442237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:37.442953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:37.444566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:37.448301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:37.450127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:38.061417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:38.073162 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9cbcca92-d9f8-48e6-a9aa-889598b502fd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 1.672622 Sep 19 15:02:38.084756 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2079/4182] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:36 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:38.108348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:38.109283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:38.133676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:38.134186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:38.134629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:38.135592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:38.136017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:38.136314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:38.213174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:40.629406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:40.644027 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa3eedfb-c945-4337-8a3e-4da254902c44 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1531 microversion: 2.1 time: 2.555027 Sep 19 15:02:40.645703 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2080/4183] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:38 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1531 bytes in 2558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:40.656901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:40.657510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:40.659195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:40.677178 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79607673-905b-427a-82f1-a9a46e8c7289 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 3.257643 Sep 19 15:02:40.678013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:40.678530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:40.679033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:40.681686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:40.682312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:40.685998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:40.704716 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2104/4184] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:37 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 3284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:40.710874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-af586d8b-f6a7-4b21-8773-11177dbe6cfc req-5dfab047-778d-4e05-813e-f671c4508bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad076e-097f-4d69-b3ed-fede15ad5ffa", "name": "network-vif-plugged", "status": "completed", "tag": "2b72fda7-5524-461e-bc6f-b19724ef1f7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:40.732130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-af586d8b-f6a7-4b21-8773-11177dbe6cfc req-5dfab047-778d-4e05-813e-f671c4508bb0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:40.732976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-af586d8b-f6a7-4b21-8773-11177dbe6cfc req-5dfab047-778d-4e05-813e-f671c4508bb0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:40.733574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-af586d8b-f6a7-4b21-8773-11177dbe6cfc req-5dfab047-778d-4e05-813e-f671c4508bb0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:40.749067 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-af586d8b-f6a7-4b21-8773-11177dbe6cfc req-5dfab047-778d-4e05-813e-f671c4508bb0 service nova] Creating event network-vif-plugged:2b72fda7-5524-461e-bc6f-b19724ef1f7c for instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa on n-h2-858384-1 Sep 19 15:02:40.758913 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-af586d8b-f6a7-4b21-8773-11177dbe6cfc req-5dfab047-778d-4e05-813e-f671c4508bb0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049676 Sep 19 15:02:40.761450 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2105/4185] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:41.694214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:41.696279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:41.720497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:41.725877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:41.726349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:41.727335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:41.727990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:41.728633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:42.384468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:42.398909 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00edb341-37f7-4b08-87d9-dfb8fa7b4b21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 1.751633 Sep 19 15:02:42.404050 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2081/4186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:40 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:42.414995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:42.415881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:42.441133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:42.445229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:42.448469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:42.449905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:42.453856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:42.455275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:43.305574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:43.325879 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-723e23f6-a0a1-4aee-a484-289acf2d919a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 1.636515 Sep 19 15:02:43.339858 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2106/4187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:41 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:43.350800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c7436cde-42f1-4a71-a4b7-d3173f3e4313 req-05592692-1bfd-48df-8657-0381a44223bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:43.363963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c7436cde-42f1-4a71-a4b7-d3173f3e4313 req-05592692-1bfd-48df-8657-0381a44223bd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:43.364765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c7436cde-42f1-4a71-a4b7-d3173f3e4313 req-05592692-1bfd-48df-8657-0381a44223bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:43.366066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c7436cde-42f1-4a71-a4b7-d3173f3e4313 req-05592692-1bfd-48df-8657-0381a44223bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:43.411333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c7436cde-42f1-4a71-a4b7-d3173f3e4313 req-05592692-1bfd-48df-8657-0381a44223bd service nova] Creating event network-changed:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:02:43.441327 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c7436cde-42f1-4a71-a4b7-d3173f3e4313 req-05592692-1bfd-48df-8657-0381a44223bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099075 Sep 19 15:02:43.452506 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2107/4188] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:43.462241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:43.500226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:43.516460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:43.520214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:43.520883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:43.521866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:43.522500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:43.524123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:44.047413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:44.064800 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7d82322-a3b5-4120-a436-014c5dd9b0f3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.659357 Sep 19 15:02:44.080749 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2082/4189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:42 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:44.366817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:44.369022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:44.394531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:44.395096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:44.399675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:44.401577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:44.403071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:44.404656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:44.957500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:44.973908 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c979e984-4db2-426a-90ca-2eef4391b3f1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 1.516824 Sep 19 15:02:45.032454 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2108/4190] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:43 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:45.101319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:45.102339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:45.114476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:45.116842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:45.119081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:45.120120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:45.124498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:45.125369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:45.613084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:45.635738 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-340fe7ec-adae-4204-a831-48526fe8128a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 1.281814 Sep 19 15:02:45.637840 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2083/4191] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:44 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:46.010271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:46.011324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:46.026599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:46.029829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:46.030929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:46.032142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:46.033548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:46.034246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:46.673870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:46.694428 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-16a6c1ec-6be6-43b6-aa62-a959e5919a39 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1507 microversion: 2.1 time: 1.588539 Sep 19 15:02:46.699399 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2109/4192] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:45 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1507 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:46.714789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:46.715777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:46.727772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:46.728275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:46.728725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:46.729456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:46.729918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:46.730363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:47.299782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:47.331502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4ecdc70e-ecbe-422d-86ef-ea254e5bda3d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 1.325425 Sep 19 15:02:47.333063 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2084/4193] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:46 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:47.425525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:47.436490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97b0ec6b-19a8-45d6-a941-2838946076e7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.735725 Sep 19 15:02:47.446523 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2110/4194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:46 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:47.729844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:47.730488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:47.753844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:47.754348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:47.754813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:47.773384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:47.778656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:47.782080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:48.360732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:48.361362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:48.374866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:48.375647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:48.376283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:48.377209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:48.385142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:48.386072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:48.868793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:48.882569 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-45364ea4-7af5-4d42-a591-467ba69f9a35 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1504 microversion: 2.1 time: 1.158778 Sep 19 15:02:48.883610 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2085/4195] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:47 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1504 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:48.903196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:48.904608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:48.912493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:48.916293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:48.917922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:48.921998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:48.922941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:48.925591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:49.853515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:49.865649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4db09709-70c8-4331-9bc9-cd251199833e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 1.508770 Sep 19 15:02:49.871680 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2111/4196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:48 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:49.905653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-63b0f661-3b18-4408-8f36-d037106f346d req-d3704956-f1da-4347-94d5-21ee885da5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff06e0-7cb4-4c0c-b4cf-8ee962114447", "name": "network-vif-unplugged", "status": "completed", "tag": "e877584e-3c02-49c7-94f4-bd9b4b16da7f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:49.932931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-63b0f661-3b18-4408-8f36-d037106f346d req-d3704956-f1da-4347-94d5-21ee885da5be service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:49.933431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-63b0f661-3b18-4408-8f36-d037106f346d req-d3704956-f1da-4347-94d5-21ee885da5be service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:49.933876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-63b0f661-3b18-4408-8f36-d037106f346d req-d3704956-f1da-4347-94d5-21ee885da5be service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:49.964729 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-63b0f661-3b18-4408-8f36-d037106f346d req-d3704956-f1da-4347-94d5-21ee885da5be service nova] Creating event network-vif-unplugged:e877584e-3c02-49c7-94f4-bd9b4b16da7f for instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 on n-h2-858384-1 Sep 19 15:02:49.977064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-63b0f661-3b18-4408-8f36-d037106f346d req-d3704956-f1da-4347-94d5-21ee885da5be service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103689 Sep 19 15:02:49.979526 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2112/4197] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:49.998185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:49.998984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:50.015329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:50.015763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:50.017651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:50.018682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:50.019187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:50.019630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:50.406306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:50.421827 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a2a6f4ca-271b-403a-b017-9fce841073d6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 1.531270 Sep 19 15:02:50.428291 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2086/4198] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:48 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:50.584634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:50.604811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ccf6f98a-1231-4f02-aa67-24b726537916 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1504 microversion: 2.1 time: 0.617112 Sep 19 15:02:50.607540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2113/4199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:49 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:50.899263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:50.900272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:50.918902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:50.920940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:50.921984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:50.925100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:50.926227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:50.929434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:51.462022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:51.462797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:51.472932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:51.494861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:51.498396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:51.498396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:51.499678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:51.502468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:51.503034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:51.821565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:51.851899 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62c8ee64-42b7-4735-b99e-c3e889d19783 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 0.959791 Sep 19 15:02:51.852785 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2087/4200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:50 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:51.867540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:51.870572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:51.889747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:51.889747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:51.889999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:51.890543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:51.896465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:51.910392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:52.563192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:52.588323 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1297d3e8-5630-4bd7-a164-0e56da017d57 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 1.135397 Sep 19 15:02:52.591097 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2114/4201] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:51 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:52.598144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ae4b7e13-becc-483d-82a1-f444014fc569 req-f8fcc0f0-86ce-45e5-a466-a8e14356c81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7dd5bd1-58c0-43fa-af56-0b78c531edd1", "name": "network-vif-plugged", "status": "completed", "tag": "e40e70f0-a86e-441f-b714-f74d10663386"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:52.638179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ae4b7e13-becc-483d-82a1-f444014fc569 req-f8fcc0f0-86ce-45e5-a466-a8e14356c81e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:52.639997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ae4b7e13-becc-483d-82a1-f444014fc569 req-f8fcc0f0-86ce-45e5-a466-a8e14356c81e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:52.640536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ae4b7e13-becc-483d-82a1-f444014fc569 req-f8fcc0f0-86ce-45e5-a466-a8e14356c81e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:52.674992 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ae4b7e13-becc-483d-82a1-f444014fc569 req-f8fcc0f0-86ce-45e5-a466-a8e14356c81e service nova] Creating event network-vif-plugged:e40e70f0-a86e-441f-b714-f74d10663386 for instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 on n-h2-858384-1 Sep 19 15:02:52.684864 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ae4b7e13-becc-483d-82a1-f444014fc569 req-f8fcc0f0-86ce-45e5-a466-a8e14356c81e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090943 Sep 19 15:02:52.689599 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2115/4202] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:52.787722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:52.809261 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-11e035d6-9d90-4b2d-9b52-4a702f7e1f6e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1504 microversion: 2.1 time: 0.952769 Sep 19 15:02:52.813228 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2088/4203] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:51 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1504 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:52.887652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:52.888219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:52.930179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:52.930711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:52.931402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:52.932326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:52.932973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:52.933592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:53.320199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:53.333093 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-15e39132-298d-4a67-8a87-dcb9fa104075 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 0.450332 Sep 19 15:02:53.334795 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2116/4204] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:52 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:53.622121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:53.622850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:53.651729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:53.652932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:53.654233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:53.655865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:53.661075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:53.662933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:53.840881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:53.841557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:53.878211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:53.879391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:53.882435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:53.884515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:53.894124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:53.894874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:53.959760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:53.972972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8335f09c-463e-4132-ade1-84e091624e8a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.356806 Sep 19 15:02:53.996760 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2089/4205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:53 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:54.220611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:54.239094 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a92d473-d838-4727-8fc8-0007eccde154 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 200 len: 1447 microversion: 2.1 time: 0.402857 Sep 19 15:02:54.244966 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2117/4206] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:53 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 1447 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:54.269907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:54.271453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:54.278797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:54.279654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:54.280288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:54.281210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:54.281867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:54.282507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:54.359949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:54.360899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:54.379633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:54.381485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:54.383359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:54.384355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:54.387496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:54.389419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:54.717569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:54.728704 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8bf8fcb6-55f4-4af9-b650-dd1c6425415f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.464508 Sep 19 15:02:54.755759 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2090/4207] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:54 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:54.769128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:54.769844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:54.782163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:54.786007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:54.787082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:54.790182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:54.791385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:54.793868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:55.351968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:55.367325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f0f1eb7e-0f0c-4d05-ae19-4c91868de9bd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.601982 Sep 19 15:02:55.391048 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2091/4208] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:54 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:55.400296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:55.402333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:55.421718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:55.422711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:55.423402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:55.424342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:55.427966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:55.431252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:55.555751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:55.569555 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9bf3ad87-48ff-434f-853b-9eb449fcc1b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1320 microversion: 2.1 time: 1.213432 Sep 19 15:02:55.587411 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2118/4209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:54 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1320 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:55.601481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:55.603090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:55.617696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:55.618288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:55.620922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:55.621851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:55.622441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:55.623032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:56.641076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:56.653497 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d541b5c9-aa98-4a70-9bd4-b9722d86dd43 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 1.260906 Sep 19 15:02:56.664484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2092/4210] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:55 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:56.680464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:56.687427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:56.722133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:56.723500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:56.726937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:56.729804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:56.732471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:56.734721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:56.998194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:57.017594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f4d1842-8d87-42c0-b43c-f9d5fa175fe7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.427763 Sep 19 15:02:57.018869 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2119/4211] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:55 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:57.048598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:57.049497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:57.063192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:57.064055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:57.064678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:57.065586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:57.069591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:57.070052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:57.112442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:57.125979 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-defb56e2-785c-4cb9-8929-00f0c116e666 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1500 microversion: 2.1 time: 0.459901 Sep 19 15:02:57.127805 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2093/4212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:56 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1500 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:57.165077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:57.166189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:57.179326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:57.180373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:57.181333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:57.182346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:57.184045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:57.188115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:57.736065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:57.747349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:57.749890 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-efff6508-3d94-425c-aec8-d823eef52b6d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.705359 Sep 19 15:02:57.750509 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2120/4213] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:57 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:57.782326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:57.790994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:57.824251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:57.830121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:57.830665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:57.832717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:57.833764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:57.834318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.138962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:58.150618 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-72ee28db-9f31-4988-9a92-b62db2bd63dd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1500 microversion: 2.1 time: 0.990378 Sep 19 15:02:58.162877 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2094/4214] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:57 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1500 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:58.162877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d77b66a-e9d0-4350-86b4-31efa4d476aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:58.184539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d77b66a-e9d0-4350-86b4-31efa4d476aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.185438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d77b66a-e9d0-4350-86b4-31efa4d476aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.186216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d77b66a-e9d0-4350-86b4-31efa4d476aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.273817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d77b66a-e9d0-4350-86b4-31efa4d476aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Going to try to stop instance {{(pid=128730) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 15:02:58.372883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d77b66a-e9d0-4350-86b4-31efa4d476aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.219028 Sep 19 15:02:58.374269 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2095/4215] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:58 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:02:58.384173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.385268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:58.393985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.394934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.395677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.397640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.398434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.399138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.444172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:58.445435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:58.453209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:02:58.464865 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5c49018a-ccf5-4799-817a-12207afe8321 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.713210 Sep 19 15:02:58.477753 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2121/4216] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:57 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:58.494650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.496043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:58.512886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.515533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.516182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.519060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.526054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.526869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.588244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff6d2980-b397-4342-a766-d0584a78550f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 204 len: 0 microversion: 2.1 time: 0.211565 Sep 19 15:02:58.588999 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2096/4217] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:02:58 2022] DELETE /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:02:58.607076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.608561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:58.627885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.629005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.629459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.630821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.631374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.636185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:00.358450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:00.368897 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26277930-38cb-4f49-aac0-561dbcd26531 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1506 microversion: 2.1 time: 1.775213 Sep 19 15:03:00.381041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:00.395020 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2097/4218] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:58 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1506 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:00.403289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:00.404244 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d867aef8-e664-44ad-a04c-5b499dccec90 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 1.924809 Sep 19 15:03:00.404851 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2122/4219] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:58 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:00.405638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:00.428146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.429129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.429849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:00.440618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.441492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.447332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.410077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.411009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:01.412878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:01.431088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.433015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.435603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2834944-3728-4246-8559-61300b493d58 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 1.038587 Sep 19 15:03:01.438286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.448224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.448224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.448224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.449160 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2098/4220] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:00 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:01.458005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.459204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:01.481519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.482305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.482976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.483898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.484523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.485129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:02.524490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:02.541519 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa5cd2b3-ed06-4732-aa07-f360474de956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 1.087964 Sep 19 15:03:02.563622 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2099/4221] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:02.577639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:02.578621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:02.583479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:02.600515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:02.601072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:02.602061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:02.606264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:02.607302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:02.608812 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-50f3b0e8-9144-40e1-a3e8-e2d06c58a8f4 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1506 microversion: 2.1 time: 1.202707 Sep 19 15:03:02.609551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:02.619383 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2123/4222] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1506 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:03.186299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:03.206728 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59a95ea3-6f3e-49e0-9895-89c5069574b4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.641447 Sep 19 15:03:03.211730 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2100/4223] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:02 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:03.453584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e2169161-f710-4cca-a020-53f81b565de6 req-a820f759-9359-4242-b8f1-598018fa0d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7dd5bd1-58c0-43fa-af56-0b78c531edd1", "name": "network-vif-deleted", "tag": "e40e70f0-a86e-441f-b714-f74d10663386"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:03.500778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e2169161-f710-4cca-a020-53f81b565de6 req-a820f759-9359-4242-b8f1-598018fa0d4b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.503696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e2169161-f710-4cca-a020-53f81b565de6 req-a820f759-9359-4242-b8f1-598018fa0d4b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.506606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e2169161-f710-4cca-a020-53f81b565de6 req-a820f759-9359-4242-b8f1-598018fa0d4b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.567129 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e2169161-f710-4cca-a020-53f81b565de6 req-a820f759-9359-4242-b8f1-598018fa0d4b service nova] Creating event network-vif-deleted:e40e70f0-a86e-441f-b714-f74d10663386 for instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 on n-h2-858384-1 Sep 19 15:03:03.577565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:03.580588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:03.604359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.610681 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e2169161-f710-4cca-a020-53f81b565de6 req-a820f759-9359-4242-b8f1-598018fa0d4b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161425 Sep 19 15:03:03.611975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.613348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.613782 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2124/4224] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:03.614831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.617728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.618426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.641944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:03.642976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:03.667280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.667792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.668241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.670697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.676625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.678153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.775366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.776134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.776748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.779341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lazy-loading 'fault' on Instance uuid a7dd5bd1-58c0-43fa-af56-0b78c531edd1 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:03.908680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:03.929526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-690fb409-2be7-4bfb-8108-edeee91cb0db tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 200 len: 1310 microversion: 2.1 time: 0.291657 Sep 19 15:03:03.930780 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2125/4225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:03 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:04.241713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:04.242830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:04.267731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:04.269321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:04.275102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:04.276832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:04.278177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:04.291594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:04.644424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:04.691804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-22b66984-1c46-4b8b-8ac3-4060a2f2ad17 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 1.117977 Sep 19 15:03:04.695721 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2101/4226] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:03 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:04.870266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:04.881922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7fc5a369-dfd7-4582-916f-6486cc33f465 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.645404 Sep 19 15:03:04.887350 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2126/4227] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:04 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:04.965924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:04.966844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:04.974987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:04.976524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:04.977810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:04.981073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:04.983581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:04.985663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.029137 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 HTTP/1.1 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a7dd5bd1-58c0-43fa-af56-0b78c531edd1'} Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:05.042683 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:05.048262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:05.051106 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f19b69ef-88de-4136-9efc-f8fac648af36 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 404 len: 111 microversion: 2.1 time: 0.082525 Sep 19 15:03:05.051106 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2102/4228] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:04 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:05.066650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-999dc43a-8e1d-4207-a8e7-8dcdc93e1e2f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: .version_select at 0x7fde28b8fdc0>, body: {"keypair": {"name": "tempest-key-694304117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1DKQzG5J/7GvXekaUbmdeB0EqxHHnn1EGQQ352IO05ocTKWqPxEpnvxUXeKvXHJNh1tZeALhryC7G14pD5nVxdgeAYB4ac2mgyfOB4kuY1x6JVzWk6d/Et4S7Cg0Mwpw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:05.098055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-999dc43a-8e1d-4207-a8e7-8dcdc93e1e2f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:03:05.105430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-999dc43a-8e1d-4207-a8e7-8dcdc93e1e2f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:03:05.168176 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-999dc43a-8e1d-4207-a8e7-8dcdc93e1e2f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.106468 Sep 19 15:03:05.171651 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2127/4229] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:03:05 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:05.186305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d164712d-8b21-42d1-9aa7-06374c0c3eae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '.version_select at 0x7fde28d65160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:05.191140 n-d-858384-1 devstack@n-api.service[128730]: WARNING oslo_db.sqlalchemy.utils [None req-d164712d-8b21-42d1-9aa7-06374c0c3eae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 19 15:03:05.200055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d164712d-8b21-42d1-9aa7-06374c0c3eae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019028 Sep 19 15:03:05.201003 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2103/4230] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 15:03:05 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:05.553220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1963410508", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-key-694304117", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:05.723203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:05.724711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:05.745572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.747051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.748067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.749322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.751446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.756355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:06.401286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:06.422853 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3c190e5-d2cd-471a-9ba1-e1441131dde8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 0.702809 Sep 19 15:03:06.440324 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2104/4231] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:05 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:06.447735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:06.448599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:06.462297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:06.466305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:06.470643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:06.471950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:06.473950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:06.474610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:06.859352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:06.882204 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd821476-9c04-47ba-bb03-dd20ab0a8ecb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.440816 Sep 19 15:03:06.886686 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2105/4232] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:06 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:07.460220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:07.461920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:07.466219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:07.484193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:07.485842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:07.488800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:07.491231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:07.491734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:07.492174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:07.842631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:03:07.999479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:08.015597 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f629056d-da5a-41f8-ba3b-61a0cc15fb32 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1678 microversion: 2.1 time: 0.567778 Sep 19 15:03:08.030868 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2106/4233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:07 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1678 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:08.036503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:08.043872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:08.068878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:08.069533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:08.074117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:08.074117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:08.074117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:08.075250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:08.681744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:08.696060 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56ddfb3e-009a-4521-9298-c3e5f95ad273 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1526 microversion: 2.1 time: 0.662902 Sep 19 15:03:08.700800 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2107/4234] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:08 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1526 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:09.223156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.224423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.234733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.235764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.236750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.238010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.238847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.239855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.321424 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0c7aad4-8604-441a-96f5-cf81b73ff397 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/ips" status: 200 len: 151 microversion: 2.20 time: 0.618863 Sep 19 15:03:09.322737 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2108/4235] 10.222.0.81 () {60 vars in 1289 bytes} [Mon Sep 19 15:03:08 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/ips => generated 151 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:03:09.329630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.332030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.339596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.340398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.341478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.342605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.343340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.343985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.946694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:09.967911 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a547903-28b4-42dc-bada-891ed0b0d47d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1655 microversion: 2.1 time: 0.641562 Sep 19 15:03:09.968886 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2109/4236] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:09 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1655 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:09.981827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.984389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.998697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.002695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.005434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:10.007698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.008372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.008978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:10.559712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:03:10.560787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:03:10.561509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:03:10.562160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:03:10.563030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:03:10.583679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.586451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.587191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:10.592367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.593125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.593813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:10.632398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:03:10.644371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:03:10.728805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:03:10.732647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:03:10.828150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:10.842044 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-60b33ab1-f3aa-40f8-ac20-64b360db8e4d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1508 microversion: 2.1 time: 0.867527 Sep 19 15:03:10.843106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82afb3f2-bf06-4dcb-867c-1ef81309505a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.295448 Sep 19 15:03:10.847237 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2128/4237] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 5301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:03:10.853292 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2110/4238] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:09 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1508 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:10.871963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-643e9300-5428-4d27-8f64-7d2631592751 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:10.873611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-643e9300-5428-4d27-8f64-7d2631592751 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:10.880944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8ba5a41-7f08-4238-b1ba-55d3a7050657 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:10.903192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8ba5a41-7f08-4238-b1ba-55d3a7050657 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.903754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8ba5a41-7f08-4238-b1ba-55d3a7050657 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.904593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8ba5a41-7f08-4238-b1ba-55d3a7050657 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:11.000952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8ba5a41-7f08-4238-b1ba-55d3a7050657 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Going to try to start instance {{(pid=128730) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 15:03:11.123478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8ba5a41-7f08-4238-b1ba-55d3a7050657 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.253742 Sep 19 15:03:11.124354 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2111/4239] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:03:10 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:03:11.141621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:11.142402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:11.173674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:11.176250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:11.178307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:11.179262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:11.183224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:11.183713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:11.193217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:11.282663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-643e9300-5428-4d27-8f64-7d2631592751 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:11.293672 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-643e9300-5428-4d27-8f64-7d2631592751 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1228 microversion: 2.1 time: 0.430840 Sep 19 15:03:11.294276 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2129/4240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:10 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1228 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:11.875296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:11.876598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:11.912620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:11.913815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:11.916321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:11.917369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:11.918046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:11.918698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:12.451777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:12.472450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a869782f-a912-4f43-81e7-8d6e13fda5d2 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1664 microversion: 2.1 time: 1.329612 Sep 19 15:03:12.494788 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2112/4241] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:11 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1664 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:12.494788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-56f0c637-60cd-4c18-8c1d-451c3390bd1f req-7da09445-3fb2-41b5-9f8c-1846a7e98ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad076e-097f-4d69-b3ed-fede15ad5ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "2b72fda7-5524-461e-bc6f-b19724ef1f7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:12.519940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56f0c637-60cd-4c18-8c1d-451c3390bd1f req-7da09445-3fb2-41b5-9f8c-1846a7e98ec9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:12.519940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56f0c637-60cd-4c18-8c1d-451c3390bd1f req-7da09445-3fb2-41b5-9f8c-1846a7e98ec9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:12.519940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-56f0c637-60cd-4c18-8c1d-451c3390bd1f req-7da09445-3fb2-41b5-9f8c-1846a7e98ec9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:12.549242 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-56f0c637-60cd-4c18-8c1d-451c3390bd1f req-7da09445-3fb2-41b5-9f8c-1846a7e98ec9 service nova] Creating event network-vif-unplugged:2b72fda7-5524-461e-bc6f-b19724ef1f7c for instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa on n-h2-858384-1 Sep 19 15:03:12.558486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-56f0c637-60cd-4c18-8c1d-451c3390bd1f req-7da09445-3fb2-41b5-9f8c-1846a7e98ec9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083117 Sep 19 15:03:12.563103 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2113/4242] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:12.579059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:12.580039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:12.595659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:12.597861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:12.602312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:12.605365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:12.606081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:12.625146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:12.819721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:12.830291 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b5dfb6d-c548-4186-96c8-4bbcfd4dfddd tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1232 microversion: 2.1 time: 0.265585 Sep 19 15:03:12.835565 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2114/4243] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:12 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1232 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:12.855565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:12.856713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:12.863750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:12.864745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:12.865448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:12.866485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:12.867234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:12.867914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:12.942068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lazy-loading 'flavor' on Instance uuid de8cd21b-27f9-4ef6-85ed-950f0b42b850 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:13.224446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:13.245925 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca47c60b-1938-4a23-b5a2-2eb53ab7d8df tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1508 microversion: 2.1 time: 1.375935 Sep 19 15:03:13.249609 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2130/4244] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:11 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1508 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:13.540576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:13.541287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:13.549646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:13.550306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:13.551477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:13.553093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:13.553585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:13.554210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:13.574782 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c6d128b4-b028-40af-b917-d5aee062cdbc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/action" status: 202 len: 0 microversion: 2.20 time: 0.737773 Sep 19 15:03:13.589603 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2115/4245] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 15:03:12 2022] POST /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:03:13.608164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:13.621712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:13.648991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:13.654660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:13.656126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:13.657745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:13.662037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:13.665492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:14.585461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:14.604939 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfa3a563-aa2c-4392-bff1-846fd760bb86 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1664 microversion: 2.1 time: 1.069652 Sep 19 15:03:14.616400 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2131/4246] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:13 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1664 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:14.634378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:14.640185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:14.659924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:14.665579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:14.668595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:14.670165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:14.671084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:14.671790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:14.836095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:14.863753 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8129b612-4da8-44a7-9c99-082db37ef124 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1286 microversion: 2.1 time: 0.244442 Sep 19 15:03:14.872367 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2132/4247] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:14 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:14.894725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:14.922385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:14.925834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:14.940144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:14.947935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:14.955631 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78e8211d-ba5e-4715-b091-9675b1885c5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1723 microversion: 2.20 time: 1.364269 Sep 19 15:03:14.966816 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2116/4248] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:13 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1723 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:14.967067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:14.967067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:14.967067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:14.968100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:14.969414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:14.970125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:15.282478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:15.304199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ce3460a8-9e87-41ad-b827-e3e42dc628f9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1451 microversion: 2.1 time: 0.426551 Sep 19 15:03:15.306711 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2133/4249] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:14 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1451 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:15.329648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:15.330304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:15.343741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:15.344245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:15.344689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:15.345409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:15.345874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:15.346300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:15.644938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:15.646279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:15.658461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:15.659003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:15.659623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:15.660436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:15.661016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:15.661866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:16.603987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:16.618251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32271207-a573-4d8b-acf6-576a91e6034a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1451 microversion: 2.1 time: 1.288480 Sep 19 15:03:16.619930 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2117/4250] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:15 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1451 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:16.679045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:16.683278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:16.690932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:16.691967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:16.692968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:16.696302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:16.697206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:16.697981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:16.800886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:16.809810 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a96d190-d107-4def-8d83-dd66faffb7f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.168725 Sep 19 15:03:16.827218 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2134/4251] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:15 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:16.836809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:16.837478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:16.844923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:16.845436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:16.846010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:16.846576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:16.847062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:16.847897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.014429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:17.023703 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0629cffb-9193-4c34-8511-239debdda8d6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1286 microversion: 2.1 time: 0.401816 Sep 19 15:03:17.025093 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2118/4252] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:16 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1286 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:17.030237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:17.031077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:17.037728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.038506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.039754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.040656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.041277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.041872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.082538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lazy-loading 'flavor' on Instance uuid c3ad076e-097f-4d69-b3ed-fede15ad5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:17.114583 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'shelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state shelved_offloaded Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 14 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: {"shelve": {}} Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'shelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state shelved_offloaded Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'shelve': {}}} Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:03:17.116626 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state shelved_offloaded Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state shelved_offloaded Sep 19 15:03:17.121903 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:17.129161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'shelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state shelved_offloaded {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:17.130170 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26435860-4331-46c2-9d04-3e537c6f5552 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 155 microversion: 2.1 time: 0.103836 Sep 19 15:03:17.130820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2119/4253] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:03:17 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:03:17.136687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:17.137308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:17.153830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.154339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.155088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.159399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.160087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.160450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.577958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:17.604531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:17.608055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:17.610495 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-448acf83-cbc2-4021-b908-62b7c0540041 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1723 microversion: 2.20 time: 0.785519 Sep 19 15:03:17.628284 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2135/4254] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:16 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1723 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:17.640367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:17.641262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:17.650341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.651202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.651795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.652981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.653872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.654475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.752225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128731) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 15:03:17.871910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:17.893788 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2752fd09-3c6b-481b-8e3c-1fa9437eea22 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.758469 Sep 19 15:03:17.919613 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2120/4255] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:17 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:17.940572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:17.945095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:17.969853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.970362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.970836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.978985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:17.979842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:17.980458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:17.998891 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-60f8a587-759e-4760-8b95-5ceef731d765 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.364351 Sep 19 15:03:18.004447 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2136/4256] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:03:17 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:03:18.028606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:18.029501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:18.057960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:18.061098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:18.061738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:18.062827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:18.063498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:18.064079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:18.758184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:18.767858 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9caaa974-4d27-4092-8c3c-9359200d75e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1459 microversion: 2.1 time: 0.758713 Sep 19 15:03:18.771904 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2137/4257] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:18 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1459 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:18.781326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:18.781841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:18.805291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:18.805992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:18.806262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:18.807092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:18.807799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:18.810138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:18.923618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:18.936424 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e4292fe1-9d41-4308-bf78-aa1577dc10aa tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.014320 Sep 19 15:03:18.943376 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2121/4258] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:17 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:18.957053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:18.959746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:18.976930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:18.977744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:18.987032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:18.988153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:18.988807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:18.991438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:19.820599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:19.828627 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0488ebff-208d-4a18-a9bf-a713c783dc1a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 1.055391 Sep 19 15:03:19.829219 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2138/4259] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:18 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:19.849122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:19.849757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:19.862429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:19.862971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:19.863411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:19.864194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:19.864669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:19.865105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:19.897110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:20.342615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:20.358776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:20.363735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:20.371410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1983881b-7710-4030-bdd1-264f2dbb78c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1723 microversion: 2.20 time: 1.422906 Sep 19 15:03:20.373385 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2122/4260] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:18 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1723 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:20.382478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:20.383880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:20.397279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:20.398003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:20.398679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:20.415912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:20.417225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:20.417913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:20.616909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:21.145941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:21.149218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:21.156466 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d9a6214-7e0d-4ac1-95d7-a0fbc851ac1d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.781755 Sep 19 15:03:21.165319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b49b7a4-7e9e-474b-9e63-aa19a5320cbd tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.334995 Sep 19 15:03:21.172839 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2123/4261] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:20 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:21.197785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:21.198423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:21.200377 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2139/4262] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:19 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:21.216810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:21.217754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:21.218508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:21.219535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:21.220179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:21.221262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:21.235045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:21.236007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:21.245711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:21.246644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:21.247621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:21.248626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:21.249276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:21.250495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:21.304507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:22.276421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:22.286945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-95230c9b-fe96-4f53-a2fa-da3a03d08f7e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 1.084798 Sep 19 15:03:22.288395 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2140/4263] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:21 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:22.298032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:22.300001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:22.314716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:22.319897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:22.326618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:22.327458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:22.328505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:22.329457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:22.329922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:22.330519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:22.334294 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a2eb5f4-a8e3-4a9a-845d-8243ab22d33e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 1.159488 Sep 19 15:03:22.336498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2124/4264] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:21 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:22.342896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:22.343843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:22.353106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:22.355009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:22.355652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:22.356385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:22.357130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:22.357719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.258579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:23.268228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:23.272549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:23.279072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2dc1ff59-3dcf-486e-b1fb-0b1cc5eb63e7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1723 microversion: 2.20 time: 0.989321 Sep 19 15:03:23.282731 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2141/4265] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:22 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1723 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:23.293189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:23.296405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:23.315387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.316402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.317194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.318418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.319298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.323641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.355517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:23.380119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lazy-loading 'flavor' on Instance uuid 7d5b990e-c5d3-4ead-83c5-138ba5427808 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:23.417254 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b51616f-6fc5-41a0-b6d0-671f87dc48ce tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 1.078980 Sep 19 15:03:23.425620 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2125/4266] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:22 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:23.523446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd12c103-382d-417f-81d1-8d83957e7725 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.238698 Sep 19 15:03:23.525105 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2142/4267] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:03:23 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:03:23.546306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:23.547159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:23.562946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.563612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.564057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.564998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.565472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.574467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.603977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e3aebd7b-b214-4a3d-8eed-9373fb4b4d0a req-5cf028df-c634-4c17-ba67-e21239bd57bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168d4a73-a50f-4b92-886f-fc483214b3be", "tag": "55ba94b3-1ae9-4361-a718-e99f0481ca55"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:23.618516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e3aebd7b-b214-4a3d-8eed-9373fb4b4d0a req-5cf028df-c634-4c17-ba67-e21239bd57bd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.620377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e3aebd7b-b214-4a3d-8eed-9373fb4b4d0a req-5cf028df-c634-4c17-ba67-e21239bd57bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.628431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e3aebd7b-b214-4a3d-8eed-9373fb4b4d0a req-5cf028df-c634-4c17-ba67-e21239bd57bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.645191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e3aebd7b-b214-4a3d-8eed-9373fb4b4d0a req-5cf028df-c634-4c17-ba67-e21239bd57bd service nova] Creating event network-changed:55ba94b3-1ae9-4361-a718-e99f0481ca55 for instance 168d4a73-a50f-4b92-886f-fc483214b3be on n-h2-858384-1 Sep 19 15:03:23.661885 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e3aebd7b-b214-4a3d-8eed-9373fb4b4d0a req-5cf028df-c634-4c17-ba67-e21239bd57bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217844 Sep 19 15:03:23.665900 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2126/4268] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:23.682788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:23.683597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:23.697008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.697609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.700869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:23.701999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:23.702571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:23.703890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:24.375381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:24.384512 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06ab48c4-f0a4-406a-8fc1-164655e3d544 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 0.857872 Sep 19 15:03:24.395699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2143/4269] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:23 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:24.400911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:24.402023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:24.418630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:24.419468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:24.420373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:24.421264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:24.421955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:24.422723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:24.875236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:24.885777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-821d226f-8866-4234-8035-fd7b71104ca6 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1676 microversion: 2.1 time: 1.218534 Sep 19 15:03:24.899467 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2127/4270] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:23 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1676 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:24.927243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:24.928497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:24.955470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:24.958827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:24.960154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:24.962104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:24.962881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:24.963538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:24.980890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:25.180526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:25.199187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:25.205920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:25.210697 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a18bd8b8-2622-46a2-870a-80d900bcd90d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1744 microversion: 2.20 time: 0.813444 Sep 19 15:03:25.213263 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2144/4271] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:24 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1744 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:25.432428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:25.433995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:25.450442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:25.451555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:25.452264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:25.454176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:25.455376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:25.459778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:25.916813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:25.947080 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d6f97aad-4823-4a82-9778-3fbcf6a784f7 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 1.025666 Sep 19 15:03:25.965806 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2128/4272] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:24 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:25.980843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:25.981797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:25.991094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:25.991946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:25.992575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:25.993510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:25.994317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:25.995099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:26.034021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:26.050045 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b68f5e7a-0296-4dd3-8119-d4f61f89537a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 0.630248 Sep 19 15:03:26.059820 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2145/4273] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:25 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:26.242613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:26.243641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:26.258733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:26.264191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:26.264663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:26.265434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:26.265881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:26.266315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:26.412614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:26.435395 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c840d6cd-1ba4-4c60-8d5f-e8a4a05a3de8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1659 microversion: 2.1 time: 0.466642 Sep 19 15:03:26.452888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2129/4274] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:25 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1659 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:26.475387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:26.476431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:26.530378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:26.532749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:26.533234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:26.534001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:26.534489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:26.534961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:26.924452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90dd1100-66b9-447d-a6cd-390dc84143c7 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action" status: 202 len: 0 microversion: 2.1 time: 0.456810 Sep 19 15:03:26.932519 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2130/4275] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:03:26 2022] POST /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:03:26.967417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:26.970532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:27.030019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:27.034184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:27.037004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:27.043255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:27.044419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:27.046524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:27.356090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:27.379872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:27.383953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:27.390878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e7c6c8ca-a706-46be-9f8f-126f55a7c300 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 1.152940 Sep 19 15:03:27.392001 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2146/4276] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:26 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:03:27.397138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:27.400289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:27.417203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:27.418031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:27.418773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:27.421883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:27.422636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:27.423280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:28.249250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:28.259739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f857db5-a04f-4326-8176-9c516522ca1c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1665 microversion: 2.1 time: 1.323725 Sep 19 15:03:28.261771 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2131/4277] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:26 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1665 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:28.289015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:28.305508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:28.326403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:28.327795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:28.329207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:28.331902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:28.334486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:28.335262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:28.854517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:28.905206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ed54028-dcca-439c-aded-42ad97a41cd8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 1.497118 Sep 19 15:03:28.907639 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2147/4278] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:27 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:28.917789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:28.925820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:28.948542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:28.954075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:28.956511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:28.958099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:28.963771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:28.964595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:29.449589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:29.481170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:29.486149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:29.489091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1fdf0d4-4fc3-4394-b2c5-099726612804 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.578523 Sep 19 15:03:29.496957 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2148/4279] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:28 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:29.521500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:29.544816 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6833f3e-f235-4fbf-95e7-3105da0c45c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 1.272084 Sep 19 15:03:29.547448 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2132/4280] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:28 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:29.568486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:29.572396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:29.593949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:29.600128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:29.601106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:29.604376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:29.608781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:29.611830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:29.904944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-02cc4806-3976-4c29-b582-72a533d4c455 req-5f6e258b-dcb0-4172-9110-c1a4e4c3c5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "name": "network-vif-plugged", "status": "completed", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:29.942955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-02cc4806-3976-4c29-b582-72a533d4c455 req-5f6e258b-dcb0-4172-9110-c1a4e4c3c5ee service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:29.943752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-02cc4806-3976-4c29-b582-72a533d4c455 req-5f6e258b-dcb0-4172-9110-c1a4e4c3c5ee service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:29.944213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-02cc4806-3976-4c29-b582-72a533d4c455 req-5f6e258b-dcb0-4172-9110-c1a4e4c3c5ee service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:29.994693 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-02cc4806-3976-4c29-b582-72a533d4c455 req-5f6e258b-dcb0-4172-9110-c1a4e4c3c5ee service nova] Creating event network-vif-plugged:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:03:30.025849 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-02cc4806-3976-4c29-b582-72a533d4c455 req-5f6e258b-dcb0-4172-9110-c1a4e4c3c5ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.526273 Sep 19 15:03:30.033576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2149/4281] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:30.060347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:30.065569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:30.091306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:30.100621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:30.101219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:30.102002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:30.114379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:30.115656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:30.896618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:30.911222 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ea343c3-22bc-451a-beea-d3f97fef7c28 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.869938 Sep 19 15:03:30.938395 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2150/4282] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:30 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:30.949243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:30.959895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:30.972119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:30.975665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:30.979414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:30.980364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:30.980973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:30.981604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:31.225205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:31.236585 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d5341655-40ef-47df-be87-7798a5b0e20a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1665 microversion: 2.1 time: 1.686106 Sep 19 15:03:31.237092 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2133/4283] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:29 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1665 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:31.256856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:31.257785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:31.274059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:31.274651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:31.275174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:31.275925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:31.276386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:31.277016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:31.730576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:31.746112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:31.753746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:31.760751 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4ea5f0a-9c3d-4443-9f04-70309672cd5a tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.820673 Sep 19 15:03:31.761671 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2151/4284] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:30 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:31.896031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:31.906451 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b412f5d3-b567-4a13-a1f4-73f1fc79414e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 0.666132 Sep 19 15:03:31.920518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2134/4285] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:31 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:31.945797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:31.947869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:31.970395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:31.972690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:31.974239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:31.979994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:31.982742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:31.983633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:32.274483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:32.277006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:32.307371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:32.310131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:32.319737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:32.321391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:32.322077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:32.322693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:32.405861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:32.434398 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ceece0e-a7be-466a-a616-ae0fa8036dbd tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.492840 Sep 19 15:03:32.451560 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2152/4286] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:31 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:32.805140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:32.805410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:32.806443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:32.819141 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a899f27f-72fd-4c23-88b8-a83cab39b0f8 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1665 microversion: 2.1 time: 0.550863 Sep 19 15:03:32.824748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:32.827091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:32.831045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:32.832591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:32.835932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:32.836708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:32.841639 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2135/4287] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:32 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1665 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:32.936046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:32.936970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:32.950624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:32.951528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:32.952801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:32.953775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:32.954432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:32.955059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:33.247800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:33.262584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:33.267929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:33.272101 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56463476-4ce1-4361-ac89-6d79f03a1156 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.472225 Sep 19 15:03:33.273143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2153/4288] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:32 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:03:33.314720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d53392f4-d54a-4872-a745-fd89fb0fb875 req-26c883c3-78c9-4aa3-969c-4471cdff6a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168d4a73-a50f-4b92-886f-fc483214b3be", "name": "network-vif-plugged", "status": "completed", "tag": "55ba94b3-1ae9-4361-a718-e99f0481ca55"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:33.329694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:33.339595 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32623fe4-a8b1-4574-8394-e4a7d340c1be tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1328 microversion: 2.1 time: 0.407447 Sep 19 15:03:33.342536 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2136/4289] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:32 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1328 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:33.363383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d53392f4-d54a-4872-a745-fd89fb0fb875 req-26c883c3-78c9-4aa3-969c-4471cdff6a16 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:33.364570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d53392f4-d54a-4872-a745-fd89fb0fb875 req-26c883c3-78c9-4aa3-969c-4471cdff6a16 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:33.365006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d53392f4-d54a-4872-a745-fd89fb0fb875 req-26c883c3-78c9-4aa3-969c-4471cdff6a16 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:33.401610 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d53392f4-d54a-4872-a745-fd89fb0fb875 req-26c883c3-78c9-4aa3-969c-4471cdff6a16 service nova] Creating event network-vif-plugged:55ba94b3-1ae9-4361-a718-e99f0481ca55 for instance 168d4a73-a50f-4b92-886f-fc483214b3be on n-h2-858384-1 Sep 19 15:03:33.417092 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d53392f4-d54a-4872-a745-fd89fb0fb875 req-26c883c3-78c9-4aa3-969c-4471cdff6a16 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106953 Sep 19 15:03:33.430968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2154/4290] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:03:33.465118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:33.466536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:33.477032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:33.479671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:33.484226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:33.485783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:33.486505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:33.487953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:33.848409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:33.849250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:33.871381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:33.872525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:33.873263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:33.882241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:33.883131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:33.883866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:34.066533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:34.096404 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e510b2fa-8228-455b-8c02-785c22934c37 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.636112 Sep 19 15:03:34.109263 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2137/4291] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:33 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:34.308811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:34.309754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:34.325896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:34.340202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:34.341564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:34.346770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:34.350039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:34.354223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:34.749514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:34.762779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:34.793585 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e2086d3-8675-4b9b-8fb6-e33326f392ab tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.947756 Sep 19 15:03:34.822576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2155/4292] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:33 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:34.866056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:34.868436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:34.910942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:34.915220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:34.916173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:34.920980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:34.921837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:34.927253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:35.196539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:35.220444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:35.222582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:35.228460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8cf11768-5937-4344-9926-d6ccb1ccc521 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.930569 Sep 19 15:03:35.236260 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2138/4293] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:34 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:35.265587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:35.274302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:35.326418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:35.327366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:35.328053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:35.330953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:35.335909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:35.336763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:35.813990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:35.834669 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8d505c22-5249-4a3a-9ab5-0abab10d3828 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1508 microversion: 2.1 time: 1.008967 Sep 19 15:03:35.835679 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2156/4294] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:34 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1508 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:35.853938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:35.854983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:35.867917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:35.869078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:35.871072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:35.872162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:35.872829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:35.874045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:36.100657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:36.116069 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be67cca5-1c78-48ff-a65e-19034abff8fe tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1668 microversion: 2.1 time: 0.878091 Sep 19 15:03:36.118519 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2139/4295] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:35 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1668 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:36.137156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:36.138727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:36.171469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:36.172973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:36.175855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:36.182178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:36.186124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:36.190531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:36.339413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:36.367704 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46afd82f-7e9b-498e-8001-b5d7ac13ddf8 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.530682 Sep 19 15:03:36.368726 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2157/4296] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:35 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:36.381129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:36.392508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:36.413164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:36.416420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:36.417269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:36.418217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:36.422974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:36.424172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:36.491982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:03:36.509801 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Working on deleting snapshot ed8c996a-5b51-4350-9694-8b2aeaae304f from shelved instance... Sep 19 15:03:36.670039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:36.684420 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-375c26cb-c49f-4f47-9e4a-50704f28a318 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1508 microversion: 2.1 time: 0.561643 Sep 19 15:03:36.685304 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2140/4297] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:36 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1508 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:36.702177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:36.706658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:36.729418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:36.730446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:36.733723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:36.734788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:36.740077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:36.740915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:37.225256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:37.251660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:37.257270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:37.263365 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d468ed13-1dcd-4f50-855a-8775b0db0585 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.576700 Sep 19 15:03:37.264850 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2141/4298] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:36 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:37.273953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:37.276491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:37.292003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:37.294309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:37.296752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:37.301775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:37.302578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:37.303300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:37.366736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:03:37.528314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:37.614549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=74 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:37.696334 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32d24dce-1b85-486b-87e4-d0797f1a660e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 204 len: 0 microversion: 2.1 time: 0.429711 Sep 19 15:03:37.701528 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2142/4299] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:03:37 2022] DELETE /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:03:37.710009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:37.713546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:37.731403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:37.734819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:37.737444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:37.738718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:37.742361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:37.743118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:38.143431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:38.154201 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a3e1697-f6bd-41d4-b699-b839f00ea337 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.450879 Sep 19 15:03:38.154832 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2143/4300] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:37 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:38.180845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:38.181934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:38.188841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:38.189260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:38.189701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:38.190421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:38.190916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:38.191805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:38.503963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:38.518956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eaed4dea-feb0-4fc8-943d-0bebb33f5f98 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1514 microversion: 2.1 time: 0.345347 Sep 19 15:03:38.541313 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2144/4301] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:38 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:38.546981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:38.552629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:38.571258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:38.571794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:38.574231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:38.576245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:38.580351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:38.581183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:39.875698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:39.899653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:39.919477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:39.927388 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-187f4447-6379-4abb-bc46-85f8ba638d5e tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 1.383488 Sep 19 15:03:39.938800 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2145/4302] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:38 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:39.961687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:39.964241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:39.984954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:39.986034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:39.987535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:39.991384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:39.992202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:39.992652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:42.172331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:42.184516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-de503d0f-2284-4b6e-af0b-a02e3e0e87e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 2.249227 Sep 19 15:03:42.198651 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2146/4303] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:39 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:42.210817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:42.218901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:42.249955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:42.252238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:42.255047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:42.256107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:42.256925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:42.257559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:42.718738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:42.779870 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aeceec0b-1f2f-42c7-949f-cbac4d7a1cd6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1472 microversion: 2.1 time: 0.555337 Sep 19 15:03:42.783569 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2147/4304] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:42 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1472 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:42.806914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:42.808001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:42.829400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:42.829909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:42.832788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:42.833582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:42.840074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:42.844560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:43.450662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:43.470943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:43.473860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:43.489217 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2fc69754-1c4c-42b7-b9d2-7816d5d9c35f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.696342 Sep 19 15:03:43.490036 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2148/4305] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:42 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:43.518501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:43.519445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:43.545024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:43.547289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:43.548051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:43.557852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:43.558603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:43.559302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.118374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:44.131536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1bee4816-17f4-4149-9096-6455504f8a0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.635999 Sep 19 15:03:44.136905 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2149/4306] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:43 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:44.153848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f0146144-3158-40e3-b3de-9d9cac333ce5 req-9528206e-2d89-4181-a38a-3b789ea5bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168d4a73-a50f-4b92-886f-fc483214b3be", "name": "network-vif-deleted", "tag": "55ba94b3-1ae9-4361-a718-e99f0481ca55"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:44.180795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f0146144-3158-40e3-b3de-9d9cac333ce5 req-9528206e-2d89-4181-a38a-3b789ea5bbcd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.181471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f0146144-3158-40e3-b3de-9d9cac333ce5 req-9528206e-2d89-4181-a38a-3b789ea5bbcd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.182032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f0146144-3158-40e3-b3de-9d9cac333ce5 req-9528206e-2d89-4181-a38a-3b789ea5bbcd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.213667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f0146144-3158-40e3-b3de-9d9cac333ce5 req-9528206e-2d89-4181-a38a-3b789ea5bbcd service nova] Creating event network-vif-deleted:55ba94b3-1ae9-4361-a718-e99f0481ca55 for instance 168d4a73-a50f-4b92-886f-fc483214b3be on n-h2-858384-1 Sep 19 15:03:44.225298 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f0146144-3158-40e3-b3de-9d9cac333ce5 req-9528206e-2d89-4181-a38a-3b789ea5bbcd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086575 Sep 19 15:03:44.226617 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2150/4307] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:44.239186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:44.240468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:44.253611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.257438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.259070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.262810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.263696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.264920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.371766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.374074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.375897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.377218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lazy-loading 'fault' on Instance uuid 168d4a73-a50f-4b92-886f-fc483214b3be {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:44.497784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:44.545637 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe9f41f7-989e-4454-89af-3ab0af7dfeec tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 200 len: 1318 microversion: 2.1 time: 0.311266 Sep 19 15:03:44.555492 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2151/4308] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:44 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:44.588697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:44.590805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:44.606198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.608901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.609643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.610634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.612148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.614517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.042797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:45.057669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:45.059250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:45.060488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dbab6dc4-bc9f-48e8-8eec-33e15ada0f68 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.483609 Sep 19 15:03:45.061085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2152/4309] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:44 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:45.183606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:45.184246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:45.196663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.197940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.198406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.199165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.202404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.202871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.508751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:45.518219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e37370f8-c49f-4970-841d-c5981c95275a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.339251 Sep 19 15:03:45.520228 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2153/4310] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:45 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:45.593859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:45.599138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:45.642197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.643732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.644845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.648463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.649683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.650828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.710090 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be HTTP/1.1 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '168d4a73-a50f-4b92-886f-fc483214b3be'} Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:45.714434 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:03:45.724647 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:45.758944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:45.761010 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26309dc2-7d98-432f-b10a-1d7c5274b5a8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 404 len: 111 microversion: 2.1 time: 0.176595 Sep 19 15:03:45.762372 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2154/4311] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:45 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:45.819569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26689176-9a6f-4122-be6d-2a59df43b70e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '.version_select at 0x7fde28c1dca0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:45.840075 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-26689176-9a6f-4122-be6d-2a59df43b70e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [e365d417-2f68-417d-b091-6297d242b712] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:03:46.403784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=35 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:46.506874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=18 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:46.851805 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [None req-26689176-9a6f-4122-be6d-2a59df43b70e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [e365d417-2f68-417d-b091-6297d242b712] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 36338. Sep 19 15:03:46.907699 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26689176-9a6f-4122-be6d-2a59df43b70e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-key-694304117" status: 202 len: 0 microversion: 2.1 time: 1.127952 Sep 19 15:03:46.911765 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2155/4312] 10.222.0.81 () {58 vars in 1206 bytes} [Mon Sep 19 15:03:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-694304117 => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:03:46.933355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:46.968759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:47.044049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:47.055918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:47.060935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:47.066035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:47.070920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:47.076131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:47.688487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:47.707576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:47.717496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:47.721075 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b2545ed-12c0-4e40-8bf0-242a930181f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1739 microversion: 2.20 time: 0.807587 Sep 19 15:03:47.725069 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2156/4313] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:46 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1739 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:47.731604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:47.732431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:47.759352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:47.760721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:47.762617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:47.766615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:47.767919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:47.768966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:48.380571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:48.402150 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f665e4e-2c32-4273-9a4a-80a6007b29cb tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.675528 Sep 19 15:03:48.423712 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2157/4314] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:47 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:48.480089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1741527033", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:51.253305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Doing local delete in cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) {{(pid=128731) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 19 15:03:51.254864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:51.255579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:51.256031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:51.256588 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 19 15:03:51.272992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] deallocate_for_instance() {{(pid=128731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 19 15:03:51.299279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:03:53.865433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:03:53.866218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:03:53.866885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:03:53.867809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:03:53.868582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:03:53.902802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:53.903284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:53.903719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:53.904709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:53.909138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:53.909864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:53.980940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:03:54.009912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:03:54.054473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:03:54.057523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:03:54.174100 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b7e721e8-e8f6-440d-9b6e-776175e892b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.747021 Sep 19 15:03:54.182885 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2158/4315] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 5758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:03:54.198238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:54.203329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:54.226803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:54.227740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:54.228405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:54.229436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:54.230322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:54.232713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:55.127250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:55.185371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:55.196395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:55.199227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2a1caa6-e92a-4a3d-b445-78e3d34f35b7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1721 microversion: 2.20 time: 1.011050 Sep 19 15:03:55.200146 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2159/4316] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:54 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1721 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:55.206339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:55.208178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:55.245682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:55.246871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:55.247575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:55.248569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:55.249378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:55.250020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:55.444860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Updating instance_info_cache with network_info: [] {{(pid=128731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 19 15:03:55.856541 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4d76e5f-b8d6-4b95-99f2-ea7fe476e720 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 204 len: 0 microversion: 2.1 time: 19.479131 Sep 19 15:03:55.857425 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2158/4317] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:03:36 2022] DELETE /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 0 bytes in 19488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:03:55.864930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:55.865784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:55.873517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:55.874372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:55.876013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:55.877048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:55.878514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:55.883883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:55.934547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:55.967557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f8723bbc-6b0c-45a6-a8ec-5d7bf5a5e0ee tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.756797 Sep 19 15:03:55.969520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2160/4318] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:55 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:55.998044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5b6511c0-632f-4f48-ac02-638d975f36dc req-13e84f17-ecd6-4053-b3f1-bd77540a7c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff06e0-7cb4-4c0c-b4cf-8ee962114447", "name": "network-vif-deleted", "tag": "e877584e-3c02-49c7-94f4-bd9b4b16da7f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:56.037095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5b6511c0-632f-4f48-ac02-638d975f36dc req-13e84f17-ecd6-4053-b3f1-bd77540a7c5b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.047753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5b6511c0-632f-4f48-ac02-638d975f36dc req-13e84f17-ecd6-4053-b3f1-bd77540a7c5b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.049111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5b6511c0-632f-4f48-ac02-638d975f36dc req-13e84f17-ecd6-4053-b3f1-bd77540a7c5b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.083340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.server_external_events [req-5b6511c0-632f-4f48-ac02-638d975f36dc req-13e84f17-ecd6-4053-b3f1-bd77540a7c5b service nova] Unable to find a host for instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447. Dropping event network-vif-deleted {{(pid=128730) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 15:03:56.084303 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5b6511c0-632f-4f48-ac02-638d975f36dc req-13e84f17-ecd6-4053-b3f1-bd77540a7c5b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.112900 Sep 19 15:03:56.085099 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2161/4319] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 115 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 15:03:56.090815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:56.091674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 91ff06e0-7cb4-4c0c-b4cf-8ee962114447] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:56.100373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.101562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.103884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.105791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.106485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.107412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.111191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:56.129208 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] HTTP exception thrown: Instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 could not be found. Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Request method failure captured: Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 HTTP/1.1 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIKW8eDVNw4LEdqVpdCBxh2Qq4Tnz38DXsRJDnV8Vo4iGmvOO6SiPpvncK1LpZrOtmc59fgqG33RJW_PttC8VA_XyUig4Bdmrx3rK2oObQsW-BQK02umlJeR4Dlz7YrgaZ_zRV_AUfvqHRA4ELMlAjpzu8OrvM9k_62FZH8uM6_j-_Q Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5b030a0534946eb96c825f4c9acc526"}]}] Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c11d7590aa1f4fa48be57e2efc017a6f Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 could not be found. Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '91ff06e0-7cb4-4c0c-b4cf-8ee962114447'} Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 could not be found. Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 could not be found. Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:56.131515 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 could not be found. Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Returning 404 to user: Instance 91ff06e0-7cb4-4c0c-b4cf-8ee962114447 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-800450d2-33a1-400d-9a33-15e5c0febe8e tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447" status: 404 len: 111 microversion: 2.1 time: 0.047071 Sep 19 15:03:56.139278 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2162/4320] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:56 2022] GET /compute/v2.1/servers/91ff06e0-7cb4-4c0c-b4cf-8ee962114447 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:56.147327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:56.147836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:56.155522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.156185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.156648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.157387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.157859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.158377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.189630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:03:56.239985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:56.268645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ed5d008-58fc-4823-aae2-5164f1c33d0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1261 microversion: 2.1 time: 0.409579 Sep 19 15:03:56.283747 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2159/4321] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:55 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1261 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:56.310051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:56.311824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:56.324937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.326381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.327648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.329336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.330556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.331744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.398215 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fdf3887f-5326-4318-8e16-0787a904af9c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 204 len: 0 microversion: 2.1 time: 0.255965 Sep 19 15:03:56.399142 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2163/4322] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:03:56 2022] DELETE /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:03:56.418128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:56.424934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:56.444366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.444366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.445161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.446953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:56.447441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:56.447882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:56.779759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:56.790407 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f1885a38-9929-40c5-9b44-d073dc17e44f tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1464 microversion: 2.1 time: 0.385351 Sep 19 15:03:56.791754 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2164/4323] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:56 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1464 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:56.798312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b1531d04-ffa8-4e77-9694-dd1a807cca9e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Action: 'create', calling method: .version_select at 0x7fde28c2f1f0>, body: {"keypair": {"name": "tempest-keypair-2085261501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdjFjtosF+gD8nrzljd2oV1LOUURD7Ijm7gUxApF0IW+wiSwslWMXdcXddgtyTpksT16spzhqsKUiWWtEtqOmZ1MxwhGiJGsCQJfllk7a7API+mj8VORtwYzbqBCxom/A=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:56.829151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b1531d04-ffa8-4e77-9694-dd1a807cca9e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Getting quotas for project 4f700c170b52496297884e50c824cdb8. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:03:56.840884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b1531d04-ffa8-4e77-9694-dd1a807cca9e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Getting quotas for user 30e85e41030d48e1a58ca69232b2c40a and project 4f700c170b52496297884e50c824cdb8. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:03:56.878468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b1531d04-ffa8-4e77-9694-dd1a807cca9e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.085152 Sep 19 15:03:56.889623 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2165/4324] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 15:03:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 15:03:56.975462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:56.994208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:56.999053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:57.001628 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ad83d0b-4244-491e-a271-f01c53cc9ff1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1721 microversion: 2.20 time: 0.715339 Sep 19 15:03:57.003112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2160/4325] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:56 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1721 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:57.011155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:57.011845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:57.027647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.028156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.028603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:57.030368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fbe1c4a6-6e75-4874-9efe-df9df792f9d7 req-fc14985b-c32e-4c9e-aed2-fa75a6a85692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "name": "network-vif-unplugged", "status": "completed", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:57.032942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.033570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.034033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:57.049803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fbe1c4a6-6e75-4874-9efe-df9df792f9d7 req-fc14985b-c32e-4c9e-aed2-fa75a6a85692 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.059154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fbe1c4a6-6e75-4874-9efe-df9df792f9d7 req-fc14985b-c32e-4c9e-aed2-fa75a6a85692 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.059715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fbe1c4a6-6e75-4874-9efe-df9df792f9d7 req-fc14985b-c32e-4c9e-aed2-fa75a6a85692 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:57.079457 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fbe1c4a6-6e75-4874-9efe-df9df792f9d7 req-fc14985b-c32e-4c9e-aed2-fa75a6a85692 service nova] Creating event network-vif-unplugged:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:03:57.095903 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fbe1c4a6-6e75-4874-9efe-df9df792f9d7 req-fc14985b-c32e-4c9e-aed2-fa75a6a85692 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074339 Sep 19 15:03:57.101423 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2161/4326] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:57.310309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:57.311053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:57.326778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.333980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.334457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:57.339693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.340207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.340655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:57.594084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:57.609577 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd04a951-8148-418a-9ae6-8023d4044f0e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1267 microversion: 2.1 time: 0.303379 Sep 19 15:03:57.629597 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2162/4327] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:57 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:57.746212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:57.767220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87a1729c-7bbe-40d9-ac84-1334f3058ef0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.752824 Sep 19 15:03:57.768020 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2166/4328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:57 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:57.818160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:57.818811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:57.828494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.829009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.829437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:57.830149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:57.830599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:57.831572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:58.031600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:58.033856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:58.042406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:58.042969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:58.043422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:58.044152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:58.044814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:58.045686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:58.180349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:58.202235 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f35203ec-f90a-4fe2-b8d5-9fec342af16c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1464 microversion: 2.1 time: 0.389282 Sep 19 15:03:58.203688 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2163/4329] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:57 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1464 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:58.430708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:58.490425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:58.500566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:58.503442 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5241bb1e-69c3-4b6e-b3f6-1c3e73944307 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1721 microversion: 2.20 time: 0.475773 Sep 19 15:03:58.506164 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2167/4330] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:58 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:03:58.640003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:58.641854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:58.661152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:58.662516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:58.664849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:58.668700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:58.669952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:58.671277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:58.809730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:58.817419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:58.819566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:58.836495 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3f3036f-f84a-468f-869c-97b1a4227748 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1267 microversion: 2.1 time: 0.200893 Sep 19 15:03:58.839022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:58.840004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:58.840432 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2164/4331] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:58 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:58.841128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:58.842128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:58.842742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:58.843410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:59.228853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:59.230264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:59.248812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:59.250399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:59.251181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:59.252443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:59.253302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:59.258445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:59.770469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:59.782971 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-80f3bec5-0c70-476b-8bc7-330a8c435bb3 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1464 microversion: 2.1 time: 0.557574 Sep 19 15:03:59.796930 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2165/4332] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:59 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1464 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:59.808648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:59.809527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:59.816230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:59.818201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:59.819046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:59.819966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:59.820625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:59.821242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:59.843141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:59.866687 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3392983f-b047-4f92-ac6e-b541a0042b7a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 1.073751 Sep 19 15:03:59.875645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2168/4333] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:58 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:59.889526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:59.893853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:59.901330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:59.902151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:59.902775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:59.904494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:59.905165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:59.905811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:00.477099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:00.494331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:00.497606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:00.500376 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0131ff7e-0ac3-4ff8-b591-9a611268c375 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1664 microversion: 2.20 time: 0.701869 Sep 19 15:04:00.501748 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2166/4334] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:03:59 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1664 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:00.508870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-771882745", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9f25db1c-7262-421f-a894-9fed3996cb3d"}, {"port": "629f4872-d0bd-4b7d-b472-27604836b34b", "tag": "port-1"}, {"port": "8569a7b5-dba0-4127-ac0a-52ca3bd03847", "tag": "port-2"}, {"uuid": "4da98ffc-3989-4f75-8dcd-c311df7f4fb3", "tag": "net-1"}, {"uuid": "4da98ffc-3989-4f75-8dcd-c311df7f4fb3"}, {"uuid": "d1e418d5-3fdc-4259-b4d4-d68648b986d9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d1e418d5-3fdc-4259-b4d4-d68648b986d9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "04b025d0-1b95-46cd-aa01-ee46f06c4da5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e929e11a-3fad-4eb5-b457-3e3aa108d725", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5e94cbe1-b137-478c-965c-01d2fda0d186", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1376852467"}], "key_name": "tempest-keypair-2085261501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:00.686639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:00.696184 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c239e47a-8f24-4d6b-9d47-83607716cb21 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1309 microversion: 2.1 time: 0.818667 Sep 19 15:04:00.699402 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2169/4335] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:59 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1309 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:00.707323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a458bf59-3740-47ea-abce-2296d141a2d1 req-93ad94ba-8a26-4512-91b0-48ccd089979e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad076e-097f-4d69-b3ed-fede15ad5ffa", "name": "network-vif-plugged", "status": "completed", "tag": "2b72fda7-5524-461e-bc6f-b19724ef1f7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:00.717980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a458bf59-3740-47ea-abce-2296d141a2d1 req-93ad94ba-8a26-4512-91b0-48ccd089979e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:00.718797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a458bf59-3740-47ea-abce-2296d141a2d1 req-93ad94ba-8a26-4512-91b0-48ccd089979e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:00.719425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a458bf59-3740-47ea-abce-2296d141a2d1 req-93ad94ba-8a26-4512-91b0-48ccd089979e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:00.732708 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a458bf59-3740-47ea-abce-2296d141a2d1 req-93ad94ba-8a26-4512-91b0-48ccd089979e service nova] Creating event network-vif-plugged:2b72fda7-5524-461e-bc6f-b19724ef1f7c for instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa on n-h2-858384-1 Sep 19 15:04:00.739731 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a458bf59-3740-47ea-abce-2296d141a2d1 req-93ad94ba-8a26-4512-91b0-48ccd089979e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Sep 19 15:04:00.741140 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2170/4336] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:00.749463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49fd9c42-1927-4a6a-a12c-1cbf8d2f7515"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:00.752523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:00.762651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:00.763577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:00.764221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:00.765539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:00.766145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:00.766682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:00.944004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] validate_networks() for [('9f25db1c-7262-421f-a894-9fed3996cb3d', None, None, None, None, None), (None, None, '629f4872-d0bd-4b7d-b472-27604836b34b', None, None, None), (None, None, '8569a7b5-dba0-4127-ac0a-52ca3bd03847', None, None, None), ('4da98ffc-3989-4f75-8dcd-c311df7f4fb3', None, None, None, None, None), ('4da98ffc-3989-4f75-8dcd-c311df7f4fb3', None, None, None, None, None), ('d1e418d5-3fdc-4259-b4d4-d68648b986d9', '10.2.2.100', None, None, None, None), ('d1e418d5-3fdc-4259-b4d4-d68648b986d9', '10.2.2.200', None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:04:01.390557 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad88a818-6123-43b7-8fa7-40428d1a3473 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.647844 Sep 19 15:04:01.391301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2171/4337] 10.222.0.81 () {62 vars in 1364 bytes} [Mon Sep 19 15:04:00 2022] POST /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-volume_attachments => generated 188 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:04:01.410545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:01.411220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:01.429511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:01.436335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:01.437088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:01.438242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:01.438965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:01.439601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:01.539868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:01.554224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:01.555020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:01.555675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:01.556338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lazy-loading 'fault' on Instance uuid 89c33789-be7c-43f3-a822-636103efa378 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:04:01.701482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:01.712636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32869c91-2a6d-4188-b108-f7132128db70 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 200 len: 1304 microversion: 2.1 time: 0.319868 Sep 19 15:04:01.713249 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2172/4338] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:01 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 1304 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:01.736773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:01.737686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:01.745814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:01.746594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:01.747239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:01.748167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:01.748789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:01.749606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:02.119559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:02.132882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9adf27e0-5ae9-49ef-be74-afedd6eee0a3 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1517 microversion: 2.1 time: 0.408401 Sep 19 15:04:02.134360 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2173/4339] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:01 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:02.141837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d0261898-3488-4ff6-b56c-bffb4c3f27f1 req-6c7dab1a-3082-4f96-9155-c543f4a55ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c33789-be7c-43f3-a822-636103efa378", "name": "network-vif-deleted", "tag": "b85f01a8-946f-4846-becb-2728173d0135"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:02.160570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d0261898-3488-4ff6-b56c-bffb4c3f27f1 req-6c7dab1a-3082-4f96-9155-c543f4a55ac1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:02.161816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d0261898-3488-4ff6-b56c-bffb4c3f27f1 req-6c7dab1a-3082-4f96-9155-c543f4a55ac1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:02.163771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d0261898-3488-4ff6-b56c-bffb4c3f27f1 req-6c7dab1a-3082-4f96-9155-c543f4a55ac1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:02.186325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d0261898-3488-4ff6-b56c-bffb4c3f27f1 req-6c7dab1a-3082-4f96-9155-c543f4a55ac1 service nova] Creating event network-vif-deleted:b85f01a8-946f-4846-becb-2728173d0135 for instance 89c33789-be7c-43f3-a822-636103efa378 on n-h1-858384-1 Sep 19 15:04:02.192855 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d0261898-3488-4ff6-b56c-bffb4c3f27f1 req-6c7dab1a-3082-4f96-9155-c543f4a55ac1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056241 Sep 19 15:04:02.193475 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2174/4340] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:02.199871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:02.200457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:02.207079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:02.207758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:02.208202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:02.208910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:02.209373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:02.209806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:02.343490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:02.655931 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f525564c-0d84-48cc-b86e-c40c81e70921 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-volume_attachments/49fd9c42-1927-4a6a-a12c-1cbf8d2f7515" status: 202 len: 0 microversion: 2.20 time: 0.460021 Sep 19 15:04:02.656662 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2175/4341] 10.222.0.81 () {60 vars in 1457 bytes} [Mon Sep 19 15:04:02 2022] DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-volume_attachments/49fd9c42-1927-4a6a-a12c-1cbf8d2f7515 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:02.694360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:02.697571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:02.712182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:02.713408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:02.714328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:02.715761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:02.716473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:02.717686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.340413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:03.355256 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb8c83dd-181c-4b40-b7a0-9336e05c922a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1309 microversion: 2.1 time: 0.683639 Sep 19 15:04:03.357261 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2176/4342] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:02 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1309 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:03.377199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:03.377836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 89c33789-be7c-43f3-a822-636103efa378] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:03.394185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:03.397972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:03.398435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.399384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:03.399856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:03.400290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.453887 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] HTTP exception thrown: Instance 89c33789-be7c-43f3-a822-636103efa378 could not be found. Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Request method failure captured: Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 HTTP/1.1 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIKW8eDVNw4LEdqVpdCBxh2Qq4Tnz38DXsRJDnV8Vo4iGmvOO6SiPpvncK1LpZrOtmc59fgqG33RJW_PttC8VA_XyUig4Bdmrx3rK2oObQsW-BQK02umlJeR4Dlz7YrgaZ_zRV_AUfvqHRA4ELMlAjpzu8OrvM9k_62FZH8uM6_j-_Q Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5b030a0534946eb96c825f4c9acc526"}]}] Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c11d7590aa1f4fa48be57e2efc017a6f Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 89c33789-be7c-43f3-a822-636103efa378 could not be found. Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '89c33789-be7c-43f3-a822-636103efa378'} Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c33789-be7c-43f3-a822-636103efa378 could not be found. Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c33789-be7c-43f3-a822-636103efa378 could not be found. Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:03.459900 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c33789-be7c-43f3-a822-636103efa378 could not be found. Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Returning 404 to user: Instance 89c33789-be7c-43f3-a822-636103efa378 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4fbe782a-a49d-43f8-839e-f3b7a15a3f16 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378" status: 404 len: 111 microversion: 2.1 time: 0.102891 Sep 19 15:04:03.468231 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2177/4343] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:03 2022] GET /compute/v2.1/servers/89c33789-be7c-43f3-a822-636103efa378 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:03.475811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:03.476447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:03.485239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:03.485734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:03.486162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.487082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:03.487538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:03.488044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.552045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128730) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 15:04:03.668641 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8472bb35-7e68-457f-a8f0-6b5eabeacf16 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "POST /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/action" status: 202 len: 0 microversion: 2.20 time: 0.200436 Sep 19 15:04:03.670005 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2178/4344] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 15:04:03 2022] POST /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:03.678719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:03.679893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:03.688630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:03.689283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:03.690510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.692511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:03.693146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:03.693849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:03.950351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:04.029628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:04.057346 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f4c05230-10f6-42af-bc55-8fdddbba9eab tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.385563 Sep 19 15:04:04.058567 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2179/4345] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:03 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:04.076467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:04.077075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:04.087503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:04.089052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:04.089785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:04.090722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:04.091410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:04.092294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:04.132391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:04:04.280149 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00687915-712c-488c-b02d-976c59b2c068 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 204 len: 0 microversion: 2.1 time: 0.219990 Sep 19 15:04:04.280757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2180/4346] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:04 2022] DELETE /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:04.286072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:04.286791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:04.293937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:04.295037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:04.295755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:04.296477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:04.296937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:04.297362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:04.840820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:04.852978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:04.854934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:04.856350 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc795c77-f434-42a0-82a7-234619aa6a86 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1672 microversion: 2.20 time: 0.574488 Sep 19 15:04:04.857155 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2181/4347] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:04 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1672 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:04.872571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:04.873196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:04.881757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:04.882278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:04.882726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:04.883479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:04.883936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:04.884733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:05.182135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:05.191240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9ed0331-5a84-4992-8102-63a695079351 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.332306 Sep 19 15:04:05.192250 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2182/4348] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:04 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:05.197515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2c3974f0-c265-483d-a1cd-caf62ab36188 req-455bad62-a78f-472b-878d-dda8ad0e31a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ff6f06-e104-4d2d-9b65-c9b25fca9f1c", "tag": "8ffe648e-5660-4665-84c1-f8e566587209"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:05.210594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2c3974f0-c265-483d-a1cd-caf62ab36188 req-455bad62-a78f-472b-878d-dda8ad0e31a0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:05.211342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2c3974f0-c265-483d-a1cd-caf62ab36188 req-455bad62-a78f-472b-878d-dda8ad0e31a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:05.212073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2c3974f0-c265-483d-a1cd-caf62ab36188 req-455bad62-a78f-472b-878d-dda8ad0e31a0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:05.234666 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2c3974f0-c265-483d-a1cd-caf62ab36188 req-455bad62-a78f-472b-878d-dda8ad0e31a0 service nova] Creating event network-changed:8ffe648e-5660-4665-84c1-f8e566587209 for instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c on n-h2-858384-1 Sep 19 15:04:05.243374 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2c3974f0-c265-483d-a1cd-caf62ab36188 req-455bad62-a78f-472b-878d-dda8ad0e31a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049400 Sep 19 15:04:05.245426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2183/4349] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:05.250898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:05.252362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:05.262290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:05.262940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:05.263984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:05.264770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:05.265244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:05.265739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:05.911966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:05.932178 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9041c033-11a1-4d64-9dcb-ef10f2688067 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1506 microversion: 2.1 time: 0.685034 Sep 19 15:04:05.936014 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2184/4350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:05 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:05.948460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:05.951459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:05.961265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:05.962102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:05.962801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:05.963778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:05.964500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:05.965142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:06.855271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=10 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:06.899861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:06.924001 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7248d80d-b466-4172-a94a-38473202c8af tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1309 microversion: 2.1 time: 0.978065 Sep 19 15:04:06.939548 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2185/4351] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:05 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1309 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:06.953039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:06.954499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:06.965397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:06.969477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:06.974130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:06.980057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:06.981961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:06.982468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:07.573739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:07.585258 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc2c3270-648a-4496-8161-fdd1d93482c9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.643648 Sep 19 15:04:07.585977 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2186/4352] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:06 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:07.598125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:07.598125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:07.602740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:07.603459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:07.604279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:07.605257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:07.606847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:07.608030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.088946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:08.105167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:08.107065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:08.109077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6121dcda-4d0f-41e3-933b-53dcac11ca7b tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.521836 Sep 19 15:04:08.111549 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2187/4353] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:07 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:08.124595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.126161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:08.150284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:08.151152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:08.151816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.152835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:08.153748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:08.161228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.382873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:08.393691 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e90eda8-060c-4db1-af70-e7a228f9d410 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 200 len: 1299 microversion: 2.1 time: 0.278043 Sep 19 15:04:08.394367 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2188/4354] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:08.401884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20b30c2c-f2b4-412c-9177-a28af15aed5a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:08.422211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:04:08.422818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:04:08.422914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:04:08.423283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:04:08.423698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:04:08.441932 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-20b30c2c-f2b4-412c-9177-a28af15aed5a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance be009b54-374f-48c6-8a49-c8014a60140d has no mapping to a cell. Sep 19 15:04:08.443393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:08.443954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:08.444532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.445305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:08.452339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20b30c2c-f2b4-412c-9177-a28af15aed5a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/be009b54-374f-48c6-8a49-c8014a60140d/action HTTP/1.1 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: {"os-stop": {}} Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance be009b54-374f-48c6-8a49-c8014a60140d has no mapping to a cell. Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'be009b54-374f-48c6-8a49-c8014a60140d', 'body': {'os-stop': {}}} Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance be009b54-374f-48c6-8a49-c8014a60140d has no mapping to a cell. Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:08.452967 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be009b54-374f-48c6-8a49-c8014a60140d has no mapping to a cell. Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be009b54-374f-48c6-8a49-c8014a60140d has no mapping to a cell. Sep 19 15:04:08.457928 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:08.459967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.460926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20b30c2c-f2b4-412c-9177-a28af15aed5a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance be009b54-374f-48c6-8a49-c8014a60140d has no mapping to a cell. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:08.464378 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20b30c2c-f2b4-412c-9177-a28af15aed5a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/be009b54-374f-48c6-8a49-c8014a60140d/action" status: 404 len: 117 microversion: 2.1 time: 0.068700 Sep 19 15:04:08.465843 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2189/4355] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:08 2022] POST /compute/v2.1/servers/be009b54-374f-48c6-8a49-c8014a60140d/action => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:08.490228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.491107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:08.513874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:08.515038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:08.518136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.519392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:08.521882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:08.523893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:08.552673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Getting quotas for project 4f700c170b52496297884e50c824cdb8. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:04:08.563510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Getting quotas for user 30e85e41030d48e1a58ca69232b2c40a and project 4f700c170b52496297884e50c824cdb8. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:04:08.926148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:08.931028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:08.967032 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ced44a10-2ca8-41cd-a8a0-d186c3fd1208 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1309 microversion: 2.1 time: 0.488040 Sep 19 15:04:08.989983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2190/4356] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:08.997415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-281ee1ee-fd6d-414e-9338-102ce5b8781d req-926ebebc-4073-4f4a-b831-99d99a37969a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d", "name": "network-vif-deleted", "tag": "ea5ba795-598c-460b-bc8b-70817e0b466a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:09.020235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-281ee1ee-fd6d-414e-9338-102ce5b8781d req-926ebebc-4073-4f4a-b831-99d99a37969a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:09.039601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-281ee1ee-fd6d-414e-9338-102ce5b8781d req-926ebebc-4073-4f4a-b831-99d99a37969a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:09.040505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-281ee1ee-fd6d-414e-9338-102ce5b8781d req-926ebebc-4073-4f4a-b831-99d99a37969a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:09.079504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:04:09.082943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='04b025d0-1b95-46cd-aa01-ee46f06c4da5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e929e11a-3fad-4eb5-b457-3e3aa108d725',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e94cbe1-b137-478c-965c-01d2fda0d186',volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:04:09.108744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-281ee1ee-fd6d-414e-9338-102ce5b8781d req-926ebebc-4073-4f4a-b831-99d99a37969a service nova] Creating event network-vif-deleted:ea5ba795-598c-460b-bc8b-70817e0b466a for instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d on n-h2-858384-1 Sep 19 15:04:09.134255 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-281ee1ee-fd6d-414e-9338-102ce5b8781d req-926ebebc-4073-4f4a-b831-99d99a37969a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142588 Sep 19 15:04:09.141350 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2191/4357] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:09.165079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:09.183602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:09.207975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:09.214145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:09.216280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:09.217177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:09.223209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:09.226115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:09.788919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:09.814489 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b6d2bd03-1b19-4933-b06e-ff419ef6e1e6 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.649739 Sep 19 15:04:09.816599 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2192/4358] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:09 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:09.828607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:09.829234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:09.848902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:09.849335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:09.849793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:09.854791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:09.855368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:09.855815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:09.963587 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-54ddef2b-b465-440f-944f-9a762262fca9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.457748 Sep 19 15:04:09.967455 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2167/4359] 10.222.0.81 () {62 vars in 1189 bytes} [Mon Sep 19 15:04:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 9465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 15:04:09.979734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-365d59ee-2eaa-4666-92f3-b348ec632d3d req-08818169-7634-4845-93ce-50bd8012f2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ff6f06-e104-4d2d-9b65-c9b25fca9f1c", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe648e-5660-4665-84c1-f8e566587209"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:10.025768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-365d59ee-2eaa-4666-92f3-b348ec632d3d req-08818169-7634-4845-93ce-50bd8012f2a4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.026822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-365d59ee-2eaa-4666-92f3-b348ec632d3d req-08818169-7634-4845-93ce-50bd8012f2a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.028712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-365d59ee-2eaa-4666-92f3-b348ec632d3d req-08818169-7634-4845-93ce-50bd8012f2a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:10.074268 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-365d59ee-2eaa-4666-92f3-b348ec632d3d req-08818169-7634-4845-93ce-50bd8012f2a4 service nova] Creating event network-vif-plugged:8ffe648e-5660-4665-84c1-f8e566587209 for instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c on n-h2-858384-1 Sep 19 15:04:10.084584 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-365d59ee-2eaa-4666-92f3-b348ec632d3d req-08818169-7634-4845-93ce-50bd8012f2a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115435 Sep 19 15:04:10.088784 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2168/4360] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:10.114397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:10.121505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:10.148418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.151017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.153241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:10.154082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.154574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.158040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:10.193475 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] HTTP exception thrown: Instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d could not be found. Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Request method failure captured: Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d HTTP/1.1 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIKW8eDVNw4LEdqVpdCBxh2Qq4Tnz38DXsRJDnV8Vo4iGmvOO6SiPpvncK1LpZrOtmc59fgqG33RJW_PttC8VA_XyUig4Bdmrx3rK2oObQsW-BQK02umlJeR4Dlz7YrgaZ_zRV_AUfvqHRA4ELMlAjpzu8OrvM9k_62FZH8uM6_j-_Q Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5b030a0534946eb96c825f4c9acc526"}]}] Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c11d7590aa1f4fa48be57e2efc017a6f Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d could not be found. Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d'} Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d could not be found. Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d could not be found. Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:10.198596 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d could not be found. Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Returning 404 to user: Instance ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9bfeb5fd-32d5-48b9-9a2d-c3cc126b48a5 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d" status: 404 len: 111 microversion: 2.1 time: 0.109733 Sep 19 15:04:10.203663 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2169/4361] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:10 2022] GET /compute/v2.1/servers/ea60c963-4eed-4bf0-ac89-6f6b9fd8f35d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:10.220643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:10.222342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:10.242352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.243486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.245427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:10.248372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.249078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.250454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:10.375994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:10.393849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:10.395738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:10.396956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e98c8f0c-e51b-4e3d-937a-d31ac3576c12 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.576706 Sep 19 15:04:10.419732 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2193/4362] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:09 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:10.430560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-368ece24-b4f1-40a3-8eb1-c2013535aa58 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:10.440023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-368ece24-b4f1-40a3-8eb1-c2013535aa58 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:10.757759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-368ece24-b4f1-40a3-8eb1-c2013535aa58 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:10.770981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-368ece24-b4f1-40a3-8eb1-c2013535aa58 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:10.772478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-368ece24-b4f1-40a3-8eb1-c2013535aa58 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:10.773931 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-368ece24-b4f1-40a3-8eb1-c2013535aa58 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1285 microversion: 2.42 time: 0.351641 Sep 19 15:04:10.803793 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2194/4363] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:10 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1285 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:10.820530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:10.821158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:10.865429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.865429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.865843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:10.866784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:10.868927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:10.869550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.015105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:11.037495 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-10cbdacf-0763-4fb6-9ca3-bcad45c36b0a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.832791 Sep 19 15:04:11.038101 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2170/4364] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:10 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:11.087620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:11.087620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:11.114184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:11.114717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:11.115207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.115963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:11.123104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:11.123666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.248306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:04:11.259265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:11.395881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:11.411422 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4537611d-a593-4b3d-940e-36a014309a2e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1309 microversion: 2.1 time: 0.606413 Sep 19 15:04:11.468271 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2195/4365] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:10 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1309 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:11.477541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c5ffc62-680f-4a91-8604-28d6a7481a46 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:11.478132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c5ffc62-680f-4a91-8604-28d6a7481a46 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 1b23118a-0f43-4a41-a003-446a41b96b08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:11.491231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9c5ffc62-680f-4a91-8604-28d6a7481a46 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 1b23118a-0f43-4a41-a003-446a41b96b08 could not be found. Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c5ffc62-680f-4a91-8604-28d6a7481a46 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/1b23118a-0f43-4a41-a003-446a41b96b08/action HTTP/1.1 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: {"suspend": {}} Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1b23118a-0f43-4a41-a003-446a41b96b08 could not be found. Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1b23118a-0f43-4a41-a003-446a41b96b08', 'body': {'suspend': {}}} Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b23118a-0f43-4a41-a003-446a41b96b08 could not be found. Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b23118a-0f43-4a41-a003-446a41b96b08 could not be found. Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:11.492908 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b23118a-0f43-4a41-a003-446a41b96b08 could not be found. Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c5ffc62-680f-4a91-8604-28d6a7481a46 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 1b23118a-0f43-4a41-a003-446a41b96b08 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c5ffc62-680f-4a91-8604-28d6a7481a46 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/1b23118a-0f43-4a41-a003-446a41b96b08/action" status: 404 len: 111 microversion: 2.1 time: 0.023916 Sep 19 15:04:11.503423 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2196/4366] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:11 2022] POST /compute/v2.1/servers/1b23118a-0f43-4a41-a003-446a41b96b08/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:11.520076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:11.520723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:11.553354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:11.554061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:11.554526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.555309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:11.555767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:11.564814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.631087 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1362f8c1-cb5b-429c-b069-18fb9360e956 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 204 len: 0 microversion: 2.1 time: 0.563335 Sep 19 15:04:11.635714 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2171/4367] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:11 2022] DELETE /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:11.665358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:11.667129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:11.682881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:11.684177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:11.685729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.687444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:11.688639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:11.689602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:11.991034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:12.022862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:12.033744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:12.042347 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2661b144-68ae-4c5b-8413-631f9b9f57f9 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.544148 Sep 19 15:04:12.048552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2197/4368] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:11 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:12.081107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:12.089631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:12.131775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:12.136409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:12.137024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:12.138839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:12.141739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:12.152280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:12.830341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:12.843224 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-992c97f2-afc7-4be9-8e35-99c588b3958d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.203482 Sep 19 15:04:12.849843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2172/4369] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:11 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:12.862249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:12.863622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:12.874449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:12.877829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:12.879061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:12.882446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:12.883089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:12.883667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.040732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:13.055856 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-edb81dfd-246f-4b2b-8bd5-e747f9ae5a12 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1492 microversion: 2.1 time: 1.001122 Sep 19 15:04:13.071641 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2198/4370] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:12 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1492 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:13.079809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:13.081705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:13.089078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.089961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:13.090617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.091950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.092640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:13.093394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.153424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:13.178854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:13.181327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:13.187702 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2830458-ae79-45ee-8722-cc26a6fe15af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1519 microversion: 2.42 time: 0.333936 Sep 19 15:04:13.188812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2173/4371] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:12 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1519 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:13.202042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:13.204320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:13.225754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.225754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:13.225754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.226201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.226539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:13.227184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.869105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:13.904350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:13.913858 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b230922c-f94e-4a14-b018-6db09dda9307 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.723225 Sep 19 15:04:13.919540 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c8e6670-6c23-4c81-a517-f96a0ca91b96 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1489 microversion: 2.1 time: 0.846650 Sep 19 15:04:13.919936 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2174/4372] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:13 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:13.927988 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2199/4373] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:13 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1489 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:13.943570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:13.944057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:13.944841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:13.946627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:13.959677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.960552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:13.961292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.962297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.967436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:13.968314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:13.989240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:13.989995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.002677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.004151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.005100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.005940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.030067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lazy-loading 'flavor' on Instance uuid c3ad076e-097f-4d69-b3ed-fede15ad5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:04:14.300670 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17ec9f1c-cf99-49cb-b849-5de34516f97d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.360928 Sep 19 15:04:14.306039 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2200/4374] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:13 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:04:14.326064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:14.333141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:14.354564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.355376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.356075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.357122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.357763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.358368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.687065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:14.702431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c6c470df-d4bc-4059-b0a2-679073a9d171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1450 microversion: 2.1 time: 0.394450 Sep 19 15:04:14.704234 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2201/4375] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:14 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1450 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:14.712196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:14.713007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:14.723276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.724417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.725142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.726064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.726539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:14.727123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.728061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.746372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:14.748125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:14.750639 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21ccf87b-2ecb-42f3-b141-52f6df5fb6ea tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.823931 Sep 19 15:04:14.757786 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2175/4376] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:13 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:14.789933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:14.792768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:14.817847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.818964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.819689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.824481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:14.825576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:14.826732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:14.981561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:15.039848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:15.046780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:15.052463 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ca9e949-c522-4024-aea9-c9ec9f85da17 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1593 microversion: 2.42 time: 0.342662 Sep 19 15:04:15.055792 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2202/4377] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:14 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1593 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:15.082951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1741527033", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:15.328747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:15.363524 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-93ad55dc-c4b8-4dd7-9df9-e1dd6666757d tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1512 microversion: 2.1 time: 0.601063 Sep 19 15:04:15.379976 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2176/4378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:14 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1512 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:15.415630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fe0cff7a-8a01-4a12-92bb-23ba07bce716 req-1753721f-4f76-409c-9d13-9fde8fb788b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d09fd9-0bd7-404f-931b-1373fd292449", "name": "network-vif-deleted", "tag": "d012f3cf-0fd8-40bb-9953-e1f54986479a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:15.448838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fe0cff7a-8a01-4a12-92bb-23ba07bce716 req-1753721f-4f76-409c-9d13-9fde8fb788b0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:15.452216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fe0cff7a-8a01-4a12-92bb-23ba07bce716 req-1753721f-4f76-409c-9d13-9fde8fb788b0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:15.456323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fe0cff7a-8a01-4a12-92bb-23ba07bce716 req-1753721f-4f76-409c-9d13-9fde8fb788b0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:15.513617 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fe0cff7a-8a01-4a12-92bb-23ba07bce716 req-1753721f-4f76-409c-9d13-9fde8fb788b0 service nova] Creating event network-vif-deleted:d012f3cf-0fd8-40bb-9953-e1f54986479a for instance 40d09fd9-0bd7-404f-931b-1373fd292449 on n-h1-858384-1 Sep 19 15:04:15.525121 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fe0cff7a-8a01-4a12-92bb-23ba07bce716 req-1753721f-4f76-409c-9d13-9fde8fb788b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142606 Sep 19 15:04:15.526859 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2177/4379] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:15.873389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:04:16.257998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:16.260431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:16.297373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:16.300635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:16.302659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:16.307105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:16.309085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:16.311423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:16.459947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:16.470269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:16.474930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:16.477962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:16.481315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lazy-loading 'fault' on Instance uuid 40d09fd9-0bd7-404f-931b-1373fd292449 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:04:17.151717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:17.160152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5109a7d6-3a17-46d4-b198-d68f52025171 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 200 len: 1304 microversion: 2.1 time: 1.433010 Sep 19 15:04:17.168835 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2178/4380] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:15 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 1304 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:17.174069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:17.174689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:17.185722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:17.186523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:17.187015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:17.187856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:17.188328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:17.188759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:17.788709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:17.811133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:17.812618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:17.813852 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b1775dd-2ea4-45c1-9632-73e9525da8ee tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.643926 Sep 19 15:04:17.814416 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2179/4381] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:17 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:17.840977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:17.841601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:17.867681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:17.868203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:17.868657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:17.869407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:17.869846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:17.881593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.224835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:04:18.225410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:04:18.225807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:04:18.226221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:04:18.226639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:04:18.248801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:18.250253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:18.253549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.255447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:18.259030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:18.259908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.332669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:04:18.353088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:04:18.418629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:04:18.429600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:04:18.505677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:18.590909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:18.686160 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6dd26cd3-dbb3-485a-b390-8f66aa41e793 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.624683 Sep 19 15:04:18.686160 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2203/4382] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:04:18.732182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:18.753870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:18.756023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:18.796305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:18.796815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:18.797318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.798056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:18.798520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:18.798989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.808351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:18.823307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:18.832635 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-caeeda85-aa24-49c6-8bfc-113c249eb69e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1661 microversion: 2.42 time: 1.009094 Sep 19 15:04:18.834115 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2180/4383] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:17 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1661 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:18.843971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:18.848430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 40d09fd9-0bd7-404f-931b-1373fd292449] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:18.863322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:18.864104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:18.865210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.867197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:18.868959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:18.871417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:18.905593 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] HTTP exception thrown: Instance 40d09fd9-0bd7-404f-931b-1373fd292449 could not be found. Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Request method failure captured: Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 HTTP/1.1 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIKW8eDVNw4LEdqVpdCBxh2Qq4Tnz38DXsRJDnV8Vo4iGmvOO6SiPpvncK1LpZrOtmc59fgqG33RJW_PttC8VA_XyUig4Bdmrx3rK2oObQsW-BQK02umlJeR4Dlz7YrgaZ_zRV_AUfvqHRA4ELMlAjpzu8OrvM9k_62FZH8uM6_j-_Q Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5b030a0534946eb96c825f4c9acc526"}]}] Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c11d7590aa1f4fa48be57e2efc017a6f Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 40d09fd9-0bd7-404f-931b-1373fd292449 could not be found. Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '40d09fd9-0bd7-404f-931b-1373fd292449'} Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d09fd9-0bd7-404f-931b-1373fd292449 could not be found. Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d09fd9-0bd7-404f-931b-1373fd292449 could not be found. Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:18.910643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d09fd9-0bd7-404f-931b-1373fd292449 could not be found. Sep 19 15:04:18.915892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:18.923570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Returning 404 to user: Instance 40d09fd9-0bd7-404f-931b-1373fd292449 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:18.926033 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3d266d7b-e62b-4cd8-8d21-cb53138c5e2a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449" status: 404 len: 111 microversion: 2.1 time: 0.090548 Sep 19 15:04:18.937664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2181/4384] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:18 2022] GET /compute/v2.1/servers/40d09fd9-0bd7-404f-931b-1373fd292449 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:18.944336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5656db0-4d8c-460e-a42a-4aa79fcc9822 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:18.945226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5656db0-4d8c-460e-a42a-4aa79fcc9822 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:19.173164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c5656db0-4d8c-460e-a42a-4aa79fcc9822 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:19.197070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5656db0-4d8c-460e-a42a-4aa79fcc9822 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1209 microversion: 2.1 time: 0.245060 Sep 19 15:04:19.219806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2182/4385] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:18 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1209 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:19.239805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:19.240648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:19.257415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.261126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.261565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.262306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.269651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.275693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.343132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:19.360552 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6ba456ba-ddb1-41a3-859c-5fcafdc3b483 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1495 microversion: 2.1 time: 0.641815 Sep 19 15:04:19.364974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2204/4386] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:18 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1495 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:19.377275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:19.379834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:19.398494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.400358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.401025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.401961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.406410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.410294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.492727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:04:19.670127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:19.692311 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fce7c0a1-257c-4ccf-a005-611bf14bff9d tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 204 len: 0 microversion: 2.1 time: 0.322789 Sep 19 15:04:19.693289 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2205/4387] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:19 2022] DELETE /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:19.723957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:19.725914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:19.739570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.747661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.749362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.750736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.753655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.767447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.843020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:19.862409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:19.863370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lazy-loading 'flavor' on Instance uuid c3ad076e-097f-4d69-b3ed-fede15ad5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:04:19.881592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:19.885703 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c705c8e1-c310-4ef8-917b-9cfad4df3a8d tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.664052 Sep 19 15:04:19.886313 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2183/4388] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:19 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:19.927241 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'suspend' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state suspended Sep 19 15:04:19.928649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: {"suspend": {}} Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'suspend' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state suspended Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'suspend': {}}} Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state suspended. Cannot suspend while the instance is in this state. Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 19 15:04:19.929006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state suspended Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state suspended Sep 19 15:04:19.933579 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:19.934584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:19.934708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'suspend' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state suspended {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:19.934708 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d0588e11-254f-4974-8cb7-c9ac3eb01a7c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 148 microversion: 2.1 time: 0.233090 Sep 19 15:04:19.946394 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2206/4389] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:19 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 148 bytes in 251 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:04:19.951761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:19.958926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.962631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.964299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:19.970977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.975533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:19.978135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:19.978597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:19.994964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.004453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.005146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.005976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.006503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.006983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.085041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:20.504503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:20.514239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:20.515750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:20.516937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9ceda814-c2f8-4ed6-9194-616881a40939 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1708 microversion: 2.42 time: 0.569100 Sep 19 15:04:20.517479 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2207/4390] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:19 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1708 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:20.532806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:20.533348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:20.541734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:20.546340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.547774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.548791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.550296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.551538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.552444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.559562 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5afbcbe-b18f-4761-8dfb-b226caea138c tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1674 microversion: 2.1 time: 0.649808 Sep 19 15:04:20.570838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2184/4391] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:19 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1674 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:20.576260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:20.579439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:20.604489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.606260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.609074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.610234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.611220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.611853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.707082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:20.719423 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4125ba8-1ea4-407c-a6ba-5d7cfe84da16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1261 microversion: 2.1 time: 0.147149 Sep 19 15:04:20.721486 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2185/4392] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:20 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:20.722695 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78691d1f-6de5-43f2-8a43-df0d08602dd9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.192085 Sep 19 15:04:20.725426 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2208/4393] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:20 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:04:20.779913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:20.780995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:20.796201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.807450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.808381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.809741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.810413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.811278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.918503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:20.920058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:20.936774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.937850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.939143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:20.946259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:20.948999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:20.950399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:22.078647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:22.098239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:22.122184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:22.134695 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d9eae12-1b92-481c-9c85-899552c472e6 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 1.221311 Sep 19 15:04:22.150366 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2209/4394] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:20 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:22.214293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:22.215402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:22.238413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:22.244331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:22.252429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:22.254480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:22.255459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:22.256383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:22.406696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:22.451172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d534a140-1f67-4ec8-9b7a-7f4ffd34529e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1501 microversion: 2.1 time: 1.709751 Sep 19 15:04:22.466941 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2186/4395] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:20 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1501 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:22.492353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:22.496567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:22.521103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:22.529043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:22.540045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:22.542054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:22.543373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:22.546182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:23.571220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:23.613880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:23.618647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:23.628456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d780589-2c31-40a3-94ed-8cb344c15b6c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1708 microversion: 2.42 time: 1.461751 Sep 19 15:04:23.638180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2210/4396] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:22 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1708 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:23.656682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:23.664851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:23.692698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:23.694260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:23.695418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:23.700126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:23.704071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:23.708549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:23.748065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:23.787507 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e5d4996-4d38-4332-a736-4e0b4672e5ec tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1674 microversion: 2.1 time: 1.333383 Sep 19 15:04:23.797866 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2187/4397] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:22 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1674 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:23.829946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:23.836483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:23.870684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:23.881550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:23.883244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:23.891907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:23.897325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:23.898299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:24.104584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:24.132259 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f3c1e4a-748d-4f8e-a638-13e472d1d855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1267 microversion: 2.1 time: 0.491230 Sep 19 15:04:24.163361 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2211/4398] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:23 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1267 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:24.184875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:24.186208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:24.198341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:24.200103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:24.201363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:24.202953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:24.204338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:24.205567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:25.916878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:25.923426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:25.934675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:25.938440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:25.947164 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b05dd44f-f247-4c76-b784-a5c24407c21f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 2.140435 Sep 19 15:04:25.949699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2188/4399] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:23 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:25.954290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:25.960924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:25.967681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:25.976035 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ddd2b377-85dd-4710-ac15-17657d4a1418 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1501 microversion: 2.1 time: 1.810867 Sep 19 15:04:25.978422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:25.978694 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2212/4400] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:24 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1501 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:25.980820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:25.986190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:25.987844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:25.988895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:25.989089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:25.989655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:25.990154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:26.005357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:26.006180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:26.006824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:26.007775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:26.008407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:26.010456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:26.290979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:26.305942 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8959be7f-bf80-444f-b82e-a7e46483cf6a tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1606 microversion: 2.1 time: 0.323679 Sep 19 15:04:26.307635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2213/4401] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:25 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1606 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:26.324378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:26.325398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:26.347316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:26.356732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:26.357982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:26.359370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:26.360201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:26.360966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:26.691723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:26.702395 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-01891ea0-3a50-471f-a228-6d53e27adb8d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1267 microversion: 2.1 time: 0.390076 Sep 19 15:04:26.709585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2214/4402] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:26 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1267 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:26.756367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:26.775819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:26.780266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:26.785997 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-446d453c-6615-4960-8c2c-9aee16ded42c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1755 microversion: 2.42 time: 0.826867 Sep 19 15:04:26.787032 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2189/4403] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:25 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1755 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:26.982264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:26.985991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:27.009248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:27.009892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:27.026593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.027122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.027739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.031415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.032333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.033312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.034240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.036310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.038151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.039182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.040408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.043271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.564443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:27.577006 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d243d5c-3fb9-48d5-814a-0982f6a90528 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1501 microversion: 2.1 time: 0.580189 Sep 19 15:04:27.581881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2190/4404] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:26 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1501 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:27.584567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:27.592618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:27.595827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:27.604461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:27.614502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:27.615900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7324926-6cab-496a-9f8a-437539c9a724 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.638079 Sep 19 15:04:27.616507 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2215/4405] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:26 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:27.628805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.636332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.639818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.644400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.665916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.666553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.739404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:27.740820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:27.778531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.779786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.782069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:27.784492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:27.788397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:27.788861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:28.290768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:28.309672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d7590aa1f4fa48be57e2efc017a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b030a0534946eb96c825f4c9acc526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:28.333605 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8038454-49e4-4900-86a7-edd404fa6770 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 200 len: 1606 microversion: 2.1 time: 0.750164 Sep 19 15:04:28.349798 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2191/4406] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:27 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 1606 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:28.356999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:28.357918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:28.367600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:28.368395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:28.369142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:28.370560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:28.371340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:28.372008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:28.400550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:28.759013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:28.774389 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-100c1390-6e00-4923-9877-4a86861e2152 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 1.041773 Sep 19 15:04:28.782855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2216/4407] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:27 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:28.796500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e07b66e0-b74f-43a2-bc7e-899a89987fd9 req-fb33135e-dfc7-4a18-929f-e7ec122116e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5b990e-c5d3-4ead-83c5-138ba5427808", "name": "network-vif-deleted", "tag": "67a117ed-ff1a-4298-933b-4a3a853bd4ee"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:28.836078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e07b66e0-b74f-43a2-bc7e-899a89987fd9 req-fb33135e-dfc7-4a18-929f-e7ec122116e4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:28.841344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e07b66e0-b74f-43a2-bc7e-899a89987fd9 req-fb33135e-dfc7-4a18-929f-e7ec122116e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:28.841889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e07b66e0-b74f-43a2-bc7e-899a89987fd9 req-fb33135e-dfc7-4a18-929f-e7ec122116e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:28.893425 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e07b66e0-b74f-43a2-bc7e-899a89987fd9 req-fb33135e-dfc7-4a18-929f-e7ec122116e4 service nova] Creating event network-vif-deleted:67a117ed-ff1a-4298-933b-4a3a853bd4ee for instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 on n-h1-858384-1 Sep 19 15:04:28.907635 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e07b66e0-b74f-43a2-bc7e-899a89987fd9 req-fb33135e-dfc7-4a18-929f-e7ec122116e4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120831 Sep 19 15:04:28.909980 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2217/4408] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:28.927824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:28.931927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:28.965358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:28.973259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:28.975860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:28.979206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:28.980137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:28.983742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:29.386890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:29.726291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:29.741635 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e9766b3b-5f56-4033-9cc9-f5fb25f4b0a2 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.828400 Sep 19 15:04:29.750940 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2218/4409] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:28 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:29.762287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:29.769431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:29.783835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:29.796339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:29.796868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:29.803619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:29.804122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:29.804566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.173051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.188210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.198245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.201634 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d2bcde27-47bd-40a3-ac84-40549b50ac07 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1849 microversion: 2.42 time: 1.850616 Sep 19 15:04:30.207165 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2192/4410] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:28 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1849 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:30.215034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:30.215872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] [instance: 7d5b990e-c5d3-4ead-83c5-138ba5427808] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:30.231602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:30.232423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:30.233228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.234121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:30.234762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:30.236838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.273579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] HTTP exception thrown: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 could not be found. Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Request method failure captured: Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 HTTP/1.1 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIKW8eDVNw4LEdqVpdCBxh2Qq4Tnz38DXsRJDnV8Vo4iGmvOO6SiPpvncK1LpZrOtmc59fgqG33RJW_PttC8VA_XyUig4Bdmrx3rK2oObQsW-BQK02umlJeR4Dlz7YrgaZ_zRV_AUfvqHRA4ELMlAjpzu8OrvM9k_62FZH8uM6_j-_Q Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5b030a0534946eb96c825f4c9acc526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5b030a0534946eb96c825f4c9acc526"}]}] Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: b5b030a0534946eb96c825f4c9acc526 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1000218241 Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c11d7590aa1f4fa48be57e2efc017a6f Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1000218241-project Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 could not be found. Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7d5b990e-c5d3-4ead-83c5-138ba5427808'} Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 could not be found. Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 could not be found. Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:30.275977 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 could not be found. Sep 19 15:04:30.288873 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:30.295519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Returning 404 to user: Instance 7d5b990e-c5d3-4ead-83c5-138ba5427808 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:30.296916 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a73280ea-af31-48f0-b373-02b594a51c55 tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808" status: 404 len: 111 microversion: 2.1 time: 0.088446 Sep 19 15:04:30.298017 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2193/4411] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:30 2022] GET /compute/v2.1/servers/7d5b990e-c5d3-4ead-83c5-138ba5427808 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:30.309113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:30.310060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:30.322503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:30.325884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:30.326698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.327728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:30.331839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:30.335973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.459873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.478676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.480460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.484967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8fe8afcc-fe9b-4843-9fbc-f44763cea864 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.732855 Sep 19 15:04:30.500223 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2219/4412] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:29 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:30.516502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:30.521834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:30.543016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:30.543518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:30.545165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.547329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:30.547919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:30.549122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:30.905223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.915258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d4fdf2a-551c-41f6-b8fb-058ad5b668ba tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.615929 Sep 19 15:04:30.932230 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2194/4413] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:30 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:30.965831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:30.984059 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-426c76c6-9ab5-4d50-9192-1ce843db5cfb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 0.481733 Sep 19 15:04:30.986006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2220/4414] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:30 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:30.997214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eac92ebe-0c4c-4511-9c3a-a4305a0b65da tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] Calling method '.version_select at 0x7fde28d0cd30>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:31.050886 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eac92ebe-0c4c-4511-9c3a-a4305a0b65da tempest-ServerActionsTestJSON-1000218241 tempest-ServerActionsTestJSON-1000218241-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201064550" status: 202 len: 0 microversion: 2.1 time: 0.061281 Sep 19 15:04:31.054817 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2221/4415] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 15:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201064550 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:04:31.063420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-435375f1-bbb3-4aa8-bb03-8143390501ac req-de7a292c-3ce0-40f9-b0f2-1c5f2b05774e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "name": "network-vif-plugged", "status": "completed", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:31.095547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-435375f1-bbb3-4aa8-bb03-8143390501ac req-de7a292c-3ce0-40f9-b0f2-1c5f2b05774e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:31.097055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-435375f1-bbb3-4aa8-bb03-8143390501ac req-de7a292c-3ce0-40f9-b0f2-1c5f2b05774e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:31.097757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-435375f1-bbb3-4aa8-bb03-8143390501ac req-de7a292c-3ce0-40f9-b0f2-1c5f2b05774e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:31.118367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-435375f1-bbb3-4aa8-bb03-8143390501ac req-de7a292c-3ce0-40f9-b0f2-1c5f2b05774e service nova] Creating event network-vif-plugged:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:04:31.120364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1ba7bd6d-1253-487b-870f-c8ad8a2b0a28 req-3f45b042-3f86-4802-9e49-f10bf8870121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "f12a897c-c664-4973-8f53-f65f9c81f88d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:31.124354 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-435375f1-bbb3-4aa8-bb03-8143390501ac req-de7a292c-3ce0-40f9-b0f2-1c5f2b05774e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071179 Sep 19 15:04:31.125241 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2222/4416] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:31.141039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab1aa6f7-0a4a-4ecc-ab8d-4490321e2c36 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:31.142083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab1aa6f7-0a4a-4ecc-ab8d-4490321e2c36 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: efe7781f-afa8-4b1a-9a23-3d76c6d90048] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:31.148489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1ba7bd6d-1253-487b-870f-c8ad8a2b0a28 req-3f45b042-3f86-4802-9e49-f10bf8870121 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:31.149064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1ba7bd6d-1253-487b-870f-c8ad8a2b0a28 req-3f45b042-3f86-4802-9e49-f10bf8870121 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:31.149724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1ba7bd6d-1253-487b-870f-c8ad8a2b0a28 req-3f45b042-3f86-4802-9e49-f10bf8870121 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:31.165151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1ba7bd6d-1253-487b-870f-c8ad8a2b0a28 req-3f45b042-3f86-4802-9e49-f10bf8870121 service nova] Creating event network-changed:f12a897c-c664-4973-8f53-f65f9c81f88d for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:31.171166 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1ba7bd6d-1253-487b-870f-c8ad8a2b0a28 req-3f45b042-3f86-4802-9e49-f10bf8870121 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237188 Sep 19 15:04:31.173073 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2195/4417] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:31.181158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ab1aa6f7-0a4a-4ecc-ab8d-4490321e2c36 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance efe7781f-afa8-4b1a-9a23-3d76c6d90048 could not be found. Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab1aa6f7-0a4a-4ecc-ab8d-4490321e2c36 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/efe7781f-afa8-4b1a-9a23-3d76c6d90048/action HTTP/1.1 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 15 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: {"unpause": {}} Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance efe7781f-afa8-4b1a-9a23-3d76c6d90048 could not be found. Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'efe7781f-afa8-4b1a-9a23-3d76c6d90048', 'body': {'unpause': {}}} Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe7781f-afa8-4b1a-9a23-3d76c6d90048 could not be found. Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe7781f-afa8-4b1a-9a23-3d76c6d90048 could not be found. Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:31.185809 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:31.193584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:31.193584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:31.193584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe7781f-afa8-4b1a-9a23-3d76c6d90048 could not be found. Sep 19 15:04:31.193584 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:31.193584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab1aa6f7-0a4a-4ecc-ab8d-4490321e2c36 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance efe7781f-afa8-4b1a-9a23-3d76c6d90048 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:31.198607 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab1aa6f7-0a4a-4ecc-ab8d-4490321e2c36 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/efe7781f-afa8-4b1a-9a23-3d76c6d90048/action" status: 404 len: 111 microversion: 2.1 time: 0.057453 Sep 19 15:04:31.201025 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2223/4418] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:31 2022] POST /compute/v2.1/servers/efe7781f-afa8-4b1a-9a23-3d76c6d90048/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:31.214242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:31.217397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:31.241403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:31.243433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:31.248850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:31.249587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:31.250504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:31.253908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:31.255134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:31.256223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:31.260893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:31.261471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:31.261953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:31.263935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:31.265929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:31.281719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:32.578103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:32.589971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:32.606408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d7b579a6-812d-45c6-97c3-c14b3281d55b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.400299 Sep 19 15:04:32.607116 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2196/4419] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:31 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:32.611386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:32.616897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:32.623114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-172be090-5962-4282-ab61-432bee1be98b req-3d61fd50-d06a-4c3d-ab89-8626b47e038b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f63ed0-1803-415c-b709-aebca601ba1e", "tag": "dee5c414-93ef-4cf0-be2d-5eb30952ea92"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:32.626038 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-410cff38-fb05-43d3-8e8b-162ed5a99fa7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1870 microversion: 2.42 time: 1.393989 Sep 19 15:04:32.638669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-172be090-5962-4282-ab61-432bee1be98b req-3d61fd50-d06a-4c3d-ab89-8626b47e038b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:32.639452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-172be090-5962-4282-ab61-432bee1be98b req-3d61fd50-d06a-4c3d-ab89-8626b47e038b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:32.641379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-172be090-5962-4282-ab61-432bee1be98b req-3d61fd50-d06a-4c3d-ab89-8626b47e038b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:32.655383 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-172be090-5962-4282-ab61-432bee1be98b req-3d61fd50-d06a-4c3d-ab89-8626b47e038b service nova] Creating event network-changed:dee5c414-93ef-4cf0-be2d-5eb30952ea92 for instance 78f63ed0-1803-415c-b709-aebca601ba1e on n-h2-858384-1 Sep 19 15:04:32.657470 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2224/4420] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:31 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1870 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:32.663433 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-172be090-5962-4282-ab61-432bee1be98b req-3d61fd50-d06a-4c3d-ab89-8626b47e038b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055033 Sep 19 15:04:32.668792 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2197/4421] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:32.669707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:32.670561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:32.678592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:32.679351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:32.679992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:32.680890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:32.681522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:32.682124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:32.684652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:32.685709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:32.701182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:32.701702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:32.702144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:32.702901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:32.703378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:32.703812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:33.613163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:33.625810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:33.632744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:33.636994 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3bbb11de-a040-494e-a929-2a3a95e16b2f tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1730 microversion: 2.20 time: 0.978306 Sep 19 15:04:33.637528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:33.649714 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2225/4422] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:32 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1730 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:33.653816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:33.655914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:33.675968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:33.676964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:33.679853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:33.681992 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ca984b3-4eca-4889-a345-dc05bb5c83e9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 1.009120 Sep 19 15:04:33.694801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:33.694801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:33.695275 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2198/4423] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:32 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:33.695457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:33.709655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-122e4028-c918-4b79-b618-dbfd167d4603 req-91d5eb76-4249-44c7-8e90-4bfedb9bc7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "629f4872-d0bd-4b7d-b472-27604836b34b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:33.740983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-122e4028-c918-4b79-b618-dbfd167d4603 req-91d5eb76-4249-44c7-8e90-4bfedb9bc7b9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:33.743546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-122e4028-c918-4b79-b618-dbfd167d4603 req-91d5eb76-4249-44c7-8e90-4bfedb9bc7b9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:33.744397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-122e4028-c918-4b79-b618-dbfd167d4603 req-91d5eb76-4249-44c7-8e90-4bfedb9bc7b9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:33.758649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:33.781264 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-122e4028-c918-4b79-b618-dbfd167d4603 req-91d5eb76-4249-44c7-8e90-4bfedb9bc7b9 service nova] Creating event network-changed:629f4872-d0bd-4b7d-b472-27604836b34b for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:33.796841 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-122e4028-c918-4b79-b618-dbfd167d4603 req-91d5eb76-4249-44c7-8e90-4bfedb9bc7b9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103285 Sep 19 15:04:33.798040 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2199/4424] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:33.808666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:33.810086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:33.818620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:33.819604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:33.820420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:33.822047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:33.822937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:33.823746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:34.598669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:34.603516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:34.614536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:34.616526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:34.618062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5defd4dd-c287-4955-998a-8f03a8c0e14f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1870 microversion: 2.42 time: 0.818457 Sep 19 15:04:34.619512 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2200/4425] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:33 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1870 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:34.622399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8c753e7-9be6-48bb-b810-454b43773810 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.979135 Sep 19 15:04:34.624197 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2226/4426] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:33 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:34.645846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:34.646502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:34.654579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:34.655392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:34.656037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:34.656976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:34.657616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:34.658222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:34.670692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:34.671950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:34.700121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:34.700994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:34.701659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:34.703067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:34.705306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:34.706298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:34.777577 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'unpause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 15 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: {"unpause": {}} Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: exception: Cannot 'unpause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'unpause': {}}} Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state active. Cannot unpause while the instance is in this state. Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:34.782947 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:34.788553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:34.788553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:34.788553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:34.788553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:34.788553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:34.790025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'unpause' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:34.791492 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cdcea0f0-e78e-4c79-9b0c-3ad258229f59 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 145 microversion: 2.1 time: 0.149450 Sep 19 15:04:34.796621 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2201/4427] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:34 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 145 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 19 15:04:34.803194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:34.804152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:34.813246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:34.814245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:34.816029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:34.817164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:34.817894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:34.818875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:35.139979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:35.148871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:35.150880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:35.157937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:35.159959 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b89a21d1-f0a6-4b4a-9540-402fbc3946c7 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1717 microversion: 2.20 time: 0.493060 Sep 19 15:04:35.161691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-954ee4ad-a810-4bf7-875c-064091d7bef6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 0.363402 Sep 19 15:04:35.162622 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2202/4428] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:34 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:35.163122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2227/4429] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:34 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1717 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:04:35.182833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:35.186155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:35.201815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:35.202422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:35.203268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:35.205165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:35.208203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:35.209381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:35.567786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:35.579526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ef81f225-7a4f-412c-80b3-15b0a696899c tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.414904 Sep 19 15:04:35.598700 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2203/4430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:35 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:35.608276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:35.608906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:35.629397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:35.630001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:35.630343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:35.631098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:35.631562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:35.631993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:35.650452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:35.651609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:35.663352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:35.668147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:35.668846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:35.669768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:35.673452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:35.674265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:36.265039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:36.296913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c15d9d3a-349d-414e-9ac5-bc3f8bd116e9 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.688855 Sep 19 15:04:36.302923 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2228/4431] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:35 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:04:36.313858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-81aaaa7f-0a92-4add-91c5-b4368bfa1683 req-586e56b7-d841-4b60-af4a-8d15ce473653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "8569a7b5-dba0-4127-ac0a-52ca3bd03847"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:36.328882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:36.340443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81aaaa7f-0a92-4add-91c5-b4368bfa1683 req-586e56b7-d841-4b60-af4a-8d15ce473653 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:36.341966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81aaaa7f-0a92-4add-91c5-b4368bfa1683 req-586e56b7-d841-4b60-af4a-8d15ce473653 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:36.343262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81aaaa7f-0a92-4add-91c5-b4368bfa1683 req-586e56b7-d841-4b60-af4a-8d15ce473653 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:36.348504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:36.350107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:36.351401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97a4d4bf-940c-4f7b-873e-caa9c4574168 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.708684 Sep 19 15:04:36.354415 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2204/4432] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:35 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:36.367049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:36.381971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:36.397779 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-81aaaa7f-0a92-4add-91c5-b4368bfa1683 req-586e56b7-d841-4b60-af4a-8d15ce473653 service nova] Creating event network-changed:8569a7b5-dba0-4127-ac0a-52ca3bd03847 for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:36.408677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:36.409324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:36.409901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:36.410882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:36.411533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:36.412147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:36.442876 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-81aaaa7f-0a92-4add-91c5-b4368bfa1683 req-586e56b7-d841-4b60-af4a-8d15ce473653 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133070 Sep 19 15:04:36.460901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2229/4433] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:36.487584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-080c053a-778e-4d7e-92ee-e03462801c0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:36.495844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-080c053a-778e-4d7e-92ee-e03462801c0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:36.508103 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-080c053a-778e-4d7e-92ee-e03462801c0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a could not be found. Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-080c053a-778e-4d7e-92ee-e03462801c0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a/action HTTP/1.1 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 18 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: {"unshelve": null} Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a could not be found. Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a', 'body': {'unshelve': None}} Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a could not be found. Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a could not be found. Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:36.509888 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a could not be found. Sep 19 15:04:36.515581 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:36.517125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-080c053a-778e-4d7e-92ee-e03462801c0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:36.518211 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-080c053a-778e-4d7e-92ee-e03462801c0b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a/action" status: 404 len: 111 microversion: 2.1 time: 0.053573 Sep 19 15:04:36.519022 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2230/4434] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:36 2022] POST /compute/v2.1/servers/c977f3cd-32ca-4bac-8fc5-a7aa6a23c08a/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:36.532214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:36.533148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:36.542045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:36.542863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:36.543672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:36.544605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:36.545242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:36.546199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:37.190688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:37.206333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8136767-b6dd-474b-bdc4-5f30eca8f957 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 0.842525 Sep 19 15:04:37.207526 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2205/4435] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:36 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:37.389621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:37.390259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:37.405947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:37.411710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:37.414363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:37.415519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:37.417298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:37.421136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:37.449039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:37.478939 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d6aa3f9-95e6-4f30-b07c-1584b81e10d5 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.947757 Sep 19 15:04:37.500084 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2231/4436] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:36 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:37.508370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:37.509187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:37.516045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:37.516594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:37.517032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:37.517679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:37.518663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:37.519337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:38.699573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:38.729455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:38.745878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:38.749001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:38.750819 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8cf37057-78f3-48b6-a0d1-5b9e096161b6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 1.367964 Sep 19 15:04:38.751993 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2206/4437] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:37 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:04:38.759273 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a62bc5cc-866d-4453-8616-af369923b3d4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 1.251583 Sep 19 15:04:38.759954 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2232/4438] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:37 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:38.775163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:38.784358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a5f00dbc-68ab-456b-9e8f-a48192cd23ee req-0ec84592-343c-4684-a297-ea72e484b681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:38.822388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a5f00dbc-68ab-456b-9e8f-a48192cd23ee req-0ec84592-343c-4684-a297-ea72e484b681 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:38.827932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a5f00dbc-68ab-456b-9e8f-a48192cd23ee req-0ec84592-343c-4684-a297-ea72e484b681 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:38.831805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a5f00dbc-68ab-456b-9e8f-a48192cd23ee req-0ec84592-343c-4684-a297-ea72e484b681 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:38.846023 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a5f00dbc-68ab-456b-9e8f-a48192cd23ee req-0ec84592-343c-4684-a297-ea72e484b681 service nova] Creating event network-changed:1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:38.865679 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a5f00dbc-68ab-456b-9e8f-a48192cd23ee req-0ec84592-343c-4684-a297-ea72e484b681 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085382 Sep 19 15:04:38.867323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2233/4439] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:38.876506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a7765a84-662b-43f2-a9cd-8c2557f9c0d8 req-40d927b1-9cd1-4574-be23-a5f456dff919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f63ed0-1803-415c-b709-aebca601ba1e", "name": "network-vif-plugged", "status": "completed", "tag": "dee5c414-93ef-4cf0-be2d-5eb30952ea92"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:38.890695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a7765a84-662b-43f2-a9cd-8c2557f9c0d8 req-40d927b1-9cd1-4574-be23-a5f456dff919 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:38.891682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a7765a84-662b-43f2-a9cd-8c2557f9c0d8 req-40d927b1-9cd1-4574-be23-a5f456dff919 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:38.892470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a7765a84-662b-43f2-a9cd-8c2557f9c0d8 req-40d927b1-9cd1-4574-be23-a5f456dff919 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:38.910436 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a7765a84-662b-43f2-a9cd-8c2557f9c0d8 req-40d927b1-9cd1-4574-be23-a5f456dff919 service nova] Creating event network-vif-plugged:dee5c414-93ef-4cf0-be2d-5eb30952ea92 for instance 78f63ed0-1803-415c-b709-aebca601ba1e on n-h2-858384-1 Sep 19 15:04:38.917491 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a7765a84-662b-43f2-a9cd-8c2557f9c0d8 req-40d927b1-9cd1-4574-be23-a5f456dff919 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047641 Sep 19 15:04:38.918296 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2234/4440] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:38.941321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:38.943547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:38.965702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:38.969618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:38.972246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:38.973752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:38.975806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:38.977426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:39.020633 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Cannot 'unshelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action HTTP/1.1 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 18 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: {"unshelve": null} Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'unshelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'unshelve': None}} Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa in vm_state active. Cannot unshelve while the instance is in this state. Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:04:39.025847 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active Sep 19 15:04:39.031684 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:39.032573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 409 to user: Cannot 'unshelve' instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa while it is in vm_state active {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:39.044818 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c61cf7c-b79a-41f4-bc78-3b1f5d27ba7b tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action" status: 409 len: 146 microversion: 2.1 time: 0.113665 Sep 19 15:04:39.052015 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2235/4441] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:04:38 2022] POST /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa/action => generated 146 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:04:39.057169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:39.057793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:39.075838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:39.078365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:39.079129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:39.084475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:39.085168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:39.085783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:39.378796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:39.396445 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cd5043c9-1cfe-4548-a776-2dc1e5df575c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 0.640482 Sep 19 15:04:39.401790 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2207/4442] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:38 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:39.614538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:39.631934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be2cdba7-223c-4766-8b7c-023cf074e561 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.578738 Sep 19 15:04:39.632696 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2236/4443] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:39 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:39.661579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:39.662259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:39.680470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:39.681112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:39.681572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:39.688329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:39.689176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:39.691473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:39.732697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:39.782106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:39.783445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:39.809855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:39.817581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:39.822464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:39.823546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:39.827704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:39.829600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:40.343711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:40.359624 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dfb8f157-287a-4363-b9d9-389bbebb2c52 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.700044 Sep 19 15:04:40.360944 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2208/4444] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:39 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:40.387275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e18b8bc7-7b47-405b-acbb-f752ae4a3434 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-939693881_updated"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:40.390164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e18b8bc7-7b47-405b-acbb-f752ae4a3434 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 5e3be2f9-e62d-402c-8f47-84fc1b100b3c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:40.408540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e18b8bc7-7b47-405b-acbb-f752ae4a3434 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 5e3be2f9-e62d-402c-8f47-84fc1b100b3c could not be found. Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e18b8bc7-7b47-405b-acbb-f752ae4a3434 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/servers/5e3be2f9-e62d-402c-8f47-84fc1b100b3c HTTP/1.1 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 80 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-939693881_updated"}} Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5e3be2f9-e62d-402c-8f47-84fc1b100b3c could not be found. Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5e3be2f9-e62d-402c-8f47-84fc1b100b3c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-939693881_updated'}}} Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e3be2f9-e62d-402c-8f47-84fc1b100b3c could not be found. Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 19 15:04:40.425925 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e3be2f9-e62d-402c-8f47-84fc1b100b3c could not be found. Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e3be2f9-e62d-402c-8f47-84fc1b100b3c could not be found. Sep 19 15:04:40.430425 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:40.432998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e18b8bc7-7b47-405b-acbb-f752ae4a3434 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 5e3be2f9-e62d-402c-8f47-84fc1b100b3c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:40.436073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e18b8bc7-7b47-405b-acbb-f752ae4a3434 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "PUT /compute/v2.1/servers/5e3be2f9-e62d-402c-8f47-84fc1b100b3c" status: 404 len: 111 microversion: 2.1 time: 0.050917 Sep 19 15:04:40.439117 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2209/4445] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:04:40 2022] PUT /compute/v2.1/servers/5e3be2f9-e62d-402c-8f47-84fc1b100b3c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:40.445297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:40.467166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:40.484480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:40.488028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:40.488755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:40.491887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:40.492675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:40.495287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:40.604043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:40.652288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:40.670486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:40.673296 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb353b11-5956-4f07-8939-fd84ff35ec05 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.895299 Sep 19 15:04:40.703310 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2237/4446] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:39 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:04:40.727470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:40.731580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:40.746660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:40.748618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:40.750470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:40.755995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:40.758068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:40.759274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:41.285859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:41.312571 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7744bda-6ed1-4d6a-b22a-7f0ce497fde9 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1309 microversion: 2.1 time: 0.864110 Sep 19 15:04:41.331574 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2210/4447] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:40 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1309 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:41.348442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8b4790e4-7745-41ba-a5d0-f9c99e1dd2b3 req-00dc7e32-c43d-4eb4-8577-2f962f238170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "5a074f08-9079-405a-bf80-1f3c93fce8a9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:41.348691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:41.365910 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7504095-6f14-42f9-a166-4fa2b526675e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.657533 Sep 19 15:04:41.367101 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2238/4448] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:40 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:41.369946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8b4790e4-7745-41ba-a5d0-f9c99e1dd2b3 req-00dc7e32-c43d-4eb4-8577-2f962f238170 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:41.371802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8b4790e4-7745-41ba-a5d0-f9c99e1dd2b3 req-00dc7e32-c43d-4eb4-8577-2f962f238170 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:41.373058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8b4790e4-7745-41ba-a5d0-f9c99e1dd2b3 req-00dc7e32-c43d-4eb4-8577-2f962f238170 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:41.397621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:41.398262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:41.419235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:41.420325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:41.423149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:41.424201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:41.430625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:41.431315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:41.437586 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8b4790e4-7745-41ba-a5d0-f9c99e1dd2b3 req-00dc7e32-c43d-4eb4-8577-2f962f238170 service nova] Creating event network-changed:5a074f08-9079-405a-bf80-1f3c93fce8a9 for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:41.480866 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8b4790e4-7745-41ba-a5d0-f9c99e1dd2b3 req-00dc7e32-c43d-4eb4-8577-2f962f238170 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142155 Sep 19 15:04:41.505133 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2211/4449] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:41.755255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:41.760277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:41.784515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:41.795127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:41.797029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:41.807053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:41.807989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:41.808541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:41.932705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:41.944237 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06812f8c-c42c-4f4e-b276-2a427ef0fde4 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.551114 Sep 19 15:04:41.945190 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2239/4450] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:41 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:04:41.974069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b4dbe31-9369-4ae0-94c6-b2485a4abb30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b4dbe31-9369-4ae0-94c6-b2485a4abb30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa HTTP/1.1 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 280 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.982552 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b4dbe31-9369-4ae0-94c6-b2485a4abb30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b4dbe31-9369-4ae0-94c6-b2485a4abb30 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "PUT /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 400 len: 619 microversion: 2.1 time: 0.014915 Sep 19 15:04:41.993326 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2240/4451] 10.222.0.81 () {60 vars in 1257 bytes} [Mon Sep 19 15:04:41 2022] PUT /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:04:42.000838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:42.000838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:42.037339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.043159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.044380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.045150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.048415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.048936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.589340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:42.600565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:42.605944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:42.610796 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ef09e81-9b16-4cb3-b315-82776971c419 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.887477 Sep 19 15:04:42.617537 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2212/4452] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:41 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:42.626062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:42.626995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:42.640605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:42.646266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.647332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.647982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.648899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.649537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.650214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.657362 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-625bfe33-55f4-42c8-9047-53b04e626881 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.665407 Sep 19 15:04:42.669624 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2241/4453] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:41 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:42.688351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:42.690450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:42.697490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.698252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.698928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.701052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.701737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.702349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.895035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:42.933356 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f9baf0ad-d8d8-4446-9189-f6bc6bc3c361 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1489 microversion: 2.1 time: 0.303365 Sep 19 15:04:42.934217 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2213/4454] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:42 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1489 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:42.968181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:42.978679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:42.992371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.993156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.993817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:42.994898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:42.995562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:42.996176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.085975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:43.095408 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe8f10b3-7aee-4e76-923f-1d9fb9cd364a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.411232 Sep 19 15:04:43.098162 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2242/4455] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:42 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:43.120453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e63c0754-b004-42e7-adad-319210e11f34 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e63c0754-b004-42e7-adad-319210e11f34 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: request: PUT /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa HTTP/1.1 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 24 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: {"server": {"name": ""}} Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa', 'body': {'server': {'name': ''}}} Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi '' Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:04:43.124867 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 19 15:04:43.131749 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:43.133530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e63c0754-b004-42e7-adad-319210e11f34 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:43.134485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e63c0754-b004-42e7-adad-319210e11f34 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "PUT /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 400 len: 108 microversion: 2.1 time: 0.018756 Sep 19 15:04:43.135129 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2243/4456] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:04:43 2022] PUT /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:04:43.147526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:43.152216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:43.181705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.182218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.182663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.183448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.183958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.184450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.345130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:43.422524 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2bd4df77-9f1c-4e39-be62-8bd7a327b344 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1489 microversion: 2.1 time: 0.456666 Sep 19 15:04:43.427099 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2214/4457] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:42 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1489 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:43.453435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:43.454336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:43.478958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.482137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.483027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.484364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.485094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.488478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.724810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:43.739821 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a1e1633b-5beb-4c02-9c1f-3e289bba0111 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1504 microversion: 2.1 time: 0.599384 Sep 19 15:04:43.743738 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2244/4458] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:43 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:43.768037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:43.769386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:43.784202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.786421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.787796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.788819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.790706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.792080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.825764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:43.845369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83456836-27af-427a-b470-3b05239c8cbe tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1489 microversion: 2.1 time: 0.396911 Sep 19 15:04:43.846211 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2215/4459] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:43 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1489 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:04:43.883762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:43.884704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:43.895673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.896672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.907583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.909322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:43.910520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:43.911375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:43.965940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:04:44.189536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:44.219157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:44.226876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:44.233377 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-090ddedf-ca78-468d-9fbd-2ec55df7a710 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.475511 Sep 19 15:04:44.234120 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2245/4460] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:43 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:44.255893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2112e552-8b46-4d96-bd6e-d60b28033390 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 204 len: 0 microversion: 2.1 time: 0.374463 Sep 19 15:04:44.258202 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2216/4461] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:43 2022] DELETE /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:44.270444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:44.271159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:44.301471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:44.302353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:44.302926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:44.303744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:44.304254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:44.304689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:44.392853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-189c461d-4707-4c16-99d6-d393f4d71e2a req-58f8d51e-73cb-493c-a25c-6b0b70cb3c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "1474cd9a-84bf-466c-8b10-53236c77b38f"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:44.414332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-189c461d-4707-4c16-99d6-d393f4d71e2a req-58f8d51e-73cb-493c-a25c-6b0b70cb3c0a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:44.415037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-189c461d-4707-4c16-99d6-d393f4d71e2a req-58f8d51e-73cb-493c-a25c-6b0b70cb3c0a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:44.417640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-189c461d-4707-4c16-99d6-d393f4d71e2a req-58f8d51e-73cb-493c-a25c-6b0b70cb3c0a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:44.452023 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-189c461d-4707-4c16-99d6-d393f4d71e2a req-58f8d51e-73cb-493c-a25c-6b0b70cb3c0a service nova] Creating event network-changed:1474cd9a-84bf-466c-8b10-53236c77b38f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:44.460112 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-189c461d-4707-4c16-99d6-d393f4d71e2a req-58f8d51e-73cb-493c-a25c-6b0b70cb3c0a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070792 Sep 19 15:04:44.461580 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2217/4462] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:04:45.112510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:45.192818 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b862fd5-4a45-4225-afc3-699f26def9b7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1495 microversion: 2.1 time: 0.926961 Sep 19 15:04:45.223987 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2246/4463] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:44 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1495 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:45.288268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:45.289177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:45.309496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:45.310364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:45.311185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:45.317223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:45.318068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:45.318708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:46.239669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:46.240879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:46.252073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:46.256937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:46.275575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:46.276363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:46.277303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:46.277952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:46.278569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:46.285945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:46.291222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:46.295906 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-69cb457f-099c-44e5-86bf-4382127dd1ec tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 1.012328 Sep 19 15:04:46.297708 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2218/4464] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:45 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:46.558885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f3a79a38-849d-4339-b91f-2ff06bd13df9 req-840a9b30-65ae-415a-87cc-3427c5820c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "ac4d87f5-429d-44db-8962-6e644307f42b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:46.581244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:46.589353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f3a79a38-849d-4339-b91f-2ff06bd13df9 req-840a9b30-65ae-415a-87cc-3427c5820c69 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:46.590204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f3a79a38-849d-4339-b91f-2ff06bd13df9 req-840a9b30-65ae-415a-87cc-3427c5820c69 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:46.595017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f3a79a38-849d-4339-b91f-2ff06bd13df9 req-840a9b30-65ae-415a-87cc-3427c5820c69 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:46.671550 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f3a79a38-849d-4339-b91f-2ff06bd13df9 req-840a9b30-65ae-415a-87cc-3427c5820c69 service nova] Creating event network-changed:ac4d87f5-429d-44db-8962-6e644307f42b for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:04:46.695946 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f3a79a38-849d-4339-b91f-2ff06bd13df9 req-840a9b30-65ae-415a-87cc-3427c5820c69 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140348 Sep 19 15:04:46.697520 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2219/4465] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:47.209922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:47.231192 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-406d462e-2526-40ff-b37f-da501bb9b6c8 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1495 microversion: 2.1 time: 0.990331 Sep 19 15:04:47.233625 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2247/4466] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:46 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1495 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:04:47.355332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:47.356128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:47.372712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:47.373729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:47.374887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:47.381490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:47.382804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:47.383531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:48.018266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:48.040063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:48.043674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:48.046845 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee65e914-d113-411b-b92b-18941703b2eb tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.697963 Sep 19 15:04:48.052463 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2220/4467] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:47 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:48.261219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:48.261977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:48.285923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:48.289120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:48.290069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:48.291153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:48.292474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:48.293110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:48.346390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:48.542935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:48.548044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0a8e3f7b-1ce6-4e48-80a0-086b05f754d3 req-fc7dbc8c-0a9f-4ea7-b1fc-599c6bf98f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f63ed0-1803-415c-b709-aebca601ba1e", "name": "network-vif-deleted", "tag": "dee5c414-93ef-4cf0-be2d-5eb30952ea92"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:48.559744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a71af04-696d-4bdd-926f-396856cb0855 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 200 len: 1453 microversion: 2.1 time: 0.301072 Sep 19 15:04:48.572734 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2248/4468] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:48 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 1453 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:48.610843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a8e3f7b-1ce6-4e48-80a0-086b05f754d3 req-fc7dbc8c-0a9f-4ea7-b1fc-599c6bf98f04 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:48.614984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a8e3f7b-1ce6-4e48-80a0-086b05f754d3 req-fc7dbc8c-0a9f-4ea7-b1fc-599c6bf98f04 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:48.616241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a8e3f7b-1ce6-4e48-80a0-086b05f754d3 req-fc7dbc8c-0a9f-4ea7-b1fc-599c6bf98f04 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:48.659681 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0a8e3f7b-1ce6-4e48-80a0-086b05f754d3 req-fc7dbc8c-0a9f-4ea7-b1fc-599c6bf98f04 service nova] Creating event network-vif-deleted:dee5c414-93ef-4cf0-be2d-5eb30952ea92 for instance 78f63ed0-1803-415c-b709-aebca601ba1e on n-h2-858384-1 Sep 19 15:04:48.670494 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0a8e3f7b-1ce6-4e48-80a0-086b05f754d3 req-fc7dbc8c-0a9f-4ea7-b1fc-599c6bf98f04 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139868 Sep 19 15:04:48.672180 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2221/4469] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:04:49.077792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:49.078830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:49.086321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:49.087196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:49.087857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:49.088784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:49.089619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:49.090265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:49.492866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:49.510356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:49.516157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:49.520447 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2b0475b-8ea2-4341-8f0d-645604b63d3d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.446601 Sep 19 15:04:49.524298 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2249/4470] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:49 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:49.586691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:49.588455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:49.603444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:49.606467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:49.607862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:49.610225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:49.612931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:49.613636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:49.657459 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e HTTP/1.1 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '78f63ed0-1803-415c-b709-aebca601ba1e'} Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:49.660474 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:04:49.666031 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:49.669734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:49.672146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e9d0228e-5f2f-42a5-b47c-e1d20164ba4d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 404 len: 111 microversion: 2.1 time: 0.090573 Sep 19 15:04:49.676182 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2222/4471] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:49 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:49.681267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:49.681900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:49.693063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:49.698503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:49.701083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:49.701970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:49.704531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:49.706644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:49.781522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:04:49.974437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:50.022097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8629f94a-455d-43bc-a5a5-3c6b38943042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 204 len: 0 microversion: 2.1 time: 0.344381 Sep 19 15:04:50.026584 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2250/4472] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:49 2022] DELETE /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:50.037325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:50.037966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:50.053167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:50.053167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:50.057505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:50.058316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:50.058973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:50.061750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:50.468637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:50.482821 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82c8e4b7-2b9b-4e80-b84d-8bc40baab2d1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1495 microversion: 2.1 time: 0.449276 Sep 19 15:04:50.494880 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2223/4473] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:50 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1495 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:50.554055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:50.554969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:50.576216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:50.576904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:50.586488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:50.587409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:50.588002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:50.588559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:51.017171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:51.036098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:51.039419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:51.043168 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-edb5f2fa-6fc3-44b5-9a92-2e4730ed3d6a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1891 microversion: 2.42 time: 0.493795 Sep 19 15:04:51.046244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2251/4474] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:50 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1891 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:51.516360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:51.516996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:51.544138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:51.544648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:51.545094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:51.546863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:51.547273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:51.547712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:52.074616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:52.075885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:52.089694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:52.090658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:52.091328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:52.092235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:52.092869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:52.095326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:52.996084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:53.008699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd80cb2f-cc79-4622-b233-cc934ad08249 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1495 microversion: 2.1 time: 1.496393 Sep 19 15:04:53.018969 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2224/4475] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:51 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1495 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:53.175286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-48dfe7c5-0b78-479e-b387-52d8532ad1af req-0d5a786f-083c-4d3c-a9df-f2724b5eda32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ff6f06-e104-4d2d-9b65-c9b25fca9f1c", "name": "network-vif-deleted", "tag": "8ffe648e-5660-4665-84c1-f8e566587209"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:53.239952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:53.251768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-48dfe7c5-0b78-479e-b387-52d8532ad1af req-0d5a786f-083c-4d3c-a9df-f2724b5eda32 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:53.253046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-48dfe7c5-0b78-479e-b387-52d8532ad1af req-0d5a786f-083c-4d3c-a9df-f2724b5eda32 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:53.253601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-48dfe7c5-0b78-479e-b387-52d8532ad1af req-0d5a786f-083c-4d3c-a9df-f2724b5eda32 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:53.263310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:53.271063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:53.276622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-451bf398-79f6-4f13-a382-095a26f06856 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 1.206001 Sep 19 15:04:53.298314 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-48dfe7c5-0b78-479e-b387-52d8532ad1af req-0d5a786f-083c-4d3c-a9df-f2724b5eda32 service nova] Creating event network-vif-deleted:8ffe648e-5660-4665-84c1-f8e566587209 for instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c on n-h2-858384-1 Sep 19 15:04:53.298897 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2252/4476] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:52 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:53.338297 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-48dfe7c5-0b78-479e-b387-52d8532ad1af req-0d5a786f-083c-4d3c-a9df-f2724b5eda32 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170168 Sep 19 15:04:53.340341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2225/4477] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:54.042118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:54.044004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:54.073633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:54.074413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:54.075316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:54.075909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:54.076504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:54.080547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:54.190838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:54.191838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:54.193377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:54.194899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lazy-loading 'fault' on Instance uuid 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:04:54.311017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:54.312443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:54.339333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:54.340322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:54.340998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:54.341990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:54.343737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:54.344547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:54.345103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:54.383284 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-84fee1fb-7117-4459-bda7-9c0e5b7c3d69 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 200 len: 1299 microversion: 2.1 time: 0.344678 Sep 19 15:04:54.385574 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2253/4478] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:54 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 1299 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:54.731490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:54.750696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:54.756401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:54.758504 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bf370ef4-66ef-4c07-978b-e0f6222af0ff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.453427 Sep 19 15:04:54.780184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2226/4479] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:54 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:55.175666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:55.176342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:55.187240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.193941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.195068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.195964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.197744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.198325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.236262 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce HTTP/1.1 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '10aa93bf-e81c-4424-a09d-5783ba44edce'} Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:55.242644 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.248196 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.250780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:55.250780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d9c7ca40-94e4-4dca-8778-15c18eca0024 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "DELETE /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 404 len: 111 microversion: 2.1 time: 0.079829 Sep 19 15:04:55.255545 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2254/4480] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:55 2022] DELETE /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:55.264162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:55.264791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: 10aa93bf-e81c-4424-a09d-5783ba44edce] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:55.271944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.272444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.283379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.284677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.285618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.286088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.328336 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce HTTP/1.1 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '10aa93bf-e81c-4424-a09d-5783ba44edce'} Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:55.343310 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.350968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance 10aa93bf-e81c-4424-a09d-5783ba44edce could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:55.351686 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e95495a-7628-496e-a753-6068dd40818e tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce" status: 404 len: 111 microversion: 2.1 time: 0.091505 Sep 19 15:04:55.355927 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2227/4481] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:55 2022] GET /compute/v2.1/servers/10aa93bf-e81c-4424-a09d-5783ba44edce => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:55.360982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:55.361808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:55.373225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.374276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.384335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.385251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.388036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.388631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.410265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:55.411250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:55.423657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.425014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.428147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.429264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.430578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.432406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.466310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c HTTP/1.1 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '71ff6f06-e104-4d2d-9b65-c9b25fca9f1c'} Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:04:55.469754 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:04:55.475242 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:04:55.477310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:04:55.479408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:04:55.485779 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78e57c6b-c4c3-4726-83f6-88a085a17f0b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 404 len: 111 microversion: 2.1 time: 0.080547 Sep 19 15:04:55.488012 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2228/4482] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:55 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:55.756296 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f16f56c7-30f2-4861-8e7d-5186584567bf tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 204 len: 0 microversion: 2.1 time: 0.399664 Sep 19 15:04:55.756909 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2255/4483] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:04:55 2022] DELETE /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:04:55.768997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:55.769850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:55.785688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.788865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.799259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:55.800487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:55.804716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.807397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.808243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.808919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.809885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.810580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.811269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:55.820819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:55.821507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:55.821960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:56.358894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:56.364946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:56.382193 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-773d7df2-9ed1-42e3-9478-f05c617648aa tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 0.620440 Sep 19 15:04:56.386597 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2229/4484] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:55 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:56.397018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-766266771", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:56.457266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:56.477300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:56.479078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:56.480479 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7ffbbb4-4d57-485d-b0cd-b37189caa7b4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.687479 Sep 19 15:04:56.481184 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2256/4485] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:55 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:04:56.500754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:04:57.178192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:04:57.179028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:04:57.179725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:04:57.180349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:04:57.180963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:04:57.198588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:57.199509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:57.199955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:57.201917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:57.206173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:57.206775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:57.238215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:04:57.246341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:04:57.271747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:04:57.275012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:04:57.368362 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d9d46f9-003e-4c28-bda2-8930cd220d5d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979242 Sep 19 15:04:57.368972 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2230/4486] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:04:57.384564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c5e035a-1d9e-4927-bbbb-a2a59153e663 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:57.385491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c5e035a-1d9e-4927-bbbb-a2a59153e663 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:57.418531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:57.419228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:57.457297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:57.457839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:57.458289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:57.469954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:57.470344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:57.471410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:57.720010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c5e035a-1d9e-4927-bbbb-a2a59153e663 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:57.729195 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c5e035a-1d9e-4927-bbbb-a2a59153e663 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1208 microversion: 2.1 time: 0.349562 Sep 19 15:04:57.735401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2257/4487] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:57 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1208 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:57.751158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:57.753822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:57.776061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:57.777646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:57.781209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:57.783395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:57.784379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:57.785399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:58.263655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:58.277674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-461a5b2a-3ed5-4984-93e6-70ca2c79478a tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1510 microversion: 2.1 time: 0.873766 Sep 19 15:04:58.278295 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2231/4488] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:57 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1510 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:58.556150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:58.588348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:58.598231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:58.605397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39d8588d-e7c2-4483-a001-175a78b64382 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.867803 Sep 19 15:04:58.618774 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2258/4489] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:57 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:58.760272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:58.761497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:58.772205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:58.775021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:58.779314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:58.780365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:58.781015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:58.781751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:58.945006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-205994d4-b9a3-4164-9385-ead989e02816 req-d443b4f2-2f81-4170-b3ab-8ad276eb15f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad076e-097f-4d69-b3ed-fede15ad5ffa", "name": "network-vif-deleted", "tag": "2b72fda7-5524-461e-bc6f-b19724ef1f7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:04:58.970168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-205994d4-b9a3-4164-9385-ead989e02816 req-d443b4f2-2f81-4170-b3ab-8ad276eb15f2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:58.974670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-205994d4-b9a3-4164-9385-ead989e02816 req-d443b4f2-2f81-4170-b3ab-8ad276eb15f2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:58.975666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-205994d4-b9a3-4164-9385-ead989e02816 req-d443b4f2-2f81-4170-b3ab-8ad276eb15f2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:59.000911 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-205994d4-b9a3-4164-9385-ead989e02816 req-d443b4f2-2f81-4170-b3ab-8ad276eb15f2 service nova] Creating event network-vif-deleted:2b72fda7-5524-461e-bc6f-b19724ef1f7c for instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa on n-h2-858384-1 Sep 19 15:04:59.019598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-205994d4-b9a3-4164-9385-ead989e02816 req-d443b4f2-2f81-4170-b3ab-8ad276eb15f2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080468 Sep 19 15:04:59.024305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2259/4490] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:59.028848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:59.066880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-30784ed3-9fa9-494f-b922-0a993258bf4b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1204 microversion: 2.1 time: 0.297817 Sep 19 15:04:59.067857 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2232/4491] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:58 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1204 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:59.306663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:59.307440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:59.340659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:59.341173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:59.341624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:59.342351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:59.342844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:59.343284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:59.460734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:59.464324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:59.465047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:59.465687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lazy-loading 'fault' on Instance uuid c3ad076e-097f-4d69-b3ed-fede15ad5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:04:59.545942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161efee238a84f78b6771e71701eda05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41eff4a51f84522bd0a289ed00bb41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:04:59.563044 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94adb87d-5bde-4adc-9f11-cacda13d52f0 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 200 len: 1306 microversion: 2.1 time: 0.260727 Sep 19 15:04:59.577453 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2260/4492] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:04:59 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 1306 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:59.635358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:59.638325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:04:59.652071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:59.656706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:59.657502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:04:59.659594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:04:59.661592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:04:59.662868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:00.094978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:00.097790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:00.134473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:00.135620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:00.136297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:00.137351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:00.138131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:00.138864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:00.413514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:00.433814 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8761d726-097a-4e54-b879-14223ea733b0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1266 microversion: 2.1 time: 0.343994 Sep 19 15:05:00.438317 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2261/4493] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:00 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:00.584639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:00.602214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:00.606083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] [instance: c3ad076e-097f-4d69-b3ed-fede15ad5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:00.621588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:00.633032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:00.636968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1cbb80d1-f3fc-4ac1-abaf-c6462771913f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 1.006130 Sep 19 15:05:00.643439 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2233/4494] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:04:59 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:00.644650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:00.658920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:00.660015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:00.661465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:00.664497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:00.665136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:00.709496 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] HTTP exception thrown: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa could not be found. Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Request method failure captured: Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa HTTP/1.1 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIPoQgyMOTZ-YQaPpuuqIB5TxK5-avr4hk0BsdrMHRcPokaaQkwrnjHxwKGTeHqOQsLUQUTg2ALUfDdmjFBtoursGhjL7UVH0O_q-Iu-JqVpbyIE0V6iNSfdV-18EVPtjTpehY1MvycWdkhqVRo-wII7zVC6-Qr34rT4tPjALrluEJk Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f41eff4a51f84522bd0a289ed00bb41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f41eff4a51f84522bd0a289ed00bb41d"}]}] Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: f41eff4a51f84522bd0a289ed00bb41d Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653869109 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 161efee238a84f78b6771e71701eda05 Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-653869109-project Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa could not be found. Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3ad076e-097f-4d69-b3ed-fede15ad5ffa'} Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa could not be found. Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa could not be found. Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:00.713732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa could not be found. Sep 19 15:05:00.719561 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:00.722086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] Returning 404 to user: Instance c3ad076e-097f-4d69-b3ed-fede15ad5ffa could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:00.723421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8eb18d5e-e649-4ba5-852b-ed37eb8cf004 tempest-ServersNegativeTestJSON-653869109 tempest-ServersNegativeTestJSON-653869109-project] 10.222.0.81 "GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa" status: 404 len: 111 microversion: 2.1 time: 0.134563 Sep 19 15:05:00.725240 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2262/4495] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:00 2022] GET /compute/v2.1/servers/c3ad076e-097f-4d69-b3ed-fede15ad5ffa => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:01.462195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:01.463130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:01.476250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:01.478004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:01.478636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:01.479737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:01.481938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:01.484362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:01.683236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:01.684527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:01.701611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:01.702119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:01.712033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:01.714002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:01.714509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:01.714996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:02.567587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:02.588324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e61a9e0-28b0-491c-8374-b38801087fea tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 1.126490 Sep 19 15:05:02.590327 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2234/4496] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:01 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:02.759909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:02.771761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:02.782240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:02.787530 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-52e0dbd5-1f93-404d-adf5-76bc6fe67cc6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 1.110437 Sep 19 15:05:02.788151 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2263/4497] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:01 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:03.620553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:03.621628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:03.637688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:03.639609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:03.640339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:03.642212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:03.644112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:03.644742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:03.822227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:03.823584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:03.834128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:03.847852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:03.848595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:03.849576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:03.850243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:03.850919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:03.903067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:04.328622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:04.349828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20b53545-6510-4df8-8f9b-bcc23d32a2da tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 0.735981 Sep 19 15:05:04.350453 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2235/4498] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:03 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:04.422510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:04.436663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:04.440355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:04.445838 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9360d1e1-a44e-44fa-adcd-9ee819672641 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.624229 Sep 19 15:05:04.470705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2264/4499] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:03 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:04.637159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bc9e940e-72eb-4dbe-b090-095e591da930 req-92425739-c537-4b32-b062-196bdbfe0570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394647cf-fa9e-462e-b5e8-2c05a98fc81e", "tag": "66cd6e58-aae1-4e4c-af9f-9acad9a2db57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:04.655999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bc9e940e-72eb-4dbe-b090-095e591da930 req-92425739-c537-4b32-b062-196bdbfe0570 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:04.656900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bc9e940e-72eb-4dbe-b090-095e591da930 req-92425739-c537-4b32-b062-196bdbfe0570 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:04.657803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bc9e940e-72eb-4dbe-b090-095e591da930 req-92425739-c537-4b32-b062-196bdbfe0570 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:04.667531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-565752428", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "9fed9540-2e71-4727-a0f7-2a7cce757b73"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:04.683459 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bc9e940e-72eb-4dbe-b090-095e591da930 req-92425739-c537-4b32-b062-196bdbfe0570 service nova] Creating event network-changed:66cd6e58-aae1-4e4c-af9f-9acad9a2db57 for instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e on n-h2-858384-1 Sep 19 15:05:04.690186 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bc9e940e-72eb-4dbe-b090-095e591da930 req-92425739-c537-4b32-b062-196bdbfe0570 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058428 Sep 19 15:05:04.691498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2265/4500] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:05:04.802528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] validate_networks() for [('9fed9540-2e71-4727-a0f7-2a7cce757b73', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:05:05.378180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:05.379001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:05.417415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:05.422688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:05.426174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:05.431617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:05.435845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:05.438243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:06.373205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:06.382448 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-defe75b0-080f-4133-8a31-c016bb07a80f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 1.011917 Sep 19 15:05:06.386692 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2266/4501] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:05 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:06.410438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:06.413583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:06.432009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:06.432788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:06.441458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:06.444681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:06.445389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:06.446032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.026791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:05:07.027976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:05:07.028864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:05:07.029529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:05:07.030177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:05:07.068773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.071901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.072790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.074353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.078691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.079561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.132210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:07.149114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Getting quotas for project 7a3b7a063d0f40498875cd6de1d6ecec. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:05:07.159336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:07.162192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:07.163063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Getting quotas for user 7894c8703a5045a79e0faa120ebb2df0 and project 7a3b7a063d0f40498875cd6de1d6ecec. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:05:07.164188 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c7c2ade-3194-4567-8b9f-8b752dd1640d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.761185 Sep 19 15:05:07.172747 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2267/4502] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:06 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:07.189221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:07.200292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:07.202523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:05:07.210099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:05:07.222413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.223697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.232152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.233696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.235359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.237183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.306668 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b46eaf45-3398-4f72-a203-e5a28a72312d tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.937265 Sep 19 15:05:07.316649 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2236/4503] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:05:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:05:07.329725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f187c825-2dc5-4780-9810-e765f8490bc9 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:07.349360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f187c825-2dc5-4780-9810-e765f8490bc9 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:07.376293 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7e4e77a-b01d-4288-b2cf-04e026982cdc tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.197795 Sep 19 15:05:07.400576 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2268/4504] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 15:05:07 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850/os-volume_attachments => generated 25 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:07.427623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:07.431933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:07.463830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.465432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.467229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.469890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.473507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.477078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.630774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f187c825-2dc5-4780-9810-e765f8490bc9 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:07.651656 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f187c825-2dc5-4780-9810-e765f8490bc9 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1216 microversion: 2.1 time: 0.332145 Sep 19 15:05:07.652913 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2237/4505] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:07 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1216 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:07.660252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:07.661645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:07.669524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.674352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.675242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.676583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:07.677243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:07.678224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:07.723567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:05:07.738659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:07.954864 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0837e170-55cf-483a-b294-fff1509efd54 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 204 len: 0 microversion: 2.20 time: 0.299751 Sep 19 15:05:07.961651 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2238/4506] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:05:07 2022] DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:05:07.996303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:07.997206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:08.007677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.021380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:08.026245 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5f8e0e20-b962-422b-92b8-909f1aa4dd9b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 0.619133 Sep 19 15:05:08.027467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:08.028022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:08.028693 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2269/4507] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:07 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:08.032876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:08.034352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:08.038000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:08.208318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:08.209606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:08.226203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:08.228356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:08.229088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:08.231417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:08.232316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:08.234028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:08.282480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.296943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.301133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.302808 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49f02d99-9f1a-4ea8-8c69-2b9d39a63884 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1723 microversion: 2.20 time: 0.323247 Sep 19 15:05:08.305953 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2239/4508] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:07 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:08.680919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:08.681742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:08.691069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:08.696274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:08.696963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:08.698051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:08.702234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:08.702888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:08.737333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.759091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.761573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.763189 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f65d990c-b084-4d32-a616-fea00f9fb486 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.562535 Sep 19 15:05:08.786999 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2270/4509] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:08 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:08.790484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:08.802514 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1fd6a62-6b43-4de1-ad49-d80d3f97e978 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1220 microversion: 2.1 time: 0.125596 Sep 19 15:05:08.814686 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2240/4510] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:08 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:09.056908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:09.057647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:09.072531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:09.074422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:09.075607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:09.077628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:09.078543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:09.082267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:09.334292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:09.335069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:09.346597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:09.350041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:09.350631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:09.356126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:09.356730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:09.357394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:09.997900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.024202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.027906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.030694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27d8da44-c4b4-4458-a9b2-25cff9904ef4 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1723 microversion: 2.20 time: 0.701017 Sep 19 15:05:10.031402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.034222 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2241/4511] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:09 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1723 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:05:10.041612 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0fa878fe-8635-4b29-9601-8c01dd9d763c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 0.993013 Sep 19 15:05:10.050182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:10.057088 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2271/4512] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:09 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:10.060097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:10.062253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:10.062902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:10.085795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:10.086702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:10.087354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:10.090724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:10.091498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:10.092138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:10.112064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:10.114896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:10.115373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:10.119065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:10.125873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:10.126220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:10.228349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.237847 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ceee94bd-3327-46b7-898c-6fb93cd3ef13 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1276 microversion: 2.1 time: 0.179318 Sep 19 15:05:10.246543 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2272/4513] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:10 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:10.671691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.713085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.714702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:10.724206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d2f8ce6-3d6c-4d07-bcce-3e079a0e44cf tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.678307 Sep 19 15:05:10.740417 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2242/4514] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:10 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:11.063148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:11.065148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:11.084851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:11.086192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:11.086874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:11.087455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:11.088195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:11.093098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:11.093923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:11.094578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:11.096720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:11.098383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:11.099071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:11.099821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:11.100292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:11.100726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:11.545944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:11.556632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:11.558204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4210519c4b84d258d456dc84406b72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e43c078348c4279b96e285b4d5a1b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:11.565272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e018cfe-189b-49e4-b7f5-1a4724bb64bd tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 200 len: 1655 microversion: 2.20 time: 0.505318 Sep 19 15:05:11.578862 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2273/4515] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:11 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 1655 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:11.591138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:11.591138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:11.638524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:11.647883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:11.648673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:11.656510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:11.657633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:11.659054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:12.118023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:12.148858 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5043be7a-d715-4cae-87bb-21bfc0ac3cc6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1274 microversion: 2.1 time: 0.575976 Sep 19 15:05:12.155621 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2274/4516] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:11 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1274 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:12.178052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1d381744-2a3a-46e7-a40b-225958de8321 req-07bcb91f-5b62-4fac-b9fc-29448cb76109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8cd21b-27f9-4ef6-85ed-950f0b42b850", "name": "network-vif-deleted", "tag": "0b3711c9-0376-4c70-9244-4cec4ec05a57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:12.221483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1d381744-2a3a-46e7-a40b-225958de8321 req-07bcb91f-5b62-4fac-b9fc-29448cb76109 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:12.222977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1d381744-2a3a-46e7-a40b-225958de8321 req-07bcb91f-5b62-4fac-b9fc-29448cb76109 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:12.225082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1d381744-2a3a-46e7-a40b-225958de8321 req-07bcb91f-5b62-4fac-b9fc-29448cb76109 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:12.281703 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1d381744-2a3a-46e7-a40b-225958de8321 req-07bcb91f-5b62-4fac-b9fc-29448cb76109 service nova] Creating event network-vif-deleted:0b3711c9-0376-4c70-9244-4cec4ec05a57 for instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 on n-h1-858384-1 Sep 19 15:05:12.305733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:12.313688 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1d381744-2a3a-46e7-a40b-225958de8321 req-07bcb91f-5b62-4fac-b9fc-29448cb76109 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155482 Sep 19 15:05:12.315710 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2275/4517] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:12.346438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:12.348102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:12.349293 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa077765-f712-4f3d-a439-955a19dba672 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 1.266406 Sep 19 15:05:12.351805 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2243/4518] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:11 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:12.387808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:12.388745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:12.389567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:12.390937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:12.391817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:12.393208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:12.600381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:12.601022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:12.614053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:12.614663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:12.615250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:12.616441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:12.616851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:12.617297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:12.660568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] HTTP exception thrown: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Request method failure captured: Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 HTTP/1.1 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKINpFsWpu9WkIGaqHvQl15m-jibTXUvAj6MhdtjCfC3tRA3ixVu-Q1wC06AVLkH1w_kjMyneoV6mwZhHGhUzDK4u3GACylkw15wa8A1LSuZZeC3eT9VWw5ai0ZU5H57TdwYz8DHSJYqbL4bfCrWQJ-8_6CT2rThs-6ZPhtb0nGmiYeM Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e43c078348c4279b96e285b4d5a1b11"}]}] Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c4210519c4b84d258d456dc84406b72f Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'de8cd21b-27f9-4ef6-85ed-950f0b42b850'} Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:12.663251 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:12.668812 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:12.675876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Returning 404 to user: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:12.679554 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-071439b4-e6e5-4a0a-aea3-426135095c14 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 404 len: 111 microversion: 2.20 time: 0.083601 Sep 19 15:05:12.682947 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2244/4519] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:12 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:05:12.693013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a995388e-acdc-4170-bf0d-b52eceefcb41 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '.version_select at 0x7fde29f48700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:12.769318 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a995388e-acdc-4170-bf0d-b52eceefcb41 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373931122" status: 204 len: 0 microversion: 2.20 time: 0.082000 Sep 19 15:05:12.773293 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2245/4520] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 15:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373931122 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:05:12.969231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:12.992134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:12.993919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:13.001176 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87c714a4-d211-4842-a2f5-b43100ef5ed6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.683225 Sep 19 15:05:13.005079 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2276/4521] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:12 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:13.165338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cb22be86-fa3f-4627-98a3-ba29c461fead req-57a7674d-2c64-4e22-b38e-5363a810efca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394647cf-fa9e-462e-b5e8-2c05a98fc81e", "name": "network-vif-plugged", "status": "completed", "tag": "66cd6e58-aae1-4e4c-af9f-9acad9a2db57"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:13.182367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:13.183124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:13.193070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cb22be86-fa3f-4627-98a3-ba29c461fead req-57a7674d-2c64-4e22-b38e-5363a810efca service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:13.193569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cb22be86-fa3f-4627-98a3-ba29c461fead req-57a7674d-2c64-4e22-b38e-5363a810efca service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:13.194013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cb22be86-fa3f-4627-98a3-ba29c461fead req-57a7674d-2c64-4e22-b38e-5363a810efca service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:13.194538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:13.195085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:13.195513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:13.196236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:13.196697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:13.205355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:13.247707 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cb22be86-fa3f-4627-98a3-ba29c461fead req-57a7674d-2c64-4e22-b38e-5363a810efca service nova] Creating event network-vif-plugged:66cd6e58-aae1-4e4c-af9f-9acad9a2db57 for instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e on n-h2-858384-1 Sep 19 15:05:13.277528 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cb22be86-fa3f-4627-98a3-ba29c461fead req-57a7674d-2c64-4e22-b38e-5363a810efca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115460 Sep 19 15:05:13.287334 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2246/4522] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:13.383039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:13.384516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:13.423362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:13.424843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:13.436138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:13.459449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:13.460952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:13.465164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:14.558428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:14.574117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a95189c-40a7-44d9-bd7e-0c965eff36d7 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 1.397116 Sep 19 15:05:14.574724 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2277/4523] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:13 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:14.589840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:14.592654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:14.609916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:14.610427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:14.610911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:14.612204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:14.612671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:14.615389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:14.627474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:14.667296 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0d7a6a06-2ee7-448f-b7fc-0f7c4ff99871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1308 microversion: 2.1 time: 1.290640 Sep 19 15:05:14.671035 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2247/4524] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:13 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1308 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:15.030132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-231198a1-bfd2-447d-ad93-eb7964ffd709 tempest-ExtensionsTest-293096788 tempest-ExtensionsTest-293096788-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:15.035643 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-231198a1-bfd2-447d-ad93-eb7964ffd709 tempest-ExtensionsTest-293096788 tempest-ExtensionsTest-293096788-project] 10.222.0.81 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.360417 Sep 19 15:05:15.036540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2248/4525] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 15:05:14 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:15.054102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2edc375f-5833-44c8-aac6-51c4df758336 tempest-ExtensionsTest-293096788 tempest-ExtensionsTest-293096788-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:15.054102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2edc375f-5833-44c8-aac6-51c4df758336 tempest-ExtensionsTest-293096788 tempest-ExtensionsTest-293096788-project] 10.222.0.81 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010560 Sep 19 15:05:15.054102 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2249/4526] 10.222.0.81 () {58 vars in 1134 bytes} [Mon Sep 19 15:05:15 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:05:15.520424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:15.538957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:15.540735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:15.550304 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca805a34-6f72-40e9-a421-1964cab465df tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.966287 Sep 19 15:05:15.551318 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2278/4527] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:14 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:15.607053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:15.608111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:15.622203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:15.623328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:15.632757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:15.634356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:15.635038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:15.635636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:15.698127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:15.699456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:15.711059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:15.715643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:15.718829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:15.719896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:15.721348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:15.728191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:16.632670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:16.643532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3cb70cb-2502-49f9-9c6c-288608bfd871 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1488 microversion: 2.1 time: 0.949370 Sep 19 15:05:16.647100 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2279/4528] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:15 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1488 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:16.659169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:16.660252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:16.678881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:16.679692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:16.680311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:16.681230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:16.681877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:16.682503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:16.721099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:16.732500 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5165c64-06ef-4ea6-9ebc-9cc03e89b20a tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 1.130486 Sep 19 15:05:16.751274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2250/4529] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:15 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:16.770286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:16.773448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:16.781300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:16.782289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:16.783649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:16.784622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:16.785310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:16.785964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:16.823535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:16.941752 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7eb89d41-383e-47a6-b671-8208797bf430 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "PUT /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1083 microversion: 2.1 time: 0.187467 Sep 19 15:05:16.964324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2251/4530] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:05:16 2022] PUT /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1083 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:16.975732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:16.978320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:17.002234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:17.020274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.022150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.022896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:17.024712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.027253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.030631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:17.083254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:17.099428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:17.102866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:17.108969 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7646bd58-3ff5-42a1-bd63-ec3444e19efe tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.456562 Sep 19 15:05:17.110681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:17.111248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2280/4531] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:16 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:17.116666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-89eea3d5-e12d-4cbe-9fc0-713d846a5c47 req-b53f8448-3c8b-404c-83ad-62b10a9f23ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facc1f22-bed7-4f92-894b-fa35ce90f4ab", "tag": "9941dc13-7f98-4321-9ce5-4acd30f986ff"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:17.246436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-89eea3d5-e12d-4cbe-9fc0-713d846a5c47 req-b53f8448-3c8b-404c-83ad-62b10a9f23ef service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.248631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-89eea3d5-e12d-4cbe-9fc0-713d846a5c47 req-b53f8448-3c8b-404c-83ad-62b10a9f23ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.254431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-89eea3d5-e12d-4cbe-9fc0-713d846a5c47 req-b53f8448-3c8b-404c-83ad-62b10a9f23ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:17.329956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-89eea3d5-e12d-4cbe-9fc0-713d846a5c47 req-b53f8448-3c8b-404c-83ad-62b10a9f23ef service nova] Creating event network-changed:9941dc13-7f98-4321-9ce5-4acd30f986ff for instance facc1f22-bed7-4f92-894b-fa35ce90f4ab on n-h1-858384-1 Sep 19 15:05:17.365478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-89eea3d5-e12d-4cbe-9fc0-713d846a5c47 req-b53f8448-3c8b-404c-83ad-62b10a9f23ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236780 Sep 19 15:05:17.367940 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2281/4532] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:17.640933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=14 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:17.762479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:17.775235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:17.776525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:17.785226 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc2dd250-3b18-4cbf-b2cf-d3996e68955e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1509 microversion: 2.1 time: 0.816770 Sep 19 15:05:17.789131 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2252/4533] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:16 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1509 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:17.792899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.793945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.794568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:17.795507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.799674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.800417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:17.837000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:17.837655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:17.854935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.855493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.859581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:17.862162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:17.862923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:17.866298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.429215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:18.447712 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbb2d357-901b-4541-9dd9-230d5f021c53 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1509 microversion: 2.1 time: 0.614638 Sep 19 15:05:18.456475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:18.460841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:18.463966 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2253/4534] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:17 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1509 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:18.473841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:18.474477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:18.482226 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-746ab204-87c4-4e4b-a3b9-2d0d80226a5b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 0.713279 Sep 19 15:05:18.482910 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2282/4535] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:17 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:18.494013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:18.494528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:18.500952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:18.502839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:18.503489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.504951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:18.511065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:18.511536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.525174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:18.528034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:18.529222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.530361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:18.536503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:18.537993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.590604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] HTTP exception thrown: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Request method failure captured: Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 HTTP/1.1 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKINpFsWpu9WkIGaqHvQl15m-jibTXUvAj6MhdtjCfC3tRA3ixVu-Q1wC06AVLkH1w_kjMyneoV6mwZhHGhUzDK4u3GACylkw15wa8A1LSuZZeC3eT9VWw5ai0ZU5H57TdwYz8DHSJYqbL4bfCrWQJ-8_6CT2rThs-6ZPhtb0nGmiYeM Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e43c078348c4279b96e285b4d5a1b11"}]}] Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c4210519c4b84d258d456dc84406b72f Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'de8cd21b-27f9-4ef6-85ed-950f0b42b850'} Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:18.593306 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:18.600061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:18.603807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Returning 404 to user: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:18.609237 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-93971616-7e8d-436f-a813-26c94d5dd3ca tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 404 len: 111 microversion: 2.20 time: 0.122612 Sep 19 15:05:18.612574 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2283/4536] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:05:18 2022] DELETE /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:05:18.628925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:18.633063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:18.652692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:18.656138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:18.656879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.661948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:18.664270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:18.665531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:18.771640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:05:19.005917 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e705c80b-4803-4154-a475-dcae081c9042 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 204 len: 0 microversion: 2.1 time: 0.391492 Sep 19 15:05:19.006927 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2284/4537] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:05:18 2022] DELETE /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:05:19.019276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:19.020018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: de8cd21b-27f9-4ef6-85ed-950f0b42b850] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:19.031785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:19.032296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:19.037349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:19.039864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:19.040448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:19.040912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:19.076149 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] HTTP exception thrown: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Request method failure captured: Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 HTTP/1.1 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKINpFsWpu9WkIGaqHvQl15m-jibTXUvAj6MhdtjCfC3tRA3ixVu-Q1wC06AVLkH1w_kjMyneoV6mwZhHGhUzDK4u3GACylkw15wa8A1LSuZZeC3eT9VWw5ai0ZU5H57TdwYz8DHSJYqbL4bfCrWQJ-8_6CT2rThs-6ZPhtb0nGmiYeM Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e43c078348c4279b96e285b4d5a1b11"}]}] Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c4210519c4b84d258d456dc84406b72f Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'de8cd21b-27f9-4ef6-85ed-950f0b42b850'} Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:19.081303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Returning 404 to user: Instance de8cd21b-27f9-4ef6-85ed-950f0b42b850 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:19.088431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5056251c-e7d0-4b47-bca0-c5f78337abe1 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850" status: 404 len: 111 microversion: 2.20 time: 0.074739 Sep 19 15:05:19.099589 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2285/4538] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:19 2022] GET /compute/v2.1/servers/de8cd21b-27f9-4ef6-85ed-950f0b42b850 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:05:19.123158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:19.128202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:19.151338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:19.158176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:19.163449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:19.165353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:19.168260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:19.187269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:19.376300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:19.409114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:19.415231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:19.420599 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-188f5451-a04e-4d2d-8c41-31e1b8151c19 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.955184 Sep 19 15:05:19.427646 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2254/4539] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:18 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:19.645721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:19.658963 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-276aed58-27c7-4176-8c55-263bc3e70e73 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1515 microversion: 2.1 time: 0.556997 Sep 19 15:05:19.661077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2286/4540] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:19 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:19.670953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:19.672362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:19.681367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:19.683512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:19.684438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:19.685595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:19.687037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:19.687748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:19.971149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:19.982947 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b36f1bf-0167-4cf2-abd6-ff9d7e17aeec tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 0.319765 Sep 19 15:05:19.999926 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2287/4541] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:19 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:20.028407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68a2a853-e7e7-4320-bad7-d54ba74f8e9e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Action: 'create', calling method: .version_select at 0x7fde28ab3af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1278786629"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:20.476715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:20.477286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:20.481610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:20.498234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:20.500695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:20.502356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:20.503506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:20.506518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:20.507182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:21.015238 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68a2a853-e7e7-4320-bad7-d54ba74f8e9e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.585678 Sep 19 15:05:21.036342 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2255/4542] 10.222.0.81 () {60 vars in 1155 bytes} [Mon Sep 19 15:05:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1595 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 15:05:21.096939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:21.108074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:21.137628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:21.138473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:21.140417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:21.144996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:21.148890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:21.150505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:21.972423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:22.019549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:22.022692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:22.029400 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f6ddd3d2-2c83-44ec-849c-352de29e0257 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 1.552306 Sep 19 15:05:22.078912 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2288/4543] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:20 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:22.096214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:22.101663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:22.129041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:22.131485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:22.132884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:22.137525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:22.138842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:22.140352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:22.597237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:22.608118 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ca90235f-5883-4a09-8a2c-5d6f0be9cd72 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1515 microversion: 2.1 time: 1.570983 Sep 19 15:05:22.619927 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2256/4544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:21 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1515 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:22.660923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6c8df2a-624b-40f1-9429-3a13497781c8 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde28ab3040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:22.889214 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6c8df2a-624b-40f1-9429-3a13497781c8 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 200 len: 345 microversion: 2.1 time: 0.253489 Sep 19 15:05:22.890333 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2257/4545] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:22 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:23.092890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:23.093878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:23.131315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.133315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.135167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.137478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.147336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.147336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.463090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:23.512941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83f0a953-983c-43d3-baff-b9aa8355f9b6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 1.430632 Sep 19 15:05:23.518068 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2289/4546] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:22 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:23.551069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9f94c78d-c02e-427f-bc48-3750ca080a7d req-a97e8f74-4460-43b0-836e-c73eb180c077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394647cf-fa9e-462e-b5e8-2c05a98fc81e", "name": "network-vif-deleted", "tag": "66cd6e58-aae1-4e4c-af9f-9acad9a2db57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:23.594359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9f94c78d-c02e-427f-bc48-3750ca080a7d req-a97e8f74-4460-43b0-836e-c73eb180c077 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.598787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9f94c78d-c02e-427f-bc48-3750ca080a7d req-a97e8f74-4460-43b0-836e-c73eb180c077 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.601814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9f94c78d-c02e-427f-bc48-3750ca080a7d req-a97e8f74-4460-43b0-836e-c73eb180c077 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.655448 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9f94c78d-c02e-427f-bc48-3750ca080a7d req-a97e8f74-4460-43b0-836e-c73eb180c077 service nova] Creating event network-vif-deleted:66cd6e58-aae1-4e4c-af9f-9acad9a2db57 for instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e on n-h2-858384-1 Sep 19 15:05:23.677446 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9f94c78d-c02e-427f-bc48-3750ca080a7d req-a97e8f74-4460-43b0-836e-c73eb180c077 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155613 Sep 19 15:05:23.680987 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2290/4547] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:23.698388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:23.701306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:23.722417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.723495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.724160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.728907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.730043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.733849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.830316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.833437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.836351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.837091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lazy-loading 'fault' on Instance uuid 394647cf-fa9e-462e-b5e8-2c05a98fc81e {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:05:23.841015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:23.861950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:23.865843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:23.869503 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f1c5b3c-b18d-4055-ba7b-89e8eda015bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.783942 Sep 19 15:05:23.871962 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2258/4548] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:23 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:05:23.883488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7489e89a-2c8f-4ecc-b232-d7d9972cca64 req-c3093eff-c62f-40a6-a26b-2ccbf9ff8773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5a074f08-9079-405a-bf80-1f3c93fce8a9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:23.905706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7489e89a-2c8f-4ecc-b232-d7d9972cca64 req-c3093eff-c62f-40a6-a26b-2ccbf9ff8773 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:23.909602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7489e89a-2c8f-4ecc-b232-d7d9972cca64 req-c3093eff-c62f-40a6-a26b-2ccbf9ff8773 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:23.910881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7489e89a-2c8f-4ecc-b232-d7d9972cca64 req-c3093eff-c62f-40a6-a26b-2ccbf9ff8773 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:23.939976 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7489e89a-2c8f-4ecc-b232-d7d9972cca64 req-c3093eff-c62f-40a6-a26b-2ccbf9ff8773 service nova] Creating event network-vif-plugged:5a074f08-9079-405a-bf80-1f3c93fce8a9 for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:23.952603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7489e89a-2c8f-4ecc-b232-d7d9972cca64 req-c3093eff-c62f-40a6-a26b-2ccbf9ff8773 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079135 Sep 19 15:05:23.965083 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2259/4549] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:23.978944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e248eb1d-f861-4d7e-87eb-f895e8d458eb tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29f48e50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:24.006987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:24.051382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8438cdd-52fe-4d73-8154-0fd20583da51 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 200 len: 1319 microversion: 2.1 time: 0.363673 Sep 19 15:05:24.056606 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2291/4550] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:23 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:24.150012 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e248eb1d-f861-4d7e-87eb-f895e8d458eb tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 200 len: 346 microversion: 2.1 time: 0.181360 Sep 19 15:05:24.151705 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2260/4551] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:23 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:24.173296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cc893dc-a11b-48ff-8f6f-a78dd0485112 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Action: 'create', calling method: .version_select at 0x7fde29d5b3a0>, body: {"snapshot": {"volume_id": "8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-12750064"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:24.547082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:24.548887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:24.574543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:24.575613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:24.576834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:24.578742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:24.580874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:24.581850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:24.783581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2cc893dc-a11b-48ff-8f6f-a78dd0485112 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.621414 Sep 19 15:05:24.791739 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2292/4552] 10.222.0.81 () {60 vars in 1162 bytes} [Mon Sep 19 15:05:24 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:24.799196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-05cb73c4-9953-4a1d-abe9-229f6816d227 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde298a5790>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:24.852555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:24.877322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b0f6af1-f871-4252-86a1-5e96a626e333 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 0.336826 Sep 19 15:05:24.879680 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2261/4553] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:24 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:24.916474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-05cb73c4-9953-4a1d-abe9-229f6816d227 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.123125 Sep 19 15:05:24.917635 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2293/4554] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:24 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:24.920074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:24.921727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:24.945208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5af112d3-3599-4a09-9a45-9868cca0823a tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde2e10b9d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:24.950409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:24.952047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:24.952784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:24.953901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:24.957318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:24.958972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:25.005508 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5af112d3-3599-4a09-9a45-9868cca0823a tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.076311 Sep 19 15:05:25.006107 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2294/4555] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 15:05:24 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:25.023255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97827a1a-f5d7-4020-b6d2-7a72bbe1c336 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde298a5c10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:25.088877 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97827a1a-f5d7-4020-b6d2-7a72bbe1c336 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.069610 Sep 19 15:05:25.096725 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2295/4556] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:25 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:25.103178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:25.107940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:25.139954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:25.142850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:25.146374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:25.149448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:25.150341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:25.152160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:25.193240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e HTTP/1.1 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '394647cf-fa9e-462e-b5e8-2c05a98fc81e'} Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:25.196520 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:05:25.202178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:25.204016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:25.206538 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a8a186d-a138-4855-bad4-b239447fcd3e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 404 len: 111 microversion: 2.1 time: 0.108261 Sep 19 15:05:25.229239 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2296/4557] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:25 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:25.467345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1827646199", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:25.487816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:25.545200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:25.558151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:25.567212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-afaf8533-e409-45a2-886d-6b5d6127f614 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.669452 Sep 19 15:05:25.573645 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2262/4558] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:24 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:25.634817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] validate_networks() for [('b71e0f1a-8e55-4ab4-83c6-aafa2dee54e3', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:05:25.936327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:25.937850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:25.956371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:25.957360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:25.958024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:25.959204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:25.963269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:25.964059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:26.383630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:26.399392 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d8d3f0b-8d16-41e3-81f4-17e9944d433e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 0.466864 Sep 19 15:05:26.417961 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2263/4559] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:25 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:26.425609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-242aeaf6-20ae-4039-8e6c-0e99ed10cc4f tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29193af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:26.508050 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-242aeaf6-20ae-4039-8e6c-0e99ed10cc4f tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.087767 Sep 19 15:05:26.509110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2264/4560] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:26 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:26.520125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "1474cd9a-84bf-466c-8b10-53236c77b38f"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "8569a7b5-dba0-4127-ac0a-52ca3bd03847"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:26.556316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:26.562855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:26.567864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:26.609772 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Creating event network-vif-plugged:1474cd9a-84bf-466c-8b10-53236c77b38f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:26.610596 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Creating event network-vif-plugged:1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:26.613552 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] Creating event network-vif-plugged:8569a7b5-dba0-4127-ac0a-52ca3bd03847 for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:26.633720 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8e74ad89-ce53-4ba3-831b-ad0270b59f21 req-3280f8f9-5c53-41d5-a594-2e09723bdc9f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.121457 Sep 19 15:05:26.636148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2265/4561] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:26.650927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:26.652644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:26.666795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:26.669409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:26.672238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:26.673280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:26.678251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:26.679181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:27.388976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:27.434776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:27.446475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:27.456335 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4748f322-3346-41c3-9442-34fd57d2c7af tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.812195 Sep 19 15:05:27.457990 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2266/4562] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:26 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:27.483452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:27.488803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:27.521545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:27.523298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:27.524447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:27.526182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:27.531668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:27.536208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:27.583262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:05:27.584162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:05:27.584925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:05:27.586189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:05:27.587395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:05:27.647900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:27.666675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:27.667880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:27.678788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:27.683619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:27.684848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:27.743632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:05:27.760045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Getting quotas for user 60baef2bea9e40d8ba4af8f3ec6755eb and project 955de381d91a4e02a1da49f38dd10e3b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:05:27.792255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:05:27.800431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:05:27.922282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:27.932450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4dc1d0f9-5756-4e6c-a076-4b3b9d19a21d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.467109 Sep 19 15:05:27.934022 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2297/4563] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:05:27.943960 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df00b708-0f87-43e3-bfca-88e4a3c5aa7c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 0.478341 Sep 19 15:05:27.945879 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2267/4564] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:27 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:27.953530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5209f860-637a-4790-910c-17f12e7c1c2b tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde28c260d0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:27.959275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:27.961298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:27.991240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:27.993868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:27.998299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.000458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:28.004289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:28.009934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.065926 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5209f860-637a-4790-910c-17f12e7c1c2b tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.129478 Sep 19 15:05:28.067113 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2298/4565] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:27 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:28.084596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-85e4f849-da50-44a2-b064-f06fa1ce2365 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:28.090987 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] HTTP exception thrown: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.096441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-85e4f849-da50-44a2-b064-f06fa1ce2365 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Request method failure captured: Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 HTTP/1.1 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKINpFsWpu9WkIGaqHvQl15m-jibTXUvAj6MhdtjCfC3tRA3ixVu-Q1wC06AVLkH1w_kjMyneoV6mwZhHGhUzDK4u3GACylkw15wa8A1LSuZZeC3eT9VWw5ai0ZU5H57TdwYz8DHSJYqbL4bfCrWQJ-8_6CT2rThs-6ZPhtb0nGmiYeM Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e43c078348c4279b96e285b4d5a1b11"}]}] Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c4210519c4b84d258d456dc84406b72f Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65'} Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:28.102249 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.112587 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.118503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Returning 404 to user: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:28.123356 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1484f75e-1f32-497c-a0d9-1a6c38cae387 tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 404 len: 111 microversion: 2.20 time: 0.170442 Sep 19 15:05:28.131766 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2268/4566] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:05:27 2022] DELETE /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:05:28.151228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:28.154661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] [instance: 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:28.179005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:28.183637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:28.191561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.194019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:28.195417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:28.196450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.256884 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] HTTP exception thrown: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Request method failure captured: Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 HTTP/1.1 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKINpFsWpu9WkIGaqHvQl15m-jibTXUvAj6MhdtjCfC3tRA3ixVu-Q1wC06AVLkH1w_kjMyneoV6mwZhHGhUzDK4u3GACylkw15wa8A1LSuZZeC3eT9VWw5ai0ZU5H57TdwYz8DHSJYqbL4bfCrWQJ-8_6CT2rThs-6ZPhtb0nGmiYeM Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e43c078348c4279b96e285b4d5a1b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e43c078348c4279b96e285b4d5a1b11"}]}] Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 6e43c078348c4279b96e285b4d5a1b11 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115809499 Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c4210519c4b84d258d456dc84406b72f Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115809499-project Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65'} Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.262309 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. Sep 19 15:05:28.275897 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:28.280770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] Returning 404 to user: Instance 6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:28.290407 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4aaf8be3-9e0a-4cc6-b0d3-b901be4443ba tempest-AttachVolumeShelveTestJSON-2115809499 tempest-AttachVolumeShelveTestJSON-2115809499-project] 10.222.0.81 "GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65" status: 404 len: 111 microversion: 2.20 time: 0.152251 Sep 19 15:05:28.299062 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2269/4567] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:28 2022] GET /compute/v2.1/servers/6e75ea3c-c3b0-48f6-86b1-dc2126f9cb65 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:05:28.324215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85e4f849-da50-44a2-b064-f06fa1ce2365 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:28.360427 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-85e4f849-da50-44a2-b064-f06fa1ce2365 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1209 microversion: 2.1 time: 0.282148 Sep 19 15:05:28.378394 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2299/4568] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:28 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1209 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:28.489605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:28.490335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:28.524746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:28.535043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:28.538579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.540293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:28.549382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:28.549807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.746767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "ac4d87f5-429d-44db-8962-6e644307f42b"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "f12a897c-c664-4973-8f53-f65f9c81f88d"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "629f4872-d0bd-4b7d-b472-27604836b34b"}, {"server_uuid": "facc1f22-bed7-4f92-894b-fa35ce90f4ab", "name": "network-vif-plugged", "status": "completed", "tag": "9941dc13-7f98-4321-9ce5-4acd30f986ff"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:28.824915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:28.828367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:28.831134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:28.902191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Creating event network-vif-plugged:ac4d87f5-429d-44db-8962-6e644307f42b for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:28.903334 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Creating event network-vif-plugged:f12a897c-c664-4973-8f53-f65f9c81f88d for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:28.906622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Creating event network-vif-plugged:629f4872-d0bd-4b7d-b472-27604836b34b for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:28.916107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] Creating event network-vif-plugged:9941dc13-7f98-4321-9ce5-4acd30f986ff for instance facc1f22-bed7-4f92-894b-fa35ce90f4ab on n-h1-858384-1 Sep 19 15:05:28.941765 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-000189c4-da4b-4996-b787-cbacce91d966 req-9e2a101f-a4d7-47d2-95ad-931d81f8d57c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.213388 Sep 19 15:05:28.980340 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2300/4569] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:29.019157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:29.040415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:29.093942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:29.094867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:29.098609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:29.102206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:29.106011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:29.109751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:30.166794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:30.178604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-528262a3-a81c-4127-bc55-e3e22b3ded3e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 1.195629 Sep 19 15:05:30.183769 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2301/4570] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:28 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:30.199749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-288e4ceb-1ae4-4352-9889-e38cac907fd3 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde2e1dfaf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:30.269015 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-288e4ceb-1ae4-4352-9889-e38cac907fd3 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 286 microversion: 2.1 time: 0.081933 Sep 19 15:05:30.269974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2302/4571] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:30 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:30.280255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:30.283584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:30.302597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:30.303553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:30.304130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:30.308474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:30.313400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:30.314266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:30.314866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:30.323055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:30.324908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:30.326332 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfa7c2f8-8195-4bdc-8b16-eea14a39fba5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 1.841620 Sep 19 15:05:30.327437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2270/4572] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:28 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:30.334491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c643ab8a-8f1f-4832-bdfc-26b454216a39 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde2b7d6670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:30.404527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:30.421902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d366847-2a71-421a-9bef-20c5cd108679 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1261 microversion: 2.1 time: 0.149538 Sep 19 15:05:30.423034 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2303/4573] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:30 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:30.493400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c643ab8a-8f1f-4832-bdfc-26b454216a39 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 202 len: 0 microversion: 2.1 time: 0.164551 Sep 19 15:05:30.503716 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2271/4574] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 15:05:30 2022] DELETE /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:05:30.504626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20e67dbf-2a17-4e5b-aae5-a684fde75fb6 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde28bb2dc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:30.557342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20e67dbf-2a17-4e5b-aae5-a684fde75fb6 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.057857 Sep 19 15:05:30.563547 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2304/4575] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:30 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:31.248063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:31.268539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:31.280309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:31.282272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:31.284940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:31.289801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:31.290517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:31.291574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:31.380499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:31.381960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:31.405173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:31.417759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:31.418980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:31.424314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:31.428290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:31.431041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:32.301224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:32.326788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:32.337796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:32.350515 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dd0afbf2-624e-4c12-bd02-86ad18697304 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1879 microversion: 2.42 time: 0.978020 Sep 19 15:05:32.381745 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2305/4576] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:31 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1879 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:05:32.423811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:32.426782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:32.472033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:32.472617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:32.475284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:32.476156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:32.476652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:32.481305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:32.509288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:32.528610 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5adee26f-99d4-4bf2-beb7-bb4b86305d60 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1316 microversion: 2.1 time: 1.301835 Sep 19 15:05:32.533294 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2272/4577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:31 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1316 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:32.538867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-163d751f-3247-46a1-8b4f-3039ea8d5202 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29268670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:32.603362 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-163d751f-3247-46a1-8b4f-3039ea8d5202 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.068456 Sep 19 15:05:32.604435 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2273/4578] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:32 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:32.628855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:32.644386 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c31573d-293d-4166-94f1-9dc56a55d6e6 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1267 microversion: 2.1 time: 0.243613 Sep 19 15:05:32.645057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2306/4579] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:32 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:33.450056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:33.461261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:33.556215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:33.557308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:33.557308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:33.558024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:33.558721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:33.559361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:33.575743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:33.576442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:33.594071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:33.596452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:33.597197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:33.598859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:33.599612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:33.600230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.313032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:34.326890 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d7b8951-2d40-4906-b75a-170d83f97c9c tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1504 microversion: 2.1 time: 0.755244 Sep 19 15:05:34.327520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2307/4580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:33 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1504 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:34.341132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1088c1e7-3c01-45b1-9f27-b192a9e67b94 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29d1ed30>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:34.368077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:34.388427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:34.393352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:34.397913 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fbe469e-e85a-4abc-bdce-52c2afa8aecd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2834 microversion: 2.42 time: 0.966751 Sep 19 15:05:34.407194 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2274/4581] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:05:33 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2834 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:34.425049 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1088c1e7-3c01-45b1-9f27-b192a9e67b94 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 200 len: 285 microversion: 2.1 time: 0.096319 Sep 19 15:05:34.431084 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2308/4582] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:34 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:34.436823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:34.439924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:34.445083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:34.446138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:34.465748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.466584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.467153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.468146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.468809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.469428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.486732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.488798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.495044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.496145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.498075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.498523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.572211 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3c4f527-ce0b-4107-87fd-29ec85fdff0e tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab/ips" status: 200 len: 108 microversion: 2.1 time: 0.139876 Sep 19 15:05:34.578272 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2309/4583] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:05:34 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab/ips => generated 108 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:34.591996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:34.595749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:34.616226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.617090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.617707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.618684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.619419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.620054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.929805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:34.941515 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4adce227-5619-43d4-a612-9f6b1f1b8ae5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 0.531908 Sep 19 15:05:34.957108 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2275/4584] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:34 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:34.966937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:34.970465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:34.991433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.995274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:34.996098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:34.997302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:34.998030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.001852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.007204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:35.046312 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d7c29a3-2a5c-4dc8-9feb-23bee69341dd tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab/ips" status: 200 len: 108 microversion: 2.1 time: 0.087203 Sep 19 15:05:35.049349 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2276/4585] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:05:34 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab/ips => generated 108 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:35.087320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:35.088562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:35.111056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:35.119842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.120701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.121984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:35.122895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.123598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.131799 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-533854a6-ee7e-4ae5-9338-4efc35c680f8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.547310 Sep 19 15:05:35.132826 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2310/4586] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 15:05:34 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3/os-interface => generated 1828 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:05:35.205727 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04c0c0ed-f749-4d86-b16b-0dadfd34678b tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab/ips/tempest-ServerAddressesTestJSON-649768563-network" status: 200 len: 93 microversion: 2.1 time: 0.134833 Sep 19 15:05:35.206354 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2277/4587] 10.222.0.81 () {58 vars in 1398 bytes} [Mon Sep 19 15:05:35 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab/ips/tempest-ServerAddressesTestJSON-649768563-network => generated 93 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:05:35.227307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:35.228929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:35.244724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:35.245572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.247930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.249287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:35.252727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.255552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.314104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:35.335217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:05:35.440137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13f0aa9b-aae3-4992-bf28-3870e01e101e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29259550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:35.509209 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-13f0aa9b-aae3-4992-bf28-3870e01e101e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] HTTP exception thrown: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13f0aa9b-aae3-4992-bf28-3870e01e101e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Request method failure captured: Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba HTTP/1.1 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIUvlo8ve9HnJDoyNHAfbs-jsqoadfqO-a3AzdpZwBRQkdRkNhSi9Cj9frQhHgpniKdg3PrOK_uCXnM20Fviph0eN9gr95HeWM6tXmEECVtvYVy9yr-9J8NXuEhH6GUoOgeK1cJim5SWDJYlO3ptlUSMsdgtxw5Kr3OTddztX68G03g Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/146b2f312f0b4e8f9917cf32cf40d0c1"}]}] Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c92c6bfebd2b47c4a59be1e677c70ea8 Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: method: Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: exception: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '2621480e-150f-46aa-b262-86970d2ff3ba'} Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. (HTTP 404) (Request-ID: req-7fc61436-3b93-4800-945b-e80e4855264a) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:05:35.519071 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13f0aa9b-aae3-4992-bf28-3870e01e101e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Returning 404 to user: Snapshot 2621480e-150f-46aa-b262-86970d2ff3ba could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13f0aa9b-aae3-4992-bf28-3870e01e101e tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba" status: 404 len: 111 microversion: 2.1 time: 0.086763 Sep 19 15:05:35.523788 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2278/4588] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 15:05:35 2022] GET /compute/v2.1/os-snapshots/2621480e-150f-46aa-b262-86970d2ff3ba => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:35.540789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3ada1ee-c020-43b9-94d9-be4bfa964e17 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde298a8b80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:35.628689 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68d24ae7-8025-4573-b829-9aed48b9ff89 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "DELETE /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 204 len: 0 microversion: 2.1 time: 0.409463 Sep 19 15:05:35.629705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2311/4589] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:05:35 2022] DELETE /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:05:35.639290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:35.640116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:35.658543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:35.659279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.659751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.660634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:35.664516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:35.665241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:35.784567 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3ada1ee-c020-43b9-94d9-be4bfa964e17 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 202 len: 0 microversion: 2.1 time: 0.254530 Sep 19 15:05:35.785853 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2279/4590] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:05:35 2022] DELETE /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:05:35.813455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80260757-9b70-4832-bbd6-91c18969d1db tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde2a6d6040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:36.031064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-80260757-9b70-4832-bbd6-91c18969d1db tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 200 len: 345 microversion: 2.1 time: 0.235765 Sep 19 15:05:36.040416 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2280/4591] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:35 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 345 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:36.048813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:36.054465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:36.068150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:36.068657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:36.069193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:36.071957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:36.072588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:36.073042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:36.725341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:36.760352 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8c633ac-fa63-4010-866f-919989604f77 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 0.717184 Sep 19 15:05:36.764840 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2281/4592] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:36 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:37.069175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e2e5f4c-c783-4a94-8be1-f3e36f89d387 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29a725e0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:37.215902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:37.255528 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be6795a1-0c98-4799-aeba-39a3ad997bf6 tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1510 microversion: 2.1 time: 1.618711 Sep 19 15:05:37.259700 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2312/4593] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:35 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1510 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:37.307799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e2e5f4c-c783-4a94-8be1-f3e36f89d387 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 200 len: 345 microversion: 2.1 time: 0.261279 Sep 19 15:05:37.309077 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2282/4594] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:37 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 345 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:37.817163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:37.817488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:37.837960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:37.882434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:37.883984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:37.887465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:37.894503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:37.898565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:37.901832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:37.994255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8753bbe4-2b34-4e20-83b8-0781bb2e549a req-4001b0d9-1579-48db-a670-a31002af9693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbf82f4-e9a3-4c49-b451-b6cda98c48c5", "tag": "9cf93cb8-bf13-4073-8fe5-bfcd3e3eb109"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:38.024983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8753bbe4-2b34-4e20-83b8-0781bb2e549a req-4001b0d9-1579-48db-a670-a31002af9693 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:38.031967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8753bbe4-2b34-4e20-83b8-0781bb2e549a req-4001b0d9-1579-48db-a670-a31002af9693 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:38.033070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8753bbe4-2b34-4e20-83b8-0781bb2e549a req-4001b0d9-1579-48db-a670-a31002af9693 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:38.084159 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8753bbe4-2b34-4e20-83b8-0781bb2e549a req-4001b0d9-1579-48db-a670-a31002af9693 service nova] Creating event network-changed:9cf93cb8-bf13-4073-8fe5-bfcd3e3eb109 for instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 on n-h2-858384-1 Sep 19 15:05:38.095333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8753bbe4-2b34-4e20-83b8-0781bb2e549a req-4001b0d9-1579-48db-a670-a31002af9693 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105331 Sep 19 15:05:38.098979 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2283/4595] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:38.287095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:38.288066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:38.305036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:38.305727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:38.306272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:38.307600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:38.314123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:38.314966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:38.349925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:40.073397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:40.089610 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dea0be92-7cec-4afe-b71b-939f8f173900 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 2.283288 Sep 19 15:05:40.104462 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2313/4596] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:37 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:40.115018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98e29153-892c-4a18-a5b9-0d455f77bdbd tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde298a5550>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:40.183649 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98e29153-892c-4a18-a5b9-0d455f77bdbd tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 200 len: 345 microversion: 2.1 time: 0.077633 Sep 19 15:05:40.184549 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2314/4597] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:40 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:40.190245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bb2ad8cd-5e46-4506-b3f2-e2ba2fabcbac req-20a67299-106b-4c0f-907f-19db38b230f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facc1f22-bed7-4f92-894b-fa35ce90f4ab", "name": "network-vif-deleted", "tag": "9941dc13-7f98-4321-9ce5-4acd30f986ff"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:40.222725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb2ad8cd-5e46-4506-b3f2-e2ba2fabcbac req-20a67299-106b-4c0f-907f-19db38b230f5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:40.227546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb2ad8cd-5e46-4506-b3f2-e2ba2fabcbac req-20a67299-106b-4c0f-907f-19db38b230f5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:40.229220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb2ad8cd-5e46-4506-b3f2-e2ba2fabcbac req-20a67299-106b-4c0f-907f-19db38b230f5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:40.257985 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bb2ad8cd-5e46-4506-b3f2-e2ba2fabcbac req-20a67299-106b-4c0f-907f-19db38b230f5 service nova] Creating event network-vif-deleted:9941dc13-7f98-4321-9ce5-4acd30f986ff for instance facc1f22-bed7-4f92-894b-fa35ce90f4ab on n-h1-858384-1 Sep 19 15:05:40.270207 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bb2ad8cd-5e46-4506-b3f2-e2ba2fabcbac req-20a67299-106b-4c0f-907f-19db38b230f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083951 Sep 19 15:05:40.271382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7894c8703a5045a79e0faa120ebb2df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3b7a063d0f40498875cd6de1d6ecec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:40.273325 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2315/4598] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:40.308380 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f38e153-4140-4240-8f10-b5db3dae65cc tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 200 len: 1510 microversion: 2.1 time: 2.027087 Sep 19 15:05:40.309516 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2284/4599] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:38 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 1510 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:40.594242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3acb3961-dc5e-44d5-bca9-ce65295d5b0a req-d968f8c1-83dd-4572-95d7-df5affe56cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "tag": "f12a897c-c664-4973-8f53-f65f9c81f88d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:40.622829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3acb3961-dc5e-44d5-bca9-ce65295d5b0a req-d968f8c1-83dd-4572-95d7-df5affe56cb8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:40.623346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3acb3961-dc5e-44d5-bca9-ce65295d5b0a req-d968f8c1-83dd-4572-95d7-df5affe56cb8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:40.623798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3acb3961-dc5e-44d5-bca9-ce65295d5b0a req-d968f8c1-83dd-4572-95d7-df5affe56cb8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:40.661702 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3acb3961-dc5e-44d5-bca9-ce65295d5b0a req-d968f8c1-83dd-4572-95d7-df5affe56cb8 service nova] Creating event network-changed:f12a897c-c664-4973-8f53-f65f9c81f88d for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:05:40.687508 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3acb3961-dc5e-44d5-bca9-ce65295d5b0a req-d968f8c1-83dd-4572-95d7-df5affe56cb8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091635 Sep 19 15:05:40.689141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2316/4600] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:41.134133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:41.135204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:41.187174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:41.195966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:41.211738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:41.218419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e5d44a-5133-4a2f-983b-5ed034dc8e4d tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29f7d310>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:41.220975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:41.230822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:41.237445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:41.367486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-43e5d44a-5133-4a2f-983b-5ed034dc8e4d tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] HTTP exception thrown: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e5d44a-5133-4a2f-983b-5ed034dc8e4d tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Request method failure captured: Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 HTTP/1.1 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIUvlo8ve9HnJDoyNHAfbs-jsqoadfqO-a3AzdpZwBRQkdRkNhSi9Cj9frQhHgpniKdg3PrOK_uCXnM20Fviph0eN9gr95HeWM6tXmEECVtvYVy9yr-9J8NXuEhH6GUoOgeK1cJim5SWDJYlO3ptlUSMsdgtxw5Kr3OTddztX68G03g Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/146b2f312f0b4e8f9917cf32cf40d0c1"}]}] Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c92c6bfebd2b47c4a59be1e677c70ea8 Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1'} Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. (HTTP 404) (Request-ID: req-f1fce35f-61c4-40e0-9e71-c692c5fad023) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:05:41.376037 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e5d44a-5133-4a2f-983b-5ed034dc8e4d tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Returning 404 to user: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43e5d44a-5133-4a2f-983b-5ed034dc8e4d tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 404 len: 109 microversion: 2.1 time: 0.180301 Sep 19 15:05:41.385487 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2317/4601] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:41 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:41.410811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:41.410811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] [instance: facc1f22-bed7-4f92-894b-fa35ce90f4ab] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:41.430132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:41.431162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:41.431741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:41.432768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:41.440931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:41.441765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:41.475461 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] HTTP exception thrown: Instance facc1f22-bed7-4f92-894b-fa35ce90f4ab could not be found. Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Request method failure captured: Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab HTTP/1.1 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIUgTy5Mt5P2pvuVuHUHfT1gd-NsJ-1neSsaeOC7qwg5w2xV8_7veV-hmIVfqqB2d1SNvEGySPs9A3_qHASXmCkKyvRHOs7AS2zhwadsLna9nWCYgDL7-Z7DnkI8FJDCceeHOi2NS4YpJS9RXgxaXYSSj5-1sXGaLqxFtaeIua1m4Lg Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7a3b7a063d0f40498875cd6de1d6ecec Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerAddressesTestJSON-1416238105 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7a3b7a063d0f40498875cd6de1d6ecec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7a3b7a063d0f40498875cd6de1d6ecec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7a3b7a063d0f40498875cd6de1d6ecec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7a3b7a063d0f40498875cd6de1d6ecec"}]}] Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerAddressesTestJSON-1416238105 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7a3b7a063d0f40498875cd6de1d6ecec Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1416238105 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerAddressesTestJSON-1416238105-project Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 7894c8703a5045a79e0faa120ebb2df0 Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerAddressesTestJSON-1416238105-project Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance facc1f22-bed7-4f92-894b-fa35ce90f4ab could not be found. Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'facc1f22-bed7-4f92-894b-fa35ce90f4ab'} Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facc1f22-bed7-4f92-894b-fa35ce90f4ab could not be found. Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facc1f22-bed7-4f92-894b-fa35ce90f4ab could not be found. Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.479403 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facc1f22-bed7-4f92-894b-fa35ce90f4ab could not be found. Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] Returning 404 to user: Instance facc1f22-bed7-4f92-894b-fa35ce90f4ab could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2c1db45-de91-4e70-9187-ee4b5d9c78ff tempest-ServerAddressesTestJSON-1416238105 tempest-ServerAddressesTestJSON-1416238105-project] 10.222.0.81 "GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab" status: 404 len: 111 microversion: 2.1 time: 0.097061 Sep 19 15:05:41.491667 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2318/4602] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:41 2022] GET /compute/v2.1/servers/facc1f22-bed7-4f92-894b-fa35ce90f4ab => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:41.497535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-154c3f0a-e38e-4ad6-b25a-5859621b6b22 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde29d5b3a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:41.590120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-154c3f0a-e38e-4ad6-b25a-5859621b6b22 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] HTTP exception thrown: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-154c3f0a-e38e-4ad6-b25a-5859621b6b22 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Request method failure captured: Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 HTTP/1.1 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIUvlo8ve9HnJDoyNHAfbs-jsqoadfqO-a3AzdpZwBRQkdRkNhSi9Cj9frQhHgpniKdg3PrOK_uCXnM20Fviph0eN9gr95HeWM6tXmEECVtvYVy9yr-9J8NXuEhH6GUoOgeK1cJim5SWDJYlO3ptlUSMsdgtxw5Kr3OTddztX68G03g Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/146b2f312f0b4e8f9917cf32cf40d0c1"}]}] Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c92c6bfebd2b47c4a59be1e677c70ea8 Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1'} Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. (HTTP 404) (Request-ID: req-2457dda4-e671-417a-9f46-6b6d376703ec) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:05:41.592366 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.598004 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.609641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-154c3f0a-e38e-4ad6-b25a-5859621b6b22 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Returning 404 to user: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:41.609641 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-154c3f0a-e38e-4ad6-b25a-5859621b6b22 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 404 len: 109 microversion: 2.1 time: 0.113335 Sep 19 15:05:41.610430 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2319/4603] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:05:41 2022] DELETE /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:41.616435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b4eb81c-1238-4ada-bfb4-5c624cfee0f9 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Calling method '.version_select at 0x7fde28cc5280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:41.656581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9b4eb81c-1238-4ada-bfb4-5c624cfee0f9 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] HTTP exception thrown: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b4eb81c-1238-4ada-bfb4-5c624cfee0f9 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Request method failure captured: Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 HTTP/1.1 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIUvlo8ve9HnJDoyNHAfbs-jsqoadfqO-a3AzdpZwBRQkdRkNhSi9Cj9frQhHgpniKdg3PrOK_uCXnM20Fviph0eN9gr95HeWM6tXmEECVtvYVy9yr-9J8NXuEhH6GUoOgeK1cJim5SWDJYlO3ptlUSMsdgtxw5Kr3OTddztX68G03g Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/146b2f312f0b4e8f9917cf32cf40d0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/146b2f312f0b4e8f9917cf32cf40d0c1"}]}] Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 146b2f312f0b4e8f9917cf32cf40d0c1 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-428318558 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c92c6bfebd2b47c4a59be1e677c70ea8 Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-428318558-project Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1'} Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. (HTTP 404) (Request-ID: req-08cefe60-a8d4-43bf-8531-e8d2c5c97814) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:05:41.659299 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b4eb81c-1238-4ada-bfb4-5c624cfee0f9 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] Returning 404 to user: Volume 8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:05:41.664703 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b4eb81c-1238-4ada-bfb4-5c624cfee0f9 tempest-VolumesSnapshotsTestJSON-428318558 tempest-VolumesSnapshotsTestJSON-428318558-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1" status: 404 len: 109 microversion: 2.1 time: 0.051127 Sep 19 15:05:41.667723 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2320/4604] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:05:41 2022] GET /compute/v2.1/os-volumes/8c74cfc1-9bd7-45ce-91fe-ee3c04ecf5b1 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:42.204721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:42.223056 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a703adf4-f07a-48b3-9385-29cc5d2348ae tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 1.098897 Sep 19 15:05:42.223680 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2285/4605] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:41 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:43.250640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:43.251565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:43.264592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:43.267619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:43.271341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:43.272414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:43.273091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:43.281654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:45.104868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:45.114502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38127f0b-984b-41bd-8cae-03eb8dfac03f tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 1.868344 Sep 19 15:05:45.131184 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2321/4606] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:43 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:46.146511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:46.154520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:46.190872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:46.191497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:46.201330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:46.206849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:46.210214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:46.211348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:46.951681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:46.968797 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f99b9e9f-e7f7-4361-a227-e1a9e4cbe460 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 0.825954 Sep 19 15:05:46.987640 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2286/4607] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:46 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:47.133553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fb140410-57a2-4872-a45b-7b13db74c4fe req-c379ade1-3650-40dc-8ce7-2de3b7d6e848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf82f4-e9a3-4c49-b451-b6cda98c48c5", "name": "network-vif-plugged", "status": "completed", "tag": "9cf93cb8-bf13-4073-8fe5-bfcd3e3eb109"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:47.156457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fb140410-57a2-4872-a45b-7b13db74c4fe req-c379ade1-3650-40dc-8ce7-2de3b7d6e848 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:47.161090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fb140410-57a2-4872-a45b-7b13db74c4fe req-c379ade1-3650-40dc-8ce7-2de3b7d6e848 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:47.163094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fb140410-57a2-4872-a45b-7b13db74c4fe req-c379ade1-3650-40dc-8ce7-2de3b7d6e848 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:47.191958 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fb140410-57a2-4872-a45b-7b13db74c4fe req-c379ade1-3650-40dc-8ce7-2de3b7d6e848 service nova] Creating event network-vif-plugged:9cf93cb8-bf13-4073-8fe5-bfcd3e3eb109 for instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 on n-h2-858384-1 Sep 19 15:05:47.203801 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fb140410-57a2-4872-a45b-7b13db74c4fe req-c379ade1-3650-40dc-8ce7-2de3b7d6e848 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075099 Sep 19 15:05:47.208306 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2322/4608] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:05:48.015862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:48.016584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:48.039560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=50 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:48.041208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:48.042579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:48.062900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:48.069220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:48.073990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:48.078551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:48.529112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:48.541848 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3b6ec53-2562-48d2-b912-85aa991536de tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 0.531975 Sep 19 15:05:48.545593 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2287/4609] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:48 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:49.581425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:49.582340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:49.612333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:49.616212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:49.620289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:49.629027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:49.629744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:49.630216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:52.196941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:52.267883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70ba619f-4f8a-4702-8b1d-54b3905bc545 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1490 microversion: 2.1 time: 2.690141 Sep 19 15:05:52.310182 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2323/4610] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:49 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1490 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:52.331736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-325029601"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:52.335276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:52.361626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:52.362782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:52.366695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:52.368219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:52.369246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:52.369907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:52.621739 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e23ae744-f3cc-4695-9abc-75d21fddec0a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "PUT /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1074 microversion: 2.1 time: 0.294291 Sep 19 15:05:52.625053 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2288/4611] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:05:52 2022] PUT /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1074 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:05:52.645248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:52.645961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:52.658937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:52.677084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:52.683300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:52.684071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:52.685058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:52.687161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:52.693191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:53.636476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:53.647753 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c5e4e8e-461b-48a6-a4e6-d8a7a6aff6b2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1500 microversion: 2.1 time: 1.007332 Sep 19 15:05:53.659226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2324/4612] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:52 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1500 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:53.684649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:53.685658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:53.695605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:53.696112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:53.696566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:53.697298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:53.697772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:53.698308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:54.427770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:54.436840 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a56a133e-7bfa-4856-b9e9-964acfd1ab62 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1500 microversion: 2.1 time: 0.756211 Sep 19 15:05:54.437453 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2289/4613] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:53 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1500 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:54.464131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a66d90e8-3dd3-4124-96ad-c82c33cb79e1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:54.484791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66d90e8-3dd3-4124-96ad-c82c33cb79e1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:54.486239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66d90e8-3dd3-4124-96ad-c82c33cb79e1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:54.486929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66d90e8-3dd3-4124-96ad-c82c33cb79e1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:54.584359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a66d90e8-3dd3-4124-96ad-c82c33cb79e1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Going to try to stop instance {{(pid=128730) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 15:05:54.761420 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a66d90e8-3dd3-4124-96ad-c82c33cb79e1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "POST /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5/action" status: 202 len: 0 microversion: 2.1 time: 0.299684 Sep 19 15:05:54.767018 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2325/4614] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:05:54 2022] POST /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:05:54.805623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:54.807090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:54.872099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:54.877615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:54.886390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:54.889460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:54.890134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:54.892797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:55.381612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:55.392716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-393682f7-46c5-439d-918a-25e35d44f117 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.622098 Sep 19 15:05:55.393796 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2290/4615] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:54 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:56.435893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:56.437103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:56.465953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:56.486307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:56.486930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:56.488022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:56.488695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:56.489499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:57.381814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:57.419002 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb414ea7-03ee-4a68-a583-42b308ca4bf2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.983494 Sep 19 15:05:57.420753 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2326/4616] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:56 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:58.489859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:05:58.494002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:05:58.516162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:58.521122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:58.522402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:58.524475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:05:58.525635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:05:58.527039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:05:59.101544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:05:59.109020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b44fed2e-403b-4dfe-870a-ea355c4f0867 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: .version_select at 0x7fde29bbfd30>, body: {"keypair": {"name": "tempest-keypair-1339252403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETa9DEQP00Wfh11qImaqLWfPefc2Xz6GYkGxIYMYWwrbG/fa0ha8n4DiSpIJ7D8phza3ySjuThweOJ7Q/0ct2mF8pICFemzDzVZmhpF06hBwn25NMt37s/YgzAGCmTZRw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:05:59.112691 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73caa50e-b089-403d-9761-ade8e8b172d0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.641695 Sep 19 15:05:59.117308 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2327/4617] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:05:58 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:05:59.150346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b44fed2e-403b-4dfe-870a-ea355c4f0867 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for project 0bbface579b84c218df369a9f954851d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:05:59.164294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b44fed2e-403b-4dfe-870a-ea355c4f0867 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for user 9d5b01187a7e4267ac429f59338557f0 and project 0bbface579b84c218df369a9f954851d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:05:59.235702 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b44fed2e-403b-4dfe-870a-ea355c4f0867 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.931298 Sep 19 15:05:59.245056 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2291/4618] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:05:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:00.177439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:00.178394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:00.196704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:00.197474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:00.199830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:00.201727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:00.205415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:00.206475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:00.694845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:00.744806 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b6c7aaf2-a4dd-4c42-a0b6-a72252db72ed tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.567930 Sep 19 15:06:00.778977 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2328/4619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:00 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:01.794057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:01.794998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:01.811141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:01.811670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:01.812118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:01.813111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:01.828482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:01.832026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:02.702626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:02.713785 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e0a6aef-5f85-4e8d-beee-6a6c39344481 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.921772 Sep 19 15:06:02.715124 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2292/4620] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:01 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:03.762313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:03.762994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:03.775927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:03.776497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:03.776984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:03.777741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:03.778266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:03.778705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:04.436770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-701747430", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cec117e-876c-4ad8-bc74-554c5efc12b5"}], "security_groups": [{"name": "tempest-securitygroup--9479316"}], "key_name": "tempest-keypair-1339252403", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:04.566693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:04.586122 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-06c0f341-4256-4af0-8e6f-b687fee94a16 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.826213 Sep 19 15:06:04.600159 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2329/4621] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:03 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:04.745410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] validate_networks() for [('0cec117e-876c-4ad8-bc74-554c5efc12b5', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:06:05.615060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:05.615666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:05.627280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:05.627920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:05.628232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:05.632122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:05.632726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:05.634805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:05.638178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:06.380164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:06.401603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-292fd468-bb29-4716-8b39-4c63a8ae774d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.788701 Sep 19 15:06:06.402428 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2330/4622] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:05 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:06.616836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:06:06.617959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:06:06.618909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:06:06.619604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:06:06.620270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:06:06.645688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:06.648453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:06.650688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:06.653766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:06.655380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:06.657140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:06.721317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:06.768856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for project 0bbface579b84c218df369a9f954851d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:06.780946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for user 9d5b01187a7e4267ac429f59338557f0 and project 0bbface579b84c218df369a9f954851d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:06.816586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:06:06.821249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:06:06.989727 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c55d272-2e88-4745-934b-fb3fb7d922c5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.558379 Sep 19 15:06:06.992899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2293/4623] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:06:04 2022] POST /compute/v2.1/servers => generated 399 bytes in 2563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:06:07.019216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a71a0689-f221-420f-8458-c86b215edd79 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:07.019890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a71a0689-f221-420f-8458-c86b215edd79 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:07.260035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a71a0689-f221-420f-8458-c86b215edd79 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:07.279781 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a71a0689-f221-420f-8458-c86b215edd79 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1237 microversion: 2.1 time: 0.270848 Sep 19 15:06:07.290919 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2331/4624] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:07 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1237 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:07.428458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:07.429684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:07.453231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:07.454469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:07.456508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:07.459007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:07.460068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:07.462583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:07.966897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:07.987618 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-705edd5e-be4f-4eb2-bb93-47404385c5a7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.555172 Sep 19 15:06:07.998394 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2294/4625] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:07 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:08.326656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:08.332835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:08.355538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:08.356665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:08.357477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:08.358477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:08.359307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:08.360283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:09.023162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:09.024295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:09.065761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:09.067093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:09.072419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:09.074137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:09.078182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:09.079614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:09.181975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:09.219715 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1a65a65-1fd0-400b-a029-236e695d6704 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1241 microversion: 2.1 time: 0.897232 Sep 19 15:06:09.227168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2332/4626] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:08 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1241 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:09.658847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:09.671538 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b4dc84e6-496b-48a8-85dd-f668f6648400 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1510 microversion: 2.1 time: 0.658296 Sep 19 15:06:09.678998 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2295/4627] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:09 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:10.245576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:10.246386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:10.269577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:10.275545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:10.278325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:10.282468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:10.286417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:10.286977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:10.701486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:10.702309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:10.716323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:10.716848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:10.719154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:10.720448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:10.725138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:10.725686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:10.726148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:10.731397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b675aab9-c448-427b-a16e-f59a34238811 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1295 microversion: 2.1 time: 0.490276 Sep 19 15:06:10.735144 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2333/4628] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:10 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1295 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:11.362958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:11.393881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8dbdee4b-7bfe-4d1d-9d9e-8d115d776d63 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1487 microversion: 2.1 time: 0.697290 Sep 19 15:06:11.398833 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2296/4629] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:10 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1487 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:11.467814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-579191946"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:11.475943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:11.491170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:11.492536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:11.493986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:11.495538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:11.496517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:11.497891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:11.616197 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-047e9269-62a3-4d69-a3b1-7fd3bc111e9c tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "PUT /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1060 microversion: 2.1 time: 0.157878 Sep 19 15:06:11.618349 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2334/4630] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:06:11 2022] PUT /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1060 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:11.639933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:11.641699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:11.654131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:11.655051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:11.659556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:11.660764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:11.661524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:11.662283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:11.769860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:11.773202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:11.800059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:11.808017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:11.809256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:11.811363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:11.813695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:11.815544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:12.584891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:12.605382 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d3a9bc4-c7d5-43c9-be7f-6befdce785aa tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1487 microversion: 2.1 time: 0.967097 Sep 19 15:06:12.627251 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2297/4631] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:11 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1487 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:12.636184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:12.636799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:12.658393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:12.660711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:12.661390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:12.663495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:12.663912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:12.664393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:12.745931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:12.773125 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5486b169-00e2-4971-a34f-847f935e237a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 1.011383 Sep 19 15:06:12.774176 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2335/4632] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:11 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:13.228233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:13.243172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e60fdcad-fe6f-4ce1-b93a-685ff785468e tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1487 microversion: 2.1 time: 0.608856 Sep 19 15:06:13.245439 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2298/4633] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:12 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1487 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:13.276687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:13.277555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:13.291755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:13.313283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:13.316892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:13.328942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:13.330907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:13.334407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:13.429691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:06:13.691818 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a1226c10-d1e5-413b-9d41-bca98215eb85 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 204 len: 0 microversion: 2.1 time: 0.419406 Sep 19 15:06:13.692762 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2336/4634] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:13 2022] DELETE /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:13.702214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:13.704562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:13.718866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:13.721938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:13.723181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:13.725056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:13.727317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:13.729598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:13.805135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:13.806196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:13.820895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:13.837897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:13.840096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:13.850975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:13.860442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:13.861511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:14.553171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:14.573052 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-44a4c3df-719a-4415-81a2-139046139393 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1493 microversion: 2.1 time: 0.875163 Sep 19 15:06:14.573887 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2299/4635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:13 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1493 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:14.596070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-92a40e6d-65ee-49b5-94a6-8591215ab1ba req-1857f80b-97d3-4fb3-8988-b64c7fd01a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31014aee-7a40-49c7-a33b-3d49834e0b51", "tag": "a58144cc-860f-4e70-988c-33c09945574a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:14.632713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-92a40e6d-65ee-49b5-94a6-8591215ab1ba req-1857f80b-97d3-4fb3-8988-b64c7fd01a96 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:14.636174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-92a40e6d-65ee-49b5-94a6-8591215ab1ba req-1857f80b-97d3-4fb3-8988-b64c7fd01a96 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:14.636693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-92a40e6d-65ee-49b5-94a6-8591215ab1ba req-1857f80b-97d3-4fb3-8988-b64c7fd01a96 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:14.671231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-92a40e6d-65ee-49b5-94a6-8591215ab1ba req-1857f80b-97d3-4fb3-8988-b64c7fd01a96 service nova] Creating event network-changed:a58144cc-860f-4e70-988c-33c09945574a for instance 31014aee-7a40-49c7-a33b-3d49834e0b51 on n-h1-858384-1 Sep 19 15:06:14.681682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:14.695897 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0dc9ca9a-0c93-48d7-a531-6c79876cb9ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 0.896890 Sep 19 15:06:14.696816 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2337/4636] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:13 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:14.733624 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-92a40e6d-65ee-49b5-94a6-8591215ab1ba req-1857f80b-97d3-4fb3-8988-b64c7fd01a96 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146529 Sep 19 15:06:14.736632 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2300/4637] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:15.604179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:15.605046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:15.633321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:15.634392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:15.635726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:15.638999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:15.643088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:15.645886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:15.724051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:15.725571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:15.734086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:15.735764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:15.736873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:15.737960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:15.738693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:15.739620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:16.712259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:16.798082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:16.820128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:16.832129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:16.863970 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0fca7c6a-7eeb-4800-af34-65253c87033f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 1.146304 Sep 19 15:06:16.893203 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c07d98c7-ffe1-418f-b994-7030750e39a1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1493 microversion: 2.1 time: 1.276878 Sep 19 15:06:16.915652 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2338/4638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:15 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1493 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:16.916321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2301/4639] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:15 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:16.926542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9fd87fdc-c3f2-4c71-acaa-501e51440003 req-7572aef3-d38b-43d2-8523-1e5370bfd79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf82f4-e9a3-4c49-b451-b6cda98c48c5", "name": "network-vif-deleted", "tag": "9cf93cb8-bf13-4073-8fe5-bfcd3e3eb109"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:16.967755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fd87fdc-c3f2-4c71-acaa-501e51440003 req-7572aef3-d38b-43d2-8523-1e5370bfd79f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:16.968246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fd87fdc-c3f2-4c71-acaa-501e51440003 req-7572aef3-d38b-43d2-8523-1e5370bfd79f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:16.973170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fd87fdc-c3f2-4c71-acaa-501e51440003 req-7572aef3-d38b-43d2-8523-1e5370bfd79f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:17.005264 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9fd87fdc-c3f2-4c71-acaa-501e51440003 req-7572aef3-d38b-43d2-8523-1e5370bfd79f service nova] Creating event network-vif-deleted:9cf93cb8-bf13-4073-8fe5-bfcd3e3eb109 for instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 on n-h2-858384-1 Sep 19 15:06:17.065130 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9fd87fdc-c3f2-4c71-acaa-501e51440003 req-7572aef3-d38b-43d2-8523-1e5370bfd79f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113087 Sep 19 15:06:17.071110 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2339/4640] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:17.896239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:17.897081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:17.934465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:17.939396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:17.939912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:17.940351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:17.941084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:17.941634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:17.942062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:17.953963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:17.994323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:18.028312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:18.042309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:18.055167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:18.056165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:18.061165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:18.061485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:18.262322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:18.264090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:18.267872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:18.269808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lazy-loading 'fault' on Instance uuid ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:06:18.482789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:18.528732 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f075afb5-a52d-4305-82da-fadbcb7e2d5b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 200 len: 1309 microversion: 2.1 time: 0.605724 Sep 19 15:06:18.534859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2340/4641] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:17 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 1309 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:19.103891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:19.118324 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f6ef5f6-cd41-4534-a66f-a47888becd7e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 1.230041 Sep 19 15:06:19.119666 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2302/4642] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:17 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:19.579772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:19.588944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:19.637540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:19.641300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:19.647019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:19.647677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:19.649913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:19.650618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:19.652986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:19.701820 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 HTTP/1.1 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ccbf82f4-e9a3-4c49-b451-b6cda98c48c5'} Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:19.707216 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.713990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:19.715559 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-77495047-6d2c-4225-9092-53abef3ef597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 404 len: 111 microversion: 2.1 time: 0.159474 Sep 19 15:06:19.720518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2303/4643] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:19 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:19.751424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:19.752343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:19.774826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:19.775690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:19.783205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:19.784585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:19.785439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:19.786226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:19.832477 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 HTTP/1.1 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ccbf82f4-e9a3-4c49-b451-b6cda98c48c5'} Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:19.834138 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d178609-33af-43f3-b6d1-884e1337e7c1 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 404 len: 111 microversion: 2.1 time: 0.106794 Sep 19 15:06:19.843643 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2304/4644] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:19 2022] DELETE /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:19.851058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:19.851878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: ccbf82f4-e9a3-4c49-b451-b6cda98c48c5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:19.865847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:19.867958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:19.871431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:19.872672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:19.874319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:19.880649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:19.937136 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 HTTP/1.1 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ccbf82f4-e9a3-4c49-b451-b6cda98c48c5'} Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:19.948372 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. Sep 19 15:06:19.971988 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:19.975448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:19.977072 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37549a43-f099-4562-87b8-e93cfa264e06 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5" status: 404 len: 111 microversion: 2.1 time: 0.134604 Sep 19 15:06:19.981370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2305/4645] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:19 2022] GET /compute/v2.1/servers/ccbf82f4-e9a3-4c49-b451-b6cda98c48c5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:20.006400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:20.007566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:20.021512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.025498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.027440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.044326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.045213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.046404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.098478 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e HTTP/1.1 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '394647cf-fa9e-462e-b5e8-2c05a98fc81e'} Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:20.102141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.116229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:20.118957 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ec344283-09ed-4d09-aa1c-a52f4f547597 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 404 len: 111 microversion: 2.1 time: 0.131932 Sep 19 15:06:20.124430 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2306/4646] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:19 2022] DELETE /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:20.135247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:20.135983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 394647cf-fa9e-462e-b5e8-2c05a98fc81e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:20.150534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.151178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.159757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.196340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aff06bdd-286c-4524-97b8-d63b48266016 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Action: 'create', calling method: .version_select at 0x7fde28d0c4c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1774252116", "policies": ["affinity"]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:20.206387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.213027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.214010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.294457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-aff06bdd-286c-4524-97b8-d63b48266016 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:20.298736 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e HTTP/1.1 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '394647cf-fa9e-462e-b5e8-2c05a98fc81e'} Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.303176 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.311412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 394647cf-fa9e-462e-b5e8-2c05a98fc81e could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:20.314455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49efd4b7-cac6-4b1b-9296-857a8be8d7fb tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e" status: 404 len: 111 microversion: 2.1 time: 0.180385 Sep 19 15:06:20.314455 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2307/4647] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:20 2022] GET /compute/v2.1/servers/394647cf-fa9e-462e-b5e8-2c05a98fc81e => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:20.319409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-aff06bdd-286c-4524-97b8-d63b48266016 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:20.329868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:20.330542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:20.381647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.388288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.388974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.389743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.390239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.401220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-aff06bdd-286c-4524-97b8-d63b48266016 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:20.402316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.408666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-aff06bdd-286c-4524-97b8-d63b48266016 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:20.427031 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aff06bdd-286c-4524-97b8-d63b48266016 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.935455 Sep 19 15:06:20.428957 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2341/4648] 10.222.0.81 () {60 vars in 1174 bytes} [Mon Sep 19 15:06:19 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:20.436578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:20.438306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:20.453996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.454325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.454961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.455776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.456537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.457307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.476585 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e HTTP/1.1 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '78f63ed0-1803-415c-b709-aebca601ba1e'} Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:20.479245 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.485501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.489273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:20.489273 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b3d02de-78e1-4eef-82ce-636987cc352d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 404 len: 111 microversion: 2.1 time: 0.058978 Sep 19 15:06:20.491518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2342/4649] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:20 2022] DELETE /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:20.501259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74b6bef0-5aaf-4eb2-81dc-6ceb6dde5247 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Action: 'create', calling method: .version_select at 0x7fde29f7d550>, body: {"server_group": {"name": "tempest-server-group-1377628913", "policies": ["affinity"]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:20.539682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-74b6bef0-5aaf-4eb2-81dc-6ceb6dde5247 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:20.557879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-74b6bef0-5aaf-4eb2-81dc-6ceb6dde5247 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:20.716636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-74b6bef0-5aaf-4eb2-81dc-6ceb6dde5247 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:20.724873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-74b6bef0-5aaf-4eb2-81dc-6ceb6dde5247 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:20.769538 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74b6bef0-5aaf-4eb2-81dc-6ceb6dde5247 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.276530 Sep 19 15:06:20.772557 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2343/4650] 10.222.0.81 () {60 vars in 1173 bytes} [Mon Sep 19 15:06:20 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:20.787834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:20.790667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 78f63ed0-1803-415c-b709-aebca601ba1e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:20.808695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:20.815793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.817083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.819157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.822672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.824870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.825462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.885243 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.886075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e HTTP/1.1 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '78f63ed0-1803-415c-b709-aebca601ba1e'} Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:20.888702 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 78f63ed0-1803-415c-b709-aebca601ba1e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d615b07b-62a4-4af6-9e02-0388ff70e842 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e" status: 404 len: 111 microversion: 2.1 time: 0.119265 Sep 19 15:06:20.904872 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2344/4651] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:20 2022] GET /compute/v2.1/servers/78f63ed0-1803-415c-b709-aebca601ba1e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:20.907542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26429629-32e1-4dd4-a635-02d1ac1563e9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 0.590371 Sep 19 15:06:20.907542 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2308/4652] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:20 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:20.910788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-77789ae1-a512-453a-ba11-3c7f99e6eb7b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Action: 'create', calling method: .version_select at 0x7fde29e4a940>, body: {"server_group": {"name": "tempest-server-group-1377628913", "policies": ["affinity"]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:20.955830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:20.958772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:20.972324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-77789ae1-a512-453a-ba11-3c7f99e6eb7b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:20.974218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.974731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.980422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:20.981964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-77789ae1-a512-453a-ba11-3c7f99e6eb7b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:20.983736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:20.985042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:20.985537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.024116 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c HTTP/1.1 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '71ff6f06-e104-4d2d-9b65-c9b25fca9f1c'} Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:21.026221 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.032935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.043366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:21.058200 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d831b68d-8a65-4bc5-afc8-b3e7fca1489d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 404 len: 111 microversion: 2.1 time: 0.123914 Sep 19 15:06:21.063226 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2309/4653] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:20 2022] DELETE /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:21.076641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-77789ae1-a512-453a-ba11-3c7f99e6eb7b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:21.082590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.083723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.092487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.093939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.094620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.096252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.096958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.098526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.109290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-77789ae1-a512-453a-ba11-3c7f99e6eb7b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:21.162263 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-77789ae1-a512-453a-ba11-3c7f99e6eb7b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.264495 Sep 19 15:06:21.168406 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2345/4654] 10.222.0.81 () {60 vars in 1173 bytes} [Mon Sep 19 15:06:20 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:21.181793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.188546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.208797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.209921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.209921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.210475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.215538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.216302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.261456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c HTTP/1.1 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '71ff6f06-e104-4d2d-9b65-c9b25fca9f1c'} Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.268009 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. Sep 19 15:06:21.277228 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.281020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 71ff6f06-e104-4d2d-9b65-c9b25fca9f1c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:21.281020 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-322ed21f-05f9-4f64-a0cf-1d559827ece5 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c" status: 404 len: 111 microversion: 2.1 time: 0.112236 Sep 19 15:06:21.302480 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2346/4655] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/servers/71ff6f06-e104-4d2d-9b65-c9b25fca9f1c => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:21.308009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9f0b5a2-1b8d-4b3d-8d86-a4b1d8566a95 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.372055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9f0b5a2-1b8d-4b3d-8d86-a4b1d8566a95 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/69569aa2-5690-47e7-bf18-63faaea91fa8" status: 204 len: 0 microversion: 2.1 time: 0.067922 Sep 19 15:06:21.372765 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2347/4656] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:21 2022] DELETE /compute/v2.1/os-server-groups/69569aa2-5690-47e7-bf18-63faaea91fa8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:21.395610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.396750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.414687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.415232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.417055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.419423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.419927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.420370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.480444 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be HTTP/1.1 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '168d4a73-a50f-4b92-886f-fc483214b3be'} Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:21.482539 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:21.488753 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a481eb9e-01b7-480c-a11f-afbf0b2d36f0 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 404 len: 111 microversion: 2.1 time: 0.110307 Sep 19 15:06:21.491711 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2348/4657] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:21 2022] DELETE /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:21.508038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8542918d-3f1b-42b0-aa06-778eaaa94f02 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.551615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8542918d-3f1b-42b0-aa06-778eaaa94f02 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.057254 Sep 19 15:06:21.552356 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2349/4658] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:21.567898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:21.571488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.573293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 168d4a73-a50f-4b92-886f-fc483214b3be] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.590519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.591438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.591591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:21.592446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.595425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:21.596099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.596725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.597929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.599725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf427637-569b-4a0b-a672-0b0cfaf31d3f tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2952 microversion: 2.42 time: 0.529885 Sep 19 15:06:21.601534 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2310/4659] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2952 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:06:21.612193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6bd35185-96c7-4512-87ea-75a72a183dd2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.635241 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be HTTP/1.1 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '168d4a73-a50f-4b92-886f-fc483214b3be'} Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.647878 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.658119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 168d4a73-a50f-4b92-886f-fc483214b3be could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:21.661547 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-28f46f58-3d08-40db-8103-2c58e72277c7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be" status: 404 len: 111 microversion: 2.1 time: 0.102303 Sep 19 15:06:21.664476 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2350/4660] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/servers/168d4a73-a50f-4b92-886f-fc483214b3be => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:21.679648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.682027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.698568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.702199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6bd35185-96c7-4512-87ea-75a72a183dd2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/00cc3600-f53a-43b3-8e68-72675a563cab" status: 204 len: 0 microversion: 2.1 time: 0.096177 Sep 19 15:06:21.702877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.704096 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2311/4661] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:21 2022] DELETE /compute/v2.1/os-server-groups/00cc3600-f53a-43b3-8e68-72675a563cab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:21.709233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.710937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.711730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.712586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.720554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.722200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.738076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.739051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.740042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.742224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.743515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.744897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.752138 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 HTTP/1.1 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a7dd5bd1-58c0-43fa-af56-0b78c531edd1'} Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:21.754284 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.762511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:21.765090 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d5ff386f-4d12-4109-a2c7-4013a1aedf0d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 404 len: 111 microversion: 2.1 time: 0.098449 Sep 19 15:06:21.769093 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2351/4662] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:21 2022] DELETE /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:21.778150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7769df5a-5e66-47f3-9dc5-e305743b818e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.799066 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7769df5a-5e66-47f3-9dc5-e305743b818e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.028152 Sep 19 15:06:21.801931 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2352/4663] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:21.815139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:21.816165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: a7dd5bd1-58c0-43fa-af56-0b78c531edd1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:21.825161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.826518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.827360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.828972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:21.829684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:21.830344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:21.851155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 HTTP/1.1 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a7dd5bd1-58c0-43fa-af56-0b78c531edd1'} Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:21.853554 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. Sep 19 15:06:21.859787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:21.861760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance a7dd5bd1-58c0-43fa-af56-0b78c531edd1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:21.863826 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c00e5e0d-ac62-46ab-8814-72f9d53e6235 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1" status: 404 len: 111 microversion: 2.1 time: 0.060416 Sep 19 15:06:21.867859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2353/4664] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/servers/a7dd5bd1-58c0-43fa-af56-0b78c531edd1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:21.873947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76db994b-42ab-46c8-9bc7-c0b7d1c941f2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Action: 'create', calling method: .version_select at 0x7fde297de5e0>, body: {"server_group": {"name": "tempest-server-group-2095032699", "policies": ["affinity"]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:21.899777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-76db994b-42ab-46c8-9bc7-c0b7d1c941f2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:21.917052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-76db994b-42ab-46c8-9bc7-c0b7d1c941f2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:22.023244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-76db994b-42ab-46c8-9bc7-c0b7d1c941f2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:22.035762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-76db994b-42ab-46c8-9bc7-c0b7d1c941f2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:22.106227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76db994b-42ab-46c8-9bc7-c0b7d1c941f2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.236246 Sep 19 15:06:22.114099 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2354/4665] 10.222.0.81 () {60 vars in 1173 bytes} [Mon Sep 19 15:06:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:22.139342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-feda9034-78d9-4e17-b858-0ff7c22297fc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:22.145035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-feda9034-78d9-4e17-b858-0ff7c22297fc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 7a830087-dda0-40f2-b21d-04a1c6870073] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:22.198987 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-feda9034-78d9-4e17-b858-0ff7c22297fc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-feda9034-78d9-4e17-b858-0ff7c22297fc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 HTTP/1.1 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '7a830087-dda0-40f2-b21d-04a1c6870073'} Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:22.223303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-feda9034-78d9-4e17-b858-0ff7c22297fc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-feda9034-78d9-4e17-b858-0ff7c22297fc tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073" status: 404 len: 111 microversion: 2.1 time: 0.108935 Sep 19 15:06:22.238166 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2355/4666] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:22 2022] DELETE /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:22.243403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:22.244761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:22.257871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:22.258525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:22.259475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:22.260621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:22.261363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:22.262104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:22.275644 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a373af6e-a60e-4839-a0a6-75b20f07c54e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.567423 Sep 19 15:06:22.276730 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2312/4667] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 15:06:21 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3/os-interface => generated 1828 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:06:22.315875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b83648e-fe7a-4501-8891-371b65f8f8e2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:22.450986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b83648e-fe7a-4501-8891-371b65f8f8e2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/151281bf-e5bf-475f-9557-ce270ac8da06" status: 204 len: 0 microversion: 2.1 time: 0.172230 Sep 19 15:06:22.456650 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2313/4668] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:22 2022] DELETE /compute/v2.1/os-server-groups/151281bf-e5bf-475f-9557-ce270ac8da06 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:22.492111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ed1813e-df0d-40cb-8fb1-afecbb615598 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:22.493434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9ed1813e-df0d-40cb-8fb1-afecbb615598 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: 7a830087-dda0-40f2-b21d-04a1c6870073] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:22.515197 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9ed1813e-df0d-40cb-8fb1-afecbb615598 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ed1813e-df0d-40cb-8fb1-afecbb615598 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 HTTP/1.1 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7a830087-dda0-40f2-b21d-04a1c6870073'} Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:22.519070 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:22.527296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:22.527296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:22.527296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:22.527296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. Sep 19 15:06:22.527296 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:22.540929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ed1813e-df0d-40cb-8fb1-afecbb615598 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance 7a830087-dda0-40f2-b21d-04a1c6870073 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:22.542850 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ed1813e-df0d-40cb-8fb1-afecbb615598 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073" status: 404 len: 111 microversion: 2.1 time: 0.083832 Sep 19 15:06:22.543656 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2314/4669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:22 2022] GET /compute/v2.1/servers/7a830087-dda0-40f2-b21d-04a1c6870073 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:22.585012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cd3cf659-766c-4337-9902-28468dddc175 req-eaae4665-480f-46dc-9dfe-a063f41d5569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31014aee-7a40-49c7-a33b-3d49834e0b51", "name": "network-vif-plugged", "status": "completed", "tag": "a58144cc-860f-4e70-988c-33c09945574a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:22.607077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd3cf659-766c-4337-9902-28468dddc175 req-eaae4665-480f-46dc-9dfe-a063f41d5569 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:22.608398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd3cf659-766c-4337-9902-28468dddc175 req-eaae4665-480f-46dc-9dfe-a063f41d5569 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:22.609585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd3cf659-766c-4337-9902-28468dddc175 req-eaae4665-480f-46dc-9dfe-a063f41d5569 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:22.661658 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cd3cf659-766c-4337-9902-28468dddc175 req-eaae4665-480f-46dc-9dfe-a063f41d5569 service nova] Creating event network-vif-plugged:a58144cc-860f-4e70-988c-33c09945574a for instance 31014aee-7a40-49c7-a33b-3d49834e0b51 on n-h1-858384-1 Sep 19 15:06:22.674128 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cd3cf659-766c-4337-9902-28468dddc175 req-eaae4665-480f-46dc-9dfe-a063f41d5569 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125216 Sep 19 15:06:22.684598 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2315/4670] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:22.697697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01553fc7-8203-49b2-a1de-63a8530ca01d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:22.705276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:22.717667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-34484f66-2d96-44e6-987f-e32d509225f0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 0.484575 Sep 19 15:06:22.732177 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2356/4671] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:22 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:22.744937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:22.745981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:22.755365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:22.762693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:22.763779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:22.766205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:22.795112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:22.796170 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01553fc7-8203-49b2-a1de-63a8530ca01d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.108570 Sep 19 15:06:22.800750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:22.801665 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2316/4672] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:06:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:22.817856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9edf36e6-56f3-4bc8-8af3-a9db88541f13 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Action: 'create', calling method: .version_select at 0x7fde2e241b80>, body: {"server_group": {"name": "tempest-server-group-708140858", "policies": ["anti-affinity"]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:22.893330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9edf36e6-56f3-4bc8-8af3-a9db88541f13 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:22.896136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:06:22.908177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9edf36e6-56f3-4bc8-8af3-a9db88541f13 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:22.999491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:23.000032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9edf36e6-56f3-4bc8-8af3-a9db88541f13 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:23.010268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-9edf36e6-56f3-4bc8-8af3-a9db88541f13 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_groups'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:23.032246 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9edf36e6-56f3-4bc8-8af3-a9db88541f13 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.219076 Sep 19 15:06:23.034310 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2317/4673] 10.222.0.81 () {60 vars in 1173 bytes} [Mon Sep 19 15:06:22 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:23.051157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1b6297c-1211-4432-b0c7-cb5f2ed62940 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:23.105997 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1b6297c-1211-4432-b0c7-cb5f2ed62940 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/b54952d3-786c-4cca-824d-2c0667b5de7a" status: 204 len: 0 microversion: 2.1 time: 0.061134 Sep 19 15:06:23.110860 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2318/4674] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:23 2022] DELETE /compute/v2.1/os-server-groups/b54952d3-786c-4cca-824d-2c0667b5de7a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:23.121926 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c095eb8-d264-4c12-8be7-523cfda39865 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 204 len: 0 microversion: 2.1 time: 0.381942 Sep 19 15:06:23.122686 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2357/4675] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:22 2022] DELETE /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:23.124199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcb78105-dafd-464c-8868-810599b364b3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:23.135996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:23.137245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:23.146255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:23.147394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:23.148235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:23.149532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:23.150340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:23.151047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:23.155594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcb78105-dafd-464c-8868-810599b364b3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041268 Sep 19 15:06:23.168711 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2319/4676] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:06:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:23.468264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1357241974", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "3fd07a3c-0420-4dda-aa54-a996512fde87"}]}, "os:scheduler_hints": {"group": "f337ebb4-78f8-419d-a2cb-df199cfd9e0b"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:23.505121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:23.523425 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-567c0b43-d34c-4049-9e6f-72360c30b34d tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1479 microversion: 2.1 time: 0.392278 Sep 19 15:06:23.545180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2358/4677] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:23 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1479 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:23.586016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] validate_networks() for [('3fd07a3c-0420-4dda-aa54-a996512fde87', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:06:23.751889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:23.752825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:23.782959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:23.785279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:23.786614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:23.791454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:23.798582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:23.802731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:24.309411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:24.324109 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-327485be-6728-4341-9be2-57aff33a137b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1360 microversion: 2.1 time: 0.580765 Sep 19 15:06:24.325058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2359/4678] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:23 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1360 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:24.337494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-80434210", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "443e9805-f9ac-4543-8ddd-7bb9c9017814"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:24.465954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] validate_networks() for [('443e9805-f9ac-4543-8ddd-7bb9c9017814', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:06:24.728125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:06:24.728543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:06:24.729027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:06:24.729575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:06:24.730007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:06:24.768256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:24.768654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:24.769407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:24.770427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:24.776264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:24.776979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:24.803316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:24.815140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:24.869832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:06:24.884891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:06:25.044876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:25.072759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:25.075676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:25.210903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:25.219811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Getting quotas for user 3a64526f6ed946f8b2176e0477f44d11 and project a924eb3d6a6643cbb242357af2ac0e76. Resources: {'server_group_members'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:25.279336 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74ac0f63-5137-4930-97bb-a26376616c17 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822683 Sep 19 15:06:25.289874 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2320/4679] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:06:25.302719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:25.306468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:25.327633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:25.331004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:25.332323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:25.334242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:25.337645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:25.338487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:26.374861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:26.384655 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b11edf0-d55d-41b9-8e44-b9d735813c6b tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1479 microversion: 2.1 time: 1.092816 Sep 19 15:06:26.392311 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2321/4680] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:25 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1479 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:26.427886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b2cbf7f-5496-4fac-bb58-36b40f5145c0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:26.467048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1b2cbf7f-5496-4fac-bb58-36b40f5145c0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:26.662508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1b2cbf7f-5496-4fac-bb58-36b40f5145c0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:26.668522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:06:26.669137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:06:26.669421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:06:26.669978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:06:26.670405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:06:26.688727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:26.689290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:26.689781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:26.690598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:26.693519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:26.694622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:26.694827 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1b2cbf7f-5496-4fac-bb58-36b40f5145c0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1213 microversion: 2.1 time: 0.300973 Sep 19 15:06:26.710742 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2322/4681] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:26 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1213 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:26.723515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:26.724604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:26.741735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:26.742274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:26.744236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:26.746058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:26.749226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:26.750073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:26.793875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Getting quotas for project 3a0ff1863ea9443682549fe0ef7f19c2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:26.801547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:26.829511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Getting quotas for user 6366da44f65947f0aa20ac58a5b2a5be and project 3a0ff1863ea9443682549fe0ef7f19c2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:26.865201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:06:26.876075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:06:26.993006 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b419f336-6ea0-4f0f-8356-03b0ec3cad04 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.666806 Sep 19 15:06:27.005835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2360/4682] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:06:27.013046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0274efa9-1b15-41e7-a7d8-90129db0cab3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:27.014021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0274efa9-1b15-41e7-a7d8-90129db0cab3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:27.694239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0274efa9-1b15-41e7-a7d8-90129db0cab3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:27.766238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0274efa9-1b15-41e7-a7d8-90129db0cab3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1212 microversion: 2.1 time: 0.757244 Sep 19 15:06:27.770144 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2361/4683] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:27 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1212 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:27.802057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:27.806506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:27.841176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:27.846912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:27.849330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:27.855012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:27.858293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:27.866707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.028559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:28.056052 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e045bf4-70ec-4182-b3ee-f0c3db47a10a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1546 microversion: 2.1 time: 1.343562 Sep 19 15:06:28.067471 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2323/4684] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:26 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1546 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:28.079501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:28.086640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:28.108281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.111594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.112131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.113344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.114157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.114911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.148933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:28.184525 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39e3786e-c85c-4497-9afd-d43d040944a2 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1437 microversion: 2.1 time: 0.412107 Sep 19 15:06:28.185119 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2362/4685] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:27 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1437 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:28.200974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6bdb572d-88b5-441c-a54c-16ff54c6d375 req-39f10436-f54b-4218-bd0f-448f039da0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41b03f9-e02f-49a8-bddc-eff40fb91f08", "name": "network-vif-deleted", "tag": "b527c2a7-5981-45fb-aaf6-b78bbc1ed937"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:28.251917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6bdb572d-88b5-441c-a54c-16ff54c6d375 req-39f10436-f54b-4218-bd0f-448f039da0b7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.255468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6bdb572d-88b5-441c-a54c-16ff54c6d375 req-39f10436-f54b-4218-bd0f-448f039da0b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.256305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6bdb572d-88b5-441c-a54c-16ff54c6d375 req-39f10436-f54b-4218-bd0f-448f039da0b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.324615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6bdb572d-88b5-441c-a54c-16ff54c6d375 req-39f10436-f54b-4218-bd0f-448f039da0b7 service nova] Creating event network-vif-deleted:b527c2a7-5981-45fb-aaf6-b78bbc1ed937 for instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 on n-h2-858384-1 Sep 19 15:06:28.332420 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6bdb572d-88b5-441c-a54c-16ff54c6d375 req-39f10436-f54b-4218-bd0f-448f039da0b7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145904 Sep 19 15:06:28.333427 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2363/4686] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:28.350094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:28.355884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:28.356929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:28.360496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:28.377373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.381130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.382376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.383629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.384233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.384839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.391148 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b93073fe-2457-472d-b12b-cb1d673de50d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1265 microversion: 2.1 time: 0.320645 Sep 19 15:06:28.392202 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2324/4687] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:28 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:28.824118 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4e2c715f-e223-4683-b46a-82451c6e8518 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.488254 Sep 19 15:06:28.826432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:28.827374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:28.835601 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2364/4688] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:06:28 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-interface => generated 285 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:28.842074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.842660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.843485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:28.844999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:28.847253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:28.847802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:29.027366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:29.037032 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-888cdcaf-4810-44f8-850e-5860773f1df9 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1208 microversion: 2.1 time: 0.214894 Sep 19 15:06:29.055605 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2325/4689] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:28 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:29.222589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:29.227566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:29.248056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:29.248551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:29.249204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:29.252033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:29.255042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:29.255802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:29.373363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:29.375144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:29.376429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:29.377520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lazy-loading 'fault' on Instance uuid b41b03f9-e02f-49a8-bddc-eff40fb91f08 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:06:29.465975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:29.476178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:29.522047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:29.528017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:29.528017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:29.537387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:29.538065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:29.538578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:29.725019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60baef2bea9e40d8ba4af8f3ec6755eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955de381d91a4e02a1da49f38dd10e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:29.746136 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8bea75d5-99b6-4d4c-b817-5cace188aa8a tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 200 len: 1282 microversion: 2.1 time: 0.528683 Sep 19 15:06:29.747276 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2365/4690] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:29 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 1282 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:29.766491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:29.784068 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3cfa76f-6290-4d7c-886e-f706677dc8e0 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1271 microversion: 2.1 time: 0.328753 Sep 19 15:06:29.800646 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2326/4691] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:29 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1271 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:30.079499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:30.080895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:30.111089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:30.112004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:30.119924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:30.121333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:30.122253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:30.123100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:30.402888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:30.426067 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-65642f3e-e065-427a-ba75-37687f1e7e73 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1282 microversion: 2.1 time: 0.362474 Sep 19 15:06:30.426673 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2366/4692] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:30 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:30.778062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:30.785238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] [instance: b41b03f9-e02f-49a8-bddc-eff40fb91f08] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:30.809462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:30.810401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:30.811334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:30.812782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:30.813667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:30.830388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:30.843320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:30.852109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:30.888930 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] HTTP exception thrown: Instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 could not be found. Sep 19 15:06:30.899086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:30.900161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:30.901385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Request method failure captured: Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 HTTP/1.1 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIRX_IH88jlXzLLsDfYyfQAy_zARirOqsxjNrWE_KibKzgs-129QNxaJaNGjljYZ06Q2sRKuSAlP2zsHoXIQfwoEZZRy4n-1T8fNSeOJ2qVB4zBS-8KuCfd9t93pdYxqbHNbbdN28ERl-ewtiUBXn0AX2fQvOLYDdeI8KdAykRVgrAA Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/955de381d91a4e02a1da49f38dd10e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/955de381d91a4e02a1da49f38dd10e3b"}]}] Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersTestJSON-1966295971 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 955de381d91a4e02a1da49f38dd10e3b Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersTestJSON-1966295971 Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 60baef2bea9e40d8ba4af8f3ec6755eb Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersTestJSON-1966295971-project Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 could not be found. Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'b41b03f9-e02f-49a8-bddc-eff40fb91f08'} Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 could not be found. Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 could not be found. Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:30.901636 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 could not be found. Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] Returning 404 to user: Instance b41b03f9-e02f-49a8-bddc-eff40fb91f08 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4cd7ceca-ccf7-4e88-9015-9d38c20808e7 tempest-ServersTestJSON-1966295971 tempest-ServersTestJSON-1966295971-project] 10.222.0.81 "GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08" status: 404 len: 111 microversion: 2.1 time: 0.135022 Sep 19 15:06:30.920179 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2327/4693] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:30 2022] GET /compute/v2.1/servers/b41b03f9-e02f-49a8-bddc-eff40fb91f08 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:30.923694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:30.923694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:30.928133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:31.512372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:31.513754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:31.539238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:31.540609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:31.541668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:31.543318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:31.544402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:31.545440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:32.174617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:32.218280 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45a047e3-d496-4071-9d72-380c9224ceaa tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1270 microversion: 2.1 time: 0.742958 Sep 19 15:06:32.228921 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2328/4694] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:31 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1270 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:32.306855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:32.339350 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a6cd7be1-8bd2-4950-86dd-19591e3c6f9a tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 1.513563 Sep 19 15:06:32.343977 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2367/4695] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:30 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:32.426595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-926f464f-b461-4e19-b65f-bf196bcfb9df req-5231784d-7ee4-4aff-a021-89a51843004d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31014aee-7a40-49c7-a33b-3d49834e0b51", "tag": "a58144cc-860f-4e70-988c-33c09945574a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:32.456602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-926f464f-b461-4e19-b65f-bf196bcfb9df req-5231784d-7ee4-4aff-a021-89a51843004d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:32.457173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-926f464f-b461-4e19-b65f-bf196bcfb9df req-5231784d-7ee4-4aff-a021-89a51843004d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:32.457751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-926f464f-b461-4e19-b65f-bf196bcfb9df req-5231784d-7ee4-4aff-a021-89a51843004d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:32.480473 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-926f464f-b461-4e19-b65f-bf196bcfb9df req-5231784d-7ee4-4aff-a021-89a51843004d service nova] Creating event network-changed:a58144cc-860f-4e70-988c-33c09945574a for instance 31014aee-7a40-49c7-a33b-3d49834e0b51 on n-h1-858384-1 Sep 19 15:06:32.491023 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-926f464f-b461-4e19-b65f-bf196bcfb9df req-5231784d-7ee4-4aff-a021-89a51843004d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091581 Sep 19 15:06:32.492832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2329/4696] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:33.253584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:33.254873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:33.296424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:33.296424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:33.296424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:33.296424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:33.296424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:33.296424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:33.369861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:33.370813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:33.384968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:33.388734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:33.393134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:33.394340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:33.394907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:33.395459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:33.934622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:33.950410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d03e2062-48cb-4db2-aaaa-1ed23c3f9490 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1270 microversion: 2.1 time: 0.702346 Sep 19 15:06:33.952109 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2368/4697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:33 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1270 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:34.222451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:34.240021 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9854e5f-f7c9-4e34-86a3-21f6b11aa8e3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 0.875339 Sep 19 15:06:34.241428 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2330/4698] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:33 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:34.982515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:34.987831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:34.991864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:34.992870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:34.993678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:34.994929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:34.995633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:34.996291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:35.283279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:35.283922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:35.299390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:35.306709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:35.307571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:35.308422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:35.309405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:35.310084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:35.311731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:36.065270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:36.095111 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f2201a1-dcd3-4860-9a46-42407791f0f3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 1.116712 Sep 19 15:06:36.096356 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2369/4699] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:34 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:36.321903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:36.377529 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4af36e7d-48b9-4562-966b-6b1fac94bcbd tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 1.099594 Sep 19 15:06:36.378253 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2331/4700] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:35 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:36.648871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bd5823e3-0bb0-448d-955d-9ab55a632d77 req-803bdc7a-1df9-482b-9c91-72a2c82fe3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28b4663-89c6-4d83-940e-764e1d3eb77c", "tag": "1e92fc99-0baf-4aa1-8e46-80a4c756bd6b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:36.669210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bd5823e3-0bb0-448d-955d-9ab55a632d77 req-803bdc7a-1df9-482b-9c91-72a2c82fe3c8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:36.671099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bd5823e3-0bb0-448d-955d-9ab55a632d77 req-803bdc7a-1df9-482b-9c91-72a2c82fe3c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:36.672787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bd5823e3-0bb0-448d-955d-9ab55a632d77 req-803bdc7a-1df9-482b-9c91-72a2c82fe3c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:36.712753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:36.744667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bd5823e3-0bb0-448d-955d-9ab55a632d77 req-803bdc7a-1df9-482b-9c91-72a2c82fe3c8 service nova] Creating event network-changed:1e92fc99-0baf-4aa1-8e46-80a4c756bd6b for instance c28b4663-89c6-4d83-940e-764e1d3eb77c on n-h2-858384-1 Sep 19 15:06:36.753685 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bd5823e3-0bb0-448d-955d-9ab55a632d77 req-803bdc7a-1df9-482b-9c91-72a2c82fe3c8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110186 Sep 19 15:06:36.755967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2370/4701] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:37.145717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:37.147894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:37.151765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=24 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:37.163343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:37.164219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:37.165031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:37.166670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:37.167904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:37.168943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:37.403335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:37.403936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:37.421503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:37.423222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:37.423965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:37.424883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:37.425517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:37.426118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:37.757460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=40 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:37.855443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:37.875407 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c8ec1ac-2335-4e0d-9d66-e8092e574fa3 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.739235 Sep 19 15:06:37.877100 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2332/4702] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:37 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:37.969802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:37.992846 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c1b7db1-069b-4b52-8df5-4ca7d0a41195 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 0.594638 Sep 19 15:06:38.011588 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2371/4703] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:37 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:38.788981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-932f7074-1192-41e1-9e48-b9e8f1137a25 req-b0b0c1dd-925d-41a2-acf4-f6a92910021d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4", "tag": "ad557411-137c-4f41-80ad-e27f7e510b6a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:38.802294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-932f7074-1192-41e1-9e48-b9e8f1137a25 req-b0b0c1dd-925d-41a2-acf4-f6a92910021d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:38.803050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-932f7074-1192-41e1-9e48-b9e8f1137a25 req-b0b0c1dd-925d-41a2-acf4-f6a92910021d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:38.803857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-932f7074-1192-41e1-9e48-b9e8f1137a25 req-b0b0c1dd-925d-41a2-acf4-f6a92910021d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:38.819056 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-932f7074-1192-41e1-9e48-b9e8f1137a25 req-b0b0c1dd-925d-41a2-acf4-f6a92910021d service nova] Creating event network-changed:ad557411-137c-4f41-80ad-e27f7e510b6a for instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 on n-h2-858384-1 Sep 19 15:06:38.825749 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-932f7074-1192-41e1-9e48-b9e8f1137a25 req-b0b0c1dd-925d-41a2-acf4-f6a92910021d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044873 Sep 19 15:06:38.827096 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2333/4704] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:38.901999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:38.903389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:38.920142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:38.920653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:38.921105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:38.922656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:38.927293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:38.927792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:39.040417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:39.041203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:39.055837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:39.057629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:39.058898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:39.059745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:39.065353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:39.066119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:39.594439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:39.625627 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59c248c8-30cb-4acd-afef-69302c41a419 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.725638 Sep 19 15:06:39.628122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2372/4705] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:38 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:39.873809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:39.882451 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03b03d2a-185d-42d4-bdb9-58b0fcee2f58 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 0.849524 Sep 19 15:06:39.883226 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2334/4706] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:39 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:40.665167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:40.666515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:40.679257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:40.683350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:40.684092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:40.685260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:40.688367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:40.689077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:40.923086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:40.926791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:40.951264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:40.952048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:40.953360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:40.954332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:40.955010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:40.955980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:41.454517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:41.479770 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e719125a-c0e2-4136-980b-3466ea8b9567 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.821126 Sep 19 15:06:41.480396 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2373/4707] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:40 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:41.579025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:41.619836 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-035725ea-dd89-499e-9178-e3d74f23b73f tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 0.709812 Sep 19 15:06:41.653674 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2335/4708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:40 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:42.525255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:42.526198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:42.538309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:42.538846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:42.542470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:42.543766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:42.544390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:42.545111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:42.669194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:42.670087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:42.691374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:42.691881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:42.692417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:42.693059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:42.693580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:42.695787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:42.799046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:42.819728 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-447f4b13-b12a-470a-879a-1980484da9bc tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.290839 Sep 19 15:06:42.819728 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2374/4709] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:42 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:43.100394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-aa547a85-3232-4e98-8755-19797c9f8ae6 req-bd575cf7-20e1-4ffb-998b-df94385908de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28b4663-89c6-4d83-940e-764e1d3eb77c", "name": "network-vif-plugged", "status": "completed", "tag": "1e92fc99-0baf-4aa1-8e46-80a4c756bd6b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:43.123996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:43.133770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aa547a85-3232-4e98-8755-19797c9f8ae6 req-bd575cf7-20e1-4ffb-998b-df94385908de service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:43.134248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aa547a85-3232-4e98-8755-19797c9f8ae6 req-bd575cf7-20e1-4ffb-998b-df94385908de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:43.134955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aa547a85-3232-4e98-8755-19797c9f8ae6 req-bd575cf7-20e1-4ffb-998b-df94385908de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:43.137489 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-496a9202-bb6a-42a0-ab34-1f3e8472cce2 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 0.472985 Sep 19 15:06:43.150360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-aa547a85-3232-4e98-8755-19797c9f8ae6 req-bd575cf7-20e1-4ffb-998b-df94385908de service nova] Creating event network-vif-plugged:1e92fc99-0baf-4aa1-8e46-80a4c756bd6b for instance c28b4663-89c6-4d83-940e-764e1d3eb77c on n-h2-858384-1 Sep 19 15:06:43.154502 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2336/4710] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:42 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:43.157240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-aa547a85-3232-4e98-8755-19797c9f8ae6 req-bd575cf7-20e1-4ffb-998b-df94385908de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063464 Sep 19 15:06:43.158572 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2375/4711] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:43.840685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:43.842131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:43.875979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:43.878099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:43.879866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:43.883084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:43.886499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:43.888613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:44.101129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:44.118009 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.282013 Sep 19 15:06:44.119671 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2337/4712] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:43 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:44.167822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:44.169399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:44.179078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:44.179961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:44.180666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:44.181670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:44.182400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:44.183094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:44.282740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:44.284828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f42f7733-2518-447a-aada-af2c1fd743ac tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002589 Sep 19 15:06:44.285604 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2338/4713] 10.222.0.81 () {56 vars in 886 bytes} [Mon Sep 19 15:06:44 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 19 15:06:44.422265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:44.434955 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef94bbbc-7d11-4164-9b2c-1b0082dc3909 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1313 microversion: 2.1 time: 0.274041 Sep 19 15:06:44.446799 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2376/4714] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:44 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:45.143452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:45.144156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:45.157992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.159910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.164666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:45.175392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.179079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.180819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:45.491974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:45.492759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:45.529936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:45.541327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.547224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.548281 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4eca991f-0f61-4a0f-9864-e66d0f114918 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.407876 Sep 19 15:06:45.550042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:45.550951 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2339/4715] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:45 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:45.552249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.552916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.554429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:45.560542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:45.763030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:45.807461 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-58f9d6f7-f404-49d0-bc2c-5efef535d2a6 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1498 microversion: 2.1 time: 0.317420 Sep 19 15:06:45.837909 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2377/4716] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:45 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1498 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:45.877530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-90b3b432-9e46-450d-ad6d-7a75e6f0f1e9 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:45.902056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.compute.server_groups [None req-90b3b432-9e46-450d-ad6d-7a75e6f0f1e9 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Querying cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) for 1 instances {{(pid=128731) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 19 15:06:45.903023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b3b432-9e46-450d-ad6d-7a75e6f0f1e9 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.904241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b3b432-9e46-450d-ad6d-7a75e6f0f1e9 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.905278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-90b3b432-9e46-450d-ad6d-7a75e6f0f1e9 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:45.933535 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-90b3b432-9e46-450d-ad6d-7a75e6f0f1e9 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/f337ebb4-78f8-419d-a2cb-df199cfd9e0b" status: 200 len: 222 microversion: 2.1 time: 0.061050 Sep 19 15:06:45.945095 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2340/4717] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 15:06:45 2022] GET /compute/v2.1/os-server-groups/f337ebb4-78f8-419d-a2cb-df199cfd9e0b => generated 222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:45.951788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:45.953057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:45.962835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.963649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.981765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:45.987337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:45.987934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:45.988694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:46.034737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:06:46.184480 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b07d3073-ab7d-4bc3-87f3-cf3040343d4b tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 204 len: 0 microversion: 2.1 time: 0.238065 Sep 19 15:06:46.190827 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2378/4718] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:45 2022] DELETE /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:06:46.201522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:46.203965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:46.220399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:46.221803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:46.223180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:46.224677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:46.226443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:46.227249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:46.527837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:46.541516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae49ac66-5e1b-4550-b46f-ba716d789029 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1504 microversion: 2.1 time: 0.349546 Sep 19 15:06:46.542625 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2341/4719] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:46 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:46.597323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:46.598269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:46.619780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:46.620939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:46.622163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:46.623871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:46.625256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:46.626351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:46.886382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-02ebc297-058a-493c-893b-57aeb07a9b93 req-c148e249-4eb0-4067-855b-689e604ce624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4", "name": "network-vif-plugged", "status": "completed", "tag": "ad557411-137c-4f41-80ad-e27f7e510b6a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:46.888971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:46.901695 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b72e81d2-b566-46bd-a757-a4cd4c14adba tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.311414 Sep 19 15:06:46.915778 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2379/4720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:46 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:46.944412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-02ebc297-058a-493c-893b-57aeb07a9b93 req-c148e249-4eb0-4067-855b-689e604ce624 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:46.945530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-02ebc297-058a-493c-893b-57aeb07a9b93 req-c148e249-4eb0-4067-855b-689e604ce624 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:46.947456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-02ebc297-058a-493c-893b-57aeb07a9b93 req-c148e249-4eb0-4067-855b-689e604ce624 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:46.983150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-02ebc297-058a-493c-893b-57aeb07a9b93 req-c148e249-4eb0-4067-855b-689e604ce624 service nova] Creating event network-vif-plugged:ad557411-137c-4f41-80ad-e27f7e510b6a for instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 on n-h2-858384-1 Sep 19 15:06:46.994012 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-02ebc297-058a-493c-893b-57aeb07a9b93 req-c148e249-4eb0-4067-855b-689e604ce624 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118831 Sep 19 15:06:46.996039 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2342/4721] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:47.566819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:47.567447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:47.580176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:47.580533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:47.580972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:47.581703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:47.582170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:47.582723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:47.920176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:47.930425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:47.931055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13ceb603-bbf3-4c92-9310-3e5418d036f5 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1504 microversion: 2.1 time: 0.368443 Sep 19 15:06:47.931436 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2380/4722] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:47 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:47.932707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:47.950088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:47.951758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:47.966942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:47.975511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:47.976535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:47.977319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:48.396714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:48.416538 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2376003-bc09-473c-b806-584dffcbed2b tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1312 microversion: 2.1 time: 0.489490 Sep 19 15:06:48.419693 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2343/4723] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:47 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:48.907960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f09f0598-0531-40b5-913e-72f9e5997ae1 req-0fb5d26f-9551-4b9d-b243-bd3b3bda6765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28b4663-89c6-4d83-940e-764e1d3eb77c", "name": "network-vif-deleted", "tag": "1e92fc99-0baf-4aa1-8e46-80a4c756bd6b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:48.948895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f09f0598-0531-40b5-913e-72f9e5997ae1 req-0fb5d26f-9551-4b9d-b243-bd3b3bda6765 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:48.949896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f09f0598-0531-40b5-913e-72f9e5997ae1 req-0fb5d26f-9551-4b9d-b243-bd3b3bda6765 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:48.950127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f09f0598-0531-40b5-913e-72f9e5997ae1 req-0fb5d26f-9551-4b9d-b243-bd3b3bda6765 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:48.980097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f09f0598-0531-40b5-913e-72f9e5997ae1 req-0fb5d26f-9551-4b9d-b243-bd3b3bda6765 service nova] Creating event network-vif-deleted:1e92fc99-0baf-4aa1-8e46-80a4c756bd6b for instance c28b4663-89c6-4d83-940e-764e1d3eb77c on n-h2-858384-1 Sep 19 15:06:48.988925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:48.989844 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f09f0598-0531-40b5-913e-72f9e5997ae1 req-0fb5d26f-9551-4b9d-b243-bd3b3bda6765 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085370 Sep 19 15:06:48.995655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:49.000640 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2381/4724] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:49.019917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:49.020777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:49.021576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:49.022596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:49.023481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:49.024387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:49.149090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a64526f6ed946f8b2176e0477f44d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924eb3d6a6643cbb242357af2ac0e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:49.161163 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e084a8b-89d1-46d9-9f06-4225db6acf47 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 200 len: 1298 microversion: 2.1 time: 0.184387 Sep 19 15:06:49.176207 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2344/4725] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:48 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:49.445148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:49.445877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:49.457202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:49.457710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:49.458155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:49.458937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:49.459403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:49.459921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:49.811837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:49.833780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6bd1dc9-72a7-489c-ae09-3f4e7a53da11 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1497 microversion: 2.1 time: 0.392300 Sep 19 15:06:49.850786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2382/4726] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:49 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1497 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:50.195218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.196152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:50.207900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.209677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.210327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.211614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.219643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.222063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.261078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c HTTP/1.1 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c28b4663-89c6-4d83-940e-764e1d3eb77c'} Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.263457 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.269077 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.271529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:50.272672 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-500b14d7-e95f-4a11-bcff-7244924368de tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 404 len: 111 microversion: 2.1 time: 0.082331 Sep 19 15:06:50.273881 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2383/4727] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:06:50.291154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e0dacbd3-feb8-4ade-ad90-84db61cd956d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.314888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.server_groups [None req-e0dacbd3-feb8-4ade-ad90-84db61cd956d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Querying cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) for 1 instances {{(pid=128730) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 19 15:06:50.316214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0dacbd3-feb8-4ade-ad90-84db61cd956d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.316976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0dacbd3-feb8-4ade-ad90-84db61cd956d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.318419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0dacbd3-feb8-4ade-ad90-84db61cd956d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.338653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e0dacbd3-feb8-4ade-ad90-84db61cd956d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.053519 Sep 19 15:06:50.340526 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2384/4728] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:50.358418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bec03aba-45e7-42ee-943f-3deab9e09d3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.392371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.server_groups [None req-bec03aba-45e7-42ee-943f-3deab9e09d3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Querying cell bc6b4e06-eb4a-4786-9d91-49c729d2b807(cell1) for 1 instances {{(pid=128730) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 19 15:06:50.394862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bec03aba-45e7-42ee-943f-3deab9e09d3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.396738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bec03aba-45e7-42ee-943f-3deab9e09d3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.397515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bec03aba-45e7-42ee-943f-3deab9e09d3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.420961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bec03aba-45e7-42ee-943f-3deab9e09d3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/f337ebb4-78f8-419d-a2cb-df199cfd9e0b" status: 200 len: 184 microversion: 2.1 time: 0.068156 Sep 19 15:06:50.422417 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2385/4729] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/os-server-groups/f337ebb4-78f8-419d-a2cb-df199cfd9e0b => generated 184 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:50.440205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.440822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:50.447498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.448091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.448655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.449486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.450300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.450892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.479046 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c HTTP/1.1 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c28b4663-89c6-4d83-940e-764e1d3eb77c'} Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:50.484652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:50.490712 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48157496-4a4b-4b2d-9946-d99aafe4b578 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 404 len: 111 microversion: 2.1 time: 0.057412 Sep 19 15:06:50.494063 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2386/4730] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:50 2022] DELETE /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:50.507406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.508112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] [instance: c28b4663-89c6-4d83-940e-764e1d3eb77c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:50.517188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.517891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.518643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.519634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.520172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.520669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.538433 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c HTTP/1.1 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c28b4663-89c6-4d83-940e-764e1d3eb77c'} Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.540641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance c28b4663-89c6-4d83-940e-764e1d3eb77c could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfb72464-3b4e-4a17-9b02-171f7affce3d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c" status: 404 len: 111 microversion: 2.1 time: 0.040104 Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2387/4731] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/servers/c28b4663-89c6-4d83-940e-764e1d3eb77c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.555801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:50.561805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.561805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.561805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.561805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.561805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.562468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.602519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:06:50.640947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bc5a034-086a-4c55-9c5d-264bee2f3036 tempest-ComputeTenantNetworksTest-1757058894 tempest-ComputeTenantNetworksTest-1757058894-project] Calling method '.version_select at 0x7fde29b60040>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.736430 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a079320-42bc-421e-8647-496f38b6d6fe tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 204 len: 0 microversion: 2.1 time: 0.191588 Sep 19 15:06:50.741988 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2388/4732] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:06:50 2022] DELETE /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:06:50.748760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8dde3a91-6013-4d40-b618-50264755b6d3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.757565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8dde3a91-6013-4d40-b618-50264755b6d3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance group b54952d3-786c-4cca-824d-2c0667b5de7a could not be found. Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8dde3a91-6013-4d40-b618-50264755b6d3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-server-groups/b54952d3-786c-4cca-824d-2c0667b5de7a HTTP/1.1 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance group b54952d3-786c-4cca-824d-2c0667b5de7a could not be found. Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'b54952d3-786c-4cca-824d-2c0667b5de7a'} Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b54952d3-786c-4cca-824d-2c0667b5de7a could not be found. Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b54952d3-786c-4cca-824d-2c0667b5de7a could not be found. Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.761102 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b54952d3-786c-4cca-824d-2c0667b5de7a could not be found. Sep 19 15:06:50.766288 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.767824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8dde3a91-6013-4d40-b618-50264755b6d3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance group b54952d3-786c-4cca-824d-2c0667b5de7a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:50.769928 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8dde3a91-6013-4d40-b618-50264755b6d3 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/b54952d3-786c-4cca-824d-2c0667b5de7a" status: 404 len: 117 microversion: 2.1 time: 0.026112 Sep 19 15:06:50.770875 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2389/4733] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:50 2022] DELETE /compute/v2.1/os-server-groups/b54952d3-786c-4cca-824d-2c0667b5de7a => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:50.777450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.778276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:50.789942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.790780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.791299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.792231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:50.792763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:50.793210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:50.926645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bc5a034-086a-4c55-9c5d-264bee2f3036 tempest-ComputeTenantNetworksTest-1757058894 tempest-ComputeTenantNetworksTest-1757058894-project] 10.222.0.81 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.824408 Sep 19 15:06:50.928560 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2345/4734] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:50.942150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c28e63f-f3d1-4b80-bf67-f6aa0fb5b12e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:50.951131 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6c28e63f-f3d1-4b80-bf67-f6aa0fb5b12e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance group 151281bf-e5bf-475f-9557-ce270ac8da06 could not be found. Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c28e63f-f3d1-4b80-bf67-f6aa0fb5b12e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/os-server-groups/151281bf-e5bf-475f-9557-ce270ac8da06 HTTP/1.1 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance group 151281bf-e5bf-475f-9557-ce270ac8da06 could not be found. Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '151281bf-e5bf-475f-9557-ce270ac8da06'} Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 151281bf-e5bf-475f-9557-ce270ac8da06 could not be found. Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 151281bf-e5bf-475f-9557-ce270ac8da06 could not be found. Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.953950 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 151281bf-e5bf-475f-9557-ce270ac8da06 could not be found. Sep 19 15:06:50.959464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:06:50.961419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c28e63f-f3d1-4b80-bf67-f6aa0fb5b12e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance group 151281bf-e5bf-475f-9557-ce270ac8da06 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:50.962499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c28e63f-f3d1-4b80-bf67-f6aa0fb5b12e tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/151281bf-e5bf-475f-9557-ce270ac8da06" status: 404 len: 117 microversion: 2.1 time: 0.031943 Sep 19 15:06:50.963672 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2346/4735] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:50 2022] DELETE /compute/v2.1/os-server-groups/151281bf-e5bf-475f-9557-ce270ac8da06 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:50.990859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c63129c2-fe6b-4422-971a-527c8db28d73 tempest-ComputeTenantNetworksTest-1757058894 tempest-ComputeTenantNetworksTest-1757058894-project] Calling method '.version_select at 0x7fde29e3df70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:51.116921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:51.133148 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-15d7295c-e1ad-4cbb-808d-8c9cd549e02f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1503 microversion: 2.1 time: 0.360732 Sep 19 15:06:51.142804 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2390/4736] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:51.142804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6c77c2b-3e44-4ebc-a1c3-2c896118d2ed tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:51.149771 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e6c77c2b-3e44-4ebc-a1c3-2c896118d2ed tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance group 00cc3600-f53a-43b3-8e68-72675a563cab could not be found. Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6c77c2b-3e44-4ebc-a1c3-2c896118d2ed tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-server-groups/00cc3600-f53a-43b3-8e68-72675a563cab HTTP/1.1 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance group 00cc3600-f53a-43b3-8e68-72675a563cab could not be found. Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '00cc3600-f53a-43b3-8e68-72675a563cab'} Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 00cc3600-f53a-43b3-8e68-72675a563cab could not be found. Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 00cc3600-f53a-43b3-8e68-72675a563cab could not be found. Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.151416 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 00cc3600-f53a-43b3-8e68-72675a563cab could not be found. Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6c77c2b-3e44-4ebc-a1c3-2c896118d2ed tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance group 00cc3600-f53a-43b3-8e68-72675a563cab could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6c77c2b-3e44-4ebc-a1c3-2c896118d2ed tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/00cc3600-f53a-43b3-8e68-72675a563cab" status: 404 len: 117 microversion: 2.1 time: 0.017413 Sep 19 15:06:51.158670 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2391/4737] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:51 2022] DELETE /compute/v2.1/os-server-groups/00cc3600-f53a-43b3-8e68-72675a563cab => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:51.167450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa04aecf-b22d-48e8-a372-a89a314bba72 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:51.179008 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-aa04aecf-b22d-48e8-a372-a89a314bba72 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] HTTP exception thrown: Instance group 69569aa2-5690-47e7-bf18-63faaea91fa8 could not be found. Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa04aecf-b22d-48e8-a372-a89a314bba72 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Request method failure captured: Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/os-server-groups/69569aa2-5690-47e7-bf18-63faaea91fa8 HTTP/1.1 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVrVLLEtvrxt3YM7H7_hoTGEUcjN8g-LGPrZSLBDyJIdHsTuw-U3bwcUlIaUf7p_i9I8MY1OCQW0AmS__9SJEiE7zqCsTIYQJ3Om1o1hly5jjn_Ssg1hPIcSiPN0LlG3AVlJjA8Er41aiIJtnsnMUhgiB6qalrxY1Q-6y8Hw90B7ew Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a924eb3d6a6643cbb242357af2ac0e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a924eb3d6a6643cbb242357af2ac0e76"}]}] Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: a924eb3d6a6643cbb242357af2ac0e76 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerGroupTestJSON-420626751 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 3a64526f6ed946f8b2176e0477f44d11 Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerGroupTestJSON-420626751-project Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance group 69569aa2-5690-47e7-bf18-63faaea91fa8 could not be found. Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '69569aa2-5690-47e7-bf18-63faaea91fa8'} Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 69569aa2-5690-47e7-bf18-63faaea91fa8 could not be found. Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 69569aa2-5690-47e7-bf18-63faaea91fa8 could not be found. Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.181202 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 69569aa2-5690-47e7-bf18-63faaea91fa8 could not be found. Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa04aecf-b22d-48e8-a372-a89a314bba72 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Returning 404 to user: Instance group 69569aa2-5690-47e7-bf18-63faaea91fa8 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa04aecf-b22d-48e8-a372-a89a314bba72 tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/69569aa2-5690-47e7-bf18-63faaea91fa8" status: 404 len: 117 microversion: 2.1 time: 0.023015 Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2392/4738] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:51 2022] DELETE /compute/v2.1/os-server-groups/69569aa2-5690-47e7-bf18-63faaea91fa8 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:06:51.229764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8c69d03c-c841-404e-8a0e-59895527778d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:51.232119 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c63129c2-fe6b-4422-971a-527c8db28d73 tempest-ComputeTenantNetworksTest-1757058894 tempest-ComputeTenantNetworksTest-1757058894-project] 10.222.0.81 "GET /compute/v2.1/os-tenant-networks/329796d4-8bc7-45dd-b05a-8f6555fdfd6d" status: 200 len: 140 microversion: 2.1 time: 0.244769 Sep 19 15:06:51.232119 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2347/4739] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 15:06:50 2022] GET /compute/v2.1/os-tenant-networks/329796d4-8bc7-45dd-b05a-8f6555fdfd6d => generated 140 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:51.239399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:51.258221 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8c69d03c-c841-404e-8a0e-59895527778d tempest-ServerGroupTestJSON-420626751 tempest-ServerGroupTestJSON-420626751-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/f337ebb4-78f8-419d-a2cb-df199cfd9e0b" status: 204 len: 0 microversion: 2.1 time: 0.065400 Sep 19 15:06:51.259416 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2393/4740] 10.222.0.81 () {58 vars in 1266 bytes} [Mon Sep 19 15:06:51 2022] DELETE /compute/v2.1/os-server-groups/f337ebb4-78f8-419d-a2cb-df199cfd9e0b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:06:52.162375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:52.164246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:52.178308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:52.178838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:52.183463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:52.188326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:52.188921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:52.189615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:52.228308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:52.733467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:52.752975 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88ccd30b-7e19-4551-ab17-4ed4611a3ed7 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1503 microversion: 2.1 time: 0.595963 Sep 19 15:06:52.770242 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2348/4741] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:52 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:53.371375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-dd25d86f-3c5d-4245-8655-62fb6199a3f8 req-68955b97-10ed-4775-a4d0-3444a8e0a236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4", "name": "network-vif-deleted", "tag": "ad557411-137c-4f41-80ad-e27f7e510b6a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:53.419496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-dd25d86f-3c5d-4245-8655-62fb6199a3f8 req-68955b97-10ed-4775-a4d0-3444a8e0a236 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:53.420228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-dd25d86f-3c5d-4245-8655-62fb6199a3f8 req-68955b97-10ed-4775-a4d0-3444a8e0a236 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:53.420818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-dd25d86f-3c5d-4245-8655-62fb6199a3f8 req-68955b97-10ed-4775-a4d0-3444a8e0a236 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:53.468070 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-dd25d86f-3c5d-4245-8655-62fb6199a3f8 req-68955b97-10ed-4775-a4d0-3444a8e0a236 service nova] Creating event network-vif-deleted:ad557411-137c-4f41-80ad-e27f7e510b6a for instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 on n-h2-858384-1 Sep 19 15:06:53.493746 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-dd25d86f-3c5d-4245-8655-62fb6199a3f8 req-68955b97-10ed-4775-a4d0-3444a8e0a236 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135272 Sep 19 15:06:53.495676 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2394/4742] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:53.801490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:53.805141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:53.840383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:53.841649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:53.851788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:53.853381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:53.854768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:53.855658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:53.966785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:53.968946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:53.970417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:53.972210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lazy-loading 'fault' on Instance uuid 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:06:54.125856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:54.142902 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f71d58c6-53e5-4ffa-b6da-f58da4266d52 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 200 len: 1302 microversion: 2.1 time: 0.362772 Sep 19 15:06:54.143832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2349/4743] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:53 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 1302 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:06:55.177664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:55.180577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:55.201895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:55.204036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:55.205574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:55.207300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:55.207542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:55.208696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:55.248537 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] HTTP exception thrown: Instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 could not be found. Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Request method failure captured: Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 HTTP/1.1 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVq2PH2h44Kxrg1Hp2mQndF6NyH4xqnuK9acy-KEkeYMNBpqaeiPRZZ5O-SiB_lbvxHpzMNU-nObZxUPGazGAVcztZeibJDWDp4B6Y9sR_gqZOtARHuO5B46KKEVM5d8kIiBt1KBCrKbqeQoq5NGV25adVc_CW8HbSHJM06RKyIPG8 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 3a0ff1863ea9443682549fe0ef7f19c2 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesActionsTest-1132431988 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3a0ff1863ea9443682549fe0ef7f19c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "tempest-type-470238770", "name": "tempest-service-1697471766", "endpoints": [{"region": "tempest-region-1110008132", "internalURL": "https://url-1374395257.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a0ff1863ea9443682549fe0ef7f19c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a0ff1863ea9443682549fe0ef7f19c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "tempest-type-155142206", "name": "tempest-service-187387261", "endpoints": []}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3a0ff1863ea9443682549fe0ef7f19c2"}]}] Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesActionsTest-1132431988 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 3a0ff1863ea9443682549fe0ef7f19c2 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesActionsTest-1132431988 Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesActionsTest-1132431988-project Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6366da44f65947f0aa20ac58a5b2a5be Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesActionsTest-1132431988-project Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 could not be found. Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4'} Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 could not be found. Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:06:55.256998 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 could not be found. Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 could not be found. Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Returning 404 to user: Instance 3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-16560e3d-834b-49c1-9e91-11a926b8bbaf tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4" status: 404 len: 111 microversion: 2.1 time: 0.093852 Sep 19 15:06:55.274393 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2395/4744] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:55 2022] GET /compute/v2.1/servers/3b2b92aa-e1c9-4b1e-837f-ef06dcb4f5d4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:06:55.626532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-252944138", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "443e9805-f9ac-4543-8ddd-7bb9c9017814"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:55.811297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] validate_networks() for [('443e9805-f9ac-4543-8ddd-7bb9c9017814', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:06:55.949379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-edc82da9-8d74-4ac0-b33a-dc2aa5a5b629 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Action: 'create', calling method: .version_select at 0x7fde29b59d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1819864344", "metadata": {"Type": "work"}}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:06:56.907800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-edc82da9-8d74-4ac0-b33a-dc2aa5a5b629 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.697505 Sep 19 15:06:56.908835 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2350/4745] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 15:06:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1700 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 15:06:56.930235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-07335c21-efe9-4099-8264-58d320fa589b tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde29dfca60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:56.964784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:06:56.965552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:06:56.966307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:06:56.967089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:06:56.967836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:06:56.990202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:56.992054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:56.993019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:56.995074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:56.997809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:57.001420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:57.058262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Getting quotas for project 3a0ff1863ea9443682549fe0ef7f19c2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:06:57.073473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Getting quotas for user 6366da44f65947f0aa20ac58a5b2a5be and project 3a0ff1863ea9443682549fe0ef7f19c2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:06:57.121157 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-07335c21-efe9-4099-8264-58d320fa589b tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 353 microversion: 2.1 time: 0.196731 Sep 19 15:06:57.122207 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2351/4746] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:06:56 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:06:57.144333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:06:57.148983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:06:57.253306 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51705868-ae44-408d-9bfd-095b2028a154 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635448 Sep 19 15:06:57.254802 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2396/4747] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:06:57.276034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2689dad9-e71b-4261-90e4-41aa5627d851 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:57.276669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2689dad9-e71b-4261-90e4-41aa5627d851 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:57.290342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:57.504112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:57.506554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:57.515418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2689dad9-e71b-4261-90e4-41aa5627d851 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:57.550579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2689dad9-e71b-4261-90e4-41aa5627d851 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1213 microversion: 2.1 time: 0.278134 Sep 19 15:06:57.556530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:57.560213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:57.562409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:57.565881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2352/4748] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:57 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1213 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:57.567880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:57.578606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:57.580870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:57.748134 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c333964f-bdc6-4ec0-a669-3e75caebd09f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/ips" status: 200 len: 146 microversion: 2.1 time: 0.252916 Sep 19 15:06:57.749427 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2397/4749] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:06:57 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/ips => generated 146 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:58.150608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cbbc581-117b-46d1-b63d-8f86ab170d0c tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde29b59550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:58.384248 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cbbc581-117b-46d1-b63d-8f86ab170d0c tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 353 microversion: 2.1 time: 0.244871 Sep 19 15:06:58.385499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2353/4750] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:06:58 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:06:58.601345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:58.602129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:58.619355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:58.620245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:58.621058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:58.622345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:06:58.630076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:06:58.632176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:06:58.883015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:06:58.917885 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed1512be-8280-48e3-8853-fbe36d34dd3f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1217 microversion: 2.1 time: 0.320565 Sep 19 15:06:58.932776 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2398/4751] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:58 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1217 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:06:59.402374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bc88723-c4b9-4ff2-ae19-755f27b7f82f tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde29dd6430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:59.944169 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9bc88723-c4b9-4ff2-ae19-755f27b7f82f tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 354 microversion: 2.1 time: 0.547010 Sep 19 15:06:59.944786 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2354/4752] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:06:59 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 354 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:06:59.967284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:06:59.968499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:06:59.970554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f821e4d-293f-4bcb-a034-53536553ea22 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde29faeaf0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:00.003120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:00.007076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:00.007624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:00.008394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:00.008882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:00.009319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:00.229479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:00.234809 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f821e4d-293f-4bcb-a034-53536553ea22 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 354 microversion: 2.1 time: 0.269449 Sep 19 15:07:00.249176 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2355/4753] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:06:59 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:00.250050 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f0d6c23c-7823-4bb2-b1c1-4ec35dba8af0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1271 microversion: 2.1 time: 0.284582 Sep 19 15:07:00.255696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f85998e-07ee-44c5-93aa-1be04cfda17f tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde29dfcb80>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:00.264128 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2399/4754] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:06:59 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:00.434719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f85998e-07ee-44c5-93aa-1be04cfda17f tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 202 len: 0 microversion: 2.1 time: 0.183101 Sep 19 15:07:00.436324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2356/4755] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:07:00 2022] DELETE /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:07:00.446703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ed4198f-a2af-49fe-bcc4-88ea8e852da1 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde2a478310>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:00.538920 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ed4198f-a2af-49fe-bcc4-88ea8e852da1 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 353 microversion: 2.1 time: 0.097592 Sep 19 15:07:00.540039 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2400/4756] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:07:00 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:07:01.290613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:01.291324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:01.306417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:01.307265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:01.307935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:01.310093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:01.314305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:01.315078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:01.616253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:01.625961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1908a2b-1448-489f-9b95-1b151c8347bc tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde28cb0160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:01.759073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b95b8a03-784e-47cf-bbf8-83b9e289cc78 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1271 microversion: 2.1 time: 0.471330 Sep 19 15:07:01.761891 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2357/4757] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:01 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1271 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:07:01.809676 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1908a2b-1448-489f-9b95-1b151c8347bc tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 353 microversion: 2.1 time: 0.259393 Sep 19 15:07:01.816216 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2401/4758] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:07:01 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:02.527648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-73257abd-6bca-4f88-bba8-09e26de1736d tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] Calling method '.version_select at 0x7fde29fae310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:02.809887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:02.812384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:02.833240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:02.834900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:02.840024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:02.842326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:02.845559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:02.846792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:02.990507 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-73257abd-6bca-4f88-bba8-09e26de1736d tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede/defaults" status: 200 len: 371 microversion: 2.1 time: 1.177209 Sep 19 15:07:02.998341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2358/4759] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 15:07:01 2022] GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede/defaults => generated 371 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:03.011916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87417288-1547-423a-8b4a-484f7493c984 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde29ef4dc0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:03.186082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87417288-1547-423a-8b4a-484f7493c984 tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 353 microversion: 2.1 time: 0.184660 Sep 19 15:07:03.187420 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2359/4760] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:07:02 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:03.202883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b024087-5c00-4132-b681-5962f9705d57 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] Calling method '.version_select at 0x7fde29b59d30>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:03.270849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:03.275473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:03.307403 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7ca893a8-6c89-4b11-8c58-22c952948a1a tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.502228 Sep 19 15:07:03.322786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2402/4761] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:02 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:07:03.470087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3950f8d7-e5c1-41bd-88c8-de0c4112a0db"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:07:03.475681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:03.504581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:03.505098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:03.505561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:03.511197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:03.512842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:03.514209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:03.819662 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b024087-5c00-4132-b681-5962f9705d57 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede" status: 200 len: 371 microversion: 2.1 time: 0.629884 Sep 19 15:07:03.832499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2360/4762] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 15:07:03 2022] GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede => generated 371 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:03.853231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7946cad3-99e3-49ea-b9f0-df13d4dbce47 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] Calling method '.version_select at 0x7fde29fae3a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:04.049073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7946cad3-99e3-49ea-b9f0-df13d4dbce47 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede/defaults" status: 200 len: 371 microversion: 2.1 time: 0.206334 Sep 19 15:07:04.052678 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2361/4763] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 15:07:03 2022] GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede/defaults => generated 371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:04.088975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c493911a-0017-4590-8689-81de7d61fd70 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] Calling method '.version_select at 0x7fde29da0af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:04.153513 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9241d3e-320e-4824-9d5f-03c548b864ae tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673245 Sep 19 15:07:04.176287 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2403/4764] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:07:03 2022] POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:04.209285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c7d38dcc-51a4-450d-b0a8-a43b71a2ab0d req-c31886ca-80bb-437b-b11c-1d27945c73d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcfd09b4-a4ea-438c-9728-277836999f4b", "tag": "e4fb6931-453e-4633-84c2-36a153a048bf"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:07:04.238832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c7d38dcc-51a4-450d-b0a8-a43b71a2ab0d req-c31886ca-80bb-437b-b11c-1d27945c73d0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:04.239243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c7d38dcc-51a4-450d-b0a8-a43b71a2ab0d req-c31886ca-80bb-437b-b11c-1d27945c73d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:04.247820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c7d38dcc-51a4-450d-b0a8-a43b71a2ab0d req-c31886ca-80bb-437b-b11c-1d27945c73d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:04.323371 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c7d38dcc-51a4-450d-b0a8-a43b71a2ab0d req-c31886ca-80bb-437b-b11c-1d27945c73d0 service nova] Creating event network-changed:e4fb6931-453e-4633-84c2-36a153a048bf for instance dcfd09b4-a4ea-438c-9728-277836999f4b on n-h2-858384-1 Sep 19 15:07:04.339083 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c7d38dcc-51a4-450d-b0a8-a43b71a2ab0d req-c31886ca-80bb-437b-b11c-1d27945c73d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158529 Sep 19 15:07:04.346600 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2404/4765] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:04.357594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9475582c-2a35-42ca-b6c8-ebc29ae0fcae tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde2a1f9820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:04.404973 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c493911a-0017-4590-8689-81de7d61fd70 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede" status: 200 len: 371 microversion: 2.1 time: 0.331937 Sep 19 15:07:04.418811 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2362/4766] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 15:07:04 2022] GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede => generated 371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:04.453474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:04.456969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:04.480138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:04.487472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:04.489330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:04.490979 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9475582c-2a35-42ca-b6c8-ebc29ae0fcae tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 200 len: 353 microversion: 2.1 time: 0.142155 Sep 19 15:07:04.492244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:04.492919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:04.493562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:04.505592 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2405/4767] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:07:04 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:04.522960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-19ca7a9b-a4a2-48bb-851b-d299cd6e7956 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] Calling method '.version_select at 0x7fde2a4b0c10>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:04.771701 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-19ca7a9b-a4a2-48bb-851b-d299cd6e7956 tempest-QuotasTestJSON-623240458 tempest-QuotasTestJSON-623240458-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede?user_id=6059c7bd93a741628914e1e09d5b57cf" status: 200 len: 371 microversion: 2.1 time: 0.263298 Sep 19 15:07:04.773097 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2406/4768] 10.222.0.81 () {58 vars in 1323 bytes} [Mon Sep 19 15:07:04 2022] GET /compute/v2.1/os-quota-sets/17586f138ae74cf8824818d7cf3c9ede?user_id=6059c7bd93a741628914e1e09d5b57cf => generated 371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:05.053253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:05.099346 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-42dcfd50-a8ee-48e5-bfac-825e5435f996 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.662202 Sep 19 15:07:05.106130 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2363/4769] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:04 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:05.517324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f87a50bf-4967-444f-a585-fd98b93f11af tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Calling method '.version_select at 0x7fde2a190b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:05.650903 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f87a50bf-4967-444f-a585-fd98b93f11af tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] HTTP exception thrown: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f87a50bf-4967-444f-a585-fd98b93f11af tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Request method failure captured: Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 HTTP/1.1 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIWPtVlYrhYRR5qBsoNX8aIlBU4rJjhFIhT_puEq1w4bxc-Jykjg4mbt-vxqCgrB5TV8CIfzenq-iFmWOzbwasG4O31o7B83f1n-DvPSWT3l4HNVOrqy2CovhVvA7v-nYT4izjWwd61FWlRhNLizy035T8Vj7DOoeuO_eItUOXJ-Lj8 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cc3227b6e8e44f168ab9ad07399f542b Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesGetTestJSON-140263478 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cc3227b6e8e44f168ab9ad07399f542b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cc3227b6e8e44f168ab9ad07399f542b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cc3227b6e8e44f168ab9ad07399f542b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cc3227b6e8e44f168ab9ad07399f542b"}]}] Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesGetTestJSON-140263478 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cc3227b6e8e44f168ab9ad07399f542b Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesGetTestJSON-140263478 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesGetTestJSON-140263478-project Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 4d0640f143374b148a46c0a9391c5ab8 Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesGetTestJSON-140263478-project Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: method: Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: exception: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6'} Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. (HTTP 404) (Request-ID: req-fe4fef1b-7d3e-4753-9b53-f69b5a410681) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:07:05.653599 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. Sep 19 15:07:05.657375 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:07:05.663134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f87a50bf-4967-444f-a585-fd98b93f11af tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] Returning 404 to user: Volume 2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:07:05.664390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f87a50bf-4967-444f-a585-fd98b93f11af tempest-VolumesGetTestJSON-140263478 tempest-VolumesGetTestJSON-140263478-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6" status: 404 len: 109 microversion: 2.1 time: 0.154912 Sep 19 15:07:05.665560 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2407/4770] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:07:05 2022] GET /compute/v2.1/os-volumes/2ceb54fc-d0f7-4cd7-b81b-eb46aaa4b8e6 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:07:06.158878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:06.161468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:06.196085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:06.196085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:06.196085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:06.196445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:06.196917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:06.200138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:06.761115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:06.771119 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-93cbaed0-e25f-4c51-8c9a-e91e52723c21 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.619663 Sep 19 15:07:06.777299 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2364/4771] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:06 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:07.824768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:07.830285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:07.831461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:07.845454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:07.846084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:07.846941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:07.848336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:07.849462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:07.850132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:08.051373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:08.085659 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5393f73a-7920-4629-aa75-81063c6c5bf0 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.261237 Sep 19 15:07:08.087173 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2408/4772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:07 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:09.116543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:09.124875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:09.160006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:09.161372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:09.165110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:09.167961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:09.170278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:09.175547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:09.596861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:09.613769 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e9261aa-15ea-466b-b93c-5e1a6c40c981 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.504591 Sep 19 15:07:09.627551 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2365/4773] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:09 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:10.659323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:10.661405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:10.679026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:10.680506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:10.681049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:10.682633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:10.683723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:10.684342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:10.948422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:10.968909 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa924556-a0cb-479f-b033-55faa0664852 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.316659 Sep 19 15:07:10.971295 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2409/4774] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:10 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:11.205628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-78055f74-bbaf-4316-a20d-8a8e62f92367 req-31152ec1-3b74-4ba8-8290-6a8597371fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcfd09b4-a4ea-438c-9728-277836999f4b", "name": "network-vif-plugged", "status": "completed", "tag": "e4fb6931-453e-4633-84c2-36a153a048bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:07:11.244861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-78055f74-bbaf-4316-a20d-8a8e62f92367 req-31152ec1-3b74-4ba8-8290-6a8597371fae service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:11.245729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-78055f74-bbaf-4316-a20d-8a8e62f92367 req-31152ec1-3b74-4ba8-8290-6a8597371fae service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:11.246376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-78055f74-bbaf-4316-a20d-8a8e62f92367 req-31152ec1-3b74-4ba8-8290-6a8597371fae service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:11.269747 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-78055f74-bbaf-4316-a20d-8a8e62f92367 req-31152ec1-3b74-4ba8-8290-6a8597371fae service nova] Creating event network-vif-plugged:e4fb6931-453e-4633-84c2-36a153a048bf for instance dcfd09b4-a4ea-438c-9728-277836999f4b on n-h2-858384-1 Sep 19 15:07:11.284386 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-78055f74-bbaf-4316-a20d-8a8e62f92367 req-31152ec1-3b74-4ba8-8290-6a8597371fae service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086009 Sep 19 15:07:11.285506 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2366/4775] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:12.003997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:12.006318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:12.016147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:12.017596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:12.018953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:12.020027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:12.021829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:12.022561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:12.230698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:12.241755 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-72796ac1-f44d-4e60-b1b4-b42f7b8175a8 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1313 microversion: 2.1 time: 0.246867 Sep 19 15:07:12.243301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2410/4776] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:11 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:13.269805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:13.270578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:13.282333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:13.282874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:13.283325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:13.284064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:13.284527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:13.284960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:13.499473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:13.509604 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b51f1466-34d3-47c9-a96b-9a8b3328e54f tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1498 microversion: 2.1 time: 0.246303 Sep 19 15:07:13.510664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2367/4777] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:13 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:14.402464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:14.403802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:14.431243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:14.431667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:14.432372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:14.433120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:14.433588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:14.434018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:14.471703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:07:14.644251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-81529464-dc55-44b0-83c4-89516a2b1587 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 204 len: 0 microversion: 2.1 time: 0.253872 Sep 19 15:07:14.645291 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2411/4778] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:07:14 2022] DELETE /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:07:14.656810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:14.658249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:14.665298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:14.670390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:14.672219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:14.672674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:14.674250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:14.674907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:14.675721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:14.993079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:15.006707 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2586b218-d31b-4c5d-b0f6-ecb03ea734be tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1504 microversion: 2.1 time: 0.355200 Sep 19 15:07:15.007617 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2368/4779] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:14 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:16.035717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:16.036450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:16.048318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=10 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:16.054877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:16.055393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:16.055847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:16.056601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:16.057078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:16.057519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:17.096353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1930f12e-72b7-41d3-8763-6bcef7b4fea0 req-649cbfe4-22f5-4027-8005-a812747e814c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcfd09b4-a4ea-438c-9728-277836999f4b", "name": "network-vif-deleted", "tag": "e4fb6931-453e-4633-84c2-36a153a048bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:07:17.116070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1930f12e-72b7-41d3-8763-6bcef7b4fea0 req-649cbfe4-22f5-4027-8005-a812747e814c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:17.116799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1930f12e-72b7-41d3-8763-6bcef7b4fea0 req-649cbfe4-22f5-4027-8005-a812747e814c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:17.117522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1930f12e-72b7-41d3-8763-6bcef7b4fea0 req-649cbfe4-22f5-4027-8005-a812747e814c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:17.141880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1930f12e-72b7-41d3-8763-6bcef7b4fea0 req-649cbfe4-22f5-4027-8005-a812747e814c service nova] Creating event network-vif-deleted:e4fb6931-453e-4633-84c2-36a153a048bf for instance dcfd09b4-a4ea-438c-9728-277836999f4b on n-h2-858384-1 Sep 19 15:07:17.160039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6366da44f65947f0aa20ac58a5b2a5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0ff1863ea9443682549fe0ef7f19c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:17.172245 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1930f12e-72b7-41d3-8763-6bcef7b4fea0 req-649cbfe4-22f5-4027-8005-a812747e814c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081044 Sep 19 15:07:17.180518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2369/4780] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:07:17.216904 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d15da6e2-6e7d-45f6-ac30-adb2df168056 tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 200 len: 1504 microversion: 2.1 time: 1.184689 Sep 19 15:07:17.222769 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2412/4781] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:16 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 1504 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:18.258740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:18.280864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] [instance: dcfd09b4-a4ea-438c-9728-277836999f4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:18.321333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:18.325888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:18.333428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:18.337892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:18.338699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:18.343793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:18.370332 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] HTTP exception thrown: Instance dcfd09b4-a4ea-438c-9728-277836999f4b could not be found. Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Request method failure captured: Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b HTTP/1.1 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIVq2PH2h44Kxrg1Hp2mQndF6NyH4xqnuK9acy-KEkeYMNBpqaeiPRZZ5O-SiB_lbvxHpzMNU-nObZxUPGazGAVcztZeibJDWDp4B6Y9sR_gqZOtARHuO5B46KKEVM5d8kIiBt1KBCrKbqeQoq5NGV25adVc_CW8HbSHJM06RKyIPG8 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 3a0ff1863ea9443682549fe0ef7f19c2 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesActionsTest-1132431988 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3a0ff1863ea9443682549fe0ef7f19c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "tempest-type-470238770", "name": "tempest-service-1697471766", "endpoints": [{"region": "tempest-region-1110008132", "internalURL": "https://url-1374395257.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a0ff1863ea9443682549fe0ef7f19c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a0ff1863ea9443682549fe0ef7f19c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "tempest-type-1398574127", "name": "tempest-service-686770904", "endpoints": [{"region": "tempest-region-673078297", "publicURL": "https://url-1436551087.com"}]}, {"type": "tempest-type-155142206", "name": "tempest-service-187387261", "endpoints": []}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3a0ff1863ea9443682549fe0ef7f19c2"}]}] Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesActionsTest-1132431988 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 3a0ff1863ea9443682549fe0ef7f19c2 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesActionsTest-1132431988 Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesActionsTest-1132431988-project Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6366da44f65947f0aa20ac58a5b2a5be Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesActionsTest-1132431988-project Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dcfd09b4-a4ea-438c-9728-277836999f4b could not be found. Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dcfd09b4-a4ea-438c-9728-277836999f4b'} Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcfd09b4-a4ea-438c-9728-277836999f4b could not be found. Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:07:18.372103 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcfd09b4-a4ea-438c-9728-277836999f4b could not be found. Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcfd09b4-a4ea-438c-9728-277836999f4b could not be found. Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] Returning 404 to user: Instance dcfd09b4-a4ea-438c-9728-277836999f4b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48c63150-69cf-4463-b51d-3ee21ec38e7c tempest-VolumesActionsTest-1132431988 tempest-VolumesActionsTest-1132431988-project] 10.222.0.81 "GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b" status: 404 len: 111 microversion: 2.1 time: 0.128754 Sep 19 15:07:18.383080 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2370/4782] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:18 2022] GET /compute/v2.1/servers/dcfd09b4-a4ea-438c-9728-277836999f4b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:07:24.923587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39fa479b-3113-43c5-b30a-89207bea5ba7 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:07:24.935770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:24.955283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39fa479b-3113-43c5-b30a-89207bea5ba7 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:24.958718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39fa479b-3113-43c5-b30a-89207bea5ba7 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:24.959454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39fa479b-3113-43c5-b30a-89207bea5ba7 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:25.015943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-39fa479b-3113-43c5-b30a-89207bea5ba7 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Going to try to stop instance {{(pid=128730) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 15:07:25.120727 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39fa479b-3113-43c5-b30a-89207bea5ba7 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action" status: 202 len: 0 microversion: 2.1 time: 0.205131 Sep 19 15:07:25.121953 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2413/4783] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:07:24 2022] POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:07:25.131047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:25.132380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:25.147338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:25.149294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:25.152108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:25.154628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:25.156625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:25.158917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:25.218655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=54 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:26.103793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:26.117262 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3665c3b-ba08-4ae2-a867-6f2eedef8d0d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.991106 Sep 19 15:07:26.118852 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2371/4784] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:25 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:27.147937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:27.148766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:27.170142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:27.172848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:27.174903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:27.177059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:27.182885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:27.183677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:27.497967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:27.526491 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-278d85d2-0880-4b63-9742-0dd32fd67e3e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.384399 Sep 19 15:07:27.527962 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2414/4785] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:27 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:28.553871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:28.556041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:28.574642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=36 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:28.579001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:28.581794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:28.582512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:28.583445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:28.584511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:28.588430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:29.091500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:29.106809 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0a837af-5cc4-4922-9ff0-14e686ba257d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.557108 Sep 19 15:07:29.114856 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2372/4786] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:28 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:30.132465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:30.135006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:30.156923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:30.158550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:30.165274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:30.170316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:30.171905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:30.174918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:30.531382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:30.549777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd4ca704-547f-42f6-b004-95b3fe00820c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.417097 Sep 19 15:07:30.551043 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2415/4787] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:30 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:31.575541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:31.578065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:31.603127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:31.604122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:31.604918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:31.606458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:31.608921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:31.610047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:31.914455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:31.929216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb1f6854-340a-460b-a484-52f2ee4c9f95 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.359002 Sep 19 15:07:31.952244 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2373/4788] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:31 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:32.959417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:32.960807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:32.977011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:32.979208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:32.980147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:32.982246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:32.982991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:32.984074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:33.231840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:33.249510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75400f09-dd5b-4360-a04e-972d1f5fb0ca tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.294608 Sep 19 15:07:33.253835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2416/4789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:32 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:34.278225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:34.279829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:34.293645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:34.299897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:34.300640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:34.301746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:34.304504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:34.307052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:34.776622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:34.796304 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba6c032a-a503-418d-ba8b-2d7ffbfce9b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.518335 Sep 19 15:07:34.821235 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2374/4790] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:34 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:35.825413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:35.826214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:35.835121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:35.835613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:35.836051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:35.836759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:35.838104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:35.839222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:35.843712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:36.126788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:36.159921 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a660bbf-d301-43b6-b9f5-1574f4c63ec0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.318908 Sep 19 15:07:36.161384 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2417/4791] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:35 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:37.208103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:37.218034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:37.229981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:37.230475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:37.230935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:37.231651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:37.232156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:37.232614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:37.464353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:37.474649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4dd896c6-fbfc-49e2-bf0a-200f150fc04b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.289266 Sep 19 15:07:37.475368 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2375/4792] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:37 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:38.500694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:38.503101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:38.530806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:38.535310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:38.544747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:38.545851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:38.549883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:38.550571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:38.848299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:38.864186 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c025d1cc-6bfa-445d-a36c-9181a211f433 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.368538 Sep 19 15:07:38.867320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2418/4793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:38 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:39.892148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:39.892794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:39.931195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:39.932160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:39.932611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:39.938769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:39.939247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:39.944205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:40.427583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:40.447285 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f9143a6f-b96e-43c2-b716-d934d2c66548 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.560400 Sep 19 15:07:40.463576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2376/4794] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:39 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:41.474633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:41.478711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:41.492521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:41.493739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:41.495209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:41.496879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:41.497573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:41.498300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:41.789943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:41.806311 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-040ec5ba-e357-41d5-9f11-ba7080475dea tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.329602 Sep 19 15:07:41.809127 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2419/4795] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:41 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:42.832865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:42.834223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:42.863305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:42.863809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:42.867731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:42.871424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:42.876219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:42.878607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:43.318874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:43.335571 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91d094d2-6eda-4789-8ea4-6d7e5beec698 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.509219 Sep 19 15:07:43.338008 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2377/4796] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:42 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:44.378538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:44.387976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:44.437380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:44.445457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:44.447694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:44.448995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:44.449487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:44.449930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:44.805219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:44.821590 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec011029-f4e6-480c-969e-9b786d2f56ee tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.456826 Sep 19 15:07:44.822226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2420/4797] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:44 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:07:45.856908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:45.859942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:45.876780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:45.879393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:45.880155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:45.883129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:45.883623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:45.884229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:46.379311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:46.392694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-54d92bb4-afe7-459d-9226-ba98efee3214 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.545481 Sep 19 15:07:46.396798 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2378/4798] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:45 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:47.423235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:47.424728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:47.444026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:47.445395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:47.446589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:47.450175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:47.453775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:47.454927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:48.466650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:48.490086 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f497811c-43fc-4609-864b-c79989e9f3b0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 1.071725 Sep 19 15:07:48.492245 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2421/4799] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:47 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:49.522468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:49.523163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:49.531994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:49.550412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:49.553743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:49.554570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:49.565789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:49.566527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:50.306943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:50.317609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff72e45f-3353-4689-81e2-441904fdaec9 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1721 microversion: 2.1 time: 0.800559 Sep 19 15:07:50.350708 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2379/4800] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:49 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1721 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:51.354429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:51.356902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:51.427306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:51.438257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:51.442380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:51.455518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:51.468953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:51.474471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:52.409426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:52.427464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7f924e3-d44a-4ccf-9be3-caa952352871 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1698 microversion: 2.1 time: 1.079042 Sep 19 15:07:52.442458 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2422/4801] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:51 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1698 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:52.464065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e199e668-d40c-42c5-8728-c165a3b6daba tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:07:52.502025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e199e668-d40c-42c5-8728-c165a3b6daba tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:52.505371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e199e668-d40c-42c5-8728-c165a3b6daba tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:52.505908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e199e668-d40c-42c5-8728-c165a3b6daba tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:52.603291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e199e668-d40c-42c5-8728-c165a3b6daba tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Going to try to start instance {{(pid=128731) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 15:07:52.768948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e199e668-d40c-42c5-8728-c165a3b6daba tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action" status: 202 len: 0 microversion: 2.1 time: 0.311168 Sep 19 15:07:52.780040 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2380/4802] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:07:52 2022] POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:07:52.791448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:52.792552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:52.816696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:52.818121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:52.818593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:52.822372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:52.826013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:52.826416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:53.927858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:53.961829 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6fbe7ce7-6677-4274-8842-2dfb588f730b tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1707 microversion: 2.1 time: 1.176395 Sep 19 15:07:53.965040 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2423/4803] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:52 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1707 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:54.991575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:54.992444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:55.014263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:55.014797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:55.022302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:55.023141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:55.023797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:55.024084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:55.648562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:55.651894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:55.673200 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f9d78a3-c356-4444-9f92-5ce64c91a061 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1707 microversion: 2.1 time: 0.687240 Sep 19 15:07:55.691684 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2381/4804] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:54 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1707 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:07:56.699672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:56.699672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:07:56.714388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:56.726801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:56.727595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:56.732978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:56.738060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:56.741574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:57.298442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:07:57.307794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-66f1af6c-a619-444f-bf4e-312ee491676f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1711 microversion: 2.1 time: 0.613017 Sep 19 15:07:57.327471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2424/4805] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:07:56 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1711 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:27.116301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=19 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:27.378339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Calling method '.version_select at 0x7fde29ce38b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:27.383316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:27.388251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:27.389944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:27.426250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:27.427019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:27.427868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:27.446295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:27.447994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:27.448716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:27.463400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f2bcaec5-4eae-4a35-8a8c-9d8fcbc62679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1417947407-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.355006 Sep 19 15:08:27.465646 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2382/4806] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 15:08:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:08:28.915953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:28.916732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:28.951870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=23 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:28.957357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=47 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:28.966923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:28.967349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:28.967802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:28.976395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:28.977450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:28.978684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:29.255734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lazy-loading 'services' on Instance uuid 31014aee-7a40-49c7-a33b-3d49834e0b51 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:08:29.455561 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-db8b6a43-df93-413b-980d-4847e34e3801 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-volume_attachments/3950f8d7-e5c1-41bd-88c8-de0c4112a0db" status: 202 len: 0 microversion: 2.1 time: 0.546379 Sep 19 15:08:29.458367 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2425/4807] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:08:28 2022] DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-volume_attachments/3950f8d7-e5c1-41bd-88c8-de0c4112a0db => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:08:29.766271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:29.767004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:29.784005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:29.784525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:29.784969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:29.785965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:29.786634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:29.787444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:29.836796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:08:30.064530 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b65045a4-1db1-42b4-886c-9fc9f1b1f520 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 204 len: 0 microversion: 2.42 time: 0.888749 Sep 19 15:08:30.066160 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2383/4808] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:08:29 2022] DELETE /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:08:30.078200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:30.088497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:30.115576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:30.116331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:30.116979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:30.117908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:30.118532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:30.119171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:30.860691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:30.880143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:30.883874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:30.888757 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e434695d-18f7-4f5d-b413-9b8c22d6cb25 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2958 microversion: 2.42 time: 0.816555 Sep 19 15:08:30.891680 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2426/4809] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:30 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2958 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:31.926943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:31.926943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:31.946221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:31.950229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:31.951206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:31.953224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:31.955338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:31.956347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:32.813918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:32.831420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:32.837024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:32.841088 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed925cf7-e8a0-401f-a58f-35c43f389dff tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2958 microversion: 2.42 time: 0.922707 Sep 19 15:08:32.843691 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2384/4810] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:31 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2958 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:33.916528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:33.923034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:33.948270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:33.949656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:33.952718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:33.954386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:33.955722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:33.956804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:35.965144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6bbb532a-9cd7-437f-a5f7-22310e9af22f req-e004db57-ddf7-442c-b6cd-b884f4b32fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "5a074f08-9079-405a-bf80-1f3c93fce8a9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:35.982004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6bbb532a-9cd7-437f-a5f7-22310e9af22f req-e004db57-ddf7-442c-b6cd-b884f4b32fa8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:35.982712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6bbb532a-9cd7-437f-a5f7-22310e9af22f req-e004db57-ddf7-442c-b6cd-b884f4b32fa8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:35.983357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6bbb532a-9cd7-437f-a5f7-22310e9af22f req-e004db57-ddf7-442c-b6cd-b884f4b32fa8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:36.017436 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6bbb532a-9cd7-437f-a5f7-22310e9af22f req-e004db57-ddf7-442c-b6cd-b884f4b32fa8 service nova] Creating event network-vif-unplugged:5a074f08-9079-405a-bf80-1f3c93fce8a9 for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:36.035062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6bbb532a-9cd7-437f-a5f7-22310e9af22f req-e004db57-ddf7-442c-b6cd-b884f4b32fa8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.423590 Sep 19 15:08:36.037342 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2385/4811] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:08:36.081146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:36.104524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:36.111342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:36.113977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-883fd014-2e95-4407-8105-b0dcfc561702 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2958 microversion: 2.42 time: 2.211695 Sep 19 15:08:36.161496 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2427/4812] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:33 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2958 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:37.156317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:37.157270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:37.183230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:37.183847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:37.184298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:37.185075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:37.185625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:37.185967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:37.996226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:38.013343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:38.018073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:38.022790 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-66c211e8-435d-4a88-9496-1287d4ed583d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2916 microversion: 2.42 time: 0.878239 Sep 19 15:08:38.026340 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2386/4813] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:37 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2916 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:38.204448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1474cd9a-84bf-466c-8b10-53236c77b38f"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "ac4d87f5-429d-44db-8962-6e644307f42b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:38.229077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:38.230473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:38.231126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:38.262056 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Creating event network-vif-unplugged:1474cd9a-84bf-466c-8b10-53236c77b38f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:38.263493 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Creating event network-vif-unplugged:1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:38.285288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] Creating event network-vif-unplugged:ac4d87f5-429d-44db-8962-6e644307f42b for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:38.317306 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a9c561d4-3240-405b-b5a2-85e14a0820b5 req-28685542-e812-46d3-bbab-8ba6ab394088 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.117842 Sep 19 15:08:38.320688 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2428/4814] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:08:39.054641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:39.055907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:39.073234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:39.073909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:39.074558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:39.081566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:39.082774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:39.088320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:39.620524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4891099f-2061-4cd3-aedb-57097b021ce1 req-ad546252-b951-430b-8e55-89968ca4bb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-deleted", "tag": "1474cd9a-84bf-466c-8b10-53236c77b38f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:39.646616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4891099f-2061-4cd3-aedb-57097b021ce1 req-ad546252-b951-430b-8e55-89968ca4bb41 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:39.652069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4891099f-2061-4cd3-aedb-57097b021ce1 req-ad546252-b951-430b-8e55-89968ca4bb41 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:39.657772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4891099f-2061-4cd3-aedb-57097b021ce1 req-ad546252-b951-430b-8e55-89968ca4bb41 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:39.693074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4891099f-2061-4cd3-aedb-57097b021ce1 req-ad546252-b951-430b-8e55-89968ca4bb41 service nova] Creating event network-vif-deleted:1474cd9a-84bf-466c-8b10-53236c77b38f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:39.704781 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4891099f-2061-4cd3-aedb-57097b021ce1 req-ad546252-b951-430b-8e55-89968ca4bb41 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102778 Sep 19 15:08:39.707949 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2429/4815] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:08:39.727149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:39.746041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:39.749117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:39.753479 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5666176f-6612-4535-8297-672549eb0d73 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2869 microversion: 2.42 time: 0.706476 Sep 19 15:08:39.757141 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2387/4816] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:39 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2869 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:40.381136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e942c74d-8017-4e88-950f-3820e6f81ea1 req-768bd193-2e17-4c13-a8fa-8cc3e01482e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "f12a897c-c664-4973-8f53-f65f9c81f88d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:40.438238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e942c74d-8017-4e88-950f-3820e6f81ea1 req-768bd193-2e17-4c13-a8fa-8cc3e01482e6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:40.439548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e942c74d-8017-4e88-950f-3820e6f81ea1 req-768bd193-2e17-4c13-a8fa-8cc3e01482e6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:40.440470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e942c74d-8017-4e88-950f-3820e6f81ea1 req-768bd193-2e17-4c13-a8fa-8cc3e01482e6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:40.472735 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e942c74d-8017-4e88-950f-3820e6f81ea1 req-768bd193-2e17-4c13-a8fa-8cc3e01482e6 service nova] Creating event network-vif-unplugged:f12a897c-c664-4973-8f53-f65f9c81f88d for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:40.496631 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e942c74d-8017-4e88-950f-3820e6f81ea1 req-768bd193-2e17-4c13-a8fa-8cc3e01482e6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119662 Sep 19 15:08:40.513786 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2430/4817] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:08:40.791284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:40.798376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:40.819085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:40.821744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:40.826035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:40.827469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:40.828493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:40.830321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:41.514444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:41.538284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:41.540919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:41.542621 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c59c3834-f675-4a17-9e30-97df4fb9fc5c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2755 microversion: 2.42 time: 0.758444 Sep 19 15:08:41.555403 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2388/4818] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:40 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2755 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:42.529714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-55374689-5449-4b7c-8fff-603e26fb8387 req-78a16d18-861a-4c43-b876-52167a43a59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-deleted", "tag": "f12a897c-c664-4973-8f53-f65f9c81f88d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:42.561674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55374689-5449-4b7c-8fff-603e26fb8387 req-78a16d18-861a-4c43-b876-52167a43a59a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:42.562365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55374689-5449-4b7c-8fff-603e26fb8387 req-78a16d18-861a-4c43-b876-52167a43a59a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:42.579723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:42.581017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:42.583664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55374689-5449-4b7c-8fff-603e26fb8387 req-78a16d18-861a-4c43-b876-52167a43a59a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:42.605825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:42.616547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:42.617068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:42.623586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:42.624095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:42.624550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:42.638021 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-55374689-5449-4b7c-8fff-603e26fb8387 req-78a16d18-861a-4c43-b876-52167a43a59a service nova] Creating event network-vif-deleted:f12a897c-c664-4973-8f53-f65f9c81f88d for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:42.648795 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-55374689-5449-4b7c-8fff-603e26fb8387 req-78a16d18-861a-4c43-b876-52167a43a59a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127469 Sep 19 15:08:42.667601 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2431/4819] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:08:43.422062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:43.464108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:43.471548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:43.472945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6b023bae-ee09-471e-98a3-31e4847b4988 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2708 microversion: 2.42 time: 0.899319 Sep 19 15:08:43.488036 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2389/4820] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:42 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2708 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:44.514989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:44.516628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:44.562271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:44.562790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:44.563243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:44.574154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:44.576487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:44.581321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:44.627339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c0b86891-638c-4ab9-b551-bef32e928457 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:44.637659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c0b86891-638c-4ab9-b551-bef32e928457 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:44.651572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c0b86891-638c-4ab9-b551-bef32e928457 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:44.652038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c0b86891-638c-4ab9-b551-bef32e928457 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:44.746198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c0b86891-638c-4ab9-b551-bef32e928457 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Going to try to stop instance {{(pid=128731) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 15:08:44.851188 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c0b86891-638c-4ab9-b551-bef32e928457 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action" status: 202 len: 0 microversion: 2.1 time: 0.230924 Sep 19 15:08:44.851818 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2390/4821] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:08:44 2022] POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:08:44.874504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:44.875298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:44.893684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:44.894197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:44.894639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:44.895388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:44.895853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:44.896286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:45.497515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:45.508309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:45.509949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:45.511335 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4bc4f978-f5b0-450a-975a-748ac88dfc10 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2370 microversion: 2.42 time: 1.003319 Sep 19 15:08:45.513209 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2432/4822] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:44 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2370 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:45.529352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-14b85639-c50f-4b63-8eff-1d952dedc3bb req-d8a7816a-0252-4514-b2f4-90e25ae6d543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-deleted", "tag": "5a074f08-9079-405a-bf80-1f3c93fce8a9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:45.565896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14b85639-c50f-4b63-8eff-1d952dedc3bb req-d8a7816a-0252-4514-b2f4-90e25ae6d543 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:45.566438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14b85639-c50f-4b63-8eff-1d952dedc3bb req-d8a7816a-0252-4514-b2f4-90e25ae6d543 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:45.566928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-14b85639-c50f-4b63-8eff-1d952dedc3bb req-d8a7816a-0252-4514-b2f4-90e25ae6d543 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:45.593606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:45.605901 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-14b85639-c50f-4b63-8eff-1d952dedc3bb req-d8a7816a-0252-4514-b2f4-90e25ae6d543 service nova] Creating event network-vif-deleted:5a074f08-9079-405a-bf80-1f3c93fce8a9 for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:45.615446 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-14b85639-c50f-4b63-8eff-1d952dedc3bb req-d8a7816a-0252-4514-b2f4-90e25ae6d543 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100133 Sep 19 15:08:45.616322 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2433/4823] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:08:45.618880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b0975596-16ee-4bb7-8562-a1b61a421d73 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1675 microversion: 2.1 time: 0.759923 Sep 19 15:08:45.626681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2391/4824] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:44 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1675 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:46.564717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:46.566680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:46.584907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:46.585623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:46.586291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:46.587254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:46.587917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:46.588548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:46.660576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:46.661241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:46.687878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:46.688395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:46.689357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:46.698079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:46.700422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:46.700916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:47.350116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:47.390162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:47.392240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:47.393924 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83e72f8f-a62f-477b-ab38-2b6beddd30e5 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 2210 microversion: 2.42 time: 0.849094 Sep 19 15:08:47.396644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2434/4825] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:46 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 2210 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:47.697223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-deleted", "tag": "ac4d87f5-429d-44db-8962-6e644307f42b"}, {"server_uuid": "4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3", "name": "network-vif-deleted", "tag": "1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:47.720593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:47.729340 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1a4a08a-0a3f-4d8e-a768-928479528d7d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1675 microversion: 2.1 time: 1.087478 Sep 19 15:08:47.729947 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2392/4826] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:46 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1675 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:47.742976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:47.742976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:47.742976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:47.824057 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] Creating event network-vif-deleted:ac4d87f5-429d-44db-8962-6e644307f42b for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:47.824572 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] Creating event network-vif-deleted:1e419a2e-a7ee-4fa3-9f15-fe1ac7b68a5f for instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 on n-h1-858384-1 Sep 19 15:08:47.864330 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b622a6a0-90c7-4dfe-a0aa-d7b8011cefc1 req-eb851297-c394-4807-8a9c-8fd61f49da8f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.173119 Sep 19 15:08:47.865439 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2435/4827] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:08:48.429612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:48.430159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:48.443951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:48.459255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:48.459729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:48.460507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:48.460977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:48.461416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:48.664012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:48.679743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:48.687000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:48.690095 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-331df1cf-bad9-471f-900d-a64b6cfbd982 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.264575 Sep 19 15:08:48.692071 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2393/4828] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:48 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:48.758912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:48.759622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:48.801387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:48.802243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:48.806379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:48.808203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:48.819624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:48.821454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:49.523131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:49.537752 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a91b5df-8bc2-4ea2-8bb7-a172553452d0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1675 microversion: 2.1 time: 0.784183 Sep 19 15:08:49.545597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2436/4829] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:48 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1675 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:49.733685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:49.736445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:49.744937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:49.746026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:49.747213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:49.748161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:49.748812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:49.749440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:49.960209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:49.984457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:49.988389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:49.994303 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f3db52a-a34d-4521-9d7d-974ce063e4ac tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.262799 Sep 19 15:08:49.999518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2394/4830] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:49 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:50.572412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:50.573800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:50.584919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:50.589564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:50.590893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:50.594926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:50.596470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:50.597300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:50.995625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:51.004874 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12a75c3f-181a-413e-8328-1b19dbef7102 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1675 microversion: 2.1 time: 0.437270 Sep 19 15:08:51.010839 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2437/4831] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:50 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1675 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:51.030456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:51.031849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:51.040346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:51.041179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:51.041856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:51.042838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:51.044231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:51.044880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:51.229522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:51.239262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:51.240750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:51.241979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e09f5e5e-bd80-488c-a136-51711f18f71e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.217208 Sep 19 15:08:51.244665 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2395/4832] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:51 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:52.047318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:52.050780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:52.080254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:52.082835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:52.083399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:52.084242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:52.094575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:52.095660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:52.270876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:52.271497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:52.287936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:52.288553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:52.289120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:52.295155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:52.295808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:52.296364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:52.332910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:52.576513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:52.599689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:52.601327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:52.602654 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74e4d328-6925-4ea9-acaf-8d1b27a6bd82 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.336343 Sep 19 15:08:52.606467 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2396/4833] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:52 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:08:52.658716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:52.668048 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0817a45e-fcc9-492f-9903-f826a2b8a450 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1675 microversion: 2.1 time: 0.631961 Sep 19 15:08:52.671738 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2438/4834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:52 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1675 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:53.631852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:53.632473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:53.645546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:53.649933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:53.650396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:53.657459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:53.658252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:53.658943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:53.697905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:53.698539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:53.719483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:53.720162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:53.720619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:53.721393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:53.732795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:53.733270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:54.132920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:54.149336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:54.159124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:54.160763 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71e6a690-ef95-4083-a3e2-41891ebd641a tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.533702 Sep 19 15:08:54.181961 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2397/4835] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:53 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:54.580609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:54.589423 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9c0fdda-a30e-4cef-90ca-7df86c740158 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1675 microversion: 2.1 time: 0.895905 Sep 19 15:08:54.591559 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2439/4836] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:53 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1675 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:55.194446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:55.195434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:55.223205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:55.223908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:55.226232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:55.231846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:55.234706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:55.236020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:55.443954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:55.470037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:55.472222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:55.473755 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2ad0bcc2-b5a4-48e0-b967-acdbb161ce26 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.285231 Sep 19 15:08:55.476800 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2398/4837] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:55 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:55.613974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:55.615837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:55.635442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:55.636859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:55.637591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:55.638570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:55.639320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:55.639984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:56.505522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:56.507460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:56.545024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:56.546539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:56.553940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:56.555039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:56.555686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:56.556298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:56.688819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:56.715179 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a354d177-9ff0-4f42-8468-d4cf69f9fee5 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1652 microversion: 2.1 time: 1.105431 Sep 19 15:08:56.727946 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2440/4838] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:55 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1652 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:56.759197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4fe86f30-c0a0-4ebf-8aac-a554b735fc23 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:08:56.776690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe86f30-c0a0-4ebf-8aac-a554b735fc23 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:56.777194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe86f30-c0a0-4ebf-8aac-a554b735fc23 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:56.778271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4fe86f30-c0a0-4ebf-8aac-a554b735fc23 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:56.783722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:56.806085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:56.821085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4fe86f30-c0a0-4ebf-8aac-a554b735fc23 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Going to try to start instance {{(pid=128730) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 15:08:56.828238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:56.833357 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8348ea3a-8381-4493-ac95-157d8ac6aa3e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.332716 Sep 19 15:08:56.840997 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2399/4839] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:56 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:56.942893 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4fe86f30-c0a0-4ebf-8aac-a554b735fc23 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action" status: 202 len: 0 microversion: 2.1 time: 0.187533 Sep 19 15:08:56.944498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2441/4840] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:08:56 2022] POST /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:08:56.954634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:56.956400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:56.985302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:56.986173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:56.986649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:56.987463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:56.987940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:56.988736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:57.870728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:57.871533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:57.894399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:57.895228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:57.899035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:57.900757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:57.905418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:57.907270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:58.284224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:58.307688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:58.311776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:58.320464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c4cee73e-be49-453e-8be1-0721d6f1dfc8 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.454473 Sep 19 15:08:58.321641 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2442/4841] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:57 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:08:58.635814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:08:58.661326 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e8cb5df-1ff1-4e0b-b020-ac24dfb57e43 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1661 microversion: 2.1 time: 1.712160 Sep 19 15:08:58.673929 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2400/4842] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:56 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1661 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:08:59.349119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:59.349865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:59.368157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=37 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:59.373980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:59.382931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:59.395590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:59.398018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:59.404199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:59.404969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:59.409161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:59.698653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:08:59.699352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:08:59.702628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:59.725850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:59.726641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:59.727269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:59.728375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:59.733850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:59.734715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:00.004385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:00.041658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:00.048472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:00.050026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-139ca8fe-dd6b-475d-b204-faa8321093a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.705415 Sep 19 15:09:00.050619 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2443/4843] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:08:59 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:00.220076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:00.228725 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-52aea16a-f650-4277-8fb8-42798f9831ce tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1665 microversion: 2.1 time: 0.534797 Sep 19 15:09:00.248718 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2401/4844] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:08:59 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1665 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:01.107028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:01.117116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:01.161350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:01.162395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:01.163442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:01.167263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:01.171684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:01.173360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:01.479232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:01.498318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:01.502212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:01.506386 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82fb29a2-2c02-4395-987b-46f42b351e37 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.427472 Sep 19 15:09:01.508231 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2444/4845] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:01 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:02.546480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:02.551857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:02.595991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:02.598292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:02.598833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:02.600037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:02.618849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:02.620404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:02.945969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:03.033733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:03.038582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:03.039936 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b64e1ee1-12f0-4e3b-9f0e-59ccda8b01e1 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.506048 Sep 19 15:09:03.053011 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2402/4846] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:02 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:04.070057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:04.071658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:04.097850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:04.099976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:04.101463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:04.102317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:04.103058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:04.103713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:04.890489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:04.908535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:04.910460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:04.924362 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-649b70e3-f41c-4301-ba72-a525d8ef9989 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.861697 Sep 19 15:09:04.927101 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2445/4847] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:04 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:05.954149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:05.954875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:05.986148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:05.988002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:05.988923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:05.989842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:05.990477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:05.991132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:06.183335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:06.204075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:06.209616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:06.211564 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8cfd59f2-fc20-420a-b8d5-5a5c06851b13 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.261976 Sep 19 15:09:06.212165 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2403/4848] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:05 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:07.257203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:07.257730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:07.282592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:07.283160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:07.284951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:07.286737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:07.291718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:07.292185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:07.448222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:07.479616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:07.485165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:07.488332 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0db8f79b-4615-4988-83d1-3bec2ec540a7 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.235162 Sep 19 15:09:07.493801 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2446/4849] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:07 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:08.549455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:08.550507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:08.568923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:08.569594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:08.571040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:08.573216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:08.579148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:08.579760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:09.047561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:09.083574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:09.093097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:09.096250 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-51f99412-5269-429d-aeac-ad8b95892c87 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.575751 Sep 19 15:09:09.096852 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2404/4850] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:08 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:10.127693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:10.128343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:10.173783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:10.174361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:10.176553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:10.180844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:10.188811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:10.189288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:10.505319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:10.517633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:10.531937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:10.535194 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6b86e5fa-7bdb-4711-ae66-133fa803046e tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.414445 Sep 19 15:09:10.537877 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2447/4851] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:10 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:11.569272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:11.570108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:11.591557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:11.592076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:11.600296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:11.601207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:11.601699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:11.602164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:11.870346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:11.889852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:11.891599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:11.893247 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd6d649c-3482-4827-881d-9c201d82c875 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.328610 Sep 19 15:09:11.907332 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2405/4852] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:11 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:12.925419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:12.926616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:12.954232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:12.954782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:12.960114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:12.966334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:12.968028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:12.973491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:13.228350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:13.266158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:13.272490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:13.275944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5468594f-8b4e-42fc-bc04-9b08b6fa53f4 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.356901 Sep 19 15:09:13.287543 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2448/4853] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:12 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:14.305820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:14.306449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:14.337646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:14.337646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:14.337646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:14.337646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:14.337646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:14.337646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:14.502661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:14.512490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:14.513975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:14.515236 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb2d3f63-b443-4a02-a331-c8e8cb98e44c tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.213359 Sep 19 15:09:14.531087 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2406/4854] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:14 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:15.543839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:15.544744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:15.560155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:15.562864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:15.565076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:15.566825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:15.567774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:15.572531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:15.822112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:15.840423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:15.848628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:15.870041 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bbfe93c8-15ea-4890-8d4d-9235cda37ae9 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.330959 Sep 19 15:09:15.871914 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2449/4855] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:15 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:16.902304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:16.904128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:16.919575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:16.923339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:16.924651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:16.927873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:16.928715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:16.929349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:17.148507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:17.170546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:17.173903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30e85e41030d48e1a58ca69232b2c40a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f700c170b52496297884e50c824cdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:17.179158 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ce53bf0-9546-4f69-850c-4106c9bd2fbc tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 200 len: 1604 microversion: 2.42 time: 0.282546 Sep 19 15:09:17.181742 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2407/4856] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:16 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 1604 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:09:18.212603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:18.213237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:18.236897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:18.237401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:18.237849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:18.252074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:18.252833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:18.256357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:18.301066 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] HTTP exception thrown: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Request method failure captured: Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 HTTP/1.1 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKISTHVOMlFaZb0vVGc_aZ9gdutuINt0D62Q1DAswB5WsUycKvGkxvmIIi6UaHAzzjSKVz0XSsRKp4q-xaP-tsXCMqec22Ql1xXvXRtF_mr3q1EAzD-dQ2l7D6NLlv4ViwC8wjkQiXza_U6Jo1cvbFLwk6AytsdUhU8aCe0_xkdB5Sf8 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.42 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 4f700c170b52496297884e50c824cdb8 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4f700c170b52496297884e50c824cdb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4f700c170b52496297884e50c824cdb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4f700c170b52496297884e50c824cdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4f700c170b52496297884e50c824cdb8"}]}] Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 4f700c170b52496297884e50c824cdb8 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TaggedBootDevicesTest_v242-1765711510-project Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 30e85e41030d48e1a58ca69232b2c40a Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1765711510-project Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3'} Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:18.309685 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Returning 404 to user: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-97c40652-84c0-43bc-a87a-f1b877c2daf6 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 404 len: 111 microversion: 2.42 time: 0.102877 Sep 19 15:09:18.315191 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2450/4857] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:18 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:09:18.321195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3a53a0ad-c435-48df-8599-8e2c6ff443bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '.version_select at 0x7fde29c15f70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:18.370777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3a53a0ad-c435-48df-8599-8e2c6ff443bd tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085261501" status: 204 len: 0 microversion: 2.42 time: 0.053697 Sep 19 15:09:18.374637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2408/4858] 10.222.0.81 () {60 vars in 1262 bytes} [Mon Sep 19 15:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085261501 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:09:29.993302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=15 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:29.999327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=43 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.005816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:30.007950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:30.023914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:30.024360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:30.024809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:30.025523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:30.025987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:30.026424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:30.069002 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] HTTP exception thrown: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Request method failure captured: Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 HTTP/1.1 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKISTHVOMlFaZb0vVGc_aZ9gdutuINt0D62Q1DAswB5WsUycKvGkxvmIIi6UaHAzzjSKVz0XSsRKp4q-xaP-tsXCMqec22Ql1xXvXRtF_mr3q1EAzD-dQ2l7D6NLlv4ViwC8wjkQiXza_U6Jo1cvbFLwk6AytsdUhU8aCe0_xkdB5Sf8 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.42 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 4f700c170b52496297884e50c824cdb8 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4f700c170b52496297884e50c824cdb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4f700c170b52496297884e50c824cdb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4f700c170b52496297884e50c824cdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4f700c170b52496297884e50c824cdb8"}]}] Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 4f700c170b52496297884e50c824cdb8 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TaggedBootDevicesTest_v242-1765711510-project Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 30e85e41030d48e1a58ca69232b2c40a Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1765711510-project Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3'} Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:09:30.070633 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Returning 404 to user: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55962187-8bce-43df-98a0-adb736012f4d tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 404 len: 111 microversion: 2.42 time: 0.080945 Sep 19 15:09:30.075452 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2451/4859] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:09:29 2022] DELETE /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:09:30.081839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:30.082468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] [instance: 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:30.086229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=69 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.087439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.112793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:30.113322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:30.113794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:30.114564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:30.115894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:30.116016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:30.148986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] HTTP exception thrown: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Request method failure captured: Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 HTTP/1.1 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKISTHVOMlFaZb0vVGc_aZ9gdutuINt0D62Q1DAswB5WsUycKvGkxvmIIi6UaHAzzjSKVz0XSsRKp4q-xaP-tsXCMqec22Ql1xXvXRtF_mr3q1EAzD-dQ2l7D6NLlv4ViwC8wjkQiXza_U6Jo1cvbFLwk6AytsdUhU8aCe0_xkdB5Sf8 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Openstack-Nova-Api-Version: 2.42 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 4f700c170b52496297884e50c824cdb8 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4f700c170b52496297884e50c824cdb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4f700c170b52496297884e50c824cdb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4f700c170b52496297884e50c824cdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4f700c170b52496297884e50c824cdb8"}]}] Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 4f700c170b52496297884e50c824cdb8 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1765711510 Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TaggedBootDevicesTest_v242-1765711510-project Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 30e85e41030d48e1a58ca69232b2c40a Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1765711510-project Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3'} Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.150397 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. Sep 19 15:09:30.156768 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:09:30.159292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] Returning 404 to user: Instance 4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:30.160361 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9fa6c22-2f3f-4307-ad7b-6f40926c2130 tempest-TaggedBootDevicesTest_v242-1765711510 tempest-TaggedBootDevicesTest_v242-1765711510-project] 10.222.0.81 "GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3" status: 404 len: 111 microversion: 2.42 time: 0.082515 Sep 19 15:09:30.164259 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2409/4860] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:09:30 2022] GET /compute/v2.1/servers/4336251e-ebc5-41e5-ac47-1c8ba0b0e9b3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:09:32.022087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:32.024677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:32.046149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:32.046738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:32.047109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:32.047848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:32.048313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:32.048739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:32.143471 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5dd3da2d-1428-4d99-bffa-dc26588942b4 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124970 Sep 19 15:09:32.144357 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2452/4861] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:09:32 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:09:32.266237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:32.266822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:32.280143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:32.280704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:32.281100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:32.281842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:32.282300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:32.282741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:32.353997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:09:32.550843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b10d8e6f-935c-4c2e-af04-82b64f344172 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 204 len: 0 microversion: 2.1 time: 0.289059 Sep 19 15:09:32.552189 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2410/4862] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:09:32 2022] DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:09:32.561734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:32.561734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:32.591396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:32.599511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:32.603852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:32.606171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:32.609416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:32.609885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:33.123699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:33.135841 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab9e9ff2-7ce1-4f73-8b3c-567496ea2966 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1671 microversion: 2.1 time: 0.579692 Sep 19 15:09:33.138639 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2453/4863] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:32 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1671 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:34.164621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:34.165398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:34.188143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:34.188936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:34.189392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:34.194165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:34.195307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:34.196504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:34.622370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:34.630543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13f8c2b4-1bfa-45d2-9dce-2e3f1d381a08 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1671 microversion: 2.1 time: 0.470253 Sep 19 15:09:34.644817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2411/4864] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:34 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1671 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:35.675918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:35.676563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:35.720830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:35.721342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:35.724399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:35.730950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:35.731711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:35.737075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:36.483281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:36.505834 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67a4b517-5c30-4451-991d-2e649bc0df47 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 200 len: 1606 microversion: 2.1 time: 0.833359 Sep 19 15:09:36.507424 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2454/4865] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:35 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 1606 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:36.674936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3a1415de-c988-466e-86e0-a181a8ddefb3 req-82dc789a-f1fa-4c0c-b73c-b6c66773f0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31014aee-7a40-49c7-a33b-3d49834e0b51", "name": "network-vif-deleted", "tag": "a58144cc-860f-4e70-988c-33c09945574a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:36.689280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3a1415de-c988-466e-86e0-a181a8ddefb3 req-82dc789a-f1fa-4c0c-b73c-b6c66773f0b4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:36.689779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3a1415de-c988-466e-86e0-a181a8ddefb3 req-82dc789a-f1fa-4c0c-b73c-b6c66773f0b4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:36.690217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3a1415de-c988-466e-86e0-a181a8ddefb3 req-82dc789a-f1fa-4c0c-b73c-b6c66773f0b4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:36.726631 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3a1415de-c988-466e-86e0-a181a8ddefb3 req-82dc789a-f1fa-4c0c-b73c-b6c66773f0b4 service nova] Creating event network-vif-deleted:a58144cc-860f-4e70-988c-33c09945574a for instance 31014aee-7a40-49c7-a33b-3d49834e0b51 on n-h1-858384-1 Sep 19 15:09:36.738652 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3a1415de-c988-466e-86e0-a181a8ddefb3 req-82dc789a-f1fa-4c0c-b73c-b6c66773f0b4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.462340 Sep 19 15:09:36.747770 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2412/4866] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:37.539435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:37.541174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:37.561846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:37.566246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:37.567832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:37.569851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:37.574198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:37.579401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:37.636706 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] HTTP exception thrown: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Request method failure captured: Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 HTTP/1.1 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVWuYvh3fGoD-oiU-MygYpoeFhtoV0oO-ekGY3bHnPSGKvEMTH5I6xTy3Ee9DoXRV4VZYu-rj1TXFvl5d4fOjVNaTVCBp0OaD7uFnpdHCV_msSwLZ7g-YnaywZR6nwE1SM4uWz3hv1ZZIh_esTTWkP8XkkJU4CCq7gRx-8XXDaD1co Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0bbface579b84c218df369a9f954851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0bbface579b84c218df369a9f954851d"}]}] Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 9d5b01187a7e4267ac429f59338557f0 Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '31014aee-7a40-49c7-a33b-3d49834e0b51'} Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:37.642951 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:09:37.648624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Returning 404 to user: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:37.649620 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87dce2a5-e585-4868-9222-e26f5b3de288 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 404 len: 111 microversion: 2.1 time: 0.114798 Sep 19 15:09:37.650581 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2455/4867] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:37 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:09:37.662379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c169a4a-e99d-404b-a090-f79706b3147c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '.version_select at 0x7fde2a7e4790>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:37.731751 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c169a4a-e99d-404b-a090-f79706b3147c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339252403" status: 202 len: 0 microversion: 2.1 time: 0.073789 Sep 19 15:09:37.737408 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2413/4868] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 15:09:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339252403 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:09:39.428624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d1636d7-cfe2-4950-bdf5-4699f4f46cde tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: .version_select at 0x7fde2a1f9820>, body: {"keypair": {"name": "tempest-keypair-212355042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeRemMFZcUP/N9UdFfegffzbblN9V/4W1U2E3T0tMdh5+vTZ/40GopsaiCj0sNYJXEHHs+6FT8VtrNWoFRNUe6/2j/nDN0PiYfgq0Niyh73xYXQaLerLu4jfq8qiLHWFA=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:39.506237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4d1636d7-cfe2-4950-bdf5-4699f4f46cde tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for project 0bbface579b84c218df369a9f954851d. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:39.526986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4d1636d7-cfe2-4950-bdf5-4699f4f46cde tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for user 9d5b01187a7e4267ac429f59338557f0 and project 0bbface579b84c218df369a9f954851d. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:39.577858 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d1636d7-cfe2-4950-bdf5-4699f4f46cde tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154701 Sep 19 15:09:39.584919 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2456/4869] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:09:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:44.895859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1857658842", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cec117e-876c-4ad8-bc74-554c5efc12b5"}], "security_groups": [{"name": "tempest-securitygroup--252647465"}], "key_name": "tempest-keypair-212355042", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:45.318052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] validate_networks() for [('0cec117e-876c-4ad8-bc74-554c5efc12b5', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:09:46.728240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:47.337018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:09:47.337940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:09:47.338587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:09:47.339765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:09:47.340595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:09:47.367803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:47.368696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:47.371429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:47.374934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:47.375803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:47.381522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:47.420094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for project 0bbface579b84c218df369a9f954851d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:47.427908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Getting quotas for user 9d5b01187a7e4267ac429f59338557f0 and project 0bbface579b84c218df369a9f954851d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:47.453803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:09:47.456097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:09:47.581177 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-010ad561-1ebc-458b-841a-44a2c7ead3e8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.691675 Sep 19 15:09:47.587463 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2414/4870] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:09:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:09:47.606444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=22 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:47.650703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d48172d9-3223-4d01-96ad-986cdeecd30d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:47.660560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d48172d9-3223-4d01-96ad-986cdeecd30d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:47.787413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d48172d9-3223-4d01-96ad-986cdeecd30d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:47.799352 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d48172d9-3223-4d01-96ad-986cdeecd30d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1237 microversion: 2.1 time: 0.202494 Sep 19 15:09:47.802145 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2457/4871] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:47 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1237 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:48.833980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:48.835622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:48.863946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:48.864987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:48.867062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:48.869518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:48.871582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:48.873042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:49.286779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:49.299970 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4e3e96f-1fb4-46e8-aa37-fcddde61bdc0 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1241 microversion: 2.1 time: 0.477152 Sep 19 15:09:49.338786 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2415/4872] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:48 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1241 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:50.341105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:50.345438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:50.373429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:50.382634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:50.383722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:50.385687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:50.387256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:50.389095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:50.729253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:50.738484 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f298bcd-2a04-4f50-9538-70d51c777d11 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1307 microversion: 2.1 time: 0.401587 Sep 19 15:09:50.743684 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2458/4873] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:50 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:51.771467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:51.772124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:51.793506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:51.794146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:51.794597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:51.795347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:51.795808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:51.796237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:52.091054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:52.103496 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f2b0496-ebcf-4396-a642-fed9f09cead6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1295 microversion: 2.1 time: 0.336074 Sep 19 15:09:52.122489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2416/4874] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:51 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1295 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:53.130145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:53.130964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:53.150298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:53.152425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:53.156895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:53.159410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:53.160975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:53.162508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:53.661907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:53.679881 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d44eb8d-0172-4618-bcbd-a3a6a7b4e366 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 0.551105 Sep 19 15:09:53.682180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2459/4875] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:53 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:54.707821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:54.708737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:54.723904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:54.739297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:54.739871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:54.746123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:54.746396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:54.752072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:55.529315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:55.540883 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b66a549-4089-47cc-b929-cf8dc42a945d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 0.837359 Sep 19 15:09:55.541443 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2417/4876] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:54 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:56.570997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:56.572677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:56.592955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:56.600854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:56.601559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:56.608319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:56.609505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:56.610155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:57.465870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:57.480457 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff982e51-9047-4fac-9309-e9928fbba6f6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 0.915025 Sep 19 15:09:57.489945 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2460/4877] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:56 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:58.047201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:58.054869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:58.519153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:58.520848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:58.529061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:58.532000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:58.532996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:58.533682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:58.534794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:58.535524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:58.536278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:58.867583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c5d9cdc7-8b53-419f-92dd-6c41f4023102 req-921de990-c7fc-4e2a-9daf-9f99211b3c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b9185e-5191-4dc0-b2b7-d48e0748e47b", "tag": "5f091468-f28d-41ec-8bf6-b48ab29992f9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:58.883825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c5d9cdc7-8b53-419f-92dd-6c41f4023102 req-921de990-c7fc-4e2a-9daf-9f99211b3c0a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:58.884596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c5d9cdc7-8b53-419f-92dd-6c41f4023102 req-921de990-c7fc-4e2a-9daf-9f99211b3c0a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:58.884963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c5d9cdc7-8b53-419f-92dd-6c41f4023102 req-921de990-c7fc-4e2a-9daf-9f99211b3c0a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:58.904472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c5d9cdc7-8b53-419f-92dd-6c41f4023102 req-921de990-c7fc-4e2a-9daf-9f99211b3c0a service nova] Creating event network-changed:5f091468-f28d-41ec-8bf6-b48ab29992f9 for instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b on n-h2-858384-1 Sep 19 15:09:58.910460 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c5d9cdc7-8b53-419f-92dd-6c41f4023102 req-921de990-c7fc-4e2a-9daf-9f99211b3c0a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.877350 Sep 19 15:09:58.911501 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2418/4878] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:09:59.077975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:59.088384 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b303eb98-3166-466d-854e-1de29903c3e1 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 0.575092 Sep 19 15:09:59.089057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2461/4879] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:58 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:00.117939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:00.118836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:00.136642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:00.147235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:00.149349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:00.149912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:00.152933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:00.154701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:00.165148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.291337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:01.301791 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-daefc8f5-8861-49a6-b064-4aeef1735b49 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 1.190555 Sep 19 15:10:01.307291 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2419/4880] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:00 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:02.341466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:02.344006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:02.367710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:02.372375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:02.373663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:02.375954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:02.377499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:02.378671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:02.381571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:03.431472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-136177968", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:03.501998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:03.513218 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d83a67b-7da2-4f61-a752-0d43da3d9a1a tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 1.180186 Sep 19 15:10:03.514709 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2462/4881] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:02 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:03.602792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:10:04.546706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:04.550122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:10:04.551066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:04.551691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:10:04.552491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:10:04.553507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:10:04.554106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:10:04.567561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.568778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:04.569437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:04.570437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.571148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:04.571769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:04.602813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.603440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:04.607069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:04.608006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.608577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:04.610838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:04.621594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Getting quotas for project 7ffc03a86e7f47c0811ff86b8c48504a. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:10:04.642294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Getting quotas for user b8c953fb73434ea1ac6945b19d1cacc7 and project 7ffc03a86e7f47c0811ff86b8c48504a. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:10:04.710487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:10:04.713409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:10:04.852188 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-336212b8-01a3-45fb-9cfa-89cb5264876d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431429 Sep 19 15:10:04.862440 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2420/4882] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:10:04.871650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6e3e0fa2-9c08-456f-8f15-dd5c53e4674a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:04.872527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6e3e0fa2-9c08-456f-8f15-dd5c53e4674a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:05.191826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6e3e0fa2-9c08-456f-8f15-dd5c53e4674a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:05.207091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6e3e0fa2-9c08-456f-8f15-dd5c53e4674a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1214 microversion: 2.1 time: 0.342488 Sep 19 15:10:05.208211 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2421/4883] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:04 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1214 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:05.984594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:05.992639 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6ce9c9aa-7b91-4f86-91d8-d3ee42577605 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 1.452294 Sep 19 15:10:05.999482 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2463/4884] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:04 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:06.040589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d39f3a4d-673b-4cf1-81cf-d044d5b0ea25 req-84648c6f-a956-4c15-8c7e-22cde5ce26e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b9185e-5191-4dc0-b2b7-d48e0748e47b", "name": "network-vif-plugged", "status": "completed", "tag": "5f091468-f28d-41ec-8bf6-b48ab29992f9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:06.064084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d39f3a4d-673b-4cf1-81cf-d044d5b0ea25 req-84648c6f-a956-4c15-8c7e-22cde5ce26e5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.064883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d39f3a4d-673b-4cf1-81cf-d044d5b0ea25 req-84648c6f-a956-4c15-8c7e-22cde5ce26e5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.065546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d39f3a4d-673b-4cf1-81cf-d044d5b0ea25 req-84648c6f-a956-4c15-8c7e-22cde5ce26e5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.087108 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d39f3a4d-673b-4cf1-81cf-d044d5b0ea25 req-84648c6f-a956-4c15-8c7e-22cde5ce26e5 service nova] Creating event network-vif-plugged:5f091468-f28d-41ec-8bf6-b48ab29992f9 for instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b on n-h2-858384-1 Sep 19 15:10:06.094172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d39f3a4d-673b-4cf1-81cf-d044d5b0ea25 req-84648c6f-a956-4c15-8c7e-22cde5ce26e5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058399 Sep 19 15:10:06.095476 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2422/4885] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:06.231098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:06.232084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:06.243849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.244441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.249221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.249986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.250684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.251149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.407025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:06.435450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9bc7ab7c-2322-49e3-b298-02737e4fd724 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1266 microversion: 2.1 time: 0.208968 Sep 19 15:10:06.439763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2464/4886] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:06 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:07.026057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:07.029996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:07.062025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.062705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.062979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.064961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.069615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.076270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.464350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:07.465145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:07.481749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.482712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.483367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.484437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.485116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.488813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.579238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:07.622630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8f0dd85d-a121-4e80-b1bc-345f1bb75795 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1362 microversion: 2.1 time: 0.599409 Sep 19 15:10:07.640814 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2423/4887] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:07 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1362 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:07.754474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:07.768923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c62a5926-55d1-4894-b2b4-3aea32aa7bd4 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1272 microversion: 2.1 time: 0.308367 Sep 19 15:10:07.775692 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2465/4888] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:07 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:08.655546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:08.657291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:08.680048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.682112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.684691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.687618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.688323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.690517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.798021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:08.798940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:08.818556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.819557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.821911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.826994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.827874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.828583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.056289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.068102 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-844475d1-81f0-4c0a-a6e5-3ef4fd475ada tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1272 microversion: 2.1 time: 0.275879 Sep 19 15:10:09.070616 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2466/4889] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:08 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:09.303542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.321787 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-633617bd-3138-4045-b7f8-45ce2dda6c85 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1548 microversion: 2.1 time: 0.667041 Sep 19 15:10:09.336054 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2424/4890] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:08 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1548 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:09.349642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:09.350600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:09.364349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.365145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.365784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.370427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.373959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.375142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.656272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-84d05dd3-e22f-4ef4-8339-0e647b1e6878 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312037 Sep 19 15:10:09.656882 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2467/4891] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:10:09 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:10.099947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:10.100676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:10.113987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.113987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.119649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.121252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.121823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.122279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.692937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:10.704433 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee8e98c2-fba7-44d8-82fd-7fdb1b5cf619 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1272 microversion: 2.1 time: 0.613433 Sep 19 15:10:10.705058 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2425/4892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:10 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1272 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:11.733066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:11.733692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:11.745687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:11.749475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:11.749947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:11.750707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:11.751210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:11.751652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.405946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.430631 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e39699e3-0f66-4d82-b02b-c90d821ab70a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.702032 Sep 19 15:10:12.434779 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2468/4893] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:11 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:13.034283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-26530721-f6e1-4f15-bab0-021902a8f388 req-5092e8a4-9789-4fa5-b3d5-9022e96a4487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b9185e-5191-4dc0-b2b7-d48e0748e47b", "tag": "5f091468-f28d-41ec-8bf6-b48ab29992f9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:13.052484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-26530721-f6e1-4f15-bab0-021902a8f388 req-5092e8a4-9789-4fa5-b3d5-9022e96a4487 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.059861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-26530721-f6e1-4f15-bab0-021902a8f388 req-5092e8a4-9789-4fa5-b3d5-9022e96a4487 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.060563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-26530721-f6e1-4f15-bab0-021902a8f388 req-5092e8a4-9789-4fa5-b3d5-9022e96a4487 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.090147 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-26530721-f6e1-4f15-bab0-021902a8f388 req-5092e8a4-9789-4fa5-b3d5-9022e96a4487 service nova] Creating event network-changed:5f091468-f28d-41ec-8bf6-b48ab29992f9 for instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b on n-h2-858384-1 Sep 19 15:10:13.108895 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-26530721-f6e1-4f15-bab0-021902a8f388 req-5092e8a4-9789-4fa5-b3d5-9022e96a4487 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078630 Sep 19 15:10:13.109537 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2426/4894] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:13.454273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:13.456148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:13.468682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.469121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.469572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.470316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.470817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.471266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.914220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:13.949712 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51f22731-4132-4491-bad3-5699a4182f3d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.495595 Sep 19 15:10:13.974966 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2469/4895] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:13 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:14.983542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:14.984550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:14.996643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:15.005095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:15.005756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:15.006224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:15.007028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:15.007503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:15.007941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:15.197723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:15.255453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:15.273881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bad2fa4e-4c5f-4783-8f4b-8e32ace5ebe9 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.296535 Sep 19 15:10:15.275619 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2427/4896] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:14 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:16.303705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:16.304339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:16.320399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.321340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.321968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.324277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.325188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.326787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.468808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c24d0212-4a31-4a45-bf20-f5c5621a6e15 req-73d0e863-fc31-4233-ada1-eda79df01cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bd3e007-3b78-4638-8864-91079c89bf1f", "tag": "b58ce862-f65a-43c3-a988-685ea4ec3f61"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:16.485909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c24d0212-4a31-4a45-bf20-f5c5621a6e15 req-73d0e863-fc31-4233-ada1-eda79df01cbf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.486663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c24d0212-4a31-4a45-bf20-f5c5621a6e15 req-73d0e863-fc31-4233-ada1-eda79df01cbf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.488779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c24d0212-4a31-4a45-bf20-f5c5621a6e15 req-73d0e863-fc31-4233-ada1-eda79df01cbf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.513446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c24d0212-4a31-4a45-bf20-f5c5621a6e15 req-73d0e863-fc31-4233-ada1-eda79df01cbf service nova] Creating event network-changed:b58ce862-f65a-43c3-a988-685ea4ec3f61 for instance 2bd3e007-3b78-4638-8864-91079c89bf1f on n-h1-858384-1 Sep 19 15:10:16.520498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c24d0212-4a31-4a45-bf20-f5c5621a6e15 req-73d0e863-fc31-4233-ada1-eda79df01cbf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055266 Sep 19 15:10:16.521984 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2428/4897] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:16.791092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:16.814203 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b99156de-f35a-4d7b-883a-303ff0375a53 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.505733 Sep 19 15:10:16.814896 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2470/4898] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:16 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:17.839619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:17.840995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:17.855110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:17.855806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:17.856431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:17.857534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:17.858163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:17.858967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:17.865279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=61 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:18.586078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.608948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17c9dfa6-f268-4de9-9edb-d0256ac6f6f6 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.770185 Sep 19 15:10:18.618816 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2429/4899] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:17 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:19.637835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:19.639320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:19.648363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.655929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.656658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.657583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.658201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.658946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.667251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=77 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:20.168149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:20.206676 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac81cbf0-be52-4b11-8fbf-a1866fc0f56a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.574208 Sep 19 15:10:20.217796 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2471/4900] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:19 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:21.243881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:21.245668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:21.259543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.260387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.260995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.261902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.263470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.280596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.933369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:21.941775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff34c594-0877-47da-9e63-74dc562f8b06 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.701946 Sep 19 15:10:21.947164 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2430/4901] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:21 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:22.967401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:22.968058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:22.991826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.995795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.996500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.997877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.998344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.998800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.567856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.581055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b29f34b-634b-4ae4-8d2c-46f2c9a4a91d tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.619168 Sep 19 15:10:23.584440 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2472/4902] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:22 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:24.609823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:24.610440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:24.621974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:24.622479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:24.622955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:24.623675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:24.624134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:24.624565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.336759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:25.360313 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71fe5750-e74b-4aeb-924b-603c5edffced tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.754381 Sep 19 15:10:25.361135 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2431/4903] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:24 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:26.325171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-87aab665-7b7b-468c-8e75-d62b98a8e2ce req-1dafe537-9110-4225-b9a4-10cd2e82f316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd3e007-3b78-4638-8864-91079c89bf1f", "name": "network-vif-plugged", "status": "completed", "tag": "b58ce862-f65a-43c3-a988-685ea4ec3f61"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:26.350718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-87aab665-7b7b-468c-8e75-d62b98a8e2ce req-1dafe537-9110-4225-b9a4-10cd2e82f316 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.351284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-87aab665-7b7b-468c-8e75-d62b98a8e2ce req-1dafe537-9110-4225-b9a4-10cd2e82f316 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.351726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-87aab665-7b7b-468c-8e75-d62b98a8e2ce req-1dafe537-9110-4225-b9a4-10cd2e82f316 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.377543 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-87aab665-7b7b-468c-8e75-d62b98a8e2ce req-1dafe537-9110-4225-b9a4-10cd2e82f316 service nova] Creating event network-vif-plugged:b58ce862-f65a-43c3-a988-685ea4ec3f61 for instance 2bd3e007-3b78-4638-8864-91079c89bf1f on n-h1-858384-1 Sep 19 15:10:26.386039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:26.386664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:26.393711 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-87aab665-7b7b-468c-8e75-d62b98a8e2ce req-1dafe537-9110-4225-b9a4-10cd2e82f316 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070847 Sep 19 15:10:26.394802 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2473/4904] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:26.451348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.451849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.452289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.453006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.453471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.460408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.920913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.936922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-27b1ba23-f0e8-4f6f-a6f9-092ca89dfef8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.552140 Sep 19 15:10:26.937559 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2432/4905] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:26 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:27.965254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:27.966695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:27.973532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.975327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.976060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.985657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.986513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.987238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:28.669746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.680992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e62d395c-5fb6-419c-8e71-0efc540a3e0a tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1314 microversion: 2.1 time: 0.724400 Sep 19 15:10:28.706998 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2474/4906] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:27 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:29.724474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:29.726269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:29.740755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.744244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.745099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.757941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.758828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.759704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.192300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:30.215128 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0eea00c-f830-4013-b202-e20ebeb5ade8 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1464 microversion: 2.1 time: 0.490345 Sep 19 15:10:30.221870 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2433/4907] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:29 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1464 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:30.275123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:30.276314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:30.294000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.294513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.295163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.297209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.298456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.301528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.387667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:10:30.576656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a01a5c5-da03-476a-9ac7-334b11888aa2 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 204 len: 0 microversion: 2.1 time: 0.305990 Sep 19 15:10:30.578804 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2475/4908] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:10:30 2022] DELETE /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:10:30.592334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:30.593326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:30.595250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:30.608469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.608972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.609417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.610131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.610596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.611175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.045461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.056847 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57ed3e85-26c3-4089-b0c1-235c1af0f2e0 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1470 microversion: 2.1 time: 0.471189 Sep 19 15:10:31.072094 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2434/4909] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:30 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:32.083441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:32.084314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:32.098389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.098389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.103342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.104918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.105523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.107006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.666148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:32.677723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-922079ac-af0c-4eb9-aa36-140e17fd267b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1470 microversion: 2.1 time: 0.600219 Sep 19 15:10:32.683578 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2476/4910] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:32 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:33.708848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:33.709662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:33.720159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.723001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.724700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:33.729949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.730697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.732243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.067980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:34.085677 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e6e25256-ecc0-414a-9e9e-4c760b7ab7f5 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1470 microversion: 2.1 time: 0.382340 Sep 19 15:10:34.098925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2435/4911] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:33 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:34.741452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a53ce701-554b-4978-afe2-f6273a3565ed req-bdc94fc0-9ca4-468f-bbc0-5abada685caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd3e007-3b78-4638-8864-91079c89bf1f", "name": "network-vif-deleted", "tag": "b58ce862-f65a-43c3-a988-685ea4ec3f61"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:34.776567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:34.778556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a53ce701-554b-4978-afe2-f6273a3565ed req-bdc94fc0-9ca4-468f-bbc0-5abada685caf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.779078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a53ce701-554b-4978-afe2-f6273a3565ed req-bdc94fc0-9ca4-468f-bbc0-5abada685caf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.779647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a53ce701-554b-4978-afe2-f6273a3565ed req-bdc94fc0-9ca4-468f-bbc0-5abada685caf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.835868 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a53ce701-554b-4978-afe2-f6273a3565ed req-bdc94fc0-9ca4-468f-bbc0-5abada685caf service nova] Creating event network-vif-deleted:b58ce862-f65a-43c3-a988-685ea4ec3f61 for instance 2bd3e007-3b78-4638-8864-91079c89bf1f on n-h1-858384-1 Sep 19 15:10:34.860964 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a53ce701-554b-4978-afe2-f6273a3565ed req-bdc94fc0-9ca4-468f-bbc0-5abada685caf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123052 Sep 19 15:10:34.861477 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2477/4912] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:10:35.154006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:35.154662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:35.189562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.190074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.190529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.220685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.221201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.221659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.299527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.300037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.300670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.301670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lazy-loading 'fault' on Instance uuid 2bd3e007-3b78-4638-8864-91079c89bf1f {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:10:35.475481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c953fb73434ea1ac6945b19d1cacc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffc03a86e7f47c0811ff86b8c48504a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.491518 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11375d54-afea-434a-a870-ae1090af66e3 tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 200 len: 1304 microversion: 2.1 time: 0.354845 Sep 19 15:10:35.495558 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2436/4913] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:35 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 1304 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:36.523257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:36.524065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] [instance: 2bd3e007-3b78-4638-8864-91079c89bf1f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:36.536561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.539792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.540365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.544680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.547826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.548453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.595518 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] HTTP exception thrown: Instance 2bd3e007-3b78-4638-8864-91079c89bf1f could not be found. Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Request method failure captured: Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f HTTP/1.1 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIZHi21lIk1jEb7rvmnIph0ch6vPPU13zm8E0KseMig1vOdnpZ-U6mDQE_N915Qz1ZB5o1sCuqOp5a_rABTjay0pRmKTunwRFxavpWAsXes8Turl7C3URnGrbBRx5rgKZSZZgEFSA9aTAdc5H4O42V-gMs6rAhaJL26qOvG3LtUZ3Wo Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 7ffc03a86e7f47c0811ff86b8c48504a Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesNegativeTest-2059518444 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ffc03a86e7f47c0811ff86b8c48504a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ffc03a86e7f47c0811ff86b8c48504a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ffc03a86e7f47c0811ff86b8c48504a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ffc03a86e7f47c0811ff86b8c48504a"}]}] Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesNegativeTest-2059518444 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 7ffc03a86e7f47c0811ff86b8c48504a Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesNegativeTest-2059518444 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesNegativeTest-2059518444-project Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b8c953fb73434ea1ac6945b19d1cacc7 Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesNegativeTest-2059518444-project Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 2bd3e007-3b78-4638-8864-91079c89bf1f could not be found. Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2bd3e007-3b78-4638-8864-91079c89bf1f'} Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bd3e007-3b78-4638-8864-91079c89bf1f could not be found. Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bd3e007-3b78-4638-8864-91079c89bf1f could not be found. Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:10:36.607201 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bd3e007-3b78-4638-8864-91079c89bf1f could not be found. Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] Returning 404 to user: Instance 2bd3e007-3b78-4638-8864-91079c89bf1f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e5ab2053-73d8-4ca4-956d-6c31d623533b tempest-VolumesNegativeTest-2059518444 tempest-VolumesNegativeTest-2059518444-project] 10.222.0.81 "GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f" status: 404 len: 111 microversion: 2.1 time: 0.090830 Sep 19 15:10:36.612320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2478/4914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:36 2022] GET /compute/v2.1/servers/2bd3e007-3b78-4638-8864-91079c89bf1f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:10:45.388125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:45.405067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:45.406014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:45.435885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.436401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.444935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.450199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.453356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.456793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.483105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=49 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:45.598524 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a5615ce-d305-4b76-b1ad-bb9b4a81c462 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/ips" status: 200 len: 146 microversion: 2.1 time: 0.196800 Sep 19 15:10:45.613120 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2479/4915] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:10:45 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/ips => generated 146 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:46.309696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-93554997", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "c09a60cb-fbe0-476a-8343-6a7d7cdb6737"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:46.445282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] validate_networks() for [('c09a60cb-fbe0-476a-8343-6a7d7cdb6737', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:10:47.883107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:10:47.885244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:10:47.885915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:10:47.886498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:10:47.887257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:10:47.907332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:47.908362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:47.909170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.910245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:47.912281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:47.917873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.972494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Getting quotas for project 8263070ad23e453b878749391d59948e. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:10:47.984962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Getting quotas for user ea55b9af77fc47b99810a4cebc5dd879 and project 8263070ad23e453b878749391d59948e. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:10:48.018381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:10:48.020869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:10:48.145488 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49cea2fe-937d-4cd1-b46a-2842d89ec03c tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.777136 Sep 19 15:10:48.152729 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2437/4916] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:10:48.173199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78446f28-4fa0-47bd-b5d9-621146233eb5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:48.173834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78446f28-4fa0-47bd-b5d9-621146233eb5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:48.400397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78446f28-4fa0-47bd-b5d9-621146233eb5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.419295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78446f28-4fa0-47bd-b5d9-621146233eb5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1215 microversion: 2.1 time: 0.251373 Sep 19 15:10:48.419904 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2480/4917] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:48 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:49.453345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-29b0a6d4-c77b-4e44-bdb0-266d842b3da9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:49.454082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-29b0a6d4-c77b-4e44-bdb0-266d842b3da9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:49.631984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-29b0a6d4-c77b-4e44-bdb0-266d842b3da9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.643434 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-29b0a6d4-c77b-4e44-bdb0-266d842b3da9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1215 microversion: 2.1 time: 0.194094 Sep 19 15:10:49.655481 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2438/4918] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:49 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:49.768978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "891a5563-4d86-446f-87be-13eb4930a964"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:49.782055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:49.814625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.815575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.816424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.817542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.822346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.823118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.826343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:50.691286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:50.699346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:50.725792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.727481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.732183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.746654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.750547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.751168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.957361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:50.966332 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-73cb7fc4-ebe1-456b-9626-f381c8769711 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1267 microversion: 2.1 time: 0.278992 Sep 19 15:10:50.975560 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2439/4919] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:50 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:51.141895 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a84e8e73-8f13-4798-b8c5-b685493d9546 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.376566 Sep 19 15:10:51.149841 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2481/4920] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:10:49 2022] POST /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments => generated 194 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:52.010985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:52.012241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:52.021273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:52.048944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:52.049613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.052139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:52.052764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:52.056311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.422404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.443948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a9c59459-226d-4671-9b20-59ff6c523504 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1273 microversion: 2.1 time: 0.438076 Sep 19 15:10:52.446263 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2440/4921] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:52 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1273 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:53.469999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:53.470716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:53.526406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.527251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.527730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.528512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.528986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.529430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.935670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.946777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-919bddc7-43de-4d42-94eb-45de2c48606b tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1273 microversion: 2.1 time: 0.481045 Sep 19 15:10:53.947988 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2482/4922] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:53 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:54.976084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:54.976716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:54.992178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.992688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.993135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:55.004525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:55.005365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:55.005995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:55.646527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:55.659479 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a13f595c-d5ab-49b9-8ef0-17866ec6c8f5 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.688651 Sep 19 15:10:55.661495 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2441/4923] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:54 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:56.688389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:56.689832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:56.703435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.704137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.706463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.716146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.716876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.717484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.150636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.163079 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74bb6baa-4bc8-44f5-8259-db3dc8f58e66 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.479195 Sep 19 15:10:57.165852 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2483/4924] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:56 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:57.818032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ef274a3b-7ec5-47fb-b724-342dabd8294f req-2e0e9513-2fc1-49bf-bbe4-3282c9bec468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19410059-f472-4cf7-9d68-54849f5797a8", "tag": "c59c5899-3cac-4597-85ae-7f85686d2c22"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:57.842058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ef274a3b-7ec5-47fb-b724-342dabd8294f req-2e0e9513-2fc1-49bf-bbe4-3282c9bec468 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.842557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ef274a3b-7ec5-47fb-b724-342dabd8294f req-2e0e9513-2fc1-49bf-bbe4-3282c9bec468 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.843032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ef274a3b-7ec5-47fb-b724-342dabd8294f req-2e0e9513-2fc1-49bf-bbe4-3282c9bec468 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.883045 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ef274a3b-7ec5-47fb-b724-342dabd8294f req-2e0e9513-2fc1-49bf-bbe4-3282c9bec468 service nova] Creating event network-changed:c59c5899-3cac-4597-85ae-7f85686d2c22 for instance 19410059-f472-4cf7-9d68-54849f5797a8 on n-h1-858384-1 Sep 19 15:10:57.903331 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ef274a3b-7ec5-47fb-b724-342dabd8294f req-2e0e9513-2fc1-49bf-bbe4-3282c9bec468 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088768 Sep 19 15:10:57.906630 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2442/4925] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:58.189679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:58.190988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:58.206543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.209289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.213055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.214143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.224924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.225534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.418574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:58.826612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.836272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca1d662f-bd14-42ea-a61b-741607021c2f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.650609 Sep 19 15:10:58.843967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2484/4926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:58 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:59.867063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:59.869836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:59.874414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:59.875190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:59.901303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.901870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.902322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.907361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.907938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.908404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.121959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.137971 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad406cf2-05d1-4956-a0d1-093b68975bd0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 1.271774 Sep 19 15:11:01.141339 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2443/4927] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:59 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:02.165403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:02.166996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:02.184369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.187157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.188614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.190553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.194709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.195531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:03.141887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:03.160384 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bb16e06a-506e-4ad4-b26f-f7a2a9ae1cf4 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.999471 Sep 19 15:11:03.161633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2485/4928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:02 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:04.189279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:04.189279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:04.208061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:04.210690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:04.211537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:04.215766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:04.216470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:04.217109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:04.741713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:04.750960 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-47f4bc57-4baf-43b4-8fa3-975a2044082f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.566812 Sep 19 15:11:04.782285 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2444/4929] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:04 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:05.793354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:05.795043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:05.815918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=20 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:05.820098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:05.822885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:05.825428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:05.829175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:05.829804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:05.830357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:06.533657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:06.552348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-425d020f-4e8e-4015-9872-e8fa5035edf7 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.764932 Sep 19 15:11:06.565197 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2486/4930] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:05 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:07.579989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:07.581774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:07.603375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:07.603905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:07.604360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:07.605099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:07.605600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:07.615710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:08.083958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:08.101400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a5620e92-ea87-41ec-acb5-76bf66596f55 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.527408 Sep 19 15:11:08.102132 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2445/4931] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:07 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:11:09.126459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:09.127292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:09.137682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:09.138316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:09.140023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:09.141270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:09.142451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:09.143169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:09.547224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:09.573483 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-255e32ca-0505-423d-8bd5-c30e5dc8e94e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.443079 Sep 19 15:11:09.574186 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2487/4932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:09 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:09.970218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-730bd029-2a0f-4b12-a888-a361cdb5382b req-d5b106d5-f94a-4ed5-81be-87db7db8dee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19410059-f472-4cf7-9d68-54849f5797a8", "name": "network-vif-plugged", "status": "completed", "tag": "c59c5899-3cac-4597-85ae-7f85686d2c22"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:10.006768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-730bd029-2a0f-4b12-a888-a361cdb5382b req-d5b106d5-f94a-4ed5-81be-87db7db8dee7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.011633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-730bd029-2a0f-4b12-a888-a361cdb5382b req-d5b106d5-f94a-4ed5-81be-87db7db8dee7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.012258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-730bd029-2a0f-4b12-a888-a361cdb5382b req-d5b106d5-f94a-4ed5-81be-87db7db8dee7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.064239 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-730bd029-2a0f-4b12-a888-a361cdb5382b req-d5b106d5-f94a-4ed5-81be-87db7db8dee7 service nova] Creating event network-vif-plugged:c59c5899-3cac-4597-85ae-7f85686d2c22 for instance 19410059-f472-4cf7-9d68-54849f5797a8 on n-h1-858384-1 Sep 19 15:11:10.085328 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-730bd029-2a0f-4b12-a888-a361cdb5382b req-d5b106d5-f94a-4ed5-81be-87db7db8dee7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116729 Sep 19 15:11:10.088414 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2446/4933] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:10.608200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:10.609825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:10.609979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:10.614034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:10.621904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.622968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.623654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.624739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.625437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.626156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.626274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.626696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.630639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.631450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.631931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.635795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.673543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-44446873-2035-4216-8ac3-3654772c290f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068790 Sep 19 15:11:10.674869 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2447/4934] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:11:10 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:10.689123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:10.693631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:10.708093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.712447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.713059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.715186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:10.716807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:10.717747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:10.809422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-229b30e3-157c-4209-b2b9-a8b05bab069c tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/891a5563-4d86-446f-87be-13eb4930a964" status: 200 len: 194 microversion: 2.1 time: 0.125122 Sep 19 15:11:10.810547 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2448/4935] 10.222.0.81 () {58 vars in 1413 bytes} [Mon Sep 19 15:11:10 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/891a5563-4d86-446f-87be-13eb4930a964 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:11.147217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:11.168700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-360df1fb-1181-41e6-a964-e74dc8df9b2a tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1315 microversion: 2.1 time: 0.569494 Sep 19 15:11:11.175839 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2488/4936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:10 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:12.198068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:12.198860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:12.208729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:12.211796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:12.213734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:12.217384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:12.218012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:12.218568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:12.706107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:12.723065 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7dbdd8dc-3ecb-41d7-9838-918ec2487dbe tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1504 microversion: 2.1 time: 0.525311 Sep 19 15:11:12.725070 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2449/4937] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:12 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:12.748292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:12.749911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:12.768881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:12.770733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:12.771235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:12.771991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:12.777990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:12.778520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:12.834458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:12.836226 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8f5f1844-737d-48ac-a09b-2be9ad8c52d9 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8/os-instance-actions/req-49cea2fe-937d-4cd1-b46a-2842d89ec03c" status: 200 len: 313 microversion: 2.1 time: 0.092781 Sep 19 15:11:12.838392 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2489/4938] 10.222.0.81 () {58 vars in 1419 bytes} [Mon Sep 19 15:11:12 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8/os-instance-actions/req-49cea2fe-937d-4cd1-b46a-2842d89ec03c => generated 313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:12.854251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:12.857164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:12.863443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:12.863946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:12.864801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:12.865780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:12.866404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:12.867619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:12.980915 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c47a6c4-04b5-4d12-8dc2-f1693c6e894f tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "POST /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8/action" status: 202 len: 0 microversion: 2.1 time: 0.130780 Sep 19 15:11:12.986230 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2450/4939] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:11:12 2022] POST /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:11:12.992558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:12.993402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:13.003496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:13.004736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:13.005507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:13.007062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:13.007787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:13.008567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:13.689414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f603e5-5f5d-4ad6-abda-b119f7cb8c3a"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:13.692507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:13.708510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:13.711405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:13.714505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:13.715578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:13.719611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:13.720955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:13.782146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:13.799682 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad1c2709-d501-4a0f-9574-3ccec1fd1ae3 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1506 microversion: 2.1 time: 0.808692 Sep 19 15:11:13.800857 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2490/4940] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:12 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:14.208957 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41a19062-932c-4e2d-b3c3-b872b0c33679 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "POST /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525593 Sep 19 15:11:14.212953 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2451/4941] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:11:13 2022] POST /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:14.843021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:14.846324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:14.866069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:14.866568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:14.872947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:14.874578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:14.875105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:14.877232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:15.584889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:15.632840 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2693bb3-6128-41e1-8425-409f087b69d8 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1511 microversion: 2.1 time: 0.800932 Sep 19 15:11:15.640039 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2491/4942] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:14 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1511 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:16.665845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:16.667969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:16.681836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:16.699972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:16.701490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:16.703346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:16.706567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:16.707934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:16.709266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:16.777694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:17.173843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:17.192585 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5a575f3-ce24-4e3b-9d2f-c714fc7cf0c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1504 microversion: 2.1 time: 0.534764 Sep 19 15:11:17.208563 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2452/4943] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:16 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:17.223953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '.version_select at 0x7fde29ab51f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:17.224774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:17.246265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:17.247218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:17.251529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:17.252752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:17.253596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:17.254239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:17.352551 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfa4df06-8f8c-4cd2-8206-316c086893fa tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.125076 Sep 19 15:11:17.356456 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2492/4944] 10.222.0.81 () {58 vars in 1296 bytes} [Mon Sep 19 15:11:17 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8/os-instance-actions => generated 611 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:17.373288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:17.374566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:17.394389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:17.395679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:17.396239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:17.399018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:17.399603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:17.401177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:17.508364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:11:17.872198 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6da5eff7-b3de-453e-a213-460fd2b6233e tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "DELETE /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 204 len: 0 microversion: 2.1 time: 0.503328 Sep 19 15:11:17.874969 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2453/4945] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:11:17 2022] DELETE /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:11:17.884143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:17.885165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:17.902795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:17.903464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:17.904011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:17.908416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:17.909267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:17.909926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:18.437567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:18.452850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d192b4a-c18c-416e-8204-6df6abf95dd6 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1510 microversion: 2.1 time: 0.574277 Sep 19 15:11:18.453760 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2493/4946] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:17 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:19.479897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:19.481496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:19.505689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:19.507677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:19.508320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:19.510426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:19.511971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:19.513746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:20.511182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:20.524779 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3713c31a-863f-4aba-909f-55b3f8b1fceb tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1510 microversion: 2.1 time: 1.051082 Sep 19 15:11:20.546986 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2454/4947] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:19 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1510 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:21.000477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a9ef39cb-ff42-4adc-a3b2-54f742fbe70d req-0092073d-7bdc-4678-bd0a-8e0c90cec118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19410059-f472-4cf7-9d68-54849f5797a8", "name": "network-vif-deleted", "tag": "c59c5899-3cac-4597-85ae-7f85686d2c22"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:21.050809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9ef39cb-ff42-4adc-a3b2-54f742fbe70d req-0092073d-7bdc-4678-bd0a-8e0c90cec118 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:21.052807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9ef39cb-ff42-4adc-a3b2-54f742fbe70d req-0092073d-7bdc-4678-bd0a-8e0c90cec118 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:21.057365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a9ef39cb-ff42-4adc-a3b2-54f742fbe70d req-0092073d-7bdc-4678-bd0a-8e0c90cec118 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:21.118051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:21.153599 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a9ef39cb-ff42-4adc-a3b2-54f742fbe70d req-0092073d-7bdc-4678-bd0a-8e0c90cec118 service nova] Creating event network-vif-deleted:c59c5899-3cac-4597-85ae-7f85686d2c22 for instance 19410059-f472-4cf7-9d68-54849f5797a8 on n-h1-858384-1 Sep 19 15:11:21.169792 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a9ef39cb-ff42-4adc-a3b2-54f742fbe70d req-0092073d-7bdc-4678-bd0a-8e0c90cec118 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176441 Sep 19 15:11:21.179201 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2494/4948] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:21.555309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:21.556024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:21.575730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:21.587762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:21.594613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:21.599014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:21.603578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:21.609430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:21.756279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:21.760121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:21.763077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:21.772240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lazy-loading 'fault' on Instance uuid 19410059-f472-4cf7-9d68-54849f5797a8 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:11:22.149991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea55b9af77fc47b99810a4cebc5dd879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263070ad23e453b878749391d59948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:22.165950 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4d7172e2-2016-4371-bc27-2819f3066f79 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 200 len: 1305 microversion: 2.1 time: 0.611213 Sep 19 15:11:22.166880 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2455/4949] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:21 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 1305 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:23.204754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:23.205641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] [instance: 19410059-f472-4cf7-9d68-54849f5797a8] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:23.233354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:23.237608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:23.238692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:23.246371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:23.248045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:23.249088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:23.315507 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] HTTP exception thrown: Instance 19410059-f472-4cf7-9d68-54849f5797a8 could not be found. Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Request method failure captured: Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 HTTP/1.1 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIZ1oEB6BKF1sh1K_gVT8cduFNFih46inQHEMsCsp4QAaonUU4inuQpFxPO4bJ3FGDHSa61xlAtrH6EGpsOf1-q46J_3Mr9D6mOQeX2TDxs4w7_mMeNc2c6pwFzSQlGUxULLB8oxmAd6WCD7gMQiuHmrN8CNyuZoBFF_-FZVaKu6b6E Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 8263070ad23e453b878749391d59948e Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-InstanceActionsTestJSON-1770986716 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8263070ad23e453b878749391d59948e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8263070ad23e453b878749391d59948e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8263070ad23e453b878749391d59948e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8263070ad23e453b878749391d59948e"}]}] Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-InstanceActionsTestJSON-1770986716 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 8263070ad23e453b878749391d59948e Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1770986716 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-InstanceActionsTestJSON-1770986716-project Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ea55b9af77fc47b99810a4cebc5dd879 Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-InstanceActionsTestJSON-1770986716-project Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 19410059-f472-4cf7-9d68-54849f5797a8 could not be found. Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '19410059-f472-4cf7-9d68-54849f5797a8'} Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19410059-f472-4cf7-9d68-54849f5797a8 could not be found. Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19410059-f472-4cf7-9d68-54849f5797a8 could not be found. Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:23.324679 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19410059-f472-4cf7-9d68-54849f5797a8 could not be found. Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:11:23.329716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] Returning 404 to user: Instance 19410059-f472-4cf7-9d68-54849f5797a8 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:11:23.331729 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9a85666e-36f4-481c-b541-83b8e903e8c0 tempest-InstanceActionsTestJSON-1770986716 tempest-InstanceActionsTestJSON-1770986716-project] 10.222.0.81 "GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8" status: 404 len: 111 microversion: 2.1 time: 0.142415 Sep 19 15:11:23.333149 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2495/4950] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:23 2022] GET /compute/v2.1/servers/19410059-f472-4cf7-9d68-54849f5797a8 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:11:31.689908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:31.692417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:31.700901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:31.701651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:31.702304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:31.703261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:31.704043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:31.704676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:31.789992 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d5af553e-c845-4f3e-9bb6-3e52676190dc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.104063 Sep 19 15:11:31.791690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2456/4951] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:11:31 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:31.936410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:31.937836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:31.948748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:31.949520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:31.950169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:31.951106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:31.951738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:31.952335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:32.017398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e97a9d7-0f05-4d40-b1ce-04f782f89399 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/891a5563-4d86-446f-87be-13eb4930a964" status: 200 len: 194 microversion: 2.1 time: 0.085006 Sep 19 15:11:32.018867 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2496/4952] 10.222.0.81 () {58 vars in 1413 bytes} [Mon Sep 19 15:11:31 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/891a5563-4d86-446f-87be-13eb4930a964 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:32.031967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:32.033068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:32.043172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:32.043861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:32.044590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:32.045537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:32.046168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:32.046801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:32.192433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lazy-loading 'services' on Instance uuid d5b9185e-5191-4dc0-b2b7-d48e0748e47b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:11:32.352184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e72391c7-ca0a-42f4-8cbc-5ce253d5f70f tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/891a5563-4d86-446f-87be-13eb4930a964" status: 202 len: 0 microversion: 2.1 time: 0.300426 Sep 19 15:11:32.361235 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2457/4953] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:11:32 2022] DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/891a5563-4d86-446f-87be-13eb4930a964 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:11:38.330202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96fc078e-83d3-42f1-95f7-c8b7a2276361 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-38960030", "availability_zone": "foo_zone"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:38.343978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.aggregate [None req-96fc078e-83d3-42f1-95f7-c8b7a2276361 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Generated uuid f2caa410-024a-4821-8aaf-e2ef0820a4db for aggregate {{(pid=128730) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 19 15:11:38.379877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=22 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:38.437909 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96fc078e-83d3-42f1-95f7-c8b7a2276361 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:11:39.451128 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [None req-96fc078e-83d3-42f1-95f7-c8b7a2276361 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 49590. Sep 19 15:11:39.458300 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96fc078e-83d3-42f1-95f7-c8b7a2276361 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 1.444191 Sep 19 15:11:39.459953 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2497/4954] 10.222.0.81 () {60 vars in 1164 bytes} [Mon Sep 19 15:11:38 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:39.490483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4629508d-5dde-4887-81bd-0a690202899d tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:39.562273 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4629508d-5dde-4887-81bd-0a690202899d tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.089915 Sep 19 15:11:39.570530 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2458/4955] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 15:11:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:39.582293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:39.586325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:39.587687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:39.591505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:39.592519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:39.593150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:39.595369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:39.662183 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3d89506-3342-4b0c-b529-b758ff5fb686 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083596 Sep 19 15:11:39.663488 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2498/4956] 10.222.0.81 () {58 vars in 1176 bytes} [Mon Sep 19 15:11:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:39.677900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d299f87-c326-4f78-943f-86e94c10c8a4 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:39.693393 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d299f87-c326-4f78-943f-86e94c10c8a4 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.019462 Sep 19 15:11:39.694274 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2459/4957] 10.222.0.81 () {58 vars in 1143 bytes} [Mon Sep 19 15:11:39 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:39.706390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d392e91-10e2-42ef-a96d-c546205d7a24 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:39.734304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d392e91-10e2-42ef-a96d-c546205d7a24 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:39.735120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d392e91-10e2-42ef-a96d-c546205d7a24 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:39.735770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d392e91-10e2-42ef-a96d-c546205d7a24 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:40.149715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-697913387", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "bb9a7513-6be2-4175-85c2-b0971f8cd0cc"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:40.230923 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d392e91-10e2-42ef-a96d-c546205d7a24 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 0.528260 Sep 19 15:11:40.231848 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2499/4958] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 15:11:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:40.243503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eb3dda7e-cdc7-4b78-87c5-9a86ac08f6f5 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:40.264825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] validate_networks() for [('bb9a7513-6be2-4175-85c2-b0971f8cd0cc', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:11:40.273295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eb3dda7e-cdc7-4b78-87c5-9a86ac08f6f5 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.033553 Sep 19 15:11:40.276297 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2500/4959] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:11:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:40.288786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a80ef536-c313-439e-b8ce-799eaeaaeada tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2137583409", "availability_zone": "foo_zone"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:40.352254 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a80ef536-c313-439e-b8ce-799eaeaaeada tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.068116 Sep 19 15:11:40.353899 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2501/4960] 10.222.0.81 () {60 vars in 1173 bytes} [Mon Sep 19 15:11:40 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:40.377729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d05b637a-588a-446f-83ea-b84d067cb66c tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:40.416591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d05b637a-588a-446f-83ea-b84d067cb66c tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.054754 Sep 19 15:11:40.417211 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2502/4961] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 15:11:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:40.428869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8ec2dcb-d32a-451e-b245-ff0a3aa53c08 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:40.457656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8ec2dcb-d32a-451e-b245-ff0a3aa53c08 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.032754 Sep 19 15:11:40.465389 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2503/4962] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Sep 19 15:11:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:40.486653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c2b5451-3a26-4dc0-a4cf-ba9c5e7e7727 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:40.509443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c2b5451-3a26-4dc0-a4cf-ba9c5e7e7727 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:40.509963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c2b5451-3a26-4dc0-a4cf-ba9c5e7e7727 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:40.510421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c2b5451-3a26-4dc0-a4cf-ba9c5e7e7727 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:40.743399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c2b5451-3a26-4dc0-a4cf-ba9c5e7e7727 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.269327 Sep 19 15:11:40.744233 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2504/4963] 10.222.0.81 () {60 vars in 1194 bytes} [Mon Sep 19 15:11:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:40.756401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-47da9b1d-771e-4be0-9304-b46c0aca6ff7 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:40.799466 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-47da9b1d-771e-4be0-9304-b46c0aca6ff7 tempest-TestAggregatesBasicOps-926212319 tempest-TestAggregatesBasicOps-926212319-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.046936 Sep 19 15:11:40.804862 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2505/4964] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 15:11:40 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 19 15:11:42.257559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:11:42.258093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:11:42.258449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:11:42.259002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:11:42.259428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:11:42.277830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:42.278601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:42.279067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:42.279979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:42.280641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:42.281247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:42.333439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Getting quotas for project fcdcf226f8ec45a1927fd92c581983cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:42.350657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Getting quotas for user 93f5603f7c23426a94324ebeb4ce6db5 and project fcdcf226f8ec45a1927fd92c581983cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:42.376416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:11:42.391490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:11:42.524291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c8b21e4b-0613-491d-aa5c-7f151de6d68b tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508925 Sep 19 15:11:42.526685 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2460/4965] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:11:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:11:42.538412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-64711c19-a010-4c81-86bd-b0d50d0fda6a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:42.539271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-64711c19-a010-4c81-86bd-b0d50d0fda6a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:42.815694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-64711c19-a010-4c81-86bd-b0d50d0fda6a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:42.824487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-64711c19-a010-4c81-86bd-b0d50d0fda6a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1213 microversion: 2.1 time: 0.291441 Sep 19 15:11:42.840731 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2506/4966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:42 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1213 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:43.862999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:43.863647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:43.868010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:43.868684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:43.882822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:43.884110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:43.885954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:43.886705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:43.887670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:43.888335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:43.889093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:43.889749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:43.890607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:43.893414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:43.894293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:43.896935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:43.980493 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6a07a0f-7571-4ae3-b844-d09bd212c2ec tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/00f603e5-5f5d-4ad6-abda-b119f7cb8c3a" status: 200 len: 194 microversion: 2.1 time: 0.121819 Sep 19 15:11:43.986658 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2507/4967] 10.222.0.81 () {58 vars in 1413 bytes} [Mon Sep 19 15:11:43 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/00f603e5-5f5d-4ad6-abda-b119f7cb8c3a => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:11:43.993363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:43.997243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:44.007361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:44.009523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:44.010626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:44.014000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:44.014725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:44.015407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:44.096636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:44.105141 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c87fdefc-6444-4e57-b213-149800e69ade tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1265 microversion: 2.1 time: 0.254269 Sep 19 15:11:44.105734 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2461/4968] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:43 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:44.157506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lazy-loading 'services' on Instance uuid d5b9185e-5191-4dc0-b2b7-d48e0748e47b {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:11:44.287624 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be1aaff6-a76f-4d24-99e5-723a535eefa8 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/00f603e5-5f5d-4ad6-abda-b119f7cb8c3a" status: 202 len: 0 microversion: 2.1 time: 0.298774 Sep 19 15:11:44.309647 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2508/4969] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:11:43 2022] DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments/00f603e5-5f5d-4ad6-abda-b119f7cb8c3a => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:11:45.129660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:45.131204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:45.145492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:45.146362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:45.147057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:45.148024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:45.148715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:45.149995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:46.022285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:46.040815 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6246da30-c07b-4009-b91b-0206040b262a tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1271 microversion: 2.1 time: 0.914362 Sep 19 15:11:46.042165 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2462/4970] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:45 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1271 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:47.067624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:47.068891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:47.089785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:47.093482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:47.094187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:47.095143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:47.096904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:47.099642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:47.418060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:47.429057 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7cef4c8a-a611-41a6-a5ad-a2a2d2c804b4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1271 microversion: 2.1 time: 0.367458 Sep 19 15:11:47.443010 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2509/4971] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:47 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:48.457796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:48.461911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:48.482375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:48.484216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:48.487653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:48.488466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:48.489936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:48.490710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:48.491433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:48.536969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:49.130572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:49.152041 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f73191d8-372f-4a0b-98c7-a3a7744bac1e tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.688935 Sep 19 15:11:49.152941 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2463/4972] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:48 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:50.085230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:50.159822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1716771916", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:50.178023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:50.178844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:50.187588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:50.188095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:50.188539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:50.189264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:50.189714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:50.190145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:50.233199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] validate_networks() for [('52983cbf-985b-48aa-bdd5-dfe3f4749931', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:11:50.433833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:50.443016 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a16f6c1-488d-472e-a985-0f9cb7d3cdd2 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.268999 Sep 19 15:11:50.466099 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2464/4973] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:50 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:51.088862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:11:51.091100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:11:51.092954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:11:51.093676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:11:51.096672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:11:51.132613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:51.133188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:51.133826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:51.145550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:51.146543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:51.147505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:51.236064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:51.257573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for user 8b884b49a6754a59bcb0c088c6eb7831 and project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:51.310988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:11:51.319481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:11:51.472972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-99b7f721-04f9-4a65-9961-0897c880a551 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.395555 Sep 19 15:11:51.480096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:51.481421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:51.494198 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2510/4974] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:11:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:11:51.500158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8df2ca75-819e-44d7-b631-496cec5bac02 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:51.500462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:51.501370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8df2ca75-819e-44d7-b631-496cec5bac02 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:51.504026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:51.504482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:51.505239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:51.505704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:51.506140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:51.665437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8df2ca75-819e-44d7-b631-496cec5bac02 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:51.685805 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8df2ca75-819e-44d7-b631-496cec5bac02 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1222 microversion: 2.1 time: 0.189833 Sep 19 15:11:51.689213 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2511/4975] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:51 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:51.822801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1895335919", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:51.923423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] validate_networks() for [('52983cbf-985b-48aa-bdd5-dfe3f4749931', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:11:52.281741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:52.312561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:52.317767 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-457bf178-a16d-4f4d-9860-26a8336789ba tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.841289 Sep 19 15:11:52.318668 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2465/4976] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:51 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:11:53.349699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:53.358046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:53.363978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:53.392676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.393344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.394069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.394981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.395704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.396515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.473418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:11:53.474014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:11:53.475412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:11:53.475992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:11:53.476658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:11:53.497880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.498528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.500118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.502443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.504508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.505591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.531041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:53.578033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:53.591021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for user 8b884b49a6754a59bcb0c088c6eb7831 and project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:53.616121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:11:53.622201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:11:53.701100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:53.738303 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bacab105-1113-4a12-b06f-283ef825a8c1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.925739 Sep 19 15:11:53.740755 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2512/4977] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:11:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:11:53.748476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:53.753090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:53.774417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.775303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.775763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.776508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.777001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.777408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.862124 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ef1b5dd-aa43-4c83-9bc4-3d02bb78d970 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119982 Sep 19 15:11:53.863049 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2513/4978] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:11:53 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:11:53.903896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f6105ff9-0021-4f70-add6-9d2408d619be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:53.904553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f6105ff9-0021-4f70-add6-9d2408d619be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:53.999243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f6105ff9-0021-4f70-add6-9d2408d619be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:54.008525 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f6105ff9-0021-4f70-add6-9d2408d619be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1222 microversion: 2.1 time: 0.143530 Sep 19 15:11:54.011471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2514/4979] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:53 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:54.084545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:54.088879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:54.103572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.105574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.108479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.110367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.112464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.113270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.123652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:54.139083 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8a48d701-1699-4b78-b9a6-8a1a76866a10 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.801747 Sep 19 15:11:54.147392 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2466/4980] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:53 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:54.217145 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e379628f-c6ea-4c68-bb3c-33f091ee083d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137577 Sep 19 15:11:54.218119 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2515/4981] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:11:54 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:11:54.330960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:54.331475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:54.340188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.343016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.344504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.347055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.349053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.351059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.433297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:11:54.444853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-081ab39f-5a1b-40e4-8fea-05eb621a7434 req-5b965c3d-80a9-4b39-8dfc-09d807677991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004d2746-d85f-42d9-8d5f-e574dd231486", "tag": "91ab90d8-3fa0-4b89-9347-3d19fbf8e681"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:54.464091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-081ab39f-5a1b-40e4-8fea-05eb621a7434 req-5b965c3d-80a9-4b39-8dfc-09d807677991 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.464734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-081ab39f-5a1b-40e4-8fea-05eb621a7434 req-5b965c3d-80a9-4b39-8dfc-09d807677991 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.465303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-081ab39f-5a1b-40e4-8fea-05eb621a7434 req-5b965c3d-80a9-4b39-8dfc-09d807677991 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.485679 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-081ab39f-5a1b-40e4-8fea-05eb621a7434 req-5b965c3d-80a9-4b39-8dfc-09d807677991 service nova] Creating event network-changed:91ab90d8-3fa0-4b89-9347-3d19fbf8e681 for instance 004d2746-d85f-42d9-8d5f-e574dd231486 on n-h1-858384-1 Sep 19 15:11:54.491951 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-081ab39f-5a1b-40e4-8fea-05eb621a7434 req-5b965c3d-80a9-4b39-8dfc-09d807677991 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058017 Sep 19 15:11:54.493087 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2516/4982] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:54.688212 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4310e29d-6abb-4963-9b01-dc5d44e8bb8e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 204 len: 0 microversion: 2.1 time: 0.360820 Sep 19 15:11:54.689428 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2467/4983] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:11:54 2022] DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:11:54.700380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:54.701448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:54.713297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.719041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.719926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.721257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.723219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.725291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:55.048893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:55.050715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:55.070531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:55.071872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:55.073363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:55.074337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:55.075016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:55.075616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:55.406532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:55.424039 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3faed42c-9d6b-4382-b9e9-df0d4f9a5cae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1274 microversion: 2.1 time: 0.391509 Sep 19 15:11:55.427908 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2468/4984] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:55 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1274 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:55.451713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:55.454258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:55.471101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:55.478404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:55.479790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:55.487414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:55.489876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:55.492506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:55.893973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:55.902948 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ddd25fbd-7dc0-4415-abe5-80855cf539ac tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1673 microversion: 2.1 time: 1.207180 Sep 19 15:11:55.916342 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2517/4985] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:54 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1673 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:56.216549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:56.224762 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0fed0bbd-b8cc-455a-9d61-1c64913500b8 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.795238 Sep 19 15:11:56.242204 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2469/4986] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:55 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:56.454207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:56.455230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:56.474503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:56.475512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:56.478078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:56.480032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:56.484443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:56.485241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:56.713066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:56.733019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd4112ad-3c7b-40c2-86cf-01cc78078207 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1280 microversion: 2.1 time: 0.283525 Sep 19 15:11:56.734578 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2518/4987] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:56 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:56.928618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:56.932419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:56.948386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:56.949200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:56.949832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:56.950740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:56.951495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:56.952106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.249699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:57.251115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:57.275709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:57.276754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:57.277565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.284011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:57.284962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:57.285616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.639203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:57.653465 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c35f0efa-d27a-4051-95f1-8491347097b6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1673 microversion: 2.1 time: 0.729068 Sep 19 15:11:57.656016 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2470/4988] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:56 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1673 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:57.757745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:57.758802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:57.768263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:57.770011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:57.770706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.771866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:57.772978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:57.773601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.825887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:57.835188 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-902a571f-2f8d-4b6a-8038-47fe580d2990 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.589436 Sep 19 15:11:57.841445 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2519/4989] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:57 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:57.907348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:57.925199 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2a11ddc-0342-4690-babb-a531ca2ffa13 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1280 microversion: 2.1 time: 0.170850 Sep 19 15:11:57.941328 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2471/4990] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:57 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:58.685276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:58.704232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:58.725836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.729234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.730840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.732092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.732784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.735200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.872298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:58.872920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:58.880316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.881083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.882108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.883766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.884874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.885501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.935907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:58.947300 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67f9077c-5c54-4708-b0ce-51602f0b615e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1606 microversion: 2.1 time: 0.270655 Sep 19 15:11:58.971919 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2520/4991] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:58 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1606 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:58.979811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:58.981269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:58.990447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.992006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.992477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.995419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.996110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.996885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:59.235919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:59.247747 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-af9bc1c1-606f-494a-9174-1943c1107cec tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1280 microversion: 2.1 time: 0.274348 Sep 19 15:11:59.248350 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2521/4992] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:58 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:59.533209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:59.545355 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ac724166-4d0e-4df8-bcd6-89d3572255e4 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 0.678401 Sep 19 15:11:59.552723 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2472/4993] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:58 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:11:59.948679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f3279c36-2a42-4826-9a92-8a04a666b736 req-dccc32d9-85a3-40f1-9081-74e39d6bdb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3273cc40-71ef-4de6-9ab7-cdda49ac1e81", "tag": "6edb0fb6-2ef9-4121-9dcb-7ac1a2dbaa59"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:59.988981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f3279c36-2a42-4826-9a92-8a04a666b736 req-dccc32d9-85a3-40f1-9081-74e39d6bdb6b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:59.989240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:59.989743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:59.990330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f3279c36-2a42-4826-9a92-8a04a666b736 req-dccc32d9-85a3-40f1-9081-74e39d6bdb6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:59.991063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f3279c36-2a42-4826-9a92-8a04a666b736 req-dccc32d9-85a3-40f1-9081-74e39d6bdb6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:00.009120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:00.009626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:00.010071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:00.028102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:00.028102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:00.028102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:00.038398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f3279c36-2a42-4826-9a92-8a04a666b736 req-dccc32d9-85a3-40f1-9081-74e39d6bdb6b service nova] Creating event network-changed:6edb0fb6-2ef9-4121-9dcb-7ac1a2dbaa59 for instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 on n-h2-858384-1 Sep 19 15:12:00.045201 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f3279c36-2a42-4826-9a92-8a04a666b736 req-dccc32d9-85a3-40f1-9081-74e39d6bdb6b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100568 Sep 19 15:12:00.048246 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2522/4994] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:00.273301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:00.274053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:00.285463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:00.299802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:00.300452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:00.301415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:00.302058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:00.302974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:00.358822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:00.369996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eb9f5d0d-1136-4f1b-a94d-f89351e62a58 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1606 microversion: 2.1 time: 0.398054 Sep 19 15:12:00.379537 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2473/4995] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:59 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1606 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:00.576322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:00.577667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:00.592437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:00.592854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:00.593481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:00.594537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:00.595211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:00.595849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.038933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:01.054592 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c486e0b-a588-42bd-b793-81f20afaf5d2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.785555 Sep 19 15:12:01.060715 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2523/4996] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:00 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:01.411492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:01.413260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:01.450418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:01.450975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:01.453984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.454840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:01.455268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:01.466288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.565708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:01.566905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:01.567839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.569061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lazy-loading 'fault' on Instance uuid d5b9185e-5191-4dc0-b2b7-d48e0748e47b {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:12:01.658469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:01.673543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd187015-a6b7-4046-ba24-87b715d41c40 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 1.100194 Sep 19 15:12:01.677742 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2474/4997] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:00 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:01.706401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b01187a7e4267ac429f59338557f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbface579b84c218df369a9f954851d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:01.721397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e2075d36-3bc1-41b5-bc2a-35a3c4930fdc tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 200 len: 1327 microversion: 2.1 time: 0.315170 Sep 19 15:12:01.722632 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2524/4998] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:01 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 1327 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:01.877683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5869a770-5d9a-4b20-bef9-14d996d227eb req-ac2b99f4-2c55-4590-86bf-718a37d6779d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004d2746-d85f-42d9-8d5f-e574dd231486", "name": "network-vif-plugged", "status": "completed", "tag": "91ab90d8-3fa0-4b89-9347-3d19fbf8e681"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:01.893438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5869a770-5d9a-4b20-bef9-14d996d227eb req-ac2b99f4-2c55-4590-86bf-718a37d6779d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:01.893982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5869a770-5d9a-4b20-bef9-14d996d227eb req-ac2b99f4-2c55-4590-86bf-718a37d6779d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:01.894396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5869a770-5d9a-4b20-bef9-14d996d227eb req-ac2b99f4-2c55-4590-86bf-718a37d6779d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.923714 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5869a770-5d9a-4b20-bef9-14d996d227eb req-ac2b99f4-2c55-4590-86bf-718a37d6779d service nova] Creating event network-vif-plugged:91ab90d8-3fa0-4b89-9347-3d19fbf8e681 for instance 004d2746-d85f-42d9-8d5f-e574dd231486 on n-h1-858384-1 Sep 19 15:12:01.936185 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5869a770-5d9a-4b20-bef9-14d996d227eb req-ac2b99f4-2c55-4590-86bf-718a37d6779d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062214 Sep 19 15:12:01.939076 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2475/4999] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:02.087236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:02.087995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:02.098429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.099152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.099597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.107944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.108414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.109033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.187335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-9cd7e516-eceb-424d-9ccb-071baceef12c req-168dafec-b938-4c98-8be2-ec76f3b868cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b9185e-5191-4dc0-b2b7-d48e0748e47b", "name": "network-vif-deleted", "tag": "5f091468-f28d-41ec-8bf6-b48ab29992f9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:02.199316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9cd7e516-eceb-424d-9ccb-071baceef12c req-168dafec-b938-4c98-8be2-ec76f3b868cd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.199860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9cd7e516-eceb-424d-9ccb-071baceef12c req-168dafec-b938-4c98-8be2-ec76f3b868cd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.200295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9cd7e516-eceb-424d-9ccb-071baceef12c req-168dafec-b938-4c98-8be2-ec76f3b868cd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.215601 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-9cd7e516-eceb-424d-9ccb-071baceef12c req-168dafec-b938-4c98-8be2-ec76f3b868cd service nova] Creating event network-vif-deleted:5f091468-f28d-41ec-8bf6-b48ab29992f9 for instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b on n-h2-858384-1 Sep 19 15:12:02.221113 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-9cd7e516-eceb-424d-9ccb-071baceef12c req-168dafec-b938-4c98-8be2-ec76f3b868cd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038661 Sep 19 15:12:02.221981 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2476/5000] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:12:02.392265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:02.407634 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff7f3a04-bee0-4dc9-aff2-db0994d48675 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.324724 Sep 19 15:12:02.423881 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2525/5001] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:02 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:02.704125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:02.704835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:02.717422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.721483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.729122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.730208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.744030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.748069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:02.748873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:02.750489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.763090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.763669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.764124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.764867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.765327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.765771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.799096 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] HTTP exception thrown: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Request method failure captured: Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b HTTP/1.1 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIVWuYvh3fGoD-oiU-MygYpoeFhtoV0oO-ekGY3bHnPSGKvEMTH5I6xTy3Ee9DoXRV4VZYu-rj1TXFvl5d4fOjVNaTVCBp0OaD7uFnpdHCV_msSwLZ7g-YnaywZR6nwE1SM4uWz3hv1ZZIh_esTTWkP8XkkJU4CCq7gRx-8XXDaD1co Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0bbface579b84c218df369a9f954851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0bbface579b84c218df369a9f954851d"}]}] Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 9d5b01187a7e4267ac429f59338557f0 Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd5b9185e-5191-4dc0-b2b7-d48e0748e47b'} Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:02.805543 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:02.810984 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:02.813183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Returning 404 to user: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:02.814376 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-22b2339a-94d6-44a7-83ea-1fc179cabb8d tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 404 len: 111 microversion: 2.1 time: 0.071645 Sep 19 15:12:02.815558 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2526/5002] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:02 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:12:02.826295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ef1233c-3e1b-4191-a40c-236899e1a5b2 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '.version_select at 0x7fde29e35ee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:02.852193 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ef1233c-3e1b-4191-a40c-236899e1a5b2 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212355042" status: 202 len: 0 microversion: 2.1 time: 0.030150 Sep 19 15:12:02.854224 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2527/5003] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 15:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212355042 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:12:03.433850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:03.435442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:03.452372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:03.454337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:03.456992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:03.458070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:03.459469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:03.460149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:03.532040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:04.005218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=18 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:04.133444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:04.142338 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f3d877b-d148-4b7d-bc1d-900551289ded tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1313 microversion: 2.1 time: 1.443221 Sep 19 15:12:04.143078 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2477/5004] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:02 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1313 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:04.300799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-11b2dc0b-a123-4433-a8e9-3fb30eb00842 req-9efbf034-ef0e-43a7-b35b-4f3020b119a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0658e2fe-21a0-4e8a-95ea-13d06e8bf02f", "tag": "4385ae20-1d0f-461e-be03-dde6b1046556"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:04.323053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-11b2dc0b-a123-4433-a8e9-3fb30eb00842 req-9efbf034-ef0e-43a7-b35b-4f3020b119a4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:04.323564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-11b2dc0b-a123-4433-a8e9-3fb30eb00842 req-9efbf034-ef0e-43a7-b35b-4f3020b119a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:04.324061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-11b2dc0b-a123-4433-a8e9-3fb30eb00842 req-9efbf034-ef0e-43a7-b35b-4f3020b119a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:04.337919 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-11b2dc0b-a123-4433-a8e9-3fb30eb00842 req-9efbf034-ef0e-43a7-b35b-4f3020b119a4 service nova] Creating event network-changed:4385ae20-1d0f-461e-be03-dde6b1046556 for instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f on n-h1-858384-1 Sep 19 15:12:04.343734 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-11b2dc0b-a123-4433-a8e9-3fb30eb00842 req-9efbf034-ef0e-43a7-b35b-4f3020b119a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049823 Sep 19 15:12:04.344365 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2478/5005] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:12:04.451961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:04.460877 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-66b3a1a4-d59a-4a3c-910e-55330d38aa6b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 1.031935 Sep 19 15:12:04.462040 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2528/5006] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:03 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:05.168118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:05.169604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:05.207840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:05.208420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:05.208874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:05.234918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:05.235656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:05.236156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:05.487848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:05.489699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:05.502537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:05.508220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:05.509223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:05.511980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:05.512717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:05.513595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:05.755034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:05.772229 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ffb6de8b-9441-408a-8f35-67ca34de05b9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1496 microversion: 2.1 time: 0.610487 Sep 19 15:12:05.773549 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2479/5007] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:05 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1496 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:06.096444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:06.121011 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1477c120-6157-472d-ba31-53959c1293a6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.638261 Sep 19 15:12:06.124690 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2529/5008] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:05 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:07.149540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:07.150454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:07.175559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:07.176154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:07.176614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:07.177372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:07.184156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:07.184634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:07.201733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:07.801501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:07.844399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a024a11d-4e54-4579-be71-26f196474221 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.699064 Sep 19 15:12:07.858898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2480/5009] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:07 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:08.554183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-52027e42-ea7c-4062-b68a-ac337adbed05 req-64ef6179-f77c-48b4-bd43-dfbcf99a4690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3273cc40-71ef-4de6-9ab7-cdda49ac1e81", "name": "network-vif-plugged", "status": "completed", "tag": "6edb0fb6-2ef9-4121-9dcb-7ac1a2dbaa59"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:08.593954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52027e42-ea7c-4062-b68a-ac337adbed05 req-64ef6179-f77c-48b4-bd43-dfbcf99a4690 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:08.594519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52027e42-ea7c-4062-b68a-ac337adbed05 req-64ef6179-f77c-48b4-bd43-dfbcf99a4690 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:08.595088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52027e42-ea7c-4062-b68a-ac337adbed05 req-64ef6179-f77c-48b4-bd43-dfbcf99a4690 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:08.629671 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-52027e42-ea7c-4062-b68a-ac337adbed05 req-64ef6179-f77c-48b4-bd43-dfbcf99a4690 service nova] Creating event network-vif-plugged:6edb0fb6-2ef9-4121-9dcb-7ac1a2dbaa59 for instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 on n-h2-858384-1 Sep 19 15:12:08.653629 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-52027e42-ea7c-4062-b68a-ac337adbed05 req-64ef6179-f77c-48b4-bd43-dfbcf99a4690 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100445 Sep 19 15:12:08.658919 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2530/5010] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:12:08.869613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:08.870349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:08.884424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:08.887697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:08.889862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:08.890857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:08.893113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:08.895146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:09.228157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:09.239942 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fde7e0f3-e20d-4e9c-bd2a-29ce68405c58 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.374618 Sep 19 15:12:09.265457 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2481/5011] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:08 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:10.269992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:10.270895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:10.280486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.282552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.284125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.285330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.286140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.286990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.569464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:10.582641 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-068c4450-5006-4d9f-9e3c-31caf30fb2ad tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.316412 Sep 19 15:12:10.591882 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2531/5012] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:10 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:10.725216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-09bcc106-9586-4fcf-a465-1a785f5b4b95 req-cbae1d2a-8bab-42d5-b098-a252ba66a258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0658e2fe-21a0-4e8a-95ea-13d06e8bf02f", "name": "network-vif-plugged", "status": "completed", "tag": "4385ae20-1d0f-461e-be03-dde6b1046556"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:10.757232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-09bcc106-9586-4fcf-a465-1a785f5b4b95 req-cbae1d2a-8bab-42d5-b098-a252ba66a258 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.757733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-09bcc106-9586-4fcf-a465-1a785f5b4b95 req-cbae1d2a-8bab-42d5-b098-a252ba66a258 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.760959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-09bcc106-9586-4fcf-a465-1a785f5b4b95 req-cbae1d2a-8bab-42d5-b098-a252ba66a258 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.786544 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-09bcc106-9586-4fcf-a465-1a785f5b4b95 req-cbae1d2a-8bab-42d5-b098-a252ba66a258 service nova] Creating event network-vif-plugged:4385ae20-1d0f-461e-be03-dde6b1046556 for instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f on n-h1-858384-1 Sep 19 15:12:10.816124 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-09bcc106-9586-4fcf-a465-1a785f5b4b95 req-cbae1d2a-8bab-42d5-b098-a252ba66a258 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092490 Sep 19 15:12:10.819030 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2482/5013] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:10.821659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:10.822439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:10.832829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.835653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.837135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.840214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.840914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.842707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.911443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:12:11.038395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:11.169988 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a065e032-ba81-4909-a0e0-3053bc164d0c tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 204 len: 0 microversion: 2.1 time: 0.354035 Sep 19 15:12:11.171705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2532/5014] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:12:10 2022] DELETE /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:12:11.182000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:11.182804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:11.195082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:11.196461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:11.196938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:11.197693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:11.198167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:11.200218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:11.423485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:11.437739 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-23c81a30-5d7d-416f-9ab1-27c1fa898b3f tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1502 microversion: 2.1 time: 0.257857 Sep 19 15:12:11.438836 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2483/5015] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:11 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:11.625866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:11.627001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:11.637939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:11.638714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:11.639959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:11.640813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:11.641666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:11.642530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:12.468017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:12.469144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:12.498227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:12.499340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:12.499945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:12.500476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:12.501307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:12.501971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:12.504240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:12.507767 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78899f21-291f-4e6e-a9da-a1fa920d7dcd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1322 microversion: 2.1 time: 0.893132 Sep 19 15:12:12.515484 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2533/5016] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:11 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1322 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:12.826694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:12.836662 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-360e18e0-83a5-4246-acd5-0ca43f3ca8f9 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1502 microversion: 2.1 time: 0.372411 Sep 19 15:12:12.840987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2484/5017] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:12 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:13.542452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:13.543116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:13.558790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:13.559492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:13.560140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:13.561050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:13.561683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:13.563524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:13.867837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:13.869678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:13.896578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:13.898199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:13.900229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:13.903014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:13.908975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:13.911619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.085823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:14.106705 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-702e53f8-d019-402e-a24c-f154dd5b5c11 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1516 microversion: 2.1 time: 0.563691 Sep 19 15:12:14.108787 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2534/5018] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:13 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1516 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:14.153840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:14.158707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:14.174063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.175221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.176168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.177195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.178133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.178728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.208973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f5603f7c23426a94324ebeb4ce6db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdcf226f8ec45a1927fd92c581983cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:14.218202 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c2ce00c-408a-47ba-ad17-279bdf683806 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 200 len: 1460 microversion: 2.1 time: 0.354709 Sep 19 15:12:14.222576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2485/5019] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:13 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 1460 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:14.239417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0afd650a-9cb4-4aa7-9811-02a9a41d04fd req-29313c31-1edd-4c92-9de8-a035e12ca64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004d2746-d85f-42d9-8d5f-e574dd231486", "name": "network-vif-deleted", "tag": "91ab90d8-3fa0-4b89-9347-3d19fbf8e681"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:14.270413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0afd650a-9cb4-4aa7-9811-02a9a41d04fd req-29313c31-1edd-4c92-9de8-a035e12ca64a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.270957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0afd650a-9cb4-4aa7-9811-02a9a41d04fd req-29313c31-1edd-4c92-9de8-a035e12ca64a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.271429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0afd650a-9cb4-4aa7-9811-02a9a41d04fd req-29313c31-1edd-4c92-9de8-a035e12ca64a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.302392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'flavor' on Instance uuid 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:12:14.304651 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0afd650a-9cb4-4aa7-9811-02a9a41d04fd req-29313c31-1edd-4c92-9de8-a035e12ca64a service nova] Creating event network-vif-deleted:91ab90d8-3fa0-4b89-9347-3d19fbf8e681 for instance 004d2746-d85f-42d9-8d5f-e574dd231486 on n-h1-858384-1 Sep 19 15:12:14.331554 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0afd650a-9cb4-4aa7-9811-02a9a41d04fd req-29313c31-1edd-4c92-9de8-a035e12ca64a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095433 Sep 19 15:12:14.332239 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2486/5020] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:14.486887 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-763560af-5922-42db-9527-7485d51ea6ab tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action" status: 200 len: 32 microversion: 2.1 time: 0.345826 Sep 19 15:12:14.488058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2535/5021] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:14 2022] POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action => generated 32 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:12:14.500215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:14.500949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:14.513872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.514308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.515639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.517802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.525728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.526448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.868645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:14.879368 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62efec97-1606-4338-952f-09050017f598 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.383769 Sep 19 15:12:14.880595 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2487/5022] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:14 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:15.253612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:15.254328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] [instance: 004d2746-d85f-42d9-8d5f-e574dd231486] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:15.270870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:15.272038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:15.274436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:15.275341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:15.279290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:15.283583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:15.313949 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] HTTP exception thrown: Instance 004d2746-d85f-42d9-8d5f-e574dd231486 could not be found. Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Request method failure captured: Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 HTTP/1.1 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIakohasu_6FnwTWsvKIjiN_4c2Cza78xBY2psZUNjnWjCnEMY2Em1DIfIYGTSIK1W4gasqjj04_g9Py6-NroANXrBKW7DX9pseTd3ef8B_kUr_Z3wcEQZru_ZsV7EtR26eEXAFy_HZsEzbXDFI0eFZNYUdcKPr18gGNHSGIVTKMV44 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: fcdcf226f8ec45a1927fd92c581983cf Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-VolumesActionsTest-1633774205 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fcdcf226f8ec45a1927fd92c581983cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fcdcf226f8ec45a1927fd92c581983cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fcdcf226f8ec45a1927fd92c581983cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fcdcf226f8ec45a1927fd92c581983cf"}]}] Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-VolumesActionsTest-1633774205 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: fcdcf226f8ec45a1927fd92c581983cf Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-VolumesActionsTest-1633774205 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-VolumesActionsTest-1633774205-project Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 93f5603f7c23426a94324ebeb4ce6db5 Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-VolumesActionsTest-1633774205-project Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 004d2746-d85f-42d9-8d5f-e574dd231486 could not be found. Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '004d2746-d85f-42d9-8d5f-e574dd231486'} Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004d2746-d85f-42d9-8d5f-e574dd231486 could not be found. Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004d2746-d85f-42d9-8d5f-e574dd231486 could not be found. Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:15.316079 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004d2746-d85f-42d9-8d5f-e574dd231486 could not be found. Sep 19 15:12:15.323164 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:15.325737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] Returning 404 to user: Instance 004d2746-d85f-42d9-8d5f-e574dd231486 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:15.326913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6da843e2-e1e4-4bd1-b2d4-3265f6ddc342 tempest-VolumesActionsTest-1633774205 tempest-VolumesActionsTest-1633774205-project] 10.222.0.81 "GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486" status: 404 len: 111 microversion: 2.1 time: 0.078882 Sep 19 15:12:15.328108 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2536/5023] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:15 2022] GET /compute/v2.1/servers/004d2746-d85f-42d9-8d5f-e574dd231486 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:12:15.909600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:15.910298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:15.924481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:15.927145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:15.931029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:15.933209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:15.938364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:15.939396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:16.387947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:16.400542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed20eb1f-a18b-4257-be22-dbcefc9a9ef1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.493387 Sep 19 15:12:16.403714 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2488/5024] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:15 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:17.425957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:17.426829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:17.443657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.444223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.444736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.445676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.446217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.446658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.857925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:17.858652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:17.874233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.874816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.875421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.876176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.876645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.877078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.917091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] HTTP exception thrown: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Request method failure captured: Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b HTTP/1.1 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIVWuYvh3fGoD-oiU-MygYpoeFhtoV0oO-ekGY3bHnPSGKvEMTH5I6xTy3Ee9DoXRV4VZYu-rj1TXFvl5d4fOjVNaTVCBp0OaD7uFnpdHCV_msSwLZ7g-YnaywZR6nwE1SM4uWz3hv1ZZIh_esTTWkP8XkkJU4CCq7gRx-8XXDaD1co Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0bbface579b84c218df369a9f954851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0bbface579b84c218df369a9f954851d"}]}] Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d5b01187a7e4267ac429f59338557f0 Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'd5b9185e-5191-4dc0-b2b7-d48e0748e47b'} Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:17.918926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.923374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Returning 404 to user: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:17.924909 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a050f3d-2a5e-4059-ac89-1f5a6a2d206e tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 404 len: 111 microversion: 2.1 time: 0.069016 Sep 19 15:12:17.925704 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2489/5025] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:12:17 2022] DELETE /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:12:17.935561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:17.936434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: d5b9185e-5191-4dc0-b2b7-d48e0748e47b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:17.945995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.947119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.947583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.948495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.949562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.953947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.975764 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] HTTP exception thrown: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Request method failure captured: Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b HTTP/1.1 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIVWuYvh3fGoD-oiU-MygYpoeFhtoV0oO-ekGY3bHnPSGKvEMTH5I6xTy3Ee9DoXRV4VZYu-rj1TXFvl5d4fOjVNaTVCBp0OaD7uFnpdHCV_msSwLZ7g-YnaywZR6nwE1SM4uWz3hv1ZZIh_esTTWkP8XkkJU4CCq7gRx-8XXDaD1co Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0bbface579b84c218df369a9f954851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0bbface579b84c218df369a9f954851d"}]}] Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d5b01187a7e4267ac429f59338557f0 Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'd5b9185e-5191-4dc0-b2b7-d48e0748e47b'} Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:17.977549 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Returning 404 to user: Instance d5b9185e-5191-4dc0-b2b7-d48e0748e47b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:17.981611 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-246f4e4e-f69d-46f1-a6bc-93276782f2f3 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b" status: 404 len: 111 microversion: 2.1 time: 0.047955 Sep 19 15:12:17.983963 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2490/5026] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:17 2022] GET /compute/v2.1/servers/d5b9185e-5191-4dc0-b2b7-d48e0748e47b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:12:18.096269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:18.108606 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-167dbf52-7585-46a1-85c1-1dd5a0331bd7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.686348 Sep 19 15:12:18.109645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2537/5027] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:17 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:19.134241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:19.134960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:19.150281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:19.151777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:19.152277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:19.152953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:19.153855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:19.154486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:19.155117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:19.818341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:19.833128 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9508ff5e-0351-4ad9-825e-35ecaef342d0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.703277 Sep 19 15:12:19.833709 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2491/5028] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:19 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:20.858937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:20.859700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:20.878805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:20.879317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:20.879767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:20.889082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:20.889082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:20.889350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:21.273246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:21.290508 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-50a639c1-d09e-4a3a-8ed1-42e0eecd4810 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.433894 Sep 19 15:12:21.291412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2538/5029] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:20 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:22.315194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:22.315938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:22.342185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:22.349955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:22.355309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:22.359496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:22.368083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:22.369134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:23.097044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:23.114496 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-937a4619-2d1e-4652-b4bc-ff84d8b6fd5b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.803796 Sep 19 15:12:23.126182 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2492/5030] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:22 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:24.157559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:24.158912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:24.179426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:24.185783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:24.186585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:24.190030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:24.192434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:24.195647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:24.197863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:25.077529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:25.078063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:25.109420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:25.109916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:25.110353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:25.111098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:25.111560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:25.111988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:25.176196 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] HTTP exception thrown: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Request method failure captured: Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 HTTP/1.1 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIVWuYvh3fGoD-oiU-MygYpoeFhtoV0oO-ekGY3bHnPSGKvEMTH5I6xTy3Ee9DoXRV4VZYu-rj1TXFvl5d4fOjVNaTVCBp0OaD7uFnpdHCV_msSwLZ7g-YnaywZR6nwE1SM4uWz3hv1ZZIh_esTTWkP8XkkJU4CCq7gRx-8XXDaD1co Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0bbface579b84c218df369a9f954851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0bbface579b84c218df369a9f954851d"}]}] Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d5b01187a7e4267ac429f59338557f0 Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '31014aee-7a40-49c7-a33b-3d49834e0b51'} Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:25.178088 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.183590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Returning 404 to user: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:25.193235 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5eaa2e61-ae74-46c5-b7f4-dc34f85883c6 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 404 len: 111 microversion: 2.1 time: 0.124503 Sep 19 15:12:25.199699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2493/5031] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:12:25 2022] DELETE /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:12:25.209809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:25.210435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] [instance: 31014aee-7a40-49c7-a33b-3d49834e0b51] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:25.256206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:25.262940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:25.265242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:25.269507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:25.278072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:25.278722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:25.316657 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] HTTP exception thrown: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Request method failure captured: Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 HTTP/1.1 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIVWuYvh3fGoD-oiU-MygYpoeFhtoV0oO-ekGY3bHnPSGKvEMTH5I6xTy3Ee9DoXRV4VZYu-rj1TXFvl5d4fOjVNaTVCBp0OaD7uFnpdHCV_msSwLZ7g-YnaywZR6nwE1SM4uWz3hv1ZZIh_esTTWkP8XkkJU4CCq7gRx-8XXDaD1co Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0bbface579b84c218df369a9f954851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0bbface579b84c218df369a9f954851d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0bbface579b84c218df369a9f954851d"}]}] Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 0bbface579b84c218df369a9f954851d Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-941709279 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 9d5b01187a7e4267ac429f59338557f0 Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeTestJSON-941709279-project Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '31014aee-7a40-49c7-a33b-3d49834e0b51'} Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:25.318502 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. Sep 19 15:12:25.323855 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:12:25.325184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] Returning 404 to user: Instance 31014aee-7a40-49c7-a33b-3d49834e0b51 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:25.336474 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8fb15b53-72c3-457b-ae75-82f0b51d1c94 tempest-AttachVolumeTestJSON-941709279 tempest-AttachVolumeTestJSON-941709279-project] 10.222.0.81 "GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51" status: 404 len: 111 microversion: 2.1 time: 0.135056 Sep 19 15:12:25.339115 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2494/5032] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:25 2022] GET /compute/v2.1/servers/31014aee-7a40-49c7-a33b-3d49834e0b51 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:12:25.553279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:25.603263 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8f26795-c7f9-4483-8432-a6255a8929f5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 1.449821 Sep 19 15:12:25.635868 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2539/5033] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:24 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:26.631034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:26.631816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:26.648866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:26.653589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:26.654328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:26.659778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:26.670964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:26.672021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:27.530489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:27.548627 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-36c16aea-f6bd-4747-a08b-9a86179c034e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.921360 Sep 19 15:12:27.555905 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2495/5034] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:26 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:28.582587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:28.584365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:28.606929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:28.607648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:28.608794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:28.609637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:28.611347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:28.611804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:29.831413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:29.846476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2027aae1-ec79-41fe-932e-ef58c9c30862 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 1.268452 Sep 19 15:12:29.853378 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2540/5035] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:28 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:30.290248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcb70593-7c24-4029-baea-95c2b7f6cdaf tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'create', calling method: .version_select at 0x7fde2aaf43a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-783514481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRyEPqmg0i6+azG3YQ6Z+QBr1nyG7UPm/48aGW7oTqN/dVhrPYwP0VgaRQIuRZVyXltwbLdBYgjrbFU3qXGC+Pm0MxfpQQ+/aYGp/lcLStwoVm4sw3Ul6GLqojJVN8RXw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:30.353568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-dcb70593-7c24-4029-baea-95c2b7f6cdaf tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for project 40a41409c324401883d3dd986a70c628. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:12:30.362716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-dcb70593-7c24-4029-baea-95c2b7f6cdaf tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for user ce59b217d95a4da9b5413ac61907ff98 and project 40a41409c324401883d3dd986a70c628. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:12:30.439933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcb70593-7c24-4029-baea-95c2b7f6cdaf tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.158150 Sep 19 15:12:30.448394 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2496/5036] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:12:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:30.879373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:30.880354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:30.901367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:30.903346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:30.907372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:30.909303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:30.909958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:30.911439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:31.444367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:31.458330 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4a545766-bbd6-481f-a0f8-fcbdb613bef2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.583306 Sep 19 15:12:31.462330 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2541/5037] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:30 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:32.492922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:32.493628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:32.519160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:32.521979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:32.524124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:32.532596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:32.536270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:32.539181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:33.360726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:33.375057 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-591abbad-3ec2-42fd-a02c-131b22f6d1f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.893038 Sep 19 15:12:33.376413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2497/5038] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:32 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:34.410487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:34.411841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:34.432073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:34.439634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:34.444091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:34.447943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:34.450893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:34.452680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:34.819227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-496349811", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "7a888822-abab-4be8-9aee-c2df212e9db4"}], "key_name": "tempest-TestNetworkBasicOps-783514481", "security_groups": [{"name": "tempest-secgroup-smoke-1393784763"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:35.073359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:35.083662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-609058ae-1dd8-466c-ae78-f7bfa137dfdd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.681130 Sep 19 15:12:35.089524 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2542/5039] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:34 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:35.254247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] validate_networks() for [('7a888822-abab-4be8-9aee-c2df212e9db4', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:12:36.120701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:36.121323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:36.122993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:12:36.124059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:12:36.124798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:12:36.125499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:12:36.126116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:12:36.129671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:36.130012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:36.130431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:36.135874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:36.136562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:36.137004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:36.144922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:36.146423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:36.146934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:36.149857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:36.151912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:36.152404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:36.202913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for project 40a41409c324401883d3dd986a70c628. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:12:36.209934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for user ce59b217d95a4da9b5413ac61907ff98 and project 40a41409c324401883d3dd986a70c628. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:12:36.227063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:12:36.229794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:12:36.314896 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37a1a03a-561a-46f1-8fd3-0a68dfe47825 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.499271 Sep 19 15:12:36.322605 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2498/5040] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:12:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:12:36.333248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be98fcb4-a42c-4206-9566-f3a17e73b37e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:36.333893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-be98fcb4-a42c-4206-9566-f3a17e73b37e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:36.446709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-be98fcb4-a42c-4206-9566-f3a17e73b37e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:36.471392 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be98fcb4-a42c-4206-9566-f3a17e73b37e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1247 microversion: 2.1 time: 0.132457 Sep 19 15:12:36.472441 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2499/5041] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:36 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1247 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:36.481418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:36.498229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9d27b176-ba70-45c1-8581-bdae029ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.385764 Sep 19 15:12:36.502323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2543/5042] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:36 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:37.498521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:37.499797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:37.514007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.514973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.515819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.518492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.519814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.520949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.530047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:37.531080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:37.542469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=80 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:37.560256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.561849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.565067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.567098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.569769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.570371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.729918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:37.739410 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-691a1c0c-cce0-48fc-a56f-6c9ee9e9303a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1299 microversion: 2.1 time: 0.245441 Sep 19 15:12:37.741881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2500/5043] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:37 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:37.819061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:37.832815 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b48b7618-fe3c-4e33-9a1d-22bf9e9c7e38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.310387 Sep 19 15:12:37.833591 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2544/5044] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:37 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:38.765580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:38.766823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:38.779351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.781916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.783638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.784824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.787344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.788193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.856617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:38.857396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:38.872571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.873398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.874217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.875247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.875936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.876901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.888186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:38.902099 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ac664dcb-1ab0-4dc5-8e9b-b1dc69f97758 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1305 microversion: 2.1 time: 0.141096 Sep 19 15:12:38.906124 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2501/5045] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:38 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:39.246764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:39.256872 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a0425e0-f8a4-407d-8289-ed9dfce63c38 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.404488 Sep 19 15:12:39.260785 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2545/5046] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:38 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:39.932324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:39.933476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:39.952083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:39.952834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:39.954874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:39.955628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:39.956106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:39.961432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:40.230474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:40.247937 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3afc15c-bda4-42c5-a04a-f7606a4617ce tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 0.315942 Sep 19 15:12:40.250442 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2502/5047] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:39 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:40.284798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:40.285468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:40.302635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:40.311452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:40.311918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:40.312684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:40.313155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:40.313588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:40.712160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:40.731622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a120e968-ee72-4630-b051-77e4573d737f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.451235 Sep 19 15:12:40.734162 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2546/5048] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:40 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:41.001288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c46f5f2b-e4ef-4193-beda-c46d7fac79f9 req-5e0242b0-b935-438c-8fdf-f812df899d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da914771-b5dd-48c7-be9a-66c0936cf508", "tag": "6cf56ee2-dc23-4d47-bc9d-f0578ba79475"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:41.056049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c46f5f2b-e4ef-4193-beda-c46d7fac79f9 req-5e0242b0-b935-438c-8fdf-f812df899d9a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.056794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c46f5f2b-e4ef-4193-beda-c46d7fac79f9 req-5e0242b0-b935-438c-8fdf-f812df899d9a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.057400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c46f5f2b-e4ef-4193-beda-c46d7fac79f9 req-5e0242b0-b935-438c-8fdf-f812df899d9a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.075907 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c46f5f2b-e4ef-4193-beda-c46d7fac79f9 req-5e0242b0-b935-438c-8fdf-f812df899d9a service nova] Creating event network-changed:6cf56ee2-dc23-4d47-bc9d-f0578ba79475 for instance da914771-b5dd-48c7-be9a-66c0936cf508 on n-h2-858384-1 Sep 19 15:12:41.083066 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c46f5f2b-e4ef-4193-beda-c46d7fac79f9 req-5e0242b0-b935-438c-8fdf-f812df899d9a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086953 Sep 19 15:12:41.084216 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2503/5049] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:41.275520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:41.276248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:41.290960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.293063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.293548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.295467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.296187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.296787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.309676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:41.760091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:41.760905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:41.783647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.793905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.795335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.801716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.802492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.803461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:42.547698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:42.562205 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a1859851-f881-4bf2-8be6-8581d42deb2e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 1.290403 Sep 19 15:12:42.563284 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2547/5050] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:41 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:42.593281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:42.602736 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-258d81e3-c004-4b84-84c4-30d9c5ee484e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1522 microversion: 2.1 time: 0.847583 Sep 19 15:12:42.603540 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2504/5051] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:41 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1522 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:43.586740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:43.588948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:43.603351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:43.607423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:43.608227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.613887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:43.614852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:43.618538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.625716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:43.626937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:43.635228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:43.643149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:43.644855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.647100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:43.648481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:43.651354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.954252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:43.965594 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee293977-a17e-4561-b57e-f701fd9235dc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1502 microversion: 2.1 time: 0.343712 Sep 19 15:12:43.968889 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2505/5052] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:43 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:43.995101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:43.996272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:44.013587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.014640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.016196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.019139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.022086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.022628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.027506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:44.036525 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b582878e-ef12-4eb4-aece-ab8d70cbdd85 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 0.454700 Sep 19 15:12:44.051069 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2548/5053] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:43 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:44.622076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:44.637630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d071d404-5530-410b-8f4c-f090f3c4b2cd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1515 microversion: 2.1 time: 0.650542 Sep 19 15:12:44.642544 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2506/5054] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:43 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:44.669878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b611b9a6-6cd6-45de-8929-47b8480ff1fb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:44.673904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b611b9a6-6cd6-45de-8929-47b8480ff1fb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 4abb1c47-5cce-4fed-886b-a91bb929c3d7] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:44.695802 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b611b9a6-6cd6-45de-8929-47b8480ff1fb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Instance 4abb1c47-5cce-4fed-886b-a91bb929c3d7 could not be found. Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b611b9a6-6cd6-45de-8929-47b8480ff1fb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/4abb1c47-5cce-4fed-886b-a91bb929c3d7/action HTTP/1.1 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 14 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: {"rescue": {}} Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4abb1c47-5cce-4fed-886b-a91bb929c3d7 could not be found. Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4abb1c47-5cce-4fed-886b-a91bb929c3d7', 'body': {'rescue': {}}} Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abb1c47-5cce-4fed-886b-a91bb929c3d7 could not be found. Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abb1c47-5cce-4fed-886b-a91bb929c3d7 could not be found. Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:44.711980 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abb1c47-5cce-4fed-886b-a91bb929c3d7 could not be found. Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b611b9a6-6cd6-45de-8929-47b8480ff1fb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 404 to user: Instance 4abb1c47-5cce-4fed-886b-a91bb929c3d7 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b611b9a6-6cd6-45de-8929-47b8480ff1fb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/4abb1c47-5cce-4fed-886b-a91bb929c3d7/action" status: 404 len: 111 microversion: 2.1 time: 0.051896 Sep 19 15:12:44.716459 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2549/5055] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:44 2022] POST /compute/v2.1/servers/4abb1c47-5cce-4fed-886b-a91bb929c3d7/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:12:44.724886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:44.725415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:44.738886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.739393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.739834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.740544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.741000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.743301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.887000 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4572d708-9230-4567-80f0-bf2f72177d3a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action" status: 202 len: 0 microversion: 2.1 time: 0.163433 Sep 19 15:12:44.901032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:44.901032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:44.906502 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2507/5056] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:44 2022] POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:12:44.916074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.918274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.918854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.919672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.921783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.922561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.074972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:45.075713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:45.089301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:45.090242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:45.094388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.097667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:45.098789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:45.099434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.165296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:45.180493 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c258584f-6f5e-430d-a8b8-88ca288c5289 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1520 microversion: 2.1 time: 0.281419 Sep 19 15:12:45.183010 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2550/5057] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:44 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:45.381035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:45.393438 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d3ef162-4282-48f7-8edf-1acd24f9e753 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 0.334371 Sep 19 15:12:45.395411 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2508/5058] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:45 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:46.209552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:46.211532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:46.224629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.225495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.226882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.230379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.231812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.233705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.422911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:46.423544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:46.426632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:46.444348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.451457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.451901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.452686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.453304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.455339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.457727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:46.560285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:46.613067 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-243e95ec-7078-4bb5-8928-d88ceb0fbfae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1500 microversion: 2.1 time: 0.407227 Sep 19 15:12:46.626855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2551/5059] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:46 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1500 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:46.642715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:46.645989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:46.663048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.663643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.668427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.669763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.670276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.670728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.756314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'flavor' on Instance uuid 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:12:46.801014 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Cannot 'rescue' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state paused Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action HTTP/1.1 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 14 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: {"rescue": {}} Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'rescue' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state paused Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '3273cc40-71ef-4de6-9ab7-cdda49ac1e81', 'body': {'rescue': {}}} Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 in vm_state paused. Cannot rescue while the instance is in this state. Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state paused Sep 19 15:12:46.810655 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state paused Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 409 to user: Cannot 'rescue' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state paused {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-622b9562-4bf1-4d84-8e7e-654108b3bb65 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action" status: 409 len: 144 microversion: 2.1 time: 0.176758 Sep 19 15:12:46.819356 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2552/5060] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:46 2022] POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action => generated 144 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:12:46.821172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:46.837182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa2eccff-1507-47cb-b2c6-49cb71cf6c41 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 0.418280 Sep 19 15:12:46.837808 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2509/5061] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:46 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:46.858413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:46.859047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:46.867312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.868197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.868815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.869724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.870356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.871000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.959128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3b11cc8c-4db7-41dd-9f31-502766d71173 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action" status: 202 len: 0 microversion: 2.1 time: 0.138901 Sep 19 15:12:46.960149 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2553/5062] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:46 2022] POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:12:46.969842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:46.970465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:46.980539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.985461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.987512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.988468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.989664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.995973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:47.451329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:47.462254 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1b98e3d7-98eb-420b-a361-846ed5ec913f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1507 microversion: 2.1 time: 0.496840 Sep 19 15:12:47.463479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2510/5063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:46 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:47.868913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:47.869635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:47.877276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:47.877773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:47.878216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:47.878971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:47.879432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:47.879862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.310154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0740c992-b14c-49b3-9bdd-9506b4f73895 req-fc536fdb-b28e-48be-b0c5-9028b849a6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da914771-b5dd-48c7-be9a-66c0936cf508", "name": "network-vif-plugged", "status": "completed", "tag": "6cf56ee2-dc23-4d47-bc9d-f0578ba79475"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:48.348267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0740c992-b14c-49b3-9bdd-9506b4f73895 req-fc536fdb-b28e-48be-b0c5-9028b849a6cf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.349613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0740c992-b14c-49b3-9bdd-9506b4f73895 req-fc536fdb-b28e-48be-b0c5-9028b849a6cf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.352756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0740c992-b14c-49b3-9bdd-9506b4f73895 req-fc536fdb-b28e-48be-b0c5-9028b849a6cf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.372262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:48.388908 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b634bba-639c-4e3d-8435-804a58e86df8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 0.524484 Sep 19 15:12:48.400449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0740c992-b14c-49b3-9bdd-9506b4f73895 req-fc536fdb-b28e-48be-b0c5-9028b849a6cf service nova] Creating event network-vif-plugged:6cf56ee2-dc23-4d47-bc9d-f0578ba79475 for instance da914771-b5dd-48c7-be9a-66c0936cf508 on n-h2-858384-1 Sep 19 15:12:48.405406 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2554/5064] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:47 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:48.420000 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0740c992-b14c-49b3-9bdd-9506b4f73895 req-fc536fdb-b28e-48be-b0c5-9028b849a6cf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116748 Sep 19 15:12:48.429262 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2511/5065] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:48.491411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:48.492671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:48.507919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.508726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.512949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.514048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.514708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.515482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.858888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:48.870586 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5f25199-edcf-4ed7-9c8d-c5c14b69a3e7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1515 microversion: 2.1 time: 0.383192 Sep 19 15:12:48.872485 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2555/5066] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:48 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:49.418880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:49.420477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:49.430932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:49.433623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:49.434494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:49.439124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:49.440139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:49.440902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:49.441547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:49.781070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:49.800734 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3a2f04ec-c238-4590-93a8-541ab3e450ea tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1373 microversion: 2.1 time: 0.379843 Sep 19 15:12:49.807779 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2512/5067] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:49 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1373 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:50.834343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:50.838019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:50.848867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:50.849361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:50.849798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:50.850838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:50.851963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:50.852571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.119341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:51.143556 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd379618-0ca1-45b3-90be-fa5d186598ee tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1545 microversion: 2.1 time: 0.315601 Sep 19 15:12:51.144351 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2556/5068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:50 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1545 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:51.173106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:51.173882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:51.182304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.182829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.183466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.185249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.186018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.186463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.404530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:51.421778 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48db96be-4b46-497d-bded-81bb7d3a3a42 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1545 microversion: 2.1 time: 0.257713 Sep 19 15:12:51.442812 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2513/5069] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:51 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1545 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:51.593380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:51.598142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:51.606525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.607589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.608285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.609443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.610051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.610690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.641027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'flavor' on Instance uuid 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:12:51.792945 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e634004f-8b3e-48c1-9b19-0e95ba804625 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action" status: 200 len: 32 microversion: 2.1 time: 0.202588 Sep 19 15:12:51.802598 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2557/5070] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:51 2022] POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:12:51.805142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:51.805956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:51.831559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.832084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.836409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.843518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.844970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.845630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:52.490819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:52.506473 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e08bf72f-2654-4648-8f24-7262807bb736 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.706613 Sep 19 15:12:52.511770 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2514/5071] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:51 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:53.541390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:53.542291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:53.570674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:53.571613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:53.574235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:53.575438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:53.582854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:53.585073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:53.989563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:54.001078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78917109-8b8f-4000-b280-198b4d38be26 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.464667 Sep 19 15:12:54.016442 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2558/5072] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:53 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:55.039831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:55.041266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:55.069258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:55.073220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:55.077679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:55.080832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:55.082770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:55.085831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:55.405070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:55.421233 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bcfe8d7f-5205-452f-8da1-f54e5af74e32 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.392928 Sep 19 15:12:55.431485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2515/5073] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:55 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:56.450525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:56.451599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:56.456092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=40 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:56.473188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:56.491048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:56.492014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:56.494386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:56.495020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:56.496671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:56.900333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:56.926040 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98f00bb6-c21c-4922-afd3-d74e41546861 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.481925 Sep 19 15:12:56.933608 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2559/5074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:56 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:57.042496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-93ff54ea-c96b-4783-8454-d93793b04aeb req-99e598ff-4cc3-4ed7-81de-918330119bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da914771-b5dd-48c7-be9a-66c0936cf508", "tag": "6cf56ee2-dc23-4d47-bc9d-f0578ba79475"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:57.057125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-93ff54ea-c96b-4783-8454-d93793b04aeb req-99e598ff-4cc3-4ed7-81de-918330119bad service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.059390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-93ff54ea-c96b-4783-8454-d93793b04aeb req-99e598ff-4cc3-4ed7-81de-918330119bad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.060455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-93ff54ea-c96b-4783-8454-d93793b04aeb req-99e598ff-4cc3-4ed7-81de-918330119bad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:57.078115 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-93ff54ea-c96b-4783-8454-d93793b04aeb req-99e598ff-4cc3-4ed7-81de-918330119bad service nova] Creating event network-changed:6cf56ee2-dc23-4d47-bc9d-f0578ba79475 for instance da914771-b5dd-48c7-be9a-66c0936cf508 on n-h2-858384-1 Sep 19 15:12:57.088237 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-93ff54ea-c96b-4783-8454-d93793b04aeb req-99e598ff-4cc3-4ed7-81de-918330119bad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049601 Sep 19 15:12:57.090571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2516/5075] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:57.961569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:57.962922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:57.985147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.987480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.988122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:57.989804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.990492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.991764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:58.426914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:58.441462 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9713f370-0f05-4c44-85bc-f556957b9545 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.483021 Sep 19 15:12:58.455738 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2560/5076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:57 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:59.468575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:59.469408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:59.488471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:59.492613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:59.495395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:59.498479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:59.500030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:59.501724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:59.888829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:59.891419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:59.904840 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bab81410-d2c3-4b60-81cf-0712a26375bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.442331 Sep 19 15:12:59.924312 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2517/5077] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:59 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:00.935106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:00.936340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:00.952045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:00.953120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:00.953806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:00.954776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:00.955445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:00.956464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:01.303595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:01.309329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:01.343785 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c962cd32-7949-457e-8068-4b357e2ce7b5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.414221 Sep 19 15:13:01.345042 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2561/5078] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:00 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:02.374517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:02.375856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:02.396581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:02.397058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:02.397445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:02.399483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:02.404399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:02.408800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:02.676244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:02.688129 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-328a5e00-36b1-4b8e-a973-9fed19737914 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.319866 Sep 19 15:13:02.689012 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2518/5079] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:02 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:03.713236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:03.714523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:03.743764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:03.745079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:03.746502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:03.752097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:03.756936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:03.757786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:03.965111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:03.976995 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b18fd6c4-e8a0-4919-b855-d80a68f2fedb tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.268836 Sep 19 15:13:03.978432 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2562/5080] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:03 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:05.003722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:05.004730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:05.020780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:05.021451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:05.021909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:05.023636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:05.026290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:05.026853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:05.507786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:05.524118 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b895cc14-5668-4319-95d6-d6a8120a7c75 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.525891 Sep 19 15:13:05.525475 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2519/5081] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:04 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:06.555260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:06.556478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:06.571492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:06.572712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:06.573369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.574306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:06.578201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:06.578959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.860933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:06.880573 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-734e6535-795e-4c94-a57c-f8072c445a18 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1501 microversion: 2.1 time: 0.331313 Sep 19 15:13:06.882949 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2563/5082] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:06 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:06.911036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c771f175-40d8-495d-b1bc-3e44e3a660d7"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:06.919227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:06.928301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:06.930182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:06.930860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.932558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:06.933921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:06.934732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.979196 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Cannot 'attach_volume' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state rescued Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/os-volume_attachments HTTP/1.1 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 74 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: {"volumeAttachment": {"volumeId": "c771f175-40d8-495d-b1bc-3e44e3a660d7"}} Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: exception: Cannot 'attach_volume' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state rescued Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': '3273cc40-71ef-4de6-9ab7-cdda49ac1e81', 'body': {'volumeAttachment': {'volumeId': 'c771f175-40d8-495d-b1bc-3e44e3a660d7'}}} Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 15:13:06.984652 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state rescued Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state rescued Sep 19 15:13:06.990161 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:06.993514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 409 to user: Cannot 'attach_volume' instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 while it is in vm_state rescued {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:13:06.994738 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7da24da3-ed20-45d9-a738-b16c8fa6368c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.089679 Sep 19 15:13:06.995863 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2520/5083] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:13:06 2022] POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:13:07.003928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:07.004477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:07.020593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.021104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.021553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.022277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.022829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.023556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.209645 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-352dcf6b-8e18-44b1-a5ca-4b5ee8ea2415 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action" status: 202 len: 0 microversion: 2.1 time: 0.208147 Sep 19 15:13:07.216803 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2564/5084] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:06 2022] POST /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:13:07.228007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:07.228631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:07.249318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.249874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.250332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.258519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.259187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.259653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.840059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:07.856229 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb39ab78-7515-4e89-9427-3b2bc596d03e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1509 microversion: 2.1 time: 0.633319 Sep 19 15:13:07.874849 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2521/5085] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:07 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1509 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:08.891365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:08.895388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:08.917984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:08.918722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:08.919723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:08.920755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:08.923961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:08.924646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:09.392750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:09.420164 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e422e576-1244-475f-aa0c-9d383b7bae2c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1509 microversion: 2.1 time: 0.536628 Sep 19 15:13:09.436204 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2565/5086] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:08 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:10.450795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:10.451592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:10.474741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:10.475362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:10.476445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:10.477359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:10.477842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:10.478295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:10.823295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:10.837089 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03af6082-ba8f-472c-821e-836010891e69 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1515 microversion: 2.1 time: 0.389568 Sep 19 15:13:10.838389 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2522/5087] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:10 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1515 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:13.827106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-570e7487-cf76-47a0-b825-d3be473f150e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'create', calling method: .version_select at 0x7fde2a4c6790>, body: {"keypair": {"name": "tempest-keypair-864254879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOipuC7VDgMRoMzK5bTpxI5whgqQCM2P6KueLCYXOdL73o5GrFRcbbuw9AsCaudBy57jQ0YbGyaYl8wwDLXsUXh9j+q0roEGxazlVWcYdZJAIkbMHvDduhasI2HFU2xPA=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:13.867017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-570e7487-cf76-47a0-b825-d3be473f150e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:13.877838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-570e7487-cf76-47a0-b825-d3be473f150e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for user 8b884b49a6754a59bcb0c088c6eb7831 and project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:13.932588 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-570e7487-cf76-47a0-b825-d3be473f150e tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110487 Sep 19 15:13:13.936759 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2566/5088] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:13:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:15.618179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:15.620593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:15.641112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:15.641749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:15.642299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:15.643153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:15.643807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:15.644341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:15.734898 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d12bbfa0-9c53-4579-b9c0-8bf68d9373be tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508/action" status: 200 len: 24567 microversion: 2.1 time: 0.120874 Sep 19 15:13:15.735956 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2523/5089] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:15 2022] POST /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508/action => generated 24567 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:13:16.453525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-439154902", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52983cbf-985b-48aa-bdd5-dfe3f4749931"}], "security_groups": [{"name": "tempest-securitygroup--1705292405"}], "key_name": "tempest-keypair-864254879", "user_data": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:16.678147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] validate_networks() for [('52983cbf-985b-48aa-bdd5-dfe3f4749931', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:13:16.822791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-925956612", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "213af5fb-c49c-4229-b0c3-846ff9cae6b9"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:16.916173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] validate_networks() for [('213af5fb-c49c-4229-b0c3-846ff9cae6b9', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:13:17.520316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:13:17.520899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:13:17.523786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:13:17.524426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:13:17.524852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:13:17.541097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.544021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.544734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.547070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.549295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.550134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.628849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:17.643014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Getting quotas for user 8b884b49a6754a59bcb0c088c6eb7831 and project 86f2b868ef9340d786ce5054b0fdf8c4. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:17.675375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:13:17.678431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:13:17.760226 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b7e5934d-691f-4376-841e-3c7c6d984148 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.312132 Sep 19 15:13:17.762340 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2567/5090] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:13:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:13:17.777051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-df7ceb1f-ff1a-459d-b24e-d8eb70cf9ee9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:17.778074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-df7ceb1f-ff1a-459d-b24e-d8eb70cf9ee9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:17.903008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-df7ceb1f-ff1a-459d-b24e-d8eb70cf9ee9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:17.915124 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-df7ceb1f-ff1a-459d-b24e-d8eb70cf9ee9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1244 microversion: 2.1 time: 0.144135 Sep 19 15:13:17.928550 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2568/5091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:17 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1244 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:17.933448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:13:17.934850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:13:17.935731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:13:17.936633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:13:17.937286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:13:17.952262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.953077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.954239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.955705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.956404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.957666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.987716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Getting quotas for project c2181449444843e7a0407f99d96f533b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:18.005263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Getting quotas for user 6066687d0a764b08a77eba51db29cc30 and project c2181449444843e7a0407f99d96f533b. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:18.039573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:13:18.044318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:13:18.152030 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-92f67a9c-f1c0-4469-88a5-fd09c1eff214 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557136 Sep 19 15:13:18.156195 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2524/5092] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:13:18.168366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16e9eeff-456f-43f3-be78-49eb3eb85f8f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:18.168912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-16e9eeff-456f-43f3-be78-49eb3eb85f8f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:18.268040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-16e9eeff-456f-43f3-be78-49eb3eb85f8f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:18.302183 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-16e9eeff-456f-43f3-be78-49eb3eb85f8f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1214 microversion: 2.1 time: 0.135383 Sep 19 15:13:18.305888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2569/5093] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:18 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:18.943711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:18.946184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:18.955845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.956888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.957687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:18.959021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.960091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.960877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.109874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:19.127320 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2dfdb19b-4d87-4647-9dbf-6f31c11255f7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1296 microversion: 2.1 time: 0.189390 Sep 19 15:13:19.129198 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2525/5094] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:18 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:19.336288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:19.337498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:19.367406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.369196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.370374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.371209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.373615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.374255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.506308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:19.521104 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d3b81dd-2ae9-4e6d-8b8f-3476ceb58ca6 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1210 microversion: 2.1 time: 0.190125 Sep 19 15:13:19.524064 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2570/5095] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:19 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:20.157716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:20.158628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:20.160672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:20.174991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:20.176832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:20.180130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:20.180978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:20.185587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:20.186306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:20.343217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:20.356368 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b9ab2de6-935b-4ad8-905d-1ba21085b24b tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1302 microversion: 2.1 time: 0.203446 Sep 19 15:13:20.358518 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2526/5096] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:20 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1302 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:20.550093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:20.551127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:20.567370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:20.568451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:20.571590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:20.572986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:20.574877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:20.575486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:20.719974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:20.731616 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-05190a21-e6d0-4e31-82bc-2576c1c06759 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1272 microversion: 2.1 time: 0.185392 Sep 19 15:13:20.732993 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2571/5097] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:20 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:21.381724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:21.382461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:21.389134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.389638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.390086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.401923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.402785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.403262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.758353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:21.758987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:21.760031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:21.772810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.773513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.773959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.774677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.775167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.775599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.790417 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f181ae29-61d8-4f0c-bf23-f24a9f33c0a5 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.412720 Sep 19 15:13:21.791258 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2527/5098] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:21 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:22.113959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:22.134330 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-135f569c-44f2-4c88-a1ab-782b26e86b61 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1314 microversion: 2.1 time: 0.381327 Sep 19 15:13:22.134969 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2572/5099] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:21 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:22.786142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5d3b778a-20cb-41d4-8f36-3d70bc69f01a req-33a93f3f-05cb-4806-8033-f87790dd2db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a32b0f6-c883-41e7-a202-54ca5ba0ff26", "tag": "d9d9a925-18c0-498f-8d36-facfee11d124"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:22.815410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d3b778a-20cb-41d4-8f36-3d70bc69f01a req-33a93f3f-05cb-4806-8033-f87790dd2db6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.816821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d3b778a-20cb-41d4-8f36-3d70bc69f01a req-33a93f3f-05cb-4806-8033-f87790dd2db6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.817971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d3b778a-20cb-41d4-8f36-3d70bc69f01a req-33a93f3f-05cb-4806-8033-f87790dd2db6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.821244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:22.822638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:22.835577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.839536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.850333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5d3b778a-20cb-41d4-8f36-3d70bc69f01a req-33a93f3f-05cb-4806-8033-f87790dd2db6 service nova] Creating event network-changed:d9d9a925-18c0-498f-8d36-facfee11d124 for instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 on n-h1-858384-1 Sep 19 15:13:22.851846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.852931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.854403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.855153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.865024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5d3b778a-20cb-41d4-8f36-3d70bc69f01a req-33a93f3f-05cb-4806-8033-f87790dd2db6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082321 Sep 19 15:13:22.865713 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2528/5100] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:23.158363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:23.159395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:23.175453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.177387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.178016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.179796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.182598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.183321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.564855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:23.575653 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-329d5718-6b94-445c-a05e-0b9b1626ab5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1314 microversion: 2.1 time: 0.421536 Sep 19 15:13:23.590833 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2529/5101] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:23 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:23.598439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-19d603b4-2c12-49bd-a4e5-47ed12524d1e req-5894784c-df50-4251-b40e-9d7227bdef77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16784b0e-0c4b-48bd-a676-13ebf792f804", "tag": "6c45f4b6-03a5-4ec4-9d90-59a5d2f72786"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:23.620065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19d603b4-2c12-49bd-a4e5-47ed12524d1e req-5894784c-df50-4251-b40e-9d7227bdef77 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.620555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19d603b4-2c12-49bd-a4e5-47ed12524d1e req-5894784c-df50-4251-b40e-9d7227bdef77 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.620985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19d603b4-2c12-49bd-a4e5-47ed12524d1e req-5894784c-df50-4251-b40e-9d7227bdef77 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.634516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-19d603b4-2c12-49bd-a4e5-47ed12524d1e req-5894784c-df50-4251-b40e-9d7227bdef77 service nova] Creating event network-changed:6c45f4b6-03a5-4ec4-9d90-59a5d2f72786 for instance 16784b0e-0c4b-48bd-a676-13ebf792f804 on n-h1-858384-1 Sep 19 15:13:23.640473 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-19d603b4-2c12-49bd-a4e5-47ed12524d1e req-5894784c-df50-4251-b40e-9d7227bdef77 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056343 Sep 19 15:13:23.641692 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2530/5102] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:23.783786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:23.793409 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68b1e405-3fc2-4e9b-8fb2-f5f2b56a6f19 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.977796 Sep 19 15:13:23.809735 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2573/5103] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:22 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:24.607608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:24.608303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:24.621945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.622478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.623143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.626650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.627460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.628060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.818285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:24.818661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:24.830661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.835388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.835849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.836600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.837069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.837502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:25.088699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:25.104349 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bf96c9e1-da71-45c7-9d17-9393a9ca8c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1314 microversion: 2.1 time: 0.501888 Sep 19 15:13:25.104957 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2531/5104] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:24 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:25.590881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:25.599801 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0ffd56a9-1117-49c8-86db-229f39b7caed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.786299 Sep 19 15:13:25.600556 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2574/5105] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:24 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:26.130628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:26.132468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:26.141941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.142567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.143153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.144237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.144817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.145357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.413706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:26.422934 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a20faa4-677d-4b07-96e3-13667155df31 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1314 microversion: 2.1 time: 0.297818 Sep 19 15:13:26.424132 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2532/5106] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:26 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:26.623838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:26.624419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:26.636013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:26.641853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.642787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.644147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.645132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.645818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.646480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.918251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:26.928049 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cad1e43e-c4b4-47e1-84d1-c7087178a1d6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.308882 Sep 19 15:13:26.932415 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2575/5107] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:26 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:27.447619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:27.449530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:27.458591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.459367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.460878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.462051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.462533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.463182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.656548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:27.670097 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-faefd0fc-7a9b-4596-9119-bc1db4108361 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1314 microversion: 2.1 time: 0.228369 Sep 19 15:13:27.682771 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2533/5108] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:27 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:27.958651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:27.959382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:27.967976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:27.977411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.977928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.981265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.982027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.983674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.985651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.239668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:28.252268 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcc9e555-e151-47c3-aae5-29c5d28bd79f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.299941 Sep 19 15:13:28.259978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2576/5109] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:27 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:28.464666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-edf89b2f-3d5f-4ad4-8171-5d80437fabea req-96faf27c-f77e-4e35-8010-7e49d216cc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a32b0f6-c883-41e7-a202-54ca5ba0ff26", "name": "network-vif-plugged", "status": "completed", "tag": "d9d9a925-18c0-498f-8d36-facfee11d124"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:28.470182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:28.473447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:28.501488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-edf89b2f-3d5f-4ad4-8171-5d80437fabea req-96faf27c-f77e-4e35-8010-7e49d216cc25 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.510180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-edf89b2f-3d5f-4ad4-8171-5d80437fabea req-96faf27c-f77e-4e35-8010-7e49d216cc25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.511139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-edf89b2f-3d5f-4ad4-8171-5d80437fabea req-96faf27c-f77e-4e35-8010-7e49d216cc25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.550679 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-edf89b2f-3d5f-4ad4-8171-5d80437fabea req-96faf27c-f77e-4e35-8010-7e49d216cc25 service nova] Creating event network-vif-plugged:d9d9a925-18c0-498f-8d36-facfee11d124 for instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 on n-h1-858384-1 Sep 19 15:13:28.560553 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-edf89b2f-3d5f-4ad4-8171-5d80437fabea req-96faf27c-f77e-4e35-8010-7e49d216cc25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100862 Sep 19 15:13:28.567189 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2534/5110] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:28.699482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:28.700336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:28.702937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:28.715168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.715706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.716154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.716894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.717395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.722660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.066895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:29.077272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-409e2be5-a54a-4d05-b397-b2a1c235ad15 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1314 microversion: 2.1 time: 0.387238 Sep 19 15:13:29.078505 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2577/5111] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:28 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:29.278599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:29.279894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:29.286521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.287063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.287540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.289348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.290167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.291601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.536691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:29.546957 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83653bb7-b728-4f8e-9dd2-91d49022ebae tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.272384 Sep 19 15:13:29.548075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2535/5112] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:29 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:30.052046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e5572a5-d18e-41fc-9056-1481fca1c2d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'create', calling method: .version_select at 0x7fde29863f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1798414268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgcYF7XX03N/H92X3VgZNdkia1mmZJ15D++m4AeYk4BULlrVmKNDUTuSLrpaZKmHeDB4/4Dpvyt9C7qkRQSzmk3wNFGOIdgM3aypDs51P1pdzSzmptKqWBjQXOIkG6GFg=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:30.089206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-9e5572a5-d18e-41fc-9056-1481fca1c2d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for project 40a41409c324401883d3dd986a70c628. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:30.108535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-9e5572a5-d18e-41fc-9056-1481fca1c2d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for user ce59b217d95a4da9b5413ac61907ff98 and project 40a41409c324401883d3dd986a70c628. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:30.111765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:30.113711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:30.124092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.125753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.126368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.127293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.128531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.129161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.174532 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e5572a5-d18e-41fc-9056-1481fca1c2d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.124450 Sep 19 15:13:30.177456 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2578/5113] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:13:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:30.441036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:30.455152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d7c27719-5e1e-4532-851d-69dff97ba006 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1501 microversion: 2.1 time: 0.347810 Sep 19 15:13:30.455152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2536/5114] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:30 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:30.492072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:30.492987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:30.501554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.502567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.503638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.504782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.505178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.505606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.575173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:30.575899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:30.590816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.595242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.595242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.596403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.597002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.597654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.977480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:30.980378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:30.980656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:30.989100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-07fdb8aa-740d-4b2e-9c53-3c258fe761c9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.420478 Sep 19 15:13:30.990117 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2537/5115] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:30 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:30.995485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea055426-e6e1-4f49-a8b8-5eab10dca117 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1501 microversion: 2.1 time: 0.514785 Sep 19 15:13:30.996890 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2579/5116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:30 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:31.013244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-75fa56c0-30a9-45d7-9ac0-b698457abad0 req-c34170a2-4cda-475e-8cbd-e5d1e5783008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16784b0e-0c4b-48bd-a676-13ebf792f804", "name": "network-vif-plugged", "status": "completed", "tag": "6c45f4b6-03a5-4ec4-9d90-59a5d2f72786"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:31.028707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-75fa56c0-30a9-45d7-9ac0-b698457abad0 req-c34170a2-4cda-475e-8cbd-e5d1e5783008 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.029965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-75fa56c0-30a9-45d7-9ac0-b698457abad0 req-c34170a2-4cda-475e-8cbd-e5d1e5783008 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.030592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-75fa56c0-30a9-45d7-9ac0-b698457abad0 req-c34170a2-4cda-475e-8cbd-e5d1e5783008 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.040408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:31.041120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:31.053762 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-75fa56c0-30a9-45d7-9ac0-b698457abad0 req-c34170a2-4cda-475e-8cbd-e5d1e5783008 service nova] Creating event network-vif-plugged:6c45f4b6-03a5-4ec4-9d90-59a5d2f72786 for instance 16784b0e-0c4b-48bd-a676-13ebf792f804 on n-h1-858384-1 Sep 19 15:13:31.061485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.062045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.062502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.062907 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-75fa56c0-30a9-45d7-9ac0-b698457abad0 req-c34170a2-4cda-475e-8cbd-e5d1e5783008 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052995 Sep 19 15:13:31.064041 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2538/5117] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:31.067482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.068440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.070061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.141074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lazy-loading 'flavor' on Instance uuid 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:31.220957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:31.257329 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c5236c2-4f1e-4799-873f-17a82d9aab2b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action" status: 202 len: 0 microversion: 2.1 time: 0.237966 Sep 19 15:13:31.258777 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2580/5118] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:31 2022] POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:13:31.286907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:31.290409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:31.301301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.305050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.305999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.307310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.308845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.310910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.528582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:31.549146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2ff02c4d-8646-4233-b733-b59309cb7ff7 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1509 microversion: 2.1 time: 0.280590 Sep 19 15:13:31.549928 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2539/5119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:31 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:32.019089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:32.020457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:32.029297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.030136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.030871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.031673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.032481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.033462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.322073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:32.341880 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8c891d4-0b3e-4d16-a830-718ab4859321 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1370 microversion: 2.1 time: 0.331822 Sep 19 15:13:32.374732 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2581/5120] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:32 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1370 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:32.488560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-282927969", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e6a8f1ca-ec62-48fd-8c0f-869dd1390a24"}], "key_name": "tempest-TestNetworkBasicOps-1798414268", "security_groups": [{"name": "tempest-secgroup-smoke-1998360946"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:32.581945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:32.587316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:32.610658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.611404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.611920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.613629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.614117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.614673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.713636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] validate_networks() for [('e6a8f1ca-ec62-48fd-8c0f-869dd1390a24', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:13:32.874481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:32.887826 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7db04dbc-008e-4a79-bc25-6b1001ceb32b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1492 microversion: 2.1 time: 0.317753 Sep 19 15:13:32.888420 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2582/5121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:32 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1492 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:32.914284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:32.915635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:32.923499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.924357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.925369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.926358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.927140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.929223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.055338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5405e894-602a-4761-b016-98d26310fe34 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action" status: 202 len: 0 microversion: 2.1 time: 0.147080 Sep 19 15:13:33.060125 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2583/5122] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:32 2022] POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:13:33.066617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:33.067627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:33.078148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.079291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.080892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.082160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.083391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.083992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.493093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:33.506458 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3fb3d876-d35e-4df8-ad0b-c2af1edcf974 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1498 microversion: 2.1 time: 0.443866 Sep 19 15:13:33.508260 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2584/5123] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:33 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1498 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:33.539085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:33.539711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:33.547724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.548215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.548924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.549636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.550091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.550511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.599896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:13:33.606987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:13:33.607917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:13:33.608539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:13:33.609605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:13:33.631731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.632913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.633434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.634553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.635143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.635758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.682407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for project 40a41409c324401883d3dd986a70c628. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:33.690991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for user ce59b217d95a4da9b5413ac61907ff98 and project 40a41409c324401883d3dd986a70c628. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:33.706413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:13:33.709416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:13:33.794688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:33.804779 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43b1bdf4-261a-4218-8a1b-87ab8b81017f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1564 microversion: 2.1 time: 0.283530 Sep 19 15:13:33.806407 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2585/5124] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:33 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1564 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:33.819984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-392f1a58-2ad6-48f1-809c-bd594d6e1fd5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.337340 Sep 19 15:13:33.834161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:33.834161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:33.835683 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2540/5125] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:13:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:13:33.840871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1fb209e0-4927-477a-8998-5cbaa74f440e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:33.842088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.842701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.843284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.844167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.844803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.845419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.846661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1fb209e0-4927-477a-8998-5cbaa74f440e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:33.923420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1fb209e0-4927-477a-8998-5cbaa74f440e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:33.936221 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1fb209e0-4927-477a-8998-5cbaa74f440e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1248 microversion: 2.1 time: 0.095897 Sep 19 15:13:33.947968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2541/5126] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:33 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1248 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:34.059803 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38665fcd-54b2-47dd-9e7e-b7f32677d7bd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232578 Sep 19 15:13:34.060004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2586/5127] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:13:33 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:13:34.542736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:34.545380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:34.555340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.556031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.556438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.557170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.558398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.559889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.888950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:34.908098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-883669f0-7f78-43d0-bc8b-ddd94bde0e2a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1498 microversion: 2.1 time: 0.370163 Sep 19 15:13:34.910348 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2542/5128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:34 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:34.966472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:34.967132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:34.981703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.983329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.984051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.985065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.986032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.986639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:35.079126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:35.097015 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc4cc3af-979c-4657-af2b-56c7c934812c tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1300 microversion: 2.1 time: 0.134491 Sep 19 15:13:35.098683 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2587/5129] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:34 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:35.934602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:35.935404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:35.950975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:35.952609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:35.953148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:35.953979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:35.954539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:35.955141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.123804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:36.125317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:36.133347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.134155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.134786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.135677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.136304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.136894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.477350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:36.495051 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7aad09d3-d9d2-4c02-9dc2-36e19deaf6f4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1306 microversion: 2.1 time: 0.374657 Sep 19 15:13:36.496350 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2588/5130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:36 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1306 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:36.517169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-487fc51b-a5cc-42c8-b0a4-405f3739bbb6 req-e2f3c809-6cb6-45b0-9e93-00cb183002f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16784b0e-0c4b-48bd-a676-13ebf792f804", "tag": "6c45f4b6-03a5-4ec4-9d90-59a5d2f72786"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:36.532624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-487fc51b-a5cc-42c8-b0a4-405f3739bbb6 req-e2f3c809-6cb6-45b0-9e93-00cb183002f5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.538693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-487fc51b-a5cc-42c8-b0a4-405f3739bbb6 req-e2f3c809-6cb6-45b0-9e93-00cb183002f5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.539553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-487fc51b-a5cc-42c8-b0a4-405f3739bbb6 req-e2f3c809-6cb6-45b0-9e93-00cb183002f5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.555101 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-487fc51b-a5cc-42c8-b0a4-405f3739bbb6 req-e2f3c809-6cb6-45b0-9e93-00cb183002f5 service nova] Creating event network-changed:6c45f4b6-03a5-4ec4-9d90-59a5d2f72786 for instance 16784b0e-0c4b-48bd-a676-13ebf792f804 on n-h1-858384-1 Sep 19 15:13:36.561056 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-487fc51b-a5cc-42c8-b0a4-405f3739bbb6 req-e2f3c809-6cb6-45b0-9e93-00cb183002f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063204 Sep 19 15:13:36.562331 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2589/5131] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:36.712436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:36.729090 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b3e40a24-59ad-4c43-8ca5-34bbbf32c230 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1501 microversion: 2.1 time: 0.798351 Sep 19 15:13:36.729813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2543/5132] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:35 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1501 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:36.759536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:36.761252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:36.773697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.777372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.778229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.782276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.786214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.787123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.821532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lazy-loading 'flavor' on Instance uuid 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:36.949792 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-32da466d-1fb1-4bec-845d-5ac9eaad8c4d tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action" status: 202 len: 0 microversion: 2.1 time: 0.194783 Sep 19 15:13:36.952736 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2590/5133] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:36 2022] POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:13:36.968777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:36.970125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:36.994253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.995402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.995962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.996933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.997450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.000271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:37.434704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:37.444411 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dff4846f-d496-4bdf-9a80-740a3a891f5b tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1509 microversion: 2.1 time: 0.486394 Sep 19 15:13:37.452796 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2544/5134] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:36 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1509 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:37.530984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:37.532356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:37.547502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:37.548011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.548456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:37.549190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:37.549663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.550111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:37.698552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:37.712158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83983948-6569-4a13-9529-b33edebb34c2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1306 microversion: 2.1 time: 0.187201 Sep 19 15:13:37.713090 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2591/5135] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:37 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:38.496037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:38.497023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:38.509523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.510093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.510560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.511389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.511874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.512298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.752185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:38.752832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:38.761382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:38.761707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.762696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.765061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.767090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.769436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.771675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.776874 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5cf0c20-1651-4807-a7b3-ce6841b35d23 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1492 microversion: 2.1 time: 0.286640 Sep 19 15:13:38.778040 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2545/5136] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:38 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1492 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:38.807828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:38.808831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:38.825240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.825770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.826206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.826944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.827400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.827825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.986669 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b3a45fce-abfc-4f3e-9ecd-e9757bf675b3 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action" status: 202 len: 0 microversion: 2.1 time: 0.186029 Sep 19 15:13:38.988133 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2546/5137] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:38 2022] POST /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:13:38.996899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:38.999235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:39.007607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:39.008575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:39.009501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:39.010473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:39.011178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:39.012003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:39.045891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:39.067065 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa9a3091-204f-4cb7-829e-2097940ae70a tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1374 microversion: 2.1 time: 0.314897 Sep 19 15:13:39.071077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2592/5138] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:38 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1374 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:39.276206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b6abdc67-66cf-4f49-a24b-803662c0ccb6 req-81968442-1a08-4829-98b0-7f736b22b7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066bc7dc-b41c-4612-af47-e8bf18ab5d0f", "tag": "ef617d62-4a05-4ddb-8514-c322c0c381f9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:39.289808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b6abdc67-66cf-4f49-a24b-803662c0ccb6 req-81968442-1a08-4829-98b0-7f736b22b7a8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:39.290298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b6abdc67-66cf-4f49-a24b-803662c0ccb6 req-81968442-1a08-4829-98b0-7f736b22b7a8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:39.290740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b6abdc67-66cf-4f49-a24b-803662c0ccb6 req-81968442-1a08-4829-98b0-7f736b22b7a8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:39.315276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b6abdc67-66cf-4f49-a24b-803662c0ccb6 req-81968442-1a08-4829-98b0-7f736b22b7a8 service nova] Creating event network-changed:ef617d62-4a05-4ddb-8514-c322c0c381f9 for instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f on n-h2-858384-1 Sep 19 15:13:39.328090 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b6abdc67-66cf-4f49-a24b-803662c0ccb6 req-81968442-1a08-4829-98b0-7f736b22b7a8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057607 Sep 19 15:13:39.331141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2593/5139] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:39.492980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:39.501307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4473e6b3-eca1-497a-bf74-eb6db1090e9a tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1498 microversion: 2.1 time: 0.508864 Sep 19 15:13:39.518691 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2547/5140] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:38 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1498 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:40.093872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:40.095294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:40.105616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.106109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.106546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.107513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.107970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.108393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.134358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:40.279514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:40.292108 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2fe29a25-d321-44b8-a8e4-40e0dba95ad7 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1374 microversion: 2.1 time: 0.203152 Sep 19 15:13:40.293762 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2594/5141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:40 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:40.530054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:40.531530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:40.542703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.544618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.546375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.547446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.549669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.550597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.745250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:40.753902 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40be7c3a-ec42-4b87-9a8e-83e24a25bb7f tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1501 microversion: 2.1 time: 0.232147 Sep 19 15:13:40.755184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2548/5142] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:40 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1501 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:40.779709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:40.780279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:40.790100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.790607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.791132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.799530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.800116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.800583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.837239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:13:40.851746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:40.932722 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5a800924-3466-4aba-a8d9-5b54941d7320 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 204 len: 0 microversion: 2.1 time: 0.157588 Sep 19 15:13:40.933585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2595/5143] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:13:40 2022] DELETE /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:13:40.944349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:40.945320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:40.951833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.952438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.952954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.953745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.954376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.954916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.316558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:41.317290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:41.325313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:41.325802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:41.326286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.326958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:41.327416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:41.327833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.328983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:41.338639 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-676bb0ba-5a38-4584-86f2-a091303d56df tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1507 microversion: 2.1 time: 0.400168 Sep 19 15:13:41.339267 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2549/5144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:40 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:41.692987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:41.703068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1e35e5e-4c8b-4d87-9216-1504b5f8bcdb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1374 microversion: 2.1 time: 0.390211 Sep 19 15:13:41.703849 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2596/5145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:41 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1374 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:42.369957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:42.371351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:42.382677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.383222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.383670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.384485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.384958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.385389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.612624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:42.624587 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45103534-04b6-44b2-9d71-0fa26316f537 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1507 microversion: 2.1 time: 0.263611 Sep 19 15:13:42.625148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2550/5146] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:42 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:42.728910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:42.730240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:42.738470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.739304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.740059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.741568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.742320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.743082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.959893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:42.969459 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9da2b9ef-8669-4d4d-856b-677da783dc6e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1374 microversion: 2.1 time: 0.246609 Sep 19 15:13:42.970913 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2597/5147] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:42 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:43.530302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8f965231-2dd9-4fc3-ae66-4adf95f4ed3c req-3a027a3d-e6c9-40ac-927d-bfe9bab98907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a32b0f6-c883-41e7-a202-54ca5ba0ff26", "name": "network-vif-deleted", "tag": "d9d9a925-18c0-498f-8d36-facfee11d124"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:43.544744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8f965231-2dd9-4fc3-ae66-4adf95f4ed3c req-3a027a3d-e6c9-40ac-927d-bfe9bab98907 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:43.545745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8f965231-2dd9-4fc3-ae66-4adf95f4ed3c req-3a027a3d-e6c9-40ac-927d-bfe9bab98907 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:43.546729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8f965231-2dd9-4fc3-ae66-4adf95f4ed3c req-3a027a3d-e6c9-40ac-927d-bfe9bab98907 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.563262 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8f965231-2dd9-4fc3-ae66-4adf95f4ed3c req-3a027a3d-e6c9-40ac-927d-bfe9bab98907 service nova] Creating event network-vif-deleted:d9d9a925-18c0-498f-8d36-facfee11d124 for instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 on n-h1-858384-1 Sep 19 15:13:43.572003 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8f965231-2dd9-4fc3-ae66-4adf95f4ed3c req-3a027a3d-e6c9-40ac-927d-bfe9bab98907 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047995 Sep 19 15:13:43.574328 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2551/5148] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:43.655369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:43.656589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:43.675541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:43.676673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:43.678433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.680495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:43.682073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:43.683564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.746682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:43.748725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:43.749874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.750582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lazy-loading 'fault' on Instance uuid 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:43.807406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6066687d0a764b08a77eba51db29cc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2181449444843e7a0407f99d96f533b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:43.823296 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9e8c363-9dee-4625-b31c-aa3262b90c88 tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 200 len: 1304 microversion: 2.1 time: 0.172953 Sep 19 15:13:43.825554 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2598/5149] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:43 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:43.997512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:43.998657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:44.000535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:44.001319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:44.008352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.008971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.009639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.021858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.022606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.023006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.235243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:44.245245 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12fb255d-5a05-419e-8441-a2200863994e tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1374 microversion: 2.1 time: 0.253270 Sep 19 15:13:44.246042 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2552/5150] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:43 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:44.837708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a92d7001-63e7-43df-a704-77b1a0487ead req-e285be6e-7105-4eca-9249-dc8a570b1e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066bc7dc-b41c-4612-af47-e8bf18ab5d0f", "name": "network-vif-plugged", "status": "completed", "tag": "ef617d62-4a05-4ddb-8514-c322c0c381f9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:44.849405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:44.851903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] [instance: 1a32b0f6-c883-41e7-a202-54ca5ba0ff26] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:44.852052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a92d7001-63e7-43df-a704-77b1a0487ead req-e285be6e-7105-4eca-9249-dc8a570b1e6b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.852456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a92d7001-63e7-43df-a704-77b1a0487ead req-e285be6e-7105-4eca-9249-dc8a570b1e6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.852898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a92d7001-63e7-43df-a704-77b1a0487ead req-e285be6e-7105-4eca-9249-dc8a570b1e6b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.859962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.860813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.862113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.863093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.863781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.864445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.866030 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a92d7001-63e7-43df-a704-77b1a0487ead req-e285be6e-7105-4eca-9249-dc8a570b1e6b service nova] Creating event network-vif-plugged:ef617d62-4a05-4ddb-8514-c322c0c381f9 for instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f on n-h2-858384-1 Sep 19 15:13:44.871187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a92d7001-63e7-43df-a704-77b1a0487ead req-e285be6e-7105-4eca-9249-dc8a570b1e6b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229390 Sep 19 15:13:44.874890 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2599/5151] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:44.886958 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] HTTP exception thrown: Instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 could not be found. Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Request method failure captured: Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 HTTP/1.1 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIcJzv9NzMwFAKQkah1K-McV_v2kABfZG0p84moxBdEgXKwlJmAQLjBs5zOWTwkop0xcqzF7kSd4LQyBFWyX_ZaPEqBGEbX9s4Ue2_3dRJMCn6Aj5sBt1D0tp5Oh75dA6Fbahuf83xnZhPKS6Lx_UsVBVPQrxzn9JmE6POyjlgCsCJ4 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: c2181449444843e7a0407f99d96f533b Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestServerAdvancedOps-2029934012 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c2181449444843e7a0407f99d96f533b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c2181449444843e7a0407f99d96f533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c2181449444843e7a0407f99d96f533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c2181449444843e7a0407f99d96f533b"}]}] Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestServerAdvancedOps-2029934012 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: c2181449444843e7a0407f99d96f533b Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestServerAdvancedOps-2029934012 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestServerAdvancedOps-2029934012-project Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6066687d0a764b08a77eba51db29cc30 Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestServerAdvancedOps-2029934012-project Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 could not be found. Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1a32b0f6-c883-41e7-a202-54ca5ba0ff26'} Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 could not be found. Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 could not be found. Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:44.889061 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 could not be found. Sep 19 15:13:44.893933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:13:44.895686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] Returning 404 to user: Instance 1a32b0f6-c883-41e7-a202-54ca5ba0ff26 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:13:44.895686 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-611fa881-e50d-49ce-a8b2-e0819b4b05bd tempest-TestServerAdvancedOps-2029934012 tempest-TestServerAdvancedOps-2029934012-project] 10.222.0.81 "GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26" status: 404 len: 111 microversion: 2.1 time: 0.050063 Sep 19 15:13:44.897584 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2553/5152] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:44 2022] GET /compute/v2.1/servers/1a32b0f6-c883-41e7-a202-54ca5ba0ff26 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:13:45.275436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:45.278284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:45.290724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:45.291846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:45.292694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:45.302522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:45.303891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:45.305142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:45.661435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:45.680389 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b36938f-ca1c-4d1e-9600-4fd72b92b714 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1374 microversion: 2.1 time: 0.411839 Sep 19 15:13:45.682825 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2600/5153] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:45 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1374 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:46.705830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:46.707674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:46.716276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:46.717066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:46.718033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:46.719644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:46.720361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:46.721043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.001392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:47.011953 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-099feeb4-09ea-4cb0-87b1-264dd2a4d892 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1546 microversion: 2.1 time: 0.310204 Sep 19 15:13:47.031421 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2554/5154] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:46 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1546 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:47.038132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:47.039453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:47.048413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:47.049337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:47.050029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.051324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:47.051944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:47.052615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.337322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:47.353451 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87389da5-064e-48f5-9c50-030d083d4265 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1546 microversion: 2.1 time: 0.319296 Sep 19 15:13:47.354425 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2601/5155] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:47 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1546 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:10.291459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e97384ff-0f7f-434b-9d26-063d0f6c2395"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:10.295801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:10.300787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:10.300787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:10.324855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:10.325449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:10.326488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:10.327606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:10.328293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:10.329255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:10.699310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cac4f5e-b3c2-415c-a4a1-8eca78821b14 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412047 Sep 19 15:14:10.700492 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2555/5156] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:14:10 2022] POST /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:16.742978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:16.745967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:16.767518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:16.768247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:16.769853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.770343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.771571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.772718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.773395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.773821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.813300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:14:16.951082 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-81bac87b-51bd-465a-a89c-d852c45d7f20 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "DELETE /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 204 len: 0 microversion: 2.1 time: 0.216001 Sep 19 15:14:16.955855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2602/5157] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:14:16 2022] DELETE /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:14:16.963515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:16.965246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:16.977847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.978360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.978839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.979584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.980049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.980483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:17.542526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:17.556319 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7350266e-1612-40b9-b72a-edea6bbec1f5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1552 microversion: 2.1 time: 0.599090 Sep 19 15:14:17.567223 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2556/5158] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:16 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1552 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:18.588641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:18.590709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:18.612516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:18.618556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:18.620649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:18.622118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:18.622917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:18.623603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:18.962322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:18.972673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f768104-0f59-4b15-a319-2542811701f8 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 200 len: 1552 microversion: 2.1 time: 0.396155 Sep 19 15:14:18.973285 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2603/5159] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:18 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 1552 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:19.198597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a588e53c-acf7-4073-98c7-575a57716400 req-cab2ab13-ae44-40b8-97e6-54da731f94c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066bc7dc-b41c-4612-af47-e8bf18ab5d0f", "name": "network-vif-deleted", "tag": "ef617d62-4a05-4ddb-8514-c322c0c381f9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:19.218502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a588e53c-acf7-4073-98c7-575a57716400 req-cab2ab13-ae44-40b8-97e6-54da731f94c9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:19.219135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a588e53c-acf7-4073-98c7-575a57716400 req-cab2ab13-ae44-40b8-97e6-54da731f94c9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:19.219675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a588e53c-acf7-4073-98c7-575a57716400 req-cab2ab13-ae44-40b8-97e6-54da731f94c9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:19.234489 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a588e53c-acf7-4073-98c7-575a57716400 req-cab2ab13-ae44-40b8-97e6-54da731f94c9 service nova] Creating event network-vif-deleted:ef617d62-4a05-4ddb-8514-c322c0c381f9 for instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f on n-h2-858384-1 Sep 19 15:14:19.240522 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a588e53c-acf7-4073-98c7-575a57716400 req-cab2ab13-ae44-40b8-97e6-54da731f94c9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046257 Sep 19 15:14:19.242278 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2557/5160] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:20.002665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:20.003330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: 066bc7dc-b41c-4612-af47-e8bf18ab5d0f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:20.011898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:20.012390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:20.012827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:20.013532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:20.014017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:20.014441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:20.029636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] HTTP exception thrown: Instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f could not be found. Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Request method failure captured: Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f HTTP/1.1 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIbLhWfJKKPJimXXqtBHfK0kruaPheR_dBXUZqlPQjcfr3HP0nnVB9KHqtx6GSdr2G-cT5vXokXm9Pr3Qf11rBxE8pEarEFoO4RSKBLoWoVWJDmUsmUFTewnNvY4nedP3cdGrAdQaR7k7CpgYzkElXJxurqL81R_rVwE4n-H78wHdx4 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 40a41409c324401883d3dd986a70c628 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestNetworkBasicOps-478788222 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_40a41409c324401883d3dd986a70c628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/40a41409c324401883d3dd986a70c628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/40a41409c324401883d3dd986a70c628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/40a41409c324401883d3dd986a70c628"}]}] Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestNetworkBasicOps-478788222 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 40a41409c324401883d3dd986a70c628 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestNetworkBasicOps-478788222 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestNetworkBasicOps-478788222-project Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ce59b217d95a4da9b5413ac61907ff98 Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestNetworkBasicOps-478788222-project Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f could not be found. Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '066bc7dc-b41c-4612-af47-e8bf18ab5d0f'} Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f could not be found. Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f could not be found. Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:14:20.031336 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f could not be found. Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Returning 404 to user: Instance 066bc7dc-b41c-4612-af47-e8bf18ab5d0f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-864e0443-2801-4095-9afc-3d6fd202b284 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f" status: 404 len: 111 microversion: 2.1 time: 0.037952 Sep 19 15:14:20.037645 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2604/5161] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:19 2022] GET /compute/v2.1/servers/066bc7dc-b41c-4612-af47-e8bf18ab5d0f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:14:20.247815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83429c62-03d0-4461-a066-a73d3bb66e52 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '.version_select at 0x7fde2911aaf0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:20.276906 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83429c62-03d0-4461-a066-a73d3bb66e52 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1798414268" status: 202 len: 0 microversion: 2.1 time: 0.034783 Sep 19 15:14:20.278153 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2558/5162] 10.222.0.81 () {58 vars in 1257 bytes} [Mon Sep 19 15:14:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1798414268 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:14:22.828658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:22.829739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:22.837636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-90e7d0e3-c076-49b3-9972-7f6c1a27a6e2 req-d98a9556-c989-4be2-a21c-022b48813c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da914771-b5dd-48c7-be9a-66c0936cf508", "tag": "6cf56ee2-dc23-4d47-bc9d-f0578ba79475"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:22.851778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.852280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.852720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.853436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.853887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.854310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.862397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-90e7d0e3-c076-49b3-9972-7f6c1a27a6e2 req-d98a9556-c989-4be2-a21c-022b48813c24 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.863195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-90e7d0e3-c076-49b3-9972-7f6c1a27a6e2 req-d98a9556-c989-4be2-a21c-022b48813c24 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.865581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-90e7d0e3-c076-49b3-9972-7f6c1a27a6e2 req-d98a9556-c989-4be2-a21c-022b48813c24 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.896348 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-90e7d0e3-c076-49b3-9972-7f6c1a27a6e2 req-d98a9556-c989-4be2-a21c-022b48813c24 service nova] Creating event network-changed:6cf56ee2-dc23-4d47-bc9d-f0578ba79475 for instance da914771-b5dd-48c7-be9a-66c0936cf508 on n-h2-858384-1 Sep 19 15:14:22.913726 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-90e7d0e3-c076-49b3-9972-7f6c1a27a6e2 req-d98a9556-c989-4be2-a21c-022b48813c24 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079991 Sep 19 15:14:22.919142 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2559/5163] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:14:22.923882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:14:23.102460 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12a39ce4-f277-4017-9768-e93b21925f2d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "DELETE /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 204 len: 0 microversion: 2.1 time: 0.278677 Sep 19 15:14:23.109714 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2605/5164] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:14:22 2022] DELETE /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:14:23.123927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:23.124655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:23.141037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.142364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.142977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.143886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.144738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.145280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.460085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:23.472669 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-293f7bc4-fcde-4802-8d51-1c54896d8385 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1670 microversion: 2.1 time: 0.357573 Sep 19 15:14:23.473646 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2560/5165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:23 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1670 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:24.498439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:24.499187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:24.507906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:24.508655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:24.509272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:24.510173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:24.510840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:24.511444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:24.914668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:24.930655 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-925229cc-3463-4b82-aa0c-600e7a2fc5a4 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1670 microversion: 2.1 time: 0.437307 Sep 19 15:14:24.933895 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2606/5166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:24 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1670 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:25.442203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ed1e3b95-4fea-4ebd-a72e-871b427dfc28 req-d453a7d8-de9f-429e-a55b-97265c0cdb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da914771-b5dd-48c7-be9a-66c0936cf508", "name": "network-vif-deleted", "tag": "6cf56ee2-dc23-4d47-bc9d-f0578ba79475"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:25.466141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed1e3b95-4fea-4ebd-a72e-871b427dfc28 req-d453a7d8-de9f-429e-a55b-97265c0cdb3c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.467594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed1e3b95-4fea-4ebd-a72e-871b427dfc28 req-d453a7d8-de9f-429e-a55b-97265c0cdb3c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.468829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ed1e3b95-4fea-4ebd-a72e-871b427dfc28 req-d453a7d8-de9f-429e-a55b-97265c0cdb3c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.496515 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ed1e3b95-4fea-4ebd-a72e-871b427dfc28 req-d453a7d8-de9f-429e-a55b-97265c0cdb3c service nova] Creating event network-vif-deleted:6cf56ee2-dc23-4d47-bc9d-f0578ba79475 for instance da914771-b5dd-48c7-be9a-66c0936cf508 on n-h2-858384-1 Sep 19 15:14:25.502261 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ed1e3b95-4fea-4ebd-a72e-871b427dfc28 req-d453a7d8-de9f-429e-a55b-97265c0cdb3c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064155 Sep 19 15:14:25.502974 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2561/5167] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:25.642315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:25.647605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:25.656563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.657059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.657978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.658921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.659551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.660162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.689395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'flavor' on Instance uuid 16784b0e-0c4b-48bd-a676-13ebf792f804 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:14:25.855799 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-473d6abe-7f43-446b-b5ac-396c0046a81a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/action" status: 200 len: 32 microversion: 2.1 time: 0.217375 Sep 19 15:14:25.856813 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2607/5168] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:14:25 2022] POST /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:14:25.867861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:25.868796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:25.875677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.876363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.876952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.877825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.878444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.879015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.958981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:25.959713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:25.970345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.975193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.976095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.979407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.980099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.981948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:26.072435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:26.082257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:26.082971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:26.083593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lazy-loading 'fault' on Instance uuid da914771-b5dd-48c7-be9a-66c0936cf508 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:14:26.128405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:26.140573 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e1dd7840-b99c-4ff1-b3f2-ddbfc5068e4f tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.277898 Sep 19 15:14:26.144098 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2562/5169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:25 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:26.176497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:26.184739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b09e05eb-5506-41dd-a027-6307474f7b39 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 200 len: 1337 microversion: 2.1 time: 0.230183 Sep 19 15:14:26.185875 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2608/5170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:25 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 1337 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:27.168065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:27.168597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:27.175981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:27.177603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:27.178195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:27.179066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:27.179556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:27.180248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:27.209040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:27.209735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: da914771-b5dd-48c7-be9a-66c0936cf508] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:27.220153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:27.221970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:27.223433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:27.224401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:27.225151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:27.225598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:27.241756 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] HTTP exception thrown: Instance da914771-b5dd-48c7-be9a-66c0936cf508 could not be found. Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Request method failure captured: Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 HTTP/1.1 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIbLhWfJKKPJimXXqtBHfK0kruaPheR_dBXUZqlPQjcfr3HP0nnVB9KHqtx6GSdr2G-cT5vXokXm9Pr3Qf11rBxE8pEarEFoO4RSKBLoWoVWJDmUsmUFTewnNvY4nedP3cdGrAdQaR7k7CpgYzkElXJxurqL81R_rVwE4n-H78wHdx4 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 40a41409c324401883d3dd986a70c628 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestNetworkBasicOps-478788222 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_40a41409c324401883d3dd986a70c628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/40a41409c324401883d3dd986a70c628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/40a41409c324401883d3dd986a70c628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/40a41409c324401883d3dd986a70c628"}]}] Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestNetworkBasicOps-478788222 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 40a41409c324401883d3dd986a70c628 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestNetworkBasicOps-478788222 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestNetworkBasicOps-478788222-project Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ce59b217d95a4da9b5413ac61907ff98 Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestNetworkBasicOps-478788222-project Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance da914771-b5dd-48c7-be9a-66c0936cf508 could not be found. Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'da914771-b5dd-48c7-be9a-66c0936cf508'} Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da914771-b5dd-48c7-be9a-66c0936cf508 could not be found. Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da914771-b5dd-48c7-be9a-66c0936cf508 could not be found. Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:14:27.243508 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da914771-b5dd-48c7-be9a-66c0936cf508 could not be found. Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Returning 404 to user: Instance da914771-b5dd-48c7-be9a-66c0936cf508 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-875f17b5-3d05-4ed9-a8a4-a9a641c01ceb tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508" status: 404 len: 111 microversion: 2.1 time: 0.039923 Sep 19 15:14:27.248767 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2609/5171] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:27 2022] GET /compute/v2.1/servers/da914771-b5dd-48c7-be9a-66c0936cf508 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:14:27.376205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:27.386438 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aa7e88b8-cc27-446e-87b3-d57f461aa8a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.222336 Sep 19 15:14:27.387846 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2563/5172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:27 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:27.727267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5932f15a-f8ee-41d7-808a-6110b3c5b922 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '.version_select at 0x7fde28ccdaf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:27.753238 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5932f15a-f8ee-41d7-808a-6110b3c5b922 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-783514481" status: 202 len: 0 microversion: 2.1 time: 0.038337 Sep 19 15:14:27.758873 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2610/5173] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 15:14:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-783514481 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:14:28.412736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:28.414503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:28.429447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:28.430681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:28.431218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:28.432171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:28.433256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:28.433907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:28.625668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:28.634225 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-608d9a40-318d-46a2-8da6-b1aa05cb5250 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.226955 Sep 19 15:14:28.634838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2564/5174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:28 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:29.676128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:29.678104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:29.699942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:29.703802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:29.703802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:29.705557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:29.706306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:29.707345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:29.979036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:29.989043 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f5403235-b856-404e-9350-a9de8fd55064 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.333127 Sep 19 15:14:29.992877 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2611/5175] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:29 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:31.018402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:31.019754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:31.032638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:31.033474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:31.034438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:31.037072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:31.037788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:31.042936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:31.381296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:31.391196 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba06c4d4-0459-4c1d-a797-cf38f059b521 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.377376 Sep 19 15:14:31.392412 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2565/5176] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:31 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:32.416378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:32.417133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:32.426202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:32.427689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:32.428317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:32.429036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:32.429665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:32.430520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:32.715215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:32.743152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1b44ad8c-f13f-43d2-93de-83e4be64e933 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.318383 Sep 19 15:14:32.761157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2612/5177] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:32 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:33.772111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:33.773850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:33.792464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.793806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.794497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.795683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.796613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.797393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.984360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:33.995220 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-22f56080-1ff5-433d-a820-c26aa5659a70 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.229150 Sep 19 15:14:33.996718 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2566/5178] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:33 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:35.021649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:35.022989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:35.031198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:35.031958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:35.032594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:35.033996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:35.034627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:35.035285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:35.262621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:35.272155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35bc75a2-51f9-4751-9184-a445e6ac53be tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.255585 Sep 19 15:14:35.272740 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2613/5179] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:35 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:36.296470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:36.297241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:36.324609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:36.325554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:36.326250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:36.329308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:36.330177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:36.330718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:36.584129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:36.595539 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a61d4bef-a15d-40f7-89f6-6d432e8584c0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.302574 Sep 19 15:14:36.597980 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2567/5180] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:36 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:37.626576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:37.627187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:37.644708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:37.648100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:37.648882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:37.651590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:37.654487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:37.655213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:38.124103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:38.143496 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-706e0d87-6adb-4027-ac91-e61219d1f3b8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1735 microversion: 2.1 time: 0.522558 Sep 19 15:14:38.155950 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2614/5181] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:37 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1735 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:39.184349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:39.185175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:39.201436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:39.203226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:39.205991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:39.207852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:39.210991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:39.212655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:39.541908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:39.560851 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89005d5f-7192-48b0-9875-f3559eb95272 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1715 microversion: 2.1 time: 0.383735 Sep 19 15:14:39.561967 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2568/5182] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:39 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1715 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:39.863086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:39.864225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:39.874553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:39.875459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:39.876068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:39.877345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:39.877971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:39.880006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:39.885232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:40.018067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d2be270-3558-4faf-8f37-ee1585cc4b8d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'create', calling method: .version_select at 0x7fde28a6b700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-360468480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDsI7685/GpyHs8AjG6GvQZXiur12FPbP3ngB6EuGCVkNf4gptUZqF8apt05I3SlJDId5ZnEJBlgTqk+T375dEB2SoaVjsmoz+uJ4bTD8KMYqrV+AGwRLtRgqWWtM9PCA=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:40.038883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Cannot 'detach_volume' instance 16784b0e-0c4b-48bd-a676-13ebf792f804 while it is in vm_state rescued Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments/e97384ff-0f7f-434b-9d26-063d0f6c2395 HTTP/1.1 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'detach_volume' instance 16784b0e-0c4b-48bd-a676-13ebf792f804 while it is in vm_state rescued Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '16784b0e-0c4b-48bd-a676-13ebf792f804', 'id': 'e97384ff-0f7f-434b-9d26-063d0f6c2395'} Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 16784b0e-0c4b-48bd-a676-13ebf792f804 while it is in vm_state rescued Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:40.041784 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:14:40.047441 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:14:40.047441 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:14:40.047441 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:14:40.047441 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:14:40.047441 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 16784b0e-0c4b-48bd-a676-13ebf792f804 while it is in vm_state rescued Sep 19 15:14:40.047441 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:14:40.048785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 409 to user: Cannot 'detach_volume' instance 16784b0e-0c4b-48bd-a676-13ebf792f804 while it is in vm_state rescued {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:14:40.049849 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-375bcf57-6f38-41d0-9716-cd1c09b335a0 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments/e97384ff-0f7f-434b-9d26-063d0f6c2395" status: 409 len: 152 microversion: 2.1 time: 0.190752 Sep 19 15:14:40.051451 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2615/5183] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:14:39 2022] DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments/e97384ff-0f7f-434b-9d26-063d0f6c2395 => generated 152 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 19 15:14:40.063263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:40.064694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5d2be270-3558-4faf-8f37-ee1585cc4b8d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for project 40a41409c324401883d3dd986a70c628. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:14:40.065554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:40.078438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5d2be270-3558-4faf-8f37-ee1585cc4b8d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for user ce59b217d95a4da9b5413ac61907ff98 and project 40a41409c324401883d3dd986a70c628. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:14:40.083914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:40.088587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:40.089416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:40.090511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:40.092170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:40.094309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:40.141211 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d2be270-3558-4faf-8f37-ee1585cc4b8d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.126858 Sep 19 15:14:40.148561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2569/5184] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:14:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:14:40.230228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6fd78f28-2e02-4544-83b3-bf0fd0b9e5ea tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/action" status: 202 len: 0 microversion: 2.1 time: 0.172903 Sep 19 15:14:40.231341 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2616/5185] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:14:40 2022] POST /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:14:40.246349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:40.247699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:40.276879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:40.298280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:40.298780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:40.299614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:40.300141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:40.300569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:40.332783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:40.660593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:40.703412 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e6d4d2e9-424b-40b6-a916-8d0809ab32e6 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1723 microversion: 2.1 time: 0.467999 Sep 19 15:14:40.712554 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2570/5186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:40 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:41.766906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:41.769064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:41.782057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:41.783557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:41.784624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:41.786712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:41.787844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:41.788846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:42.267047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:42.293415 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-588b1188-39f8-4a5b-8b79-00681f1ed896 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1723 microversion: 2.1 time: 0.534082 Sep 19 15:14:42.296113 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2617/5187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:41 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1723 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:42.917242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-925405311", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "811ae527-de4b-4bf5-9058-ee7ea6f4ba53"}], "key_name": "tempest-TestNetworkBasicOps-360468480", "security_groups": [{"name": "tempest-secgroup-smoke-1857760919"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:42.947688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:43.157430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] validate_networks() for [('811ae527-de4b-4bf5-9058-ee7ea6f4ba53', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:14:43.324731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:43.325995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:43.345177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:43.345668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:43.346327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:43.347248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:43.347876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:43.348473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:43.788487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:43.811414 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03fcbdfb-bed9-4487-8da5-a546243f04fd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1729 microversion: 2.1 time: 0.490548 Sep 19 15:14:43.812600 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2618/5188] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:43 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1729 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:43.848370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:43.849722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:43.867472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:43.867967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:43.868412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:43.869132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:43.869592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:43.870023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:44.025844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:14:44.026401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:14:44.026920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:14:44.027582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:14:44.028107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:14:44.042716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:44.045269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:44.048357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:44.049440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:44.050153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:44.055993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:44.064545 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48b4852b-4638-4b56-80bf-d58858fcf930 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228467 Sep 19 15:14:44.066184 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2619/5189] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:14:43 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:44.093450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for project 40a41409c324401883d3dd986a70c628. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:14:44.107875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Getting quotas for user ce59b217d95a4da9b5413ac61907ff98 and project 40a41409c324401883d3dd986a70c628. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:14:44.165048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:14:44.167525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:14:44.319120 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1329df5-b94d-4c0a-b07e-daf1a5b819de tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.409141 Sep 19 15:14:44.322983 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2571/5190] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:14:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:14:44.340269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef779caa-e532-409a-bae5-d3c3152fb222 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:44.341012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef779caa-e532-409a-bae5-d3c3152fb222 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:44.410328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ef779caa-e532-409a-bae5-d3c3152fb222 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:44.421827 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef779caa-e532-409a-bae5-d3c3152fb222 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1247 microversion: 2.1 time: 0.086789 Sep 19 15:14:44.449580 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2620/5191] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:44 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1247 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:45.455949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:45.456829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:45.464962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:45.465550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:45.466010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:45.466877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:45.467549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:45.468056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:45.575442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:45.588638 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-75630f24-4daf-41b9-8088-aef08579ee88 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1299 microversion: 2.1 time: 0.138757 Sep 19 15:14:45.589890 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2572/5192] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:45 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:46.333362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5c07b2e0-5d49-42c0-9cef-6efebe101858 req-083e6a60-fb80-4fc3-9be5-d7716a843c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16784b0e-0c4b-48bd-a676-13ebf792f804", "tag": "6c45f4b6-03a5-4ec4-9d90-59a5d2f72786"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:46.366770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5c07b2e0-5d49-42c0-9cef-6efebe101858 req-083e6a60-fb80-4fc3-9be5-d7716a843c0e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:46.367757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5c07b2e0-5d49-42c0-9cef-6efebe101858 req-083e6a60-fb80-4fc3-9be5-d7716a843c0e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:46.370605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5c07b2e0-5d49-42c0-9cef-6efebe101858 req-083e6a60-fb80-4fc3-9be5-d7716a843c0e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:46.392150 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5c07b2e0-5d49-42c0-9cef-6efebe101858 req-083e6a60-fb80-4fc3-9be5-d7716a843c0e service nova] Creating event network-changed:6c45f4b6-03a5-4ec4-9d90-59a5d2f72786 for instance 16784b0e-0c4b-48bd-a676-13ebf792f804 on n-h1-858384-1 Sep 19 15:14:46.403885 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5c07b2e0-5d49-42c0-9cef-6efebe101858 req-083e6a60-fb80-4fc3-9be5-d7716a843c0e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.454699 Sep 19 15:14:46.404633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2621/5193] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:46.614655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:46.616530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:46.624011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:46.624937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:46.625602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:46.626703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:46.627632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:46.628280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:46.816203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:46.825416 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6517c64f-9b44-4376-997e-995d06354d54 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1305 microversion: 2.1 time: 0.215226 Sep 19 15:14:46.831159 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2573/5194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:46 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:47.855832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:47.856628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:47.871521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:47.878794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:47.879667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:47.880864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:47.881925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:47.882636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:47.883345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:48.241241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:48.254915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62a2e7f0-d67c-41f4-889d-07c1d520548b tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.404214 Sep 19 15:14:48.258141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2622/5195] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:47 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:48.428011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5277aced-3b84-421d-97f2-3b61f170f1e0 req-d1e0e580-d957-4c0f-872c-88bbcf3b03c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16784b0e-0c4b-48bd-a676-13ebf792f804", "tag": "6c45f4b6-03a5-4ec4-9d90-59a5d2f72786"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:48.439844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5277aced-3b84-421d-97f2-3b61f170f1e0 req-d1e0e580-d957-4c0f-872c-88bbcf3b03c1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:48.440494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5277aced-3b84-421d-97f2-3b61f170f1e0 req-d1e0e580-d957-4c0f-872c-88bbcf3b03c1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:48.441183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5277aced-3b84-421d-97f2-3b61f170f1e0 req-d1e0e580-d957-4c0f-872c-88bbcf3b03c1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:48.456366 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5277aced-3b84-421d-97f2-3b61f170f1e0 req-d1e0e580-d957-4c0f-872c-88bbcf3b03c1 service nova] Creating event network-changed:6c45f4b6-03a5-4ec4-9d90-59a5d2f72786 for instance 16784b0e-0c4b-48bd-a676-13ebf792f804 on n-h1-858384-1 Sep 19 15:14:48.462441 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5277aced-3b84-421d-97f2-3b61f170f1e0 req-d1e0e580-d957-4c0f-872c-88bbcf3b03c1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040241 Sep 19 15:14:48.463656 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2574/5196] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:48.573394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ac9eb654-0162-47db-b426-9abb6fc8e57f req-a90a79d0-42e7-47be-96da-98968be460d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a7ab99-2565-4f22-9189-69152059b3b5", "tag": "5a9c9f7c-60ad-4917-a400-39dc5b448e26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:48.608636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ac9eb654-0162-47db-b426-9abb6fc8e57f req-a90a79d0-42e7-47be-96da-98968be460d0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:48.610125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ac9eb654-0162-47db-b426-9abb6fc8e57f req-a90a79d0-42e7-47be-96da-98968be460d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:48.611473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ac9eb654-0162-47db-b426-9abb6fc8e57f req-a90a79d0-42e7-47be-96da-98968be460d0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:48.627798 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ac9eb654-0162-47db-b426-9abb6fc8e57f req-a90a79d0-42e7-47be-96da-98968be460d0 service nova] Creating event network-changed:5a9c9f7c-60ad-4917-a400-39dc5b448e26 for instance c4a7ab99-2565-4f22-9189-69152059b3b5 on n-h2-858384-1 Sep 19 15:14:48.635757 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ac9eb654-0162-47db-b426-9abb6fc8e57f req-a90a79d0-42e7-47be-96da-98968be460d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069798 Sep 19 15:14:48.637355 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2623/5197] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:49.285905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:49.287550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:49.294398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:49.294998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:49.295505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:49.296306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:49.296841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:49.297340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:49.453933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:49.463054 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83f85210-959c-4386-9b9d-d1b5bd1a78fd tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.181207 Sep 19 15:14:49.464145 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2575/5198] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:49 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:50.487833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:50.489227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:50.496242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:50.496998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:50.497611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:50.498530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:50.499194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:50.499789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:50.677276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:50.686431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7897eefb-3cad-4aa4-8c72-43a6ecaf6779 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.203829 Sep 19 15:14:50.687055 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2624/5199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:50 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:51.712180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:51.712815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:51.721961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:51.722461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:51.722936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:51.724407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:51.724827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:51.725257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:51.883076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:51.891842 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9b616c9d-c963-4a4c-b986-795156bbf2a3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.185383 Sep 19 15:14:51.892438 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2576/5200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:51 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:52.917097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:52.918011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:52.926144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:52.927153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:52.928022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:52.928813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:52.929275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:52.929694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:53.148830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:53.168283 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-844a1cb7-8b57-48c6-b465-499047b74973 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.257254 Sep 19 15:14:53.169455 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2625/5201] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:52 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:54.194082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:54.195022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:54.199126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:54.200632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:54.205234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:54.206052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:54.206601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:54.207643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:54.208282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:54.208997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:54.365477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:54.374841 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb47350e-edc4-4232-94ed-4a79f41b2ea2 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.185793 Sep 19 15:14:54.375418 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2577/5202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:54 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:54.742117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9c10fe53-0c09-42e6-ba20-488555b6bd54 req-9e27c690-3e67-4360-aea4-83220b901f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a7ab99-2565-4f22-9189-69152059b3b5", "name": "network-vif-plugged", "status": "completed", "tag": "5a9c9f7c-60ad-4917-a400-39dc5b448e26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:54.757697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:54.759953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9c10fe53-0c09-42e6-ba20-488555b6bd54 req-9e27c690-3e67-4360-aea4-83220b901f25 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:54.760429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9c10fe53-0c09-42e6-ba20-488555b6bd54 req-9e27c690-3e67-4360-aea4-83220b901f25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:54.761059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9c10fe53-0c09-42e6-ba20-488555b6bd54 req-9e27c690-3e67-4360-aea4-83220b901f25 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:54.775276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9c10fe53-0c09-42e6-ba20-488555b6bd54 req-9e27c690-3e67-4360-aea4-83220b901f25 service nova] Creating event network-vif-plugged:5a9c9f7c-60ad-4917-a400-39dc5b448e26 for instance c4a7ab99-2565-4f22-9189-69152059b3b5 on n-h2-858384-1 Sep 19 15:14:54.781059 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9c10fe53-0c09-42e6-ba20-488555b6bd54 req-9e27c690-3e67-4360-aea4-83220b901f25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044277 Sep 19 15:14:54.782225 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2626/5203] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:55.401905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:55.402644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:55.421195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:55.424894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:55.427851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:55.428794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:55.429488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:55.430973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:55.637699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:55.650218 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f13a0f84-f486-441b-a94e-147f35bfa4d0 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1373 microversion: 2.1 time: 0.253096 Sep 19 15:14:55.651918 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2578/5204] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:55 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:56.677315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:56.678910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:56.685494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:56.686327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:56.687039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:56.688049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:56.688755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:56.689244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:56.845856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:56.856434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59fbacc4-ad53-4e44-a7b9-46b7dfbbe9d3 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1543 microversion: 2.1 time: 0.186116 Sep 19 15:14:56.857431 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2627/5205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:56 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1543 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:56.883463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:56.884085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:56.890399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:56.890935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:56.891378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:56.892081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:56.892540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:56.892966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:57.056827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:57.065676 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ead31184-3121-45ee-843f-c9c9174370c5 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1543 microversion: 2.1 time: 0.188974 Sep 19 15:14:57.066569 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2579/5206] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:56 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1543 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:59.201318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bab5f097-aac0-43fa-bbf0-a32803e0ac81 req-74e0e9f1-fab1-49a2-81d1-bc4db55359cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a7ab99-2565-4f22-9189-69152059b3b5", "tag": "5a9c9f7c-60ad-4917-a400-39dc5b448e26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:59.212313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bab5f097-aac0-43fa-bbf0-a32803e0ac81 req-74e0e9f1-fab1-49a2-81d1-bc4db55359cc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:59.213130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bab5f097-aac0-43fa-bbf0-a32803e0ac81 req-74e0e9f1-fab1-49a2-81d1-bc4db55359cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:59.213756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bab5f097-aac0-43fa-bbf0-a32803e0ac81 req-74e0e9f1-fab1-49a2-81d1-bc4db55359cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:59.232473 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bab5f097-aac0-43fa-bbf0-a32803e0ac81 req-74e0e9f1-fab1-49a2-81d1-bc4db55359cc service nova] Creating event network-changed:5a9c9f7c-60ad-4917-a400-39dc5b448e26 for instance c4a7ab99-2565-4f22-9189-69152059b3b5 on n-h2-858384-1 Sep 19 15:14:59.238587 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bab5f097-aac0-43fa-bbf0-a32803e0ac81 req-74e0e9f1-fab1-49a2-81d1-bc4db55359cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222897 Sep 19 15:14:59.240727 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2628/5207] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:15.269463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:15.270363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:15.276668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:15.277388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=51 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:15.278949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:15.279577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:15.280026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:15.280738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:15.281203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:15.281636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:15.400124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'services' on Instance uuid 16784b0e-0c4b-48bd-a676-13ebf792f804 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:15:15.497937 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a20da57-26ce-4195-a374-c2360ba0bac8 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments/e97384ff-0f7f-434b-9d26-063d0f6c2395" status: 202 len: 0 microversion: 2.1 time: 0.235349 Sep 19 15:15:15.503013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2580/5208] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:15:15 2022] DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments/e97384ff-0f7f-434b-9d26-063d0f6c2395 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:15:15.509495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:15.511872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:15.521264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=13 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:15.522151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:15.527798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:15.528367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:15.528815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:15.529564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:15.530022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:15.530444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:15.591328 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-63469324-ab4b-4f09-9037-6ac8535172f4 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084283 Sep 19 15:15:15.592981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2629/5209] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:15:15 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:16.607485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:16.610029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:16.619015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:16.619945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:16.620587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:16.621480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:16.622111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:16.622801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:16.663603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f5e28cb-2b6f-407d-8579-01831fd63f3d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061676 Sep 19 15:15:16.669409 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2581/5210] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:15:16 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:17.678443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:17.681053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:17.694846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:17.696069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:17.699471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:17.700915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:17.701801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:17.703226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:17.755740 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ae444ac-edce-44e6-976c-4c5caf60ba47 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081393 Sep 19 15:15:17.757078 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2630/5211] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:15:17 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:18.770152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:18.773295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:18.786323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:18.787636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:18.788294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:18.789562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:18.790451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:18.791172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:18.842966 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41b507ad-ede2-4378-a4ab-de91b17463f1 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077846 Sep 19 15:15:18.848370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2582/5212] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:15:18 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:19.855882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:19.857942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:19.865612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:19.866449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:19.867168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:19.868119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:19.868792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:19.869438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:19.905162 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d0736b8f-cc7a-4532-999d-2bc540e8c09c tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053196 Sep 19 15:15:19.906870 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2631/5213] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:15:19 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:20.919409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:20.921986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:20.930506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:20.931296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:20.931740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:20.932454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:20.932913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:20.933339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:20.968556 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd2f926b-9013-4d22-b75f-d6120d21a1ed tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053020 Sep 19 15:15:20.975437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2583/5214] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:15:20 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:15:21.052320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:21.054885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:21.062709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.063330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.063844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.064769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.065408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.065842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.099169 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Cannot 'reboot' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action HTTP/1.1 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 28 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: {"reboot": {"type": "HARD"}} Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: exception: Cannot 'reboot' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '0658e2fe-21a0-4e8a-95ea-13d06e8bf02f', 'body': {'reboot': {'type': 'HARD'}}} Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:15:21.100884 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 409 to user: Cannot 'reboot' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:15:21.114293 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0da3f107-1ccb-4139-9488-cee5cab3ea7d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action" status: 409 len: 145 microversion: 2.1 time: 0.057428 Sep 19 15:15:21.118930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:21.118930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:21.119408 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2632/5215] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:15:21 2022] POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action => generated 145 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:15:21.123793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.124291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.124809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.125701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.125969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.126429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.163070 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Cannot 'rebuild' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action HTTP/1.1 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 65 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: exception: Cannot 'rebuild' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '0658e2fe-21a0-4e8a-95ea-13d06e8bf02f', 'body': {'rebuild': {'imageRef': '65e17483-129b-4a3b-97d8-49cd96ae0799'}}} Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:15:21.165056 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 409 to user: Cannot 'rebuild' instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f while it is in vm_state rescued {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:15:21.178621 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b534176-1b09-49bc-9fca-de2305300106 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action" status: 409 len: 146 microversion: 2.1 time: 0.056990 Sep 19 15:15:21.183361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:21.183361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:21.183794 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2584/5216] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:15:21 2022] POST /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f/action => generated 146 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 19 15:15:21.185454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.186126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.186573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.188027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.188027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.188541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.221042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:15:21.350900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4593a85b-76ad-4572-adf7-6668db22a867 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 204 len: 0 microversion: 2.1 time: 0.177540 Sep 19 15:15:21.351962 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2633/5217] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:15:21 2022] DELETE /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:15:21.360228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:21.360946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:21.368582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.369433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.369942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.370725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.371307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.371836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.424794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:21.428764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:21.446067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.446784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.447411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.448346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:21.448962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:21.449548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:21.522232 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b1168428-11d4-4364-86f0-35f956495c48 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5/action" status: 200 len: 24570 microversion: 2.1 time: 0.101477 Sep 19 15:15:21.530578 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2634/5218] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:15:21 2022] POST /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5/action => generated 24570 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:15:21.539182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:21.551965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9c148e23-4e15-46ca-b5ca-e44bb9be69bc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1689 microversion: 2.1 time: 0.195216 Sep 19 15:15:21.553489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2585/5219] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:21 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:22.578720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:22.579338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:22.588064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:22.588666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:22.589405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:22.590250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:22.591132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:22.591791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:22.742614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:22.750782 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad235055-db35-453b-8a17-db7daecf7426 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1689 microversion: 2.1 time: 0.177656 Sep 19 15:15:22.763261 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2635/5220] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:22 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:23.778218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:23.779254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:23.789054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:23.789793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:23.790376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:23.791227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:23.791792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:23.792319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:23.945505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:23.953899 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a527e38a-d2cc-4af3-80ea-2afda1ac6cdf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1689 microversion: 2.1 time: 0.181187 Sep 19 15:15:23.954614 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2586/5221] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:23 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:24.980560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:24.981164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:24.989846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:24.990342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:24.991056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:24.991746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:24.992408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:24.992801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:25.581810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:25.609289 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9dc7672-2092-44f0-a485-04e679bf95b2 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 200 len: 1689 microversion: 2.1 time: 0.634383 Sep 19 15:15:25.615305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2636/5222] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:24 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 1689 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:25.724519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-49882286-6a3d-4c2a-bb04-8dbacfa70909 req-4348c017-c7eb-458d-b3e9-464bdb677c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16784b0e-0c4b-48bd-a676-13ebf792f804", "name": "network-vif-deleted", "tag": "6c45f4b6-03a5-4ec4-9d90-59a5d2f72786"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:25.743387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-49882286-6a3d-4c2a-bb04-8dbacfa70909 req-4348c017-c7eb-458d-b3e9-464bdb677c86 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:25.755696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-49882286-6a3d-4c2a-bb04-8dbacfa70909 req-4348c017-c7eb-458d-b3e9-464bdb677c86 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:25.756259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-49882286-6a3d-4c2a-bb04-8dbacfa70909 req-4348c017-c7eb-458d-b3e9-464bdb677c86 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:25.784580 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-49882286-6a3d-4c2a-bb04-8dbacfa70909 req-4348c017-c7eb-458d-b3e9-464bdb677c86 service nova] Creating event network-vif-deleted:6c45f4b6-03a5-4ec4-9d90-59a5d2f72786 for instance 16784b0e-0c4b-48bd-a676-13ebf792f804 on n-h1-858384-1 Sep 19 15:15:25.792629 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-49882286-6a3d-4c2a-bb04-8dbacfa70909 req-4348c017-c7eb-458d-b3e9-464bdb677c86 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075026 Sep 19 15:15:25.807241 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2587/5223] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:26.637912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:26.638513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 16784b0e-0c4b-48bd-a676-13ebf792f804] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:26.649712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:26.650205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:26.650637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:26.651432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:26.652034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:26.652409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:26.667478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 could not be found. Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 HTTP/1.1 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 could not be found. Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '16784b0e-0c4b-48bd-a676-13ebf792f804'} Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 could not be found. Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 could not be found. Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:26.669313 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 could not be found. Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 404 to user: Instance 16784b0e-0c4b-48bd-a676-13ebf792f804 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-766bbd56-0f0d-4cf4-9dd8-a19d006dfc67 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804" status: 404 len: 111 microversion: 2.1 time: 0.037074 Sep 19 15:15:26.673919 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2637/5224] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:26 2022] GET /compute/v2.1/servers/16784b0e-0c4b-48bd-a676-13ebf792f804 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:15:26.681131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8237abb7-7c8d-4736-88a3-3a319e6d154a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '.version_select at 0x7fde28a4ba60>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:26.704310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8237abb7-7c8d-4736-88a3-3a319e6d154a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864254879" status: 202 len: 0 microversion: 2.1 time: 0.028243 Sep 19 15:15:26.704898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2588/5225] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 15:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864254879 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:15:28.439130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:28.444452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:28.462692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:28.463642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:28.464316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:28.465283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:28.465988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:28.466646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:28.528833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7498f6e4-aa72-4617-9ef3-261546239c91 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "POST /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5/action" status: 200 len: 32635 microversion: 2.1 time: 0.102273 Sep 19 15:15:28.530085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2638/5226] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:15:28 2022] POST /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5/action => generated 32635 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:15:29.954549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:29.955153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-abdfddb5-6f82-46d0-a764-c5da9c814871 req-25ba79ab-0496-422e-b46a-d5995ccb8ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a7ab99-2565-4f22-9189-69152059b3b5", "tag": "5a9c9f7c-60ad-4917-a400-39dc5b448e26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:29.955567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:29.974156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:29.974961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:29.975593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:29.976499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:29.977131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:29.977640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-abdfddb5-6f82-46d0-a764-c5da9c814871 req-25ba79ab-0496-422e-b46a-d5995ccb8ffe service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:29.977809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:29.978431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-abdfddb5-6f82-46d0-a764-c5da9c814871 req-25ba79ab-0496-422e-b46a-d5995ccb8ffe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:29.979051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-abdfddb5-6f82-46d0-a764-c5da9c814871 req-25ba79ab-0496-422e-b46a-d5995ccb8ffe service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:30.013591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-abdfddb5-6f82-46d0-a764-c5da9c814871 req-25ba79ab-0496-422e-b46a-d5995ccb8ffe service nova] Creating event network-changed:5a9c9f7c-60ad-4917-a400-39dc5b448e26 for instance c4a7ab99-2565-4f22-9189-69152059b3b5 on n-h2-858384-1 Sep 19 15:15:30.024573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:15:30.027012 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-abdfddb5-6f82-46d0-a764-c5da9c814871 req-25ba79ab-0496-422e-b46a-d5995ccb8ffe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075874 Sep 19 15:15:30.029039 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2639/5227] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:30.257696 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-144e5222-6d78-4097-aac9-9b7357a49d65 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 204 len: 0 microversion: 2.1 time: 0.309470 Sep 19 15:15:30.258360 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2589/5228] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:15:29 2022] DELETE /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:15:30.301894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:30.307906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:30.329274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:30.330191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:30.331374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:30.332182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:30.334410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:30.336902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:30.598051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:30.607990 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f27c298-4609-48a5-b513-d574c3a22b95 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1667 microversion: 2.1 time: 0.315084 Sep 19 15:15:30.609241 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2640/5229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:30 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1667 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:31.634230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:31.635003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:31.653534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:31.654034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:31.654692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:31.655605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:31.656232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:31.656842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:32.140430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:32.158521 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa657134-539f-4039-9041-b10b4e287ce9 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1667 microversion: 2.1 time: 0.528267 Sep 19 15:15:32.159565 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2590/5230] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:31 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1667 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:32.938484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7339c480-fb91-4b45-b473-68782545e10a req-1522428f-fab3-4fb0-9ba8-1cae254e306c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a7ab99-2565-4f22-9189-69152059b3b5", "name": "network-vif-deleted", "tag": "5a9c9f7c-60ad-4917-a400-39dc5b448e26"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:32.985833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7339c480-fb91-4b45-b473-68782545e10a req-1522428f-fab3-4fb0-9ba8-1cae254e306c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:32.986544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7339c480-fb91-4b45-b473-68782545e10a req-1522428f-fab3-4fb0-9ba8-1cae254e306c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:32.987123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7339c480-fb91-4b45-b473-68782545e10a req-1522428f-fab3-4fb0-9ba8-1cae254e306c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:33.016849 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7339c480-fb91-4b45-b473-68782545e10a req-1522428f-fab3-4fb0-9ba8-1cae254e306c service nova] Creating event network-vif-deleted:5a9c9f7c-60ad-4917-a400-39dc5b448e26 for instance c4a7ab99-2565-4f22-9189-69152059b3b5 on n-h2-858384-1 Sep 19 15:15:33.026523 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7339c480-fb91-4b45-b473-68782545e10a req-1522428f-fab3-4fb0-9ba8-1cae254e306c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092903 Sep 19 15:15:33.027784 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2641/5231] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:33.185903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:33.187487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:33.202086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:33.205930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:33.206653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:33.207814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:33.208466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:33.212891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:33.287736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:33.288560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:33.289261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:33.289927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lazy-loading 'fault' on Instance uuid c4a7ab99-2565-4f22-9189-69152059b3b5 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:15:33.374211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59b217d95a4da9b5413ac61907ff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a41409c324401883d3dd986a70c628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:33.383817 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c049c8a-8ff4-4df3-bc6e-ba7a18e8ec17 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 200 len: 1337 microversion: 2.1 time: 0.202460 Sep 19 15:15:33.387628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2591/5232] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:33 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 1337 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:34.416093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:34.416964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] [instance: c4a7ab99-2565-4f22-9189-69152059b3b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:34.447615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:34.448139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:34.448582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:34.449310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:34.449771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:34.450200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:34.487778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] HTTP exception thrown: Instance c4a7ab99-2565-4f22-9189-69152059b3b5 could not be found. Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Request method failure captured: Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 HTTP/1.1 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIbLhWfJKKPJimXXqtBHfK0kruaPheR_dBXUZqlPQjcfr3HP0nnVB9KHqtx6GSdr2G-cT5vXokXm9Pr3Qf11rBxE8pEarEFoO4RSKBLoWoVWJDmUsmUFTewnNvY4nedP3cdGrAdQaR7k7CpgYzkElXJxurqL81R_rVwE4n-H78wHdx4 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 40a41409c324401883d3dd986a70c628 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestNetworkBasicOps-478788222 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_40a41409c324401883d3dd986a70c628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/40a41409c324401883d3dd986a70c628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/40a41409c324401883d3dd986a70c628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/40a41409c324401883d3dd986a70c628"}]}] Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestNetworkBasicOps-478788222 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 40a41409c324401883d3dd986a70c628 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestNetworkBasicOps-478788222 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestNetworkBasicOps-478788222-project Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ce59b217d95a4da9b5413ac61907ff98 Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestNetworkBasicOps-478788222-project Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c4a7ab99-2565-4f22-9189-69152059b3b5 could not be found. Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c4a7ab99-2565-4f22-9189-69152059b3b5'} Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a7ab99-2565-4f22-9189-69152059b3b5 could not be found. Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a7ab99-2565-4f22-9189-69152059b3b5 could not be found. Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:34.489770 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a7ab99-2565-4f22-9189-69152059b3b5 could not be found. Sep 19 15:15:34.494333 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:34.503824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Returning 404 to user: Instance c4a7ab99-2565-4f22-9189-69152059b3b5 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:15:34.506326 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1510890c-7e1c-401d-a3de-be7618a8ed5d tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5" status: 404 len: 111 microversion: 2.1 time: 0.097884 Sep 19 15:15:34.508885 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2642/5233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:34 2022] GET /compute/v2.1/servers/c4a7ab99-2565-4f22-9189-69152059b3b5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:15:34.794556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5cca0a08-20b5-4363-aa52-d408cd2e8d04 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] Calling method '.version_select at 0x7fde290101f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:34.833040 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5cca0a08-20b5-4363-aa52-d408cd2e8d04 tempest-TestNetworkBasicOps-478788222 tempest-TestNetworkBasicOps-478788222-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-360468480" status: 202 len: 0 microversion: 2.1 time: 0.044329 Sep 19 15:15:34.834792 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2592/5234] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 15:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-360468480 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:15:35.608870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:35.615196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:35.634176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:35.636050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:35.636773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:35.643588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:35.647275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:35.649715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:35.686621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:15:35.911520 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4f12b11d-3b56-43db-becb-c87fa1ca0b41 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 204 len: 0 microversion: 2.1 time: 0.309624 Sep 19 15:15:35.912390 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2643/5235] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:15:35 2022] DELETE /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:15:35.924399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:35.926318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:35.946916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:35.948304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:35.950087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:35.954122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:35.955106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:35.955823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:36.223792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:36.241806 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-98499a46-f1cd-4575-adb9-8682742fcfe9 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1508 microversion: 2.1 time: 0.324026 Sep 19 15:15:36.256786 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2593/5236] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:35 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:37.275129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:37.276381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:37.287369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:37.288417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:37.289055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:37.289953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:37.290580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:37.291380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:37.592334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:37.619351 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c169136-436f-42e1-bc3c-df1eb5c2321d tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1508 microversion: 2.1 time: 0.349283 Sep 19 15:15:37.619953 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2644/5237] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:37 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:38.643097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:38.647549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:38.660720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:38.663535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:38.667275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:38.668258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:38.668914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:38.669546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:38.869003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:38.878147 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d29ea8e3-0f00-4e48-a0b4-e6cb5df96206 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1466 microversion: 2.1 time: 0.239647 Sep 19 15:15:38.883200 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2594/5238] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:38 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1466 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:39.039928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-22e55156-bed0-4616-96b5-58e0acdccfb5 req-e7628e31-4aaa-4c8b-9253-933a3c2a2da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0658e2fe-21a0-4e8a-95ea-13d06e8bf02f", "name": "network-vif-deleted", "tag": "4385ae20-1d0f-461e-be03-dde6b1046556"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:39.060340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22e55156-bed0-4616-96b5-58e0acdccfb5 req-e7628e31-4aaa-4c8b-9253-933a3c2a2da4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:39.060903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22e55156-bed0-4616-96b5-58e0acdccfb5 req-e7628e31-4aaa-4c8b-9253-933a3c2a2da4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:39.061544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22e55156-bed0-4616-96b5-58e0acdccfb5 req-e7628e31-4aaa-4c8b-9253-933a3c2a2da4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:39.085630 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-22e55156-bed0-4616-96b5-58e0acdccfb5 req-e7628e31-4aaa-4c8b-9253-933a3c2a2da4 service nova] Creating event network-vif-deleted:4385ae20-1d0f-461e-be03-dde6b1046556 for instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f on n-h1-858384-1 Sep 19 15:15:39.097185 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-22e55156-bed0-4616-96b5-58e0acdccfb5 req-e7628e31-4aaa-4c8b-9253-933a3c2a2da4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061523 Sep 19 15:15:39.110398 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2645/5239] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:39.920749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:39.927634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:39.937072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:39.937569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:39.938072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:39.938804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:39.939267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:39.939696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:39.977955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:39.979822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:39.980450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:39.981090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'fault' on Instance uuid 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:15:40.107401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:40.118825 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9fa68ab2-3165-4668-b65c-1b7d5b796384 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 200 len: 1312 microversion: 2.1 time: 0.202113 Sep 19 15:15:40.120596 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2595/5240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:39 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:41.151821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:41.153146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:41.159739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:41.160492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:41.161307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:41.162208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:41.162866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:41.163468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:41.180012 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f could not be found. Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f HTTP/1.1 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f could not be found. Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '0658e2fe-21a0-4e8a-95ea-13d06e8bf02f'} Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f could not be found. Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f could not be found. Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:41.182373 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f could not be found. Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 404 to user: Instance 0658e2fe-21a0-4e8a-95ea-13d06e8bf02f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87c73471-bb3d-4dcf-a69d-52faa4f26dcf tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f" status: 404 len: 111 microversion: 2.1 time: 0.037944 Sep 19 15:15:41.190276 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2646/5241] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:41 2022] GET /compute/v2.1/servers/0658e2fe-21a0-4e8a-95ea-13d06e8bf02f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:15:41.193549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:41.194054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:41.203036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:41.211005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:41.212005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:41.213266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:41.214535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:41.215233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:41.238928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:41.258303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:15:41.360185 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e40fb857-6509-4af0-9dd1-af94172f635a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 204 len: 0 microversion: 2.1 time: 0.170905 Sep 19 15:15:41.361842 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2596/5242] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:15:41 2022] DELETE /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:15:41.370192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:41.371245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:41.377737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:41.378439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:41.379734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:41.380764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:41.381841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:41.382531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:41.387502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:41.623195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:41.639583 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef5f3166-b195-49f6-9848-817790159f80 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.273245 Sep 19 15:15:41.641853 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2647/5243] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:41 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:42.665705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:42.667725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:42.679264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:42.679874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:42.682223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:42.683020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:42.683492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:42.683999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:42.881497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:42.890828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-916eca00-810d-4534-b33f-3317235f7abc tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.229318 Sep 19 15:15:42.892289 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2597/5244] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:42 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:43.921700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:43.923403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:43.932393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:43.933227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:43.933952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:43.935281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:43.940879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:43.942096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:44.129794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:44.138237 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a15d40b8-077d-4d6f-934e-8e1dc531f8dd tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1521 microversion: 2.1 time: 0.220885 Sep 19 15:15:44.139123 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2648/5245] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:43 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:45.048917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cd869a87-b8ce-446c-9adb-1c4c0453bc51 req-ecaaaccb-18f5-44c6-b929-5b601432e972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3273cc40-71ef-4de6-9ab7-cdda49ac1e81", "name": "network-vif-deleted", "tag": "6edb0fb6-2ef9-4121-9dcb-7ac1a2dbaa59"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:45.063005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd869a87-b8ce-446c-9adb-1c4c0453bc51 req-ecaaaccb-18f5-44c6-b929-5b601432e972 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:45.063709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd869a87-b8ce-446c-9adb-1c4c0453bc51 req-ecaaaccb-18f5-44c6-b929-5b601432e972 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:45.064249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd869a87-b8ce-446c-9adb-1c4c0453bc51 req-ecaaaccb-18f5-44c6-b929-5b601432e972 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:45.083642 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cd869a87-b8ce-446c-9adb-1c4c0453bc51 req-ecaaaccb-18f5-44c6-b929-5b601432e972 service nova] Creating event network-vif-deleted:6edb0fb6-2ef9-4121-9dcb-7ac1a2dbaa59 for instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 on n-h2-858384-1 Sep 19 15:15:45.091268 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cd869a87-b8ce-446c-9adb-1c4c0453bc51 req-ecaaaccb-18f5-44c6-b929-5b601432e972 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047464 Sep 19 15:15:45.092837 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2598/5246] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:45.163350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:45.164545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:45.176087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:45.176819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:45.178293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:45.179602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:45.180046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:45.182059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:45.262209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:45.262881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:45.263165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:45.264146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lazy-loading 'fault' on Instance uuid 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:15:45.317112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b884b49a6754a59bcb0c088c6eb7831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f2b868ef9340d786ce5054b0fdf8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:45.325169 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dcab2435-1804-4fff-a22d-2df3a75bf6d7 tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 200 len: 1312 microversion: 2.1 time: 0.167655 Sep 19 15:15:45.326333 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2649/5247] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:45 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:46.351693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:46.353769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] [instance: 3273cc40-71ef-4de6-9ab7-cdda49ac1e81] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:46.357481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:46.365211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:46.366136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:46.367022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:46.367997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:46.368812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:46.369448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:46.397645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] HTTP exception thrown: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 could not be found. Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Request method failure captured: Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 HTTP/1.1 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIa1FKLkYnyP00VsMsQMSOY892Ow2lEfi-5uukeUKsU_3JBvGqM4R68XW8Y6mhqmEYjADTq-w4i8emd6SJ0s2wjlbGbdSisBL54w1hwOYpPlYfQS7Jl1jVsa3HssGM1gSK4eRCfkhjHEGIaOqy7vFv2_VDN-QQKUKBd1BpRvWzNDFIc Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86f2b868ef9340d786ce5054b0fdf8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86f2b868ef9340d786ce5054b0fdf8c4"}]}] Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 86f2b868ef9340d786ce5054b0fdf8c4 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1354254654 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8b884b49a6754a59bcb0c088c6eb7831 Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1354254654-project Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 could not be found. Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '3273cc40-71ef-4de6-9ab7-cdda49ac1e81'} Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 could not be found. Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 could not be found. Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:46.399777 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 could not be found. Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:15:46.406009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] Returning 404 to user: Instance 3273cc40-71ef-4de6-9ab7-cdda49ac1e81 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:15:46.417151 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d79db074-2865-4ce5-bd96-92fc1b8da16a tempest-ServerRescueNegativeTestJSON-1354254654 tempest-ServerRescueNegativeTestJSON-1354254654-project] 10.222.0.81 "GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81" status: 404 len: 111 microversion: 2.1 time: 0.059662 Sep 19 15:15:46.418233 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2599/5248] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:46 2022] GET /compute/v2.1/servers/3273cc40-71ef-4de6-9ab7-cdda49ac1e81 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:15:55.155461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-138608846", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:55.166569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:55.261072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:15:55.263259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:15:55.264497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:15:55.265674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:15:55.266567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:15:55.278569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:55.279416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:55.280128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:55.282726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:55.283473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:55.284132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:55.333219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Getting quotas for project 22a42ca45fa4490a950b059d82ea56f3. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:15:55.359592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Getting quotas for user 235c49a4c76e4c988a28c644b2f49b79 and project 22a42ca45fa4490a950b059d82ea56f3. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:15:55.383393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:15:55.386140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:15:55.471615 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:15:56.480746 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 55532. Sep 19 15:15:56.490873 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f94b7491-87f0-4712-b690-366bea1abee6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.649668 Sep 19 15:15:56.491588 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2650/5249] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 15:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 15:15:56.512613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-92cb87ef-d269-4396-83c4-de14fdde42af tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:56.513761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92cb87ef-d269-4396-83c4-de14fdde42af tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:56.517190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:56.522841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:56.663030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92cb87ef-d269-4396-83c4-de14fdde42af tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:56.671108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92cb87ef-d269-4396-83c4-de14fdde42af tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:56.672580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92cb87ef-d269-4396-83c4-de14fdde42af tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:56.673744 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-92cb87ef-d269-4396-83c4-de14fdde42af tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373" status: 200 len: 1277 microversion: 2.47 time: 0.165840 Sep 19 15:15:56.689527 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2600/5250] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:15:56 2022] GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:15:57.122324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1263408053", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": "none"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:57.280776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:15:57.282175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:15:57.285117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:15:57.290701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:15:57.291957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:15:57.328647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:57.329019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:57.332963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:57.333985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:57.337879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:57.338334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:57.367231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Getting quotas for project 22a42ca45fa4490a950b059d82ea56f3. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:15:57.381452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Getting quotas for user 235c49a4c76e4c988a28c644b2f49b79 and project 22a42ca45fa4490a950b059d82ea56f3. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:15:57.404458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:15:57.407047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:15:57.517356 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4db70938-3751-4edd-b485-7869e8eb4b3a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.411332 Sep 19 15:15:57.537976 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2651/5251] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 15:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 15:15:57.541463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a11b47c4-723f-4860-a006-67d20058afff tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:57.545093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a11b47c4-723f-4860-a006-67d20058afff tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:57.661301 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a11b47c4-723f-4860-a006-67d20058afff tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "PUT /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 992 microversion: 2.47 time: 0.123807 Sep 19 15:15:57.673552 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2601/5252] 10.222.0.81 () {62 vars in 1297 bytes} [Mon Sep 19 15:15:57 2022] PUT /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 992 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:15:57.686787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c0ac9778-fbbb-4e82-9c91-b9b666d618c6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:57.687999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c0ac9778-fbbb-4e82-9c91-b9b666d618c6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:57.839624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ac9778-fbbb-4e82-9c91-b9b666d618c6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:57.854971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ac9778-fbbb-4e82-9c91-b9b666d618c6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:57.859856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c0ac9778-fbbb-4e82-9c91-b9b666d618c6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:57.864228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c0ac9778-fbbb-4e82-9c91-b9b666d618c6 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1278 microversion: 2.47 time: 0.183441 Sep 19 15:15:57.868399 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2652/5253] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:15:57 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:15:58.894357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:58.895169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:58.908434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:58.909231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:58.910237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:58.914097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:58.914831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:58.915426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:59.101459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:59.120061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:59.121824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:59.123174 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a0968b9-ab0c-486c-b453-dbf1471d12f2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1282 microversion: 2.47 time: 0.234421 Sep 19 15:15:59.138231 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2602/5254] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:15:58 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:00.157335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:00.158652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:00.184384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:00.186580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:00.193920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:00.195091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:00.196113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:00.198686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:00.362933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:00.374094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:00.377468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:00.379262 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5be4badc-785f-4782-a985-c557cbf31958 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1330 microversion: 2.47 time: 0.229210 Sep 19 15:16:00.380170 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2653/5255] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:00 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1330 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:01.430460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:01.431120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:01.439377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:01.440108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:01.440694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:01.444604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:01.445266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:01.445877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:01.541662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:01.556357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:01.558954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:01.560220 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a07e44fe-3aef-44c4-87ba-7710586203c0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1336 microversion: 2.47 time: 0.134015 Sep 19 15:16:01.561161 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2603/5256] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:01 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:02.587006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:02.587680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:02.601388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:02.602143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:02.602824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:02.604090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:02.604957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:02.605616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:02.738456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:02.751388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:02.753242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:02.755456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa80cd88-c864-419a-9765-746a55855cb9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1336 microversion: 2.47 time: 0.172816 Sep 19 15:16:02.759780 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2654/5257] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:02 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:03.796296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:03.797619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:03.825771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:03.828951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:03.829342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:03.830107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:03.830584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:03.831113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:03.977453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:03.992178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:03.993731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:03.997676 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26602bfb-2f3d-41aa-94f5-03c31c578aaa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1357 microversion: 2.47 time: 0.213052 Sep 19 15:16:04.016548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2604/5258] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:03 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:04.045112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:04.048856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:04.077808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:04.083906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:04.085945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:04.087307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:04.087995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:04.088703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:04.252517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:16:04.267420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:16:04.269425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:16:04.269984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:16:04.271044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:16:04.401707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:04.414330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:04.423505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:04.424644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:04.426171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:04.426768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:04.427312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:04.484210 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ec6d660-8d24-4df0-b078-3f7c1f0922a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "POST /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039/action" status: 202 len: 1079 microversion: 2.47 time: 0.457487 Sep 19 15:16:04.502839 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2655/5259] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 15:16:04 2022] POST /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039/action => generated 1079 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 19 15:16:04.523055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:04.525536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:04.538709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:04.540445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:04.540904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:04.541647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:04.542111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:04.542545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:04.793682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:04.815309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:04.829166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:04.840586 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62177349-0864-4ea8-81c7-59c823db13e9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.328659 Sep 19 15:16:04.852744 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2605/5260] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:04 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:05.887109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:05.887740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:05.903520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:05.904255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:05.904880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:05.905757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:05.906387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:05.907001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:06.093463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:06.103516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:06.105517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:06.111937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9addf5e8-5a7c-4018-95e6-50a573a8e833 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.228319 Sep 19 15:16:06.134267 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2656/5261] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:05 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:06.667524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:06.900932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49f8d390-1149-4319-a4e9-814908864fd7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Action: 'create', calling method: .version_select at 0x7fde298a4160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1114014386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsg+5k2ZP/rLr529hCqSbyhw0YWBCWgUPgIAVyM28QfSANfRKw1YaxvaA7vI/ucUMLHaU7lVt0ZzrJqMm3/NMFb7Zq2cXPUhfCdamKV2+fGuzYa1YS47GeBjOLPLTSl9g=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:06.921779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-49f8d390-1149-4319-a4e9-814908864fd7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Getting quotas for project d8e5e47ad91b489aba5d6595e70485d8. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:16:06.929695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-49f8d390-1149-4319-a4e9-814908864fd7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Getting quotas for user ed008147855d4176a6ff767950fd20ca and project d8e5e47ad91b489aba5d6595e70485d8. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:16:06.960566 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49f8d390-1149-4319-a4e9-814908864fd7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.324914 Sep 19 15:16:06.962162 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2606/5262] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:16:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:16:07.140378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:07.141626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:07.151232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:07.151982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:07.152645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:07.153655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:07.154312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:07.155036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:07.279118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:07.291338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:07.299095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:07.300939 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c667b183-d040-40b3-8b32-2140cec4e7cb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.166020 Sep 19 15:16:07.302382 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2657/5263] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:07 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:08.335322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:08.335977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:08.352661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:08.353177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:08.353623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:08.354344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:08.354848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:08.355272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:08.402047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-16660663", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1114014386", "security_groups": [{"name": "tempest-secgroup-smoke-524347786"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "00c86ef5-c265-47d4-9c90-f2956aea9688"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:08.430527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:08.431196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:08.508093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:08.516944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:08.518551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:08.520627 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a860d70-88b9-46c1-810a-81b9e0bf4fdb tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.190793 Sep 19 15:16:08.544294 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2607/5264] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:08 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:08.648898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] validate_networks() for [('00c86ef5-c265-47d4-9c90-f2956aea9688', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:16:09.279082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Getting quotas for project d8e5e47ad91b489aba5d6595e70485d8. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:16:09.292452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Getting quotas for user ed008147855d4176a6ff767950fd20ca and project d8e5e47ad91b489aba5d6595e70485d8. Resources: dict_keys(['metadata_items']) {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:16:09.334211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:16:09.334601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:16:09.342716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:16:09.343206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:16:09.343639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:16:09.360328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:09.360843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:09.361293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:09.364634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:09.365139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:09.367907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:09.407798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Getting quotas for project d8e5e47ad91b489aba5d6595e70485d8. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:16:09.422581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Getting quotas for user ed008147855d4176a6ff767950fd20ca and project d8e5e47ad91b489aba5d6595e70485d8. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:16:09.465299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:16:09.468063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:16:09.553745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:09.554550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:09.573975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:09.574781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:09.575491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:09.576406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:09.577029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:09.577621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:09.641375 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-27ba3cbc-821d-4f8d-b224-47d2a00cf59e tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.243173 Sep 19 15:16:09.651483 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2658/5265] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:16:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:16:09.693420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7a86dc2-40b2-4c0b-ba9f-88ff5c7da775 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:09.696222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7a86dc2-40b2-4c0b-ba9f-88ff5c7da775 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:09.740448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:09.752228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:09.767251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:09.769475 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cd8faf2c-54e8-4150-98d9-e2ca83a8e054 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.220754 Sep 19 15:16:09.770300 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2608/5266] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:09 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:16:09.915972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e7a86dc2-40b2-4c0b-ba9f-88ff5c7da775 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:09.928919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7a86dc2-40b2-4c0b-ba9f-88ff5c7da775 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1301 microversion: 2.1 time: 0.273121 Sep 19 15:16:09.947040 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2659/5267] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:09 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1301 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:10.799789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:10.800968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:10.813423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:10.813936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:10.814488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:10.827665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:10.828179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:10.828776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:10.946464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:10.954403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:10.955122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:10.959630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:10.961116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:10.965167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:10.965834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:10.966409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:10.967423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:10.968173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:10.968739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:10.971734 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6b4d1a06-6122-443b-8ac6-3770e28c596b tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.166546 Sep 19 15:16:10.973468 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2609/5268] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:10 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:11.062345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:11.073152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5b171c9-eda2-42a0-9ecf-2585a374388f tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1353 microversion: 2.1 time: 0.123551 Sep 19 15:16:11.073745 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2660/5269] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:10 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:16:12.000737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:12.001245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:12.009123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:12.009667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:12.010116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:12.010854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:12.011314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:12.011740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:12.096756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:12.098094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:12.108477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:12.115272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:12.116141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:12.117279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:12.118467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:12.119337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:12.119964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:12.124805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:12.126482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:12.128089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:12.131866 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-80e1e214-451c-4942-8ac2-9e95d55b40be tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.131019 Sep 19 15:16:12.142808 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2610/5270] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:11 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:12.216166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:12.225095 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-325ada68-80e4-407e-bc24-cecffcf44ff3 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1359 microversion: 2.1 time: 0.132278 Sep 19 15:16:12.238773 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2661/5271] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:12 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1359 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:13.162993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:13.164467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:13.172012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:13.172817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:13.173495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:13.174411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:13.175820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:13.176857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:13.255109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:13.256388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:13.275101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:13.285787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:13.287517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:13.288272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:13.290139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:13.294347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:13.296450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:13.296926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:13.299146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:13.305492 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fe672a49-73ab-4eaa-9e45-8211d9c3737a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.147774 Sep 19 15:16:13.308205 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2611/5272] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:13 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:13.478364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0fcdc8fe-2e77-4db2-9016-89ff651bea73 req-864fd24b-811f-41ac-bb35-05900e653923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd70135-c3b7-429e-b35a-fd2b2ef08fde", "tag": "00ffe343-20c5-4698-a9f1-6b5c9101ecd4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:13.505633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0fcdc8fe-2e77-4db2-9016-89ff651bea73 req-864fd24b-811f-41ac-bb35-05900e653923 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:13.506285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0fcdc8fe-2e77-4db2-9016-89ff651bea73 req-864fd24b-811f-41ac-bb35-05900e653923 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:13.506926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0fcdc8fe-2e77-4db2-9016-89ff651bea73 req-864fd24b-811f-41ac-bb35-05900e653923 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:13.531465 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0fcdc8fe-2e77-4db2-9016-89ff651bea73 req-864fd24b-811f-41ac-bb35-05900e653923 service nova] Creating event network-changed:00ffe343-20c5-4698-a9f1-6b5c9101ecd4 for instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde on n-h2-858384-1 Sep 19 15:16:13.542547 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0fcdc8fe-2e77-4db2-9016-89ff651bea73 req-864fd24b-811f-41ac-bb35-05900e653923 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068428 Sep 19 15:16:13.544784 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2612/5273] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:16:13.727391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:13.735896 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35729384-5ebb-46e2-82c0-75d3cbe6f31c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1426 microversion: 2.1 time: 0.486838 Sep 19 15:16:13.741352 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2662/5274] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:13 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1426 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:14.340131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:14.340748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:14.347662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:14.348165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:14.348598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:14.349300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:14.349756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:14.350184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:14.429785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:14.447867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:14.448928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:14.450435 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad0fe56e-ed2d-4cfb-b13e-96fdba8027c9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.115595 Sep 19 15:16:14.451115 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2613/5275] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:14 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:14.767784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:14.768397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:14.775486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:14.775974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:14.776416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:14.777112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:14.777609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:14.777996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:15.008212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:15.016526 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4ba572b-58a2-4cf5-991b-d1f9e6a4c377 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1426 microversion: 2.1 time: 0.252570 Sep 19 15:16:15.027298 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2663/5276] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:14 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1426 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:15.479682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:15.480822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:15.490377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:15.491345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:15.492888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:15.494382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:15.495439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:15.496017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:15.589416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:15.602012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:15.604068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:15.605575 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-29e44c87-2393-47e6-a128-49106d549b66 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.131063 Sep 19 15:16:15.606550 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2614/5277] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:15 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:16.044232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:16.044947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:16.052089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:16.052731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:16.053272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:16.054178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:16.054756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:16.055296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:16.223943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:16.231746 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffac5579-0e3a-406d-a9f4-8c5c9e9d976b tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1426 microversion: 2.1 time: 0.193031 Sep 19 15:16:16.232335 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2664/5278] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:16 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1426 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:16.634992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:16.634992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:16.657501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:16.658102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:16.658850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:16.659867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:16.660603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:16.661174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:16.742547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:16.752915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:16.755397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:16.756815 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a1b4bc4-c96c-4b87-9c93-92b81c0f360e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.127194 Sep 19 15:16:16.757387 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2615/5279] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:16 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:17.256808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:17.258068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:17.266192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:17.266909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:17.267850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:17.269554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:17.270341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:17.271086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:17.455202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:17.476301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8fc48df9-3d60-4873-a072-47da9206d89c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1426 microversion: 2.1 time: 0.224691 Sep 19 15:16:17.476904 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2665/5280] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:17 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1426 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:17.785469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:17.786916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:17.789625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:17.805941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:17.807399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:17.808126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:17.809111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:17.810036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:17.811165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:17.899926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:17.912774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:17.913918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:17.915255 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-564d2b49-60c6-41f9-89c4-7db2d143a99e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.135393 Sep 19 15:16:17.916009 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2616/5281] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:17 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:18.505459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:18.506782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:18.513390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:18.513901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:18.514325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:18.515057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:18.515514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:18.515934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:18.673263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:18.684225 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aca4c757-4842-4ff7-92f1-2b3c5c13ac66 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1426 microversion: 2.1 time: 0.183645 Sep 19 15:16:18.685125 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2666/5282] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:18 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1426 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:18.942704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:18.943977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:18.952306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:18.953016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:18.953759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:18.954683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:18.955403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:18.955995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:19.028973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:19.040354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:19.041821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:19.043116 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88426ff8-700e-45cc-88cb-f2c3bfed61b9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.105167 Sep 19 15:16:19.043682 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2617/5283] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:18 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:19.311959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-40b83f57-fd2e-4e00-9419-26f63f271dca req-4792684f-a792-43ce-9b90-0b5b07b80bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd70135-c3b7-429e-b35a-fd2b2ef08fde", "name": "network-vif-plugged", "status": "completed", "tag": "00ffe343-20c5-4698-a9f1-6b5c9101ecd4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:19.327261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-40b83f57-fd2e-4e00-9419-26f63f271dca req-4792684f-a792-43ce-9b90-0b5b07b80bc3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:19.332537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-40b83f57-fd2e-4e00-9419-26f63f271dca req-4792684f-a792-43ce-9b90-0b5b07b80bc3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:19.333144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-40b83f57-fd2e-4e00-9419-26f63f271dca req-4792684f-a792-43ce-9b90-0b5b07b80bc3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:19.354564 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-40b83f57-fd2e-4e00-9419-26f63f271dca req-4792684f-a792-43ce-9b90-0b5b07b80bc3 service nova] Creating event network-vif-plugged:00ffe343-20c5-4698-a9f1-6b5c9101ecd4 for instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde on n-h2-858384-1 Sep 19 15:16:19.360598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-40b83f57-fd2e-4e00-9419-26f63f271dca req-4792684f-a792-43ce-9b90-0b5b07b80bc3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052397 Sep 19 15:16:19.361539 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2667/5284] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:16:19.711180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:19.711933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:19.718012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:19.718502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:19.718970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:19.719667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:19.720129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:19.720617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:19.886563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:19.895755 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-51cb68a1-0ab0-4d03-bcf4-fc66aa7a43d7 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1426 microversion: 2.1 time: 0.191668 Sep 19 15:16:19.896441 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2618/5285] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:19 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1426 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:20.068883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:20.070926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:20.075268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:20.076156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:20.085084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:20.085511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:20.086146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:20.086881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:20.087355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:20.087769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:20.158832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:20.174940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:20.177086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:20.178467 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4821a891-0077-455e-9d07-e137663df6e2 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.110662 Sep 19 15:16:20.179520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2668/5286] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:20 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:20.919579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:20.920116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:20.928191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:20.928677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:20.929114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:20.929803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:20.930258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:20.930681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.084953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:21.101644 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7947c516-cf36-4ce3-bc0a-9e12b390bab5 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1605 microversion: 2.1 time: 0.185990 Sep 19 15:16:21.102973 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2619/5287] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:20 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1605 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:21.143136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:21.144571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:21.161684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:21.162185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:21.162622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.163430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:21.164240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:21.164672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.205322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:21.206732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:21.213655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:21.214188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:21.214636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.215368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:21.216406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:21.216914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.221331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:21.306041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:21.318554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:21.320139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:21.321334 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba2a2db9-f88e-4964-b460-ddfe00464716 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.120055 Sep 19 15:16:21.322058 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2620/5288] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:21 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:16:21.342383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:21.353072 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c7bcb8f9-c5cc-4b80-90eb-79eb712b55aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1605 microversion: 2.1 time: 0.230315 Sep 19 15:16:21.353905 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2669/5289] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:21 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:21.376128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:21.376750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:21.383138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:21.383637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:21.384073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.384774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:21.385243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:21.385654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:21.522675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:21.531060 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d5e9fcb2-f0e6-463e-bffc-3d57eef9d9aa tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1605 microversion: 2.1 time: 0.158656 Sep 19 15:16:21.531671 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2621/5290] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:21 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:22.354160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:22.354160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:22.356928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:22.379972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:22.380591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:22.381114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:22.383829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:22.384380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:22.384892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:22.481737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:22.494386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:22.495886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:22.497267 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b1b1a833-1f27-4323-ba98-b68d02cdce40 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.150269 Sep 19 15:16:22.513542 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2670/5291] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:22 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:23.528070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:23.528801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:23.551532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:23.552393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:23.553187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:23.554229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:23.555036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:23.557292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:23.644459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:23.665041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:23.666657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:23.668264 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c375f42-77fc-4bef-9790-c4b4f08380ea tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.144722 Sep 19 15:16:23.669365 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2622/5292] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:23 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:23.708860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2a140e4d-b518-4cdb-9147-a8a52b6ba206 req-fff678ff-5d6e-41b4-9325-796aa7272226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd70135-c3b7-429e-b35a-fd2b2ef08fde", "tag": "00ffe343-20c5-4698-a9f1-6b5c9101ecd4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:23.723060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a140e4d-b518-4cdb-9147-a8a52b6ba206 req-fff678ff-5d6e-41b4-9325-796aa7272226 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:23.723544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a140e4d-b518-4cdb-9147-a8a52b6ba206 req-fff678ff-5d6e-41b4-9325-796aa7272226 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:23.723969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a140e4d-b518-4cdb-9147-a8a52b6ba206 req-fff678ff-5d6e-41b4-9325-796aa7272226 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:23.738773 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2a140e4d-b518-4cdb-9147-a8a52b6ba206 req-fff678ff-5d6e-41b4-9325-796aa7272226 service nova] Creating event network-changed:00ffe343-20c5-4698-a9f1-6b5c9101ecd4 for instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde on n-h2-858384-1 Sep 19 15:16:23.745946 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2a140e4d-b518-4cdb-9147-a8a52b6ba206 req-fff678ff-5d6e-41b4-9325-796aa7272226 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041888 Sep 19 15:16:23.746539 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2671/5293] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:16:24.709022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:24.710331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:24.728653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:24.729388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:24.729988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:24.731052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:24.731674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:24.732261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:24.830589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:24.841927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:24.843711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:24.844911 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-857e0e0c-91cd-416d-8ab7-ddbbd32fbc32 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.141299 Sep 19 15:16:24.845458 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2623/5294] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:24 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:25.877545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:25.893234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:25.905053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:25.905761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:25.906383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:25.907560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:25.908973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:25.908973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:26.003819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:26.013326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:26.015566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:26.017225 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc074f61-f7cd-42c5-b31a-fc15f3235b44 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.147106 Sep 19 15:16:26.018038 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2672/5295] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:25 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:27.062612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:27.062612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:27.070962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:27.092442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:27.092925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:27.093597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:27.094536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:27.095371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:27.096105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:27.219438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:27.236097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:27.239224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:27.240918 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-346d429e-2fd8-452f-b15e-16f740b51f56 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.184058 Sep 19 15:16:27.246808 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2624/5296] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:27 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:28.282188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:28.283625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:28.295136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:28.295900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:28.296549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:28.297485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:28.298171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:28.298904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:28.389142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:28.398833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:28.401074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:28.402488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9dcc526-f041-46c2-bac5-d6625dbee197 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.125238 Sep 19 15:16:28.403937 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2673/5297] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:28 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:29.463335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:29.465325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:29.474160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:29.474718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:29.475189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:29.475910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:29.476432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:29.476892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:29.551537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:29.560533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:29.562301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:29.563700 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c504faf7-3591-42af-9a2d-e1a70a47d081 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.108139 Sep 19 15:16:29.564819 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2625/5298] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:29 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:30.592000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:30.592621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:30.600937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:30.601442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:30.601885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:30.602591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:30.603157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:30.603585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:30.683902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:30.697291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:30.697291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:30.699252 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dbcab15b-a4d5-408c-8760-90912717078d tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.111489 Sep 19 15:16:30.699945 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2674/5299] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:30 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:31.726088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:31.727352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:31.746493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:31.749071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:31.752816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:31.752816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:31.752816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:31.752816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:31.828153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:31.837900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:31.839410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:31.840630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f4babec-e49d-4cad-b2e7-c0d92b3ceff0 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1366 microversion: 2.47 time: 0.119100 Sep 19 15:16:31.841187 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2626/5300] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:31 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:32.868339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:32.868958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:32.876322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:32.876818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:32.877258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:32.878340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:32.878832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:32.879295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:32.954109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:32.963791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:32.965383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:32.966989 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ccbfe406-4eda-4c02-ae7f-0cdffb46d7a3 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1372 microversion: 2.47 time: 0.102424 Sep 19 15:16:32.967680 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2675/5301] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:32 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:16:33.994727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:33.995401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:34.004279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:34.004663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:34.005105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:34.005841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:34.006354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:34.006736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:34.083749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:34.092712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:34.094585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:34.095815 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7d4d811-fcb2-41df-b091-e250429295f9 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1372 microversion: 2.47 time: 0.105341 Sep 19 15:16:34.097186 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2627/5302] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:33 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:35.123296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:35.123999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:35.132689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.133227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.134735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.135564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.136096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.136596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.219502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.233402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.234927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.236110 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a088bce6-b3be-4209-be51-a4df77ae945e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1357 microversion: 2.47 time: 0.117127 Sep 19 15:16:35.236739 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2676/5303] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:35 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:35.267430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:35.274070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.275013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Searching by: {'deleted': False, 'project_id': '22a42ca45fa4490a950b059d82ea56f3'} {{(pid=128731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 15:16:35.282439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.283684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.285304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.287009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.287158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.287645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.418781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.multi_cell_list [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 15:16:35.511382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.511382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.511382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.511914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.524061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.525534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.562002 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5bec8ca6-3899-4b75-abc0-bebc60e3d681 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.299755 Sep 19 15:16:35.562594 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2628/5304] 10.222.0.81 () {60 vars in 1187 bytes} [Mon Sep 19 15:16:35 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:35.597154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:35.597980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:35.604338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.604853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.605289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.606027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.606481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.606940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.635651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:16:35.693848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:35.731952 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5e74186-8ffd-491c-b376-4e3c5cf6f1fa tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 204 len: 0 microversion: 2.47 time: 0.139040 Sep 19 15:16:35.732766 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2677/5305] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:16:35 2022] DELETE /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:16:35.742355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:35.742924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:35.749770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.750478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.751101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.751807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:35.752422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:35.753359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:35.834546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.844430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.845923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:35.847796 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-da405b91-09ac-4e21-aa67-6f18b0457580 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1363 microversion: 2.47 time: 0.110449 Sep 19 15:16:35.848375 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2629/5306] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:35 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1363 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:36.875195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:36.876005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:36.883697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:36.884535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:36.885127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:36.885986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:36.886581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:36.887173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:36.966590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:36.977158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:36.979307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:36.980487 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70cb3469-d2b0-4a01-8ec2-ed5398484e50 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1363 microversion: 2.47 time: 0.110176 Sep 19 15:16:36.983233 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2678/5307] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:36 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1363 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:38.010667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:38.011920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:38.020792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:38.021469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:38.022079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:38.022969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:38.023574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:38.024148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:38.074100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:38.074588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:38.075136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:38.075664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lazy-loading 'fault' on Instance uuid 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:16:38.127134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:38.136868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:38.138347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:38.139664 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f99191b-2f82-423c-89b1-22ecd2de3d2e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 200 len: 1368 microversion: 2.47 time: 0.133981 Sep 19 15:16:38.140267 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2630/5308] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:38 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 1368 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:39.166459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:39.167289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 6a2549e5-b5a7-444e-bcb2-cb800fe3a039] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:39.175005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:39.175498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:39.176113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:39.177067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:39.177527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:39.177951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:39.193196 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] HTTP exception thrown: Instance 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 could not be found. Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Request method failure captured: Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 HTTP/1.1 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIeqzD19ZlANXf3EstAB5gcZeARpGTfToVOHO9HQbRJOSHwfta9zZNOufUChYPc43i5yPHJXfQR2IEjBw1FWXnU2NqVObpJ5VE0FmARKUiqUcq9BnWIr1VQVwhlZ2Lnqno97rwk-UiZMezESzTCb4Y9W79dP4Mv8bT4K2f_AxiwYVU0 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.47 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 22a42ca45fa4490a950b059d82ea56f3 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerShowV247Test-835793768 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_22a42ca45fa4490a950b059d82ea56f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/22a42ca45fa4490a950b059d82ea56f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/22a42ca45fa4490a950b059d82ea56f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/22a42ca45fa4490a950b059d82ea56f3"}]}] Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerShowV247Test-835793768 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 22a42ca45fa4490a950b059d82ea56f3 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerShowV247Test-835793768 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerShowV247Test-835793768-project Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 235c49a4c76e4c988a28c644b2f49b79 Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerShowV247Test-835793768-project Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 could not be found. Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6a2549e5-b5a7-444e-bcb2-cb800fe3a039'} Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 could not be found. Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 could not be found. Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:16:39.195014 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 could not be found. Sep 19 15:16:39.199628 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:39.201675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Returning 404 to user: Instance 6a2549e5-b5a7-444e-bcb2-cb800fe3a039 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:16:39.202545 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ddf706b-b7f4-45cd-b4df-aec5f78eb401 tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039" status: 404 len: 111 microversion: 2.47 time: 0.040133 Sep 19 15:16:39.206697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2679/5309] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:39 2022] GET /compute/v2.1/servers/6a2549e5-b5a7-444e-bcb2-cb800fe3a039 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:16:39.212335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:39.212901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:39.220382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:39.222451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:39.222962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:39.223837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:39.224310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:39.224767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:39.258805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:16:39.351841 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2131327-6e0b-429d-b275-65a71dd6e91c tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "DELETE /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373" status: 204 len: 0 microversion: 2.47 time: 0.142201 Sep 19 15:16:39.352490 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2631/5310] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 15:16:39 2022] DELETE /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:16:39.360875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:39.361495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:39.368707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:39.369241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:39.369795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:39.370620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:39.371257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:39.371796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:39.460083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:39.478607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:39.480068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:39.481273 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7ac9355c-356a-4087-9ad0-537aef93bf9a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373" status: 200 len: 1362 microversion: 2.47 time: 0.124398 Sep 19 15:16:39.503041 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2680/5311] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:39 2022] GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:40.509849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:40.510480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:40.517670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:40.518889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:40.519384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:40.520429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:40.520926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:40.521560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:40.597217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:40.606336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:40.607857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '235c49a4c76e4c988a28c644b2f49b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a42ca45fa4490a950b059d82ea56f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:40.609267 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-86e60fa2-05f8-4e6d-9b5b-4b0a0425b45a tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373" status: 200 len: 1362 microversion: 2.47 time: 0.103770 Sep 19 15:16:40.609870 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2632/5312] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:40 2022] GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373 => generated 1362 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:16:41.637718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:41.638330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] [instance: 70acb6cf-63fe-408d-a1cc-a98af307e373] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:41.645994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:41.646478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:41.646945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:41.647641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:41.648091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:41.648539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:41.671452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] HTTP exception thrown: Instance 70acb6cf-63fe-408d-a1cc-a98af307e373 could not be found. Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Request method failure captured: Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373 HTTP/1.1 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIeqzD19ZlANXf3EstAB5gcZeARpGTfToVOHO9HQbRJOSHwfta9zZNOufUChYPc43i5yPHJXfQR2IEjBw1FWXnU2NqVObpJ5VE0FmARKUiqUcq9BnWIr1VQVwhlZ2Lnqno97rwk-UiZMezESzTCb4Y9W79dP4Mv8bT4K2f_AxiwYVU0 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Openstack-Nova-Api-Version: 2.47 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 22a42ca45fa4490a950b059d82ea56f3 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerShowV247Test-835793768 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_22a42ca45fa4490a950b059d82ea56f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/22a42ca45fa4490a950b059d82ea56f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/22a42ca45fa4490a950b059d82ea56f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/22a42ca45fa4490a950b059d82ea56f3"}]}] Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerShowV247Test-835793768 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 22a42ca45fa4490a950b059d82ea56f3 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerShowV247Test-835793768 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerShowV247Test-835793768-project Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 235c49a4c76e4c988a28c644b2f49b79 Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerShowV247Test-835793768-project Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 70acb6cf-63fe-408d-a1cc-a98af307e373 could not be found. Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '70acb6cf-63fe-408d-a1cc-a98af307e373'} Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70acb6cf-63fe-408d-a1cc-a98af307e373 could not be found. Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70acb6cf-63fe-408d-a1cc-a98af307e373 could not be found. Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:16:41.673137 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70acb6cf-63fe-408d-a1cc-a98af307e373 could not be found. Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] Returning 404 to user: Instance 70acb6cf-63fe-408d-a1cc-a98af307e373 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3a521673-7c90-4d43-8579-f2c056468a6e tempest-ServerShowV247Test-835793768 tempest-ServerShowV247Test-835793768-project] 10.222.0.81 "GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373" status: 404 len: 111 microversion: 2.47 time: 0.040889 Sep 19 15:16:41.677251 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2681/5313] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 15:16:41 2022] GET /compute/v2.1/servers/70acb6cf-63fe-408d-a1cc-a98af307e373 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:16:42.260910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-54c5a034-5088-41cc-be58-e5b12f46ac5a tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Action: 'create', calling method: .version_select at 0x7fde289f8d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1221663127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuR/b78g+GEE9Ydp09zx0jALSevcNbiOIOcUd5Y8wB7buQQC4GStPjgbyrTrkMLUqXgGLLW8e9txQ7hsPUmVRqVJ6kpzC5lb5z90Q4qonwJli2mPUoyhRDP9ozhgaYrbg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:42.279526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-54c5a034-5088-41cc-be58-e5b12f46ac5a tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Getting quotas for project 0172823b31a9411dbbd0067d7f70be2b. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:16:42.286947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-54c5a034-5088-41cc-be58-e5b12f46ac5a tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Getting quotas for user 839074cc2587424fb04099307652919c and project 0172823b31a9411dbbd0067d7f70be2b. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:16:42.316848 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-54c5a034-5088-41cc-be58-e5b12f46ac5a tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059922 Sep 19 15:16:42.317757 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2633/5314] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:16:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:16:43.582482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-7388397", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b55fa222-4673-4417-9653-aca9d13ad743", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1221663127", "security_groups": [{"name": "tempest-secgroup-smoke-434073547"}], "networks": [{"uuid": "bf3b210a-b7ec-4352-b761-6015eefe31a5"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:43.731104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] validate_networks() for [('bf3b210a-b7ec-4352-b761-6015eefe31a5', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:16:44.291177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:16:44.291608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:16:44.292097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:16:44.292513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:16:44.292946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:16:44.303227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:44.304072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:44.304721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:44.305668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:44.306357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:44.307040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:44.332662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Getting quotas for project 0172823b31a9411dbbd0067d7f70be2b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:16:44.340265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Getting quotas for user 839074cc2587424fb04099307652919c and project 0172823b31a9411dbbd0067d7f70be2b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:16:44.413667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:16:44.416087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b55fa222-4673-4417-9653-aca9d13ad743',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:16:44.625393 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-152fb305-048b-4a58-b01e-0a1b83f2c718 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.045015 Sep 19 15:16:44.626189 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2682/5315] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:16:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:16:44.637482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d9d82e4e-ac8d-4a6f-b08e-33ef6a76d660 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:44.638276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d9d82e4e-ac8d-4a6f-b08e-33ef6a76d660 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:44.794628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d9d82e4e-ac8d-4a6f-b08e-33ef6a76d660 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:44.817766 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d9d82e4e-ac8d-4a6f-b08e-33ef6a76d660 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1096 microversion: 2.1 time: 0.170875 Sep 19 15:16:44.818474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2634/5316] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:44 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1096 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:45.842642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:45.843298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:45.854486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:45.855266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:45.855957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:45.865965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:45.866566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:45.867071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:45.994559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:46.005845 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aba26e0f-9058-480c-958a-07775df4e06b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1194 microversion: 2.1 time: 0.167023 Sep 19 15:16:46.016004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2683/5317] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:45 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1194 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:47.042710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:47.044809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:47.055199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:47.084147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:47.084967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:47.085625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:47.087005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:47.087679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:47.089096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:47.613142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:47.628957 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f16d1d4b-06d9-4c58-aee2-4063e103cbce tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1279 microversion: 2.1 time: 0.593490 Sep 19 15:16:47.630136 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2635/5318] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:47 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1279 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:48.633108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8ec639b4-227c-4669-bf70-8f5e991390b6 req-66af153a-3c6c-4ee5-9e7b-09aa8ddc3d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:48.653769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:48.654554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:48.661931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:48.672814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:48.673414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:48.674326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:48.675018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:48.675600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:48.687597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:48.695304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8ec639b4-227c-4669-bf70-8f5e991390b6 req-66af153a-3c6c-4ee5-9e7b-09aa8ddc3d1d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:48.695831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8ec639b4-227c-4669-bf70-8f5e991390b6 req-66af153a-3c6c-4ee5-9e7b-09aa8ddc3d1d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:48.696269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8ec639b4-227c-4669-bf70-8f5e991390b6 req-66af153a-3c6c-4ee5-9e7b-09aa8ddc3d1d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:48.741041 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8ec639b4-227c-4669-bf70-8f5e991390b6 req-66af153a-3c6c-4ee5-9e7b-09aa8ddc3d1d service nova] Creating event network-changed:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:16:48.762111 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8ec639b4-227c-4669-bf70-8f5e991390b6 req-66af153a-3c6c-4ee5-9e7b-09aa8ddc3d1d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133888 Sep 19 15:16:48.767186 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2684/5319] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:16:49.305093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:49.322351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e3aa04e-6868-4ca2-b67d-923d8d5a9373 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1279 microversion: 2.1 time: 0.672099 Sep 19 15:16:49.323490 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2636/5320] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:48 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1279 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:50.354260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:50.355102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:50.373817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:50.375190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:50.376483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:50.379807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:50.380923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:50.383335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:50.675736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:50.686399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91277826-7c5c-448e-8d0e-4cf1758479b0 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1279 microversion: 2.1 time: 0.337996 Sep 19 15:16:50.687377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2685/5321] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:50 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:51.710631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:51.711328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:51.725967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:51.726470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:51.726942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:51.727828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:51.728443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:51.729027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:51.955702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:51.966883 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-96de2734-7575-4e87-9b31-2403e387a5e1 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1279 microversion: 2.1 time: 0.260463 Sep 19 15:16:51.983408 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2637/5322] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:51 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:52.996364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:52.997166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:53.000220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:53.010989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:53.016494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:53.017063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:53.017986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:53.018556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:53.019118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:53.316985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:53.328350 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13b6cb1e-241e-4731-acb1-df726d695296 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1279 microversion: 2.1 time: 0.336327 Sep 19 15:16:53.328947 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2686/5323] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:52 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:54.353614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:54.354217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:54.372277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:54.372787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:54.373228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:54.380706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:54.383108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:54.383847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:54.737586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:54.798518 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-229e6547-8456-4bcc-ae2a-7a7e6ea7e4f5 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.447006 Sep 19 15:16:54.811041 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2638/5324] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:54 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:55.832474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:55.833252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:55.836184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:55.839537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:55.854210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:55.854724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:55.864859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:55.870784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:55.870784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:55.872171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:56.210150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:56.225105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad4fc716-ec24-4681-966b-e7f51d91f055 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.395234 Sep 19 15:16:56.225759 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2687/5325] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:55 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:57.249870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:57.251180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:57.258357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:57.261535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:57.270461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:57.271330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:57.271968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:57.272882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:57.273536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:57.274416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:57.446642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:57.455996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13923171-9dae-47c7-a181-1ae10e99530f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.210028 Sep 19 15:16:57.457490 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2639/5326] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:57 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:58.270129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-471985065", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "dcc240e7-b61b-4a60-b0be-dcb960908162"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:58.336023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] validate_networks() for [('dcc240e7-b61b-4a60-b0be-dcb960908162', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:16:58.481761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:58.483010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:58.500172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:58.505369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:58.506079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:58.507206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:58.508972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:58.509803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:58.728616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:58.739917 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ed037e8-8fb9-47dd-8434-477abff13a00 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.262193 Sep 19 15:16:58.751489 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2640/5327] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:58 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:58.992304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:16:58.992775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:16:58.993411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:16:58.994019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:16:58.994433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:16:59.003632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.004137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.004570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.005290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.005840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.006139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.024776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Getting quotas for project 86bd173cf42b4eff8df3c6e3d7af0447. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:16:59.030639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Getting quotas for user 37df15805ca842bc9a8de0e2b30b402b and project 86bd173cf42b4eff8df3c6e3d7af0447. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:16:59.045538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:16:59.049844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:16:59.104941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1dcdf3f-4199-4785-98c5-177eaeba328d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076958 Sep 19 15:16:59.113581 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2688/5328] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:16:59.125644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-15908ec8-81b4-4e3f-b8bf-883c3dcfc5ce tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:59.126274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-15908ec8-81b4-4e3f-b8bf-883c3dcfc5ce tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:59.185781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-15908ec8-81b4-4e3f-b8bf-883c3dcfc5ce tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:59.194140 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-15908ec8-81b4-4e3f-b8bf-883c3dcfc5ce tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1227 microversion: 2.1 time: 0.074020 Sep 19 15:16:59.194761 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2641/5329] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:59 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1227 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:59.773976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:59.787092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:59.787686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:59.788673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:59.804089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.804603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.805070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.806894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.807392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.808818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.809282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.809718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.811027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.811764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.812263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.818906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.881012 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86cba7f9-955f-4299-adbd-3c593b939b11 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.122751 Sep 19 15:16:59.881937 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2689/5330] 10.222.0.81 () {58 vars in 1293 bytes} [Mon Sep 19 15:16:59 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde/os-server-password => generated 116 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:00.042807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:00.052260 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d67ea2fe-f060-4965-9185-31d01c1e4dcb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.290685 Sep 19 15:17:00.055912 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2642/5331] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:59 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:00.219373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:00.220413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:00.229631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:00.230111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:00.230730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:00.231458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:00.233579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:00.234148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:00.311123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:00.320024 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec2f70ee-aeb1-4e46-9845-9d6b468023f1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1279 microversion: 2.1 time: 0.104732 Sep 19 15:17:00.320620 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2690/5332] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:00 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:01.080652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:01.082190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:01.090082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:01.090926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:01.091573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:01.092474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:01.093153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:01.093776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:01.345071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:01.347791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:01.366408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:01.367120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:01.367738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:01.373852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:01.374345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:01.374815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:01.525242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:01.544485 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-77a0bda2-0b5a-4612-a50a-0a38dcfd72fd tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.469510 Sep 19 15:17:01.546024 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2643/5333] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:01 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:01.823273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:01.838298 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ddb6e4a4-39a9-4908-95ca-b9564e2078ab tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.497907 Sep 19 15:17:01.851220 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2691/5334] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:01 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:02.568938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:02.569708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:02.580560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.583490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.585266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.586140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.590487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.591094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.807986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ffbd0769-a598-4da2-a2f1-9b0d987d637c req-ab6d981c-707b-4bfe-a92d-4f10ba2bfcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e928460-1f00-4521-a575-01f40b55c577", "tag": "5a84fa15-beca-4d57-89c5-633fd780084b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:02.822493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ffbd0769-a598-4da2-a2f1-9b0d987d637c req-ab6d981c-707b-4bfe-a92d-4f10ba2bfcd2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.823096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ffbd0769-a598-4da2-a2f1-9b0d987d637c req-ab6d981c-707b-4bfe-a92d-4f10ba2bfcd2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.823540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ffbd0769-a598-4da2-a2f1-9b0d987d637c req-ab6d981c-707b-4bfe-a92d-4f10ba2bfcd2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.840327 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ffbd0769-a598-4da2-a2f1-9b0d987d637c req-ab6d981c-707b-4bfe-a92d-4f10ba2bfcd2 service nova] Creating event network-changed:5a84fa15-beca-4d57-89c5-633fd780084b for instance 1e928460-1f00-4521-a575-01f40b55c577 on n-h2-858384-1 Sep 19 15:17:02.845436 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ffbd0769-a598-4da2-a2f1-9b0d987d637c req-ab6d981c-707b-4bfe-a92d-4f10ba2bfcd2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041784 Sep 19 15:17:02.846605 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2692/5335] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:02.863658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:02.864288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:02.872392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.872898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.873346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.874117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.874872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.875144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.932122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:02.941980 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5a3b574d-adc0-49cf-8f6a-05ef831ff07b tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.377335 Sep 19 15:17:02.943292 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2644/5336] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:02 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:03.194260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:03.209046 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3833cc8b-f3a8-48c4-80ee-25f0e4891db5 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.350160 Sep 19 15:17:03.210473 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2693/5337] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:02 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:03.230439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-389f0bc9-6200-409d-a13b-796add434cf3 req-d9a58808-4db2-48a8-853a-c5d4be26d037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "name": "network-vif-plugged", "status": "completed", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:03.249599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-389f0bc9-6200-409d-a13b-796add434cf3 req-d9a58808-4db2-48a8-853a-c5d4be26d037 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:03.250091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-389f0bc9-6200-409d-a13b-796add434cf3 req-d9a58808-4db2-48a8-853a-c5d4be26d037 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:03.250526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-389f0bc9-6200-409d-a13b-796add434cf3 req-d9a58808-4db2-48a8-853a-c5d4be26d037 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:03.285723 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-389f0bc9-6200-409d-a13b-796add434cf3 req-d9a58808-4db2-48a8-853a-c5d4be26d037 service nova] Creating event network-vif-plugged:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:17:03.292969 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-389f0bc9-6200-409d-a13b-796add434cf3 req-d9a58808-4db2-48a8-853a-c5d4be26d037 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065547 Sep 19 15:17:03.294370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2645/5338] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:03.969588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:03.970455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:03.977232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:03.977862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:03.979001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:03.979711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:03.980166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:03.980591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:04.118797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:04.126657 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abedbb28-a233-4987-a8da-d37c58b696a6 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1267 microversion: 2.1 time: 0.162168 Sep 19 15:17:04.127934 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2694/5339] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:03 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:04.233804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:04.234550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:04.240885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:04.241367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:04.241898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:04.242579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:04.243064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:04.243484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:04.513104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:04.523299 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d84472ad-df9d-4e13-a40b-7328aa51c3d2 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.294502 Sep 19 15:17:04.524168 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2646/5340] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:04 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:05.150112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:05.150776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:05.157725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.158208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.159306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.160038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.160452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.160873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.306861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:05.315907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d39a28cc-7091-4e4f-8e70-0cd7a4f6d17f tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1456 microversion: 2.1 time: 0.169699 Sep 19 15:17:05.316605 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2695/5341] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:05 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1456 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:05.338470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:05.339118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:05.345772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.346212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.346648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.347427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.347883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.348310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.485297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:05.494998 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71274179-94ee-4605-9a63-732fe40a6a60 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1456 microversion: 2.1 time: 0.160331 Sep 19 15:17:05.495584 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2647/5342] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:05 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1456 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:05.549370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:05.550962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:05.559153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.560006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.560750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.561660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.562297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.562935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.707931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:05.717519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:05.721673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c67f2c3a-4737-458c-9a97-a787b30cd66b tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.176480 Sep 19 15:17:05.723242 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2696/5343] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:05 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:06.746083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:06.746711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:06.753628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:06.754212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:06.754731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:06.755555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:06.756456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:06.756899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:06.920510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:06.929413 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b8a02a1-18a7-49bc-9f58-c9b9d94b846c tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.187726 Sep 19 15:17:06.930275 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2648/5344] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:06 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:07.385873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-51003549-30ea-4619-982c-74d8772f5cb8 req-7442dcd9-6d73-4d84-9149-e581395677c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:07.427719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-51003549-30ea-4619-982c-74d8772f5cb8 req-7442dcd9-6d73-4d84-9149-e581395677c8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:07.428209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-51003549-30ea-4619-982c-74d8772f5cb8 req-7442dcd9-6d73-4d84-9149-e581395677c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:07.428639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-51003549-30ea-4619-982c-74d8772f5cb8 req-7442dcd9-6d73-4d84-9149-e581395677c8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:07.454069 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-51003549-30ea-4619-982c-74d8772f5cb8 req-7442dcd9-6d73-4d84-9149-e581395677c8 service nova] Creating event network-changed:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:17:07.465795 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-51003549-30ea-4619-982c-74d8772f5cb8 req-7442dcd9-6d73-4d84-9149-e581395677c8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082134 Sep 19 15:17:07.466481 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2697/5345] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:07.953217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:07.954610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:07.963093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:07.963954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:07.964637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:07.965624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:07.966307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:07.966996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:08.140496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:08.157831 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e0c050c8-d801-4f3e-8a26-2f6721d30c5f tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.208434 Sep 19 15:17:08.171330 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2649/5346] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:07 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:09.188723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:09.191100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:09.195216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:09.196107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:09.202883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:09.203603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:09.204327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:09.205774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:09.207204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:09.207808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:09.422715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:09.441408 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-acb50017-ece8-4c5c-ad2b-4b9bb359b7be tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.258571 Sep 19 15:17:09.443140 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2698/5347] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:09 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:09.552055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-136df0d7-603e-454f-b19d-4992fd784262 req-266ca9a5-7b6f-4dce-93cf-706b269b6459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e928460-1f00-4521-a575-01f40b55c577", "name": "network-vif-plugged", "status": "completed", "tag": "5a84fa15-beca-4d57-89c5-633fd780084b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:09.568496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:09.602576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5eb3fa58-560e-4863-a8ce-f64595cf6b1a req-739afe35-a055-4b49-a107-c558084c3b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:09.610618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-136df0d7-603e-454f-b19d-4992fd784262 req-266ca9a5-7b6f-4dce-93cf-706b269b6459 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:09.613151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-136df0d7-603e-454f-b19d-4992fd784262 req-266ca9a5-7b6f-4dce-93cf-706b269b6459 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:09.614600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-136df0d7-603e-454f-b19d-4992fd784262 req-266ca9a5-7b6f-4dce-93cf-706b269b6459 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:09.627059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5eb3fa58-560e-4863-a8ce-f64595cf6b1a req-739afe35-a055-4b49-a107-c558084c3b40 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:09.629392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5eb3fa58-560e-4863-a8ce-f64595cf6b1a req-739afe35-a055-4b49-a107-c558084c3b40 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:09.630399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5eb3fa58-560e-4863-a8ce-f64595cf6b1a req-739afe35-a055-4b49-a107-c558084c3b40 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:09.653584 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5eb3fa58-560e-4863-a8ce-f64595cf6b1a req-739afe35-a055-4b49-a107-c558084c3b40 service nova] Creating event network-changed:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:17:09.655660 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-136df0d7-603e-454f-b19d-4992fd784262 req-266ca9a5-7b6f-4dce-93cf-706b269b6459 service nova] Creating event network-vif-plugged:5a84fa15-beca-4d57-89c5-633fd780084b for instance 1e928460-1f00-4521-a575-01f40b55c577 on n-h2-858384-1 Sep 19 15:17:09.659673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5eb3fa58-560e-4863-a8ce-f64595cf6b1a req-739afe35-a055-4b49-a107-c558084c3b40 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074141 Sep 19 15:17:09.664448 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2699/5348] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:09.673136 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-136df0d7-603e-454f-b19d-4992fd784262 req-266ca9a5-7b6f-4dce-93cf-706b269b6459 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125954 Sep 19 15:17:09.674090 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2650/5349] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:10.469874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:10.471302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:10.478536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:10.479163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:10.479665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:10.480439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:10.481399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:10.481908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:10.639069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:10.649502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f8032a8-532f-41e0-afd6-9b696568087d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1327 microversion: 2.1 time: 0.185117 Sep 19 15:17:10.650796 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2700/5350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:10 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:11.674780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:11.676111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:11.676322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-31301059-8604-4c76-88e8-da2c7e758350 req-5f1fceea-fe5d-4d99-99f7-798512307959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:11.685325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.686046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.686680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:11.687596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.688209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.688792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:11.697349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-31301059-8604-4c76-88e8-da2c7e758350 req-5f1fceea-fe5d-4d99-99f7-798512307959 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.697843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-31301059-8604-4c76-88e8-da2c7e758350 req-5f1fceea-fe5d-4d99-99f7-798512307959 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.698396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-31301059-8604-4c76-88e8-da2c7e758350 req-5f1fceea-fe5d-4d99-99f7-798512307959 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:11.711092 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-31301059-8604-4c76-88e8-da2c7e758350 req-5f1fceea-fe5d-4d99-99f7-798512307959 service nova] Creating event network-changed:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:17:11.716111 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-31301059-8604-4c76-88e8-da2c7e758350 req-5f1fceea-fe5d-4d99-99f7-798512307959 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044114 Sep 19 15:17:11.717069 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2701/5351] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:11.835276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:11.844310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1c10f130-b1d3-4496-8c93-421482337972 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1526 microversion: 2.1 time: 0.175169 Sep 19 15:17:11.856610 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2651/5352] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:11 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1526 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:11.869668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:11.870385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:11.876921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.877907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.878507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:11.879320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.879954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.880550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.031427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:12.048082 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ce234ff-ca44-4bf0-a69f-01da3362f2d9 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1526 microversion: 2.1 time: 0.182994 Sep 19 15:17:12.049512 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2702/5353] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:11 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1526 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:12.131136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:12.131641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:12.139426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.140490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.141000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.142222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.143677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.143677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.159955 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] HTTP exception thrown: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Request method failure captured: Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 HTTP/1.1 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIfp7oEs_BvLAu1jPgG2oqxDbcMq4k_CSIiOVHMRod_BdFDGRfE3NxtI1fsjrYWMtJ8-C1mxUxcvZYbEh5PfyuqR1rtf3VIi7pvp85HtVJl4DO-Us2rjP54Us-mlickoD21WWZr_CMY8Su2kidVNLciaFHLBcwsjQMfqSIZ2rrPURqg Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 776323a930154ea8817b990111bc7138 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1046096313 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_776323a930154ea8817b990111bc7138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/776323a930154ea8817b990111bc7138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/776323a930154ea8817b990111bc7138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/776323a930154ea8817b990111bc7138"}]}] Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1046096313 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 776323a930154ea8817b990111bc7138 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1046096313 Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1046096313-project Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: d53cbbc51f024e20801a400b3a3dbb1d Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1046096313-project Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1e928460-1f00-4521-a575-01f40b55c577'} Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:17:12.161798 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Returning 404 to user: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-960a088d-cc43-485f-a345-f6e0c3ee7c93 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 404 len: 111 microversion: 2.1 time: 0.095599 Sep 19 15:17:12.165501 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2652/5354] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:17:12 2022] DELETE /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:17:12.173365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:12.174867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:12.181478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.181989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.182648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.183663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.184298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.184899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.339487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:12.348285 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82950e5f-8396-4ca0-8946-11e81ce8a2b6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1526 microversion: 2.1 time: 0.178768 Sep 19 15:17:12.348864 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2703/5355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:12 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1526 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:12.370740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Action: 'update', calling method: >, body: {"server": {"name": "1e928460-1f00-4521-a575-01f40b55c577_new"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:12.373350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:12.379781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.380278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.380732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.381425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.381888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.382318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.396710 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] HTTP exception thrown: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Request method failure captured: Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: request: PUT /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 HTTP/1.1 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 64 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIfp7oEs_BvLAu1jPgG2oqxDbcMq4k_CSIiOVHMRod_BdFDGRfE3NxtI1fsjrYWMtJ8-C1mxUxcvZYbEh5PfyuqR1rtf3VIi7pvp85HtVJl4DO-Us2rjP54Us-mlickoD21WWZr_CMY8Su2kidVNLciaFHLBcwsjQMfqSIZ2rrPURqg Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 776323a930154ea8817b990111bc7138 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1046096313 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_776323a930154ea8817b990111bc7138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/776323a930154ea8817b990111bc7138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/776323a930154ea8817b990111bc7138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/776323a930154ea8817b990111bc7138"}]}] Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1046096313 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 776323a930154ea8817b990111bc7138 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1046096313 Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1046096313-project Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: d53cbbc51f024e20801a400b3a3dbb1d Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1046096313-project Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: {"server": {"name": "1e928460-1f00-4521-a575-01f40b55c577_new"}} Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '1e928460-1f00-4521-a575-01f40b55c577', 'body': {'server': {'name': '1e928460-1f00-4521-a575-01f40b55c577_new'}}} Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:17:12.398362 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] Returning 404 to user: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e2883423-a04e-4f55-aac1-989fd75b9af5 tempest-ServersNegativeTestMultiTenantJSON-1046096313 tempest-ServersNegativeTestMultiTenantJSON-1046096313-project] 10.222.0.81 "PUT /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 404 len: 111 microversion: 2.1 time: 0.033035 Sep 19 15:17:12.402618 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2653/5356] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:17:12 2022] PUT /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:17:12.412036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:12.412624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:12.419110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.419711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.420244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.421043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.421504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.421955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.449476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:17:12.536161 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4517bdd8-fd47-4625-952a-61cd3ba97df6 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 204 len: 0 microversion: 2.1 time: 0.130536 Sep 19 15:17:12.537187 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2704/5357] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:17:12 2022] DELETE /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:17:12.545218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:12.545832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:12.553235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.553727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.554163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.555086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:12.555551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:12.555977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.697411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:12.705611 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0439236a-3e0c-40d0-a054-ebfd665d804d tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1532 microversion: 2.1 time: 0.163759 Sep 19 15:17:12.706185 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2654/5358] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:12 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1532 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:13.728864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:13.729827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:13.737706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:13.738197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:13.738635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:13.739364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:13.739852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:13.740278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:13.952574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df15805ca842bc9a8de0e2b30b402b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bd173cf42b4eff8df3c6e3d7af0447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:13.962497 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-015607d4-cc15-4f0f-a21f-7b5bd818c2a1 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 200 len: 1532 microversion: 2.1 time: 0.237935 Sep 19 15:17:13.963122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2705/5359] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:13 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 1532 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:14.359384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fc46f551-2f1d-4eeb-ac43-70e7ba110c84 req-f7d2e068-7d75-4fec-93c1-e5d7cab4db51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e928460-1f00-4521-a575-01f40b55c577", "name": "network-vif-deleted", "tag": "5a84fa15-beca-4d57-89c5-633fd780084b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:14.376412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc46f551-2f1d-4eeb-ac43-70e7ba110c84 req-f7d2e068-7d75-4fec-93c1-e5d7cab4db51 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:14.378115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc46f551-2f1d-4eeb-ac43-70e7ba110c84 req-f7d2e068-7d75-4fec-93c1-e5d7cab4db51 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:14.379043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc46f551-2f1d-4eeb-ac43-70e7ba110c84 req-f7d2e068-7d75-4fec-93c1-e5d7cab4db51 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:14.393346 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fc46f551-2f1d-4eeb-ac43-70e7ba110c84 req-f7d2e068-7d75-4fec-93c1-e5d7cab4db51 service nova] Creating event network-vif-deleted:5a84fa15-beca-4d57-89c5-633fd780084b for instance 1e928460-1f00-4521-a575-01f40b55c577 on n-h2-858384-1 Sep 19 15:17:14.401213 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fc46f551-2f1d-4eeb-ac43-70e7ba110c84 req-f7d2e068-7d75-4fec-93c1-e5d7cab4db51 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050239 Sep 19 15:17:14.402405 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2655/5360] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:14.986466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:14.987294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] [instance: 1e928460-1f00-4521-a575-01f40b55c577] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:14.994829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:14.995412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:14.995938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:14.996633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:14.997136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:14.997566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:15.012803 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] HTTP exception thrown: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Request method failure captured: Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 HTTP/1.1 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIfi2jIxJ8tnq_MxvbDWUC9SSl4Gm0WNjwCMB9oMHK1bTEsIuqEYQ4k-tPEuUQnol9jPz6zWqEHH96UnQ1T9YRiZmeFwqEi2VQ9zXZIbRUGR3yk8w2kbIIy5YYN6cYSLVxGUfhFUCkTkDeLTtjCe5lSYDCjztKcPQGoCEHwjUlVuI0I Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 86bd173cf42b4eff8df3c6e3d7af0447 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1641719380 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_86bd173cf42b4eff8df3c6e3d7af0447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86bd173cf42b4eff8df3c6e3d7af0447"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/86bd173cf42b4eff8df3c6e3d7af0447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/86bd173cf42b4eff8df3c6e3d7af0447"}]}] Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1641719380 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 86bd173cf42b4eff8df3c6e3d7af0447 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1641719380 Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1641719380-project Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 37df15805ca842bc9a8de0e2b30b402b Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1641719380-project Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1e928460-1f00-4521-a575-01f40b55c577'} Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:15.014639 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] Returning 404 to user: Instance 1e928460-1f00-4521-a575-01f40b55c577 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5e5bc4a-d4bd-4aa4-8e64-de6124f4c4b0 tempest-ServersNegativeTestMultiTenantJSON-1641719380 tempest-ServersNegativeTestMultiTenantJSON-1641719380-project] 10.222.0.81 "GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577" status: 404 len: 111 microversion: 2.1 time: 0.034118 Sep 19 15:17:15.022385 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2706/5361] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:14 2022] GET /compute/v2.1/servers/1e928460-1f00-4521-a575-01f40b55c577 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:17:20.600521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-820143067", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "2cb3053d-7429-42e6-a6df-ea5826ce4cf8"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:20.654372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] validate_networks() for [('2cb3053d-7429-42e6-a6df-ea5826ce4cf8', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:17:21.217684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:17:21.218138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:17:21.218624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:17:21.219325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:17:21.219732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:17:21.230732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:21.231360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:21.231808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:21.232543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:21.233000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:21.233630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:21.243355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=93 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:21.256381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Getting quotas for project c855da9e8d70492ea6a5f7dfe0954381. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:17:21.265295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Getting quotas for user f44fcee816db480995cf3b7a80f2bbc4 and project c855da9e8d70492ea6a5f7dfe0954381. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:17:21.282124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:17:21.285769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:17:21.338840 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [b9d5f57d-9513-414d-b848-e04262bc8d4b] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:17:22.350198 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [b9d5f57d-9513-414d-b848-e04262bc8d4b] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 57560. Sep 19 15:17:22.356231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-590cfa9b-f98f-456f-8c59-05402b698ea1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760991 Sep 19 15:17:22.366418 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2656/5362] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:17:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:17:22.372584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1fb0309a-759d-40a0-9801-9a7e44497281 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:22.373895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1fb0309a-759d-40a0-9801-9a7e44497281 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:22.505386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1fb0309a-759d-40a0-9801-9a7e44497281 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:22.520214 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1fb0309a-759d-40a0-9801-9a7e44497281 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1218 microversion: 2.1 time: 0.151822 Sep 19 15:17:22.521390 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2707/5363] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:22 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:23.547639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:23.549832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:23.558570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:23.559734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:23.560770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:23.561810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:23.562468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:23.563104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:23.673354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:23.682194 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14ea620f-d3a6-4080-b2b2-a7ad05c4f8f0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1288 microversion: 2.1 time: 0.140273 Sep 19 15:17:23.683528 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2657/5364] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:23 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1288 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:24.707545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:24.708224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:24.711941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:24.718767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:24.719369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:24.720225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:24.722599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:24.723688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:24.724233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:24.959367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:24.968915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-898b44be-bc0f-445f-8a3f-565d4693b4dd tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1318 microversion: 2.1 time: 0.266625 Sep 19 15:17:24.969948 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2708/5365] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:24 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:25.365433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-39af2672-361c-4e4e-9f38-90ba1c3110de req-f91ec0a5-294f-4c1b-9c98-6a3923c92664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9980023f-c1d9-4744-8134-6ea45c77893c", "tag": "ef9106cf-300f-472e-a90d-c9126b537bf6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:25.377283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-39af2672-361c-4e4e-9f38-90ba1c3110de req-f91ec0a5-294f-4c1b-9c98-6a3923c92664 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:25.378031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-39af2672-361c-4e4e-9f38-90ba1c3110de req-f91ec0a5-294f-4c1b-9c98-6a3923c92664 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:25.378554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-39af2672-361c-4e4e-9f38-90ba1c3110de req-f91ec0a5-294f-4c1b-9c98-6a3923c92664 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:25.393266 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-39af2672-361c-4e4e-9f38-90ba1c3110de req-f91ec0a5-294f-4c1b-9c98-6a3923c92664 service nova] Creating event network-changed:ef9106cf-300f-472e-a90d-c9126b537bf6 for instance 9980023f-c1d9-4744-8134-6ea45c77893c on n-h2-858384-1 Sep 19 15:17:25.400064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-39af2672-361c-4e4e-9f38-90ba1c3110de req-f91ec0a5-294f-4c1b-9c98-6a3923c92664 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040306 Sep 19 15:17:25.400922 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2658/5366] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:25.994860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:25.996196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:26.004794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.005585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.006260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.007641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.008650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.009513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.668577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:26.677913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-624b4fa8-dc73-48af-a5f0-17ae37d218d0 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1318 microversion: 2.1 time: 0.686951 Sep 19 15:17:26.678944 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2709/5367] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:25 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:27.711181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:27.712042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:27.717018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:27.721757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:27.722335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:27.722940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:27.724710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:27.725483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:27.726447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:28.363262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:28.371128 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5bb576a4-91a0-4eb7-8745-bcb7ab865235 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1318 microversion: 2.1 time: 0.668302 Sep 19 15:17:28.371906 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2659/5368] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:27 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:29.394403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:29.395058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:29.402449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:29.403137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:29.403770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:29.404639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:29.405254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:29.405828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:29.575977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:29.584463 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-418bb12a-408a-4dfc-aec7-3f3ca7545418 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1318 microversion: 2.1 time: 0.194533 Sep 19 15:17:29.585380 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2710/5369] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:29 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:30.614984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:30.621114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:30.632078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.634016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.634814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:30.638282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.639040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.639719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:30.810680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:30.819937 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-97dbd8cc-3b48-4b6c-b0a2-7311f9e2ba7f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1318 microversion: 2.1 time: 0.213706 Sep 19 15:17:30.821500 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2660/5370] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:30 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:30.938059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-71fdfeaa-01e4-48f5-bc43-ab8bd5d6a311 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: .version_select at 0x7fde28d949d0>, body: {"keypair": {"name": "tempest-keypair-778190934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl8An278TK8zZjiqx0dfdbYLWJmhp7BRrwgxzIOtxACh7rHWnpI9dgF4ALxRPaF8wjoXqD+6A42RKSjG2xZKR0C+jQaxx0luvomfx71INz7ALllB/vQcKJzz+wg3zbrFQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:30.956823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-71fdfeaa-01e4-48f5-bc43-ab8bd5d6a311 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:17:30.963412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-71fdfeaa-01e4-48f5-bc43-ab8bd5d6a311 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:17:30.980078 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71fdfeaa-01e4-48f5-bc43-ab8bd5d6a311 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [e365d417-2f68-417d-b091-6297d242b712] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:17:31.565321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2f75c729-54bd-4c9b-bc1a-943c885c8dd6 req-9430980f-753d-45ac-94ab-93c6bcfde010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9980023f-c1d9-4744-8134-6ea45c77893c", "name": "network-vif-plugged", "status": "completed", "tag": "ef9106cf-300f-472e-a90d-c9126b537bf6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:31.571306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:31.572588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:31.580162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2f75c729-54bd-4c9b-bc1a-943c885c8dd6 req-9430980f-753d-45ac-94ab-93c6bcfde010 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:31.580667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2f75c729-54bd-4c9b-bc1a-943c885c8dd6 req-9430980f-753d-45ac-94ab-93c6bcfde010 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:31.581096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2f75c729-54bd-4c9b-bc1a-943c885c8dd6 req-9430980f-753d-45ac-94ab-93c6bcfde010 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:31.593091 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2f75c729-54bd-4c9b-bc1a-943c885c8dd6 req-9430980f-753d-45ac-94ab-93c6bcfde010 service nova] Creating event network-vif-plugged:ef9106cf-300f-472e-a90d-c9126b537bf6 for instance 9980023f-c1d9-4744-8134-6ea45c77893c on n-h2-858384-1 Sep 19 15:17:31.598329 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2f75c729-54bd-4c9b-bc1a-943c885c8dd6 req-9430980f-753d-45ac-94ab-93c6bcfde010 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042475 Sep 19 15:17:31.599092 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2661/5371] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:31.852279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:31.853448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:31.860595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:31.862129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:31.862799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:31.864005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:31.864980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:31.865513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:31.989641 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [None req-71fdfeaa-01e4-48f5-bc43-ab8bd5d6a311 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [e365d417-2f68-417d-b091-6297d242b712] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 57650. Sep 19 15:17:32.012750 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-71fdfeaa-01e4-48f5-bc43-ab8bd5d6a311 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.142017 Sep 19 15:17:32.021728 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2711/5372] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:17:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:32.028184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:32.046257 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-950daab2-50dc-4d04-82b7-2858377529e3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1318 microversion: 2.1 time: 0.204388 Sep 19 15:17:32.059726 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2662/5373] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:31 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:33.074803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:33.075615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:33.084219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:33.084749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:33.085189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:33.085913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:33.086365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:33.086806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:33.665531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:33.675253 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-488d23cd-6b34-41e2-81c3-301cb7d0da06 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1506 microversion: 2.1 time: 0.605201 Sep 19 15:17:33.675849 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2712/5374] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:33 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:33.916518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-422298835", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46c10aad-0460-472f-a035-c74ef8a10be1"}], "security_groups": [{"name": "tempest-securitygroup--1865855133"}], "key_name": "tempest-keypair-778190934", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:34.043586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] validate_networks() for [('46c10aad-0460-472f-a035-c74ef8a10be1', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:17:34.503558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:17:34.504156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:17:34.504642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:17:34.505057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:17:34.506279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:17:34.518324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:34.519011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:34.519624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:34.520507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:34.521117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:34.521888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:34.541917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:17:34.552909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:17:34.570290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:17:34.573762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:17:34.648389 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d6bc850d-2188-49c7-92db-796c015cd42d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736355 Sep 19 15:17:34.649437 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2663/5375] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:17:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:17:34.662175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa050931-cd4b-4af0-8722-a8ef838de1b7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:34.663546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa050931-cd4b-4af0-8722-a8ef838de1b7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:34.751134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa050931-cd4b-4af0-8722-a8ef838de1b7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:34.760821 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa050931-cd4b-4af0-8722-a8ef838de1b7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1240 microversion: 2.1 time: 0.104036 Sep 19 15:17:34.761835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2713/5376] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:34 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:35.791900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:35.792518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:35.800208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:35.800896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:35.801326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:35.802045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:35.802506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:35.802977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:35.874842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:35.887629 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aeb2bcbf-cfb3-450a-a014-c925158b680b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1292 microversion: 2.1 time: 0.099404 Sep 19 15:17:35.888873 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2664/5377] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:35 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:36.912147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:36.912777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:36.921795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:36.922555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:36.923042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:36.924314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:36.924835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:36.925205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:37.100910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:37.111793 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5ae28b5-faa9-476c-87aa-f1c6d0fa27ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.203824 Sep 19 15:17:37.112518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2714/5378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:36 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:37.860719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-58e4a830-ef23-4dfe-894b-4a25638cf55f req-0f32ad53-aaf0-4ac5-be80-e77f450e933a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40515bb4-6996-4d2b-88c2-f943c1971312", "tag": "f1a5b173-566f-4e4d-873e-9d8fdfa2ae63"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:37.872614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-58e4a830-ef23-4dfe-894b-4a25638cf55f req-0f32ad53-aaf0-4ac5-be80-e77f450e933a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:37.873474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-58e4a830-ef23-4dfe-894b-4a25638cf55f req-0f32ad53-aaf0-4ac5-be80-e77f450e933a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:37.877447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-58e4a830-ef23-4dfe-894b-4a25638cf55f req-0f32ad53-aaf0-4ac5-be80-e77f450e933a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:37.889898 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-58e4a830-ef23-4dfe-894b-4a25638cf55f req-0f32ad53-aaf0-4ac5-be80-e77f450e933a service nova] Creating event network-changed:f1a5b173-566f-4e4d-873e-9d8fdfa2ae63 for instance 40515bb4-6996-4d2b-88c2-f943c1971312 on n-h1-858384-1 Sep 19 15:17:37.896587 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-58e4a830-ef23-4dfe-894b-4a25638cf55f req-0f32ad53-aaf0-4ac5-be80-e77f450e933a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Sep 19 15:17:37.897302 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2665/5379] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:17:38.136213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:38.136837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:38.145489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:38.145990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:38.146535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:38.147277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:38.148002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:38.148500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:38.167910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:38.330275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:38.341953 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-44daf8cc-c63c-4454-a0dc-1bd9c45fa675 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.209496 Sep 19 15:17:38.342741 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2715/5380] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:38 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:39.366810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:39.368186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:39.375000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:39.375854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:39.376873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:39.377916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:39.378493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:39.378959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:39.532594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:39.545117 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cdeb04f7-31a4-4cfb-bef5-c6eba4d501b1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.183950 Sep 19 15:17:39.560548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2666/5381] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:39 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:40.569719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:40.570607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:40.578139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:40.578633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:40.579305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:40.580339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:40.580865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:40.581295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:40.784118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:40.795130 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e278de2d-cf0a-431a-be97-28d8ba54fa5b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.229583 Sep 19 15:17:40.796140 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2716/5382] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:40 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:41.567881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:41.569134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:41.570870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1abf0a54-cfdd-44a5-aa52-8581ee9698f3 req-93e64316-1973-40da-a92d-c8da7a7f4978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:41.578197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.578679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.581395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.584147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.584827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.586218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.586341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1abf0a54-cfdd-44a5-aa52-8581ee9698f3 req-93e64316-1973-40da-a92d-c8da7a7f4978 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.586838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1abf0a54-cfdd-44a5-aa52-8581ee9698f3 req-93e64316-1973-40da-a92d-c8da7a7f4978 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.589956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1abf0a54-cfdd-44a5-aa52-8581ee9698f3 req-93e64316-1973-40da-a92d-c8da7a7f4978 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.609656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1abf0a54-cfdd-44a5-aa52-8581ee9698f3 req-93e64316-1973-40da-a92d-c8da7a7f4978 service nova] Creating event network-changed:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:17:41.618363 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1abf0a54-cfdd-44a5-aa52-8581ee9698f3 req-93e64316-1973-40da-a92d-c8da7a7f4978 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050964 Sep 19 15:17:41.622646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:17:41.622885 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2717/5383] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:17:41.774698 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7fb0eab5-411d-422e-b2e0-397bc92f819d tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 204 len: 0 microversion: 2.1 time: 0.211749 Sep 19 15:17:41.775799 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2667/5384] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:17:41 2022] DELETE /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:17:41.787881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:41.790791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:41.807968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.810028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.812826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.817870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.819338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.820274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.823057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:41.823820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:41.839971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.841986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.844802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.846335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.849514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.850081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:42.109651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:42.119516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41254956-2af4-4700-bcf2-5d11e9eb89fe tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.302027 Sep 19 15:17:42.131605 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2668/5385] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:41 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:42.171800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:42.183486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3bd08d7-e8df-44b9-8ad1-202d24f08318 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1580 microversion: 2.1 time: 0.401511 Sep 19 15:17:42.184546 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2718/5386] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:41 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1580 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:43.146550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:43.147217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:43.154473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.155609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.156079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.156995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.157701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.161207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.212295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:43.213550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:43.226323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.226851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.227291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.228184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.228641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.229341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.381314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:43.393180 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5882a7af-1257-4e7a-b714-3f7758d6650f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.251259 Sep 19 15:17:43.395618 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2669/5387] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:43 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:43.400602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3099e064-26ef-4967-b4ae-78d6d93bf057 req-e89b1ec8-23aa-4df4-8287-84ba98738189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40515bb4-6996-4d2b-88c2-f943c1971312", "name": "network-vif-plugged", "status": "completed", "tag": "f1a5b173-566f-4e4d-873e-9d8fdfa2ae63"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:43.411686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3099e064-26ef-4967-b4ae-78d6d93bf057 req-e89b1ec8-23aa-4df4-8287-84ba98738189 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.412474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3099e064-26ef-4967-b4ae-78d6d93bf057 req-e89b1ec8-23aa-4df4-8287-84ba98738189 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.413426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3099e064-26ef-4967-b4ae-78d6d93bf057 req-e89b1ec8-23aa-4df4-8287-84ba98738189 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.427363 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3099e064-26ef-4967-b4ae-78d6d93bf057 req-e89b1ec8-23aa-4df4-8287-84ba98738189 service nova] Creating event network-vif-plugged:f1a5b173-566f-4e4d-873e-9d8fdfa2ae63 for instance 40515bb4-6996-4d2b-88c2-f943c1971312 on n-h1-858384-1 Sep 19 15:17:43.437509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3099e064-26ef-4967-b4ae-78d6d93bf057 req-e89b1ec8-23aa-4df4-8287-84ba98738189 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040271 Sep 19 15:17:43.438387 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2670/5388] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:43.499927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:43.509945 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6274c8f5-5c7c-4050-9161-3086f1266810 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1580 microversion: 2.1 time: 0.305356 Sep 19 15:17:43.510526 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2719/5389] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:43 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1580 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:44.080964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c95b98dc-86dc-42af-a344-11360c225a69 req-33e91d74-c23b-415e-9514-975169e8359f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a13931-015d-423f-b259-4e8144372a42", "name": "network-vif-deleted", "tag": "f36b155d-4798-458a-81ef-5686ebd5c38a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:44.090951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c95b98dc-86dc-42af-a344-11360c225a69 req-33e91d74-c23b-415e-9514-975169e8359f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.091439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c95b98dc-86dc-42af-a344-11360c225a69 req-33e91d74-c23b-415e-9514-975169e8359f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.091857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c95b98dc-86dc-42af-a344-11360c225a69 req-33e91d74-c23b-415e-9514-975169e8359f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.104126 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c95b98dc-86dc-42af-a344-11360c225a69 req-33e91d74-c23b-415e-9514-975169e8359f service nova] Creating event network-vif-deleted:f36b155d-4798-458a-81ef-5686ebd5c38a for instance a8a13931-015d-423f-b259-4e8144372a42 on n-h1-858384-1 Sep 19 15:17:44.109399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c95b98dc-86dc-42af-a344-11360c225a69 req-33e91d74-c23b-415e-9514-975169e8359f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Sep 19 15:17:44.109997 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2671/5390] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:44.425397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:44.426041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:44.433780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.435022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.435748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.436891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.437579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.438226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.536404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:44.537125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:44.540024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:44.558955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.559456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.561242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.562030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.562497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.562984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.563483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:44.654701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:44.664838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:44.667073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d4f90bd-c253-4401-8292-80f6a0fc28b8 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1227 microversion: 2.1 time: 0.135877 Sep 19 15:17:44.678788 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2672/5391] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:44 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1227 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:44.692094 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-472af319-a878-4fb8-b160-cd8d52330e37 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1366 microversion: 2.1 time: 0.278215 Sep 19 15:17:44.693340 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2720/5392] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:44 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:45.691929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:45.695276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:45.703940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.704958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.705399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.706094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.706551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.707012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.716306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:45.716979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:45.724497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:45.726998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.727501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.727953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.728664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.729130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.729734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.787122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:45.795787 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b8916343-538f-4695-84d4-ad3c3bf9fbf7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1227 microversion: 2.1 time: 0.108139 Sep 19 15:17:45.811312 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2673/5393] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:45 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1227 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:45.914686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:45.923617 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-863178f2-0830-4fe1-8bb9-62cb400c9bb5 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1555 microversion: 2.1 time: 0.210896 Sep 19 15:17:45.924249 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2721/5394] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:45 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:45.947436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:45.947835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:45.955705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.956217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.956654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.957378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.957840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.958311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.053453 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fe70454e-d9cf-402e-afe1-ad8d08e47f6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110288 Sep 19 15:17:46.054485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2674/5395] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:17:45 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:46.821149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:46.822500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:46.830165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:46.831049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:46.831715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.832656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:46.833361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:46.834093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.910003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:46.919140 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9828e4a-a5ba-45d5-a597-cbc7443cacfb tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1227 microversion: 2.1 time: 0.101741 Sep 19 15:17:46.931430 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2722/5396] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:46 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1227 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:47.150073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cc650616-fd2f-44d7-9130-c850336909a6 req-5525af76-775b-4966-95eb-0a7af3b68d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40515bb4-6996-4d2b-88c2-f943c1971312", "tag": "f1a5b173-566f-4e4d-873e-9d8fdfa2ae63"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:47.162835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc650616-fd2f-44d7-9130-c850336909a6 req-5525af76-775b-4966-95eb-0a7af3b68d03 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.164714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc650616-fd2f-44d7-9130-c850336909a6 req-5525af76-775b-4966-95eb-0a7af3b68d03 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.164714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc650616-fd2f-44d7-9130-c850336909a6 req-5525af76-775b-4966-95eb-0a7af3b68d03 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:47.176660 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cc650616-fd2f-44d7-9130-c850336909a6 req-5525af76-775b-4966-95eb-0a7af3b68d03 service nova] Creating event network-changed:f1a5b173-566f-4e4d-873e-9d8fdfa2ae63 for instance 40515bb4-6996-4d2b-88c2-f943c1971312 on n-h1-858384-1 Sep 19 15:17:47.182644 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cc650616-fd2f-44d7-9130-c850336909a6 req-5525af76-775b-4966-95eb-0a7af3b68d03 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038679 Sep 19 15:17:47.186792 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2675/5397] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:17:47.945069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:47.946293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:47.953477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.954205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.955459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:47.956340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.956945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.957526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:48.034309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:48.043056 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc0e5af1-d9d9-4c69-b75a-b5bac9ca4703 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1227 microversion: 2.1 time: 0.101737 Sep 19 15:17:48.043962 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2723/5398] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:47 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:49.069493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:49.070088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:49.076420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.076900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.077333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.078015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.078466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.078922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.111948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.112496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.112934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.113388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lazy-loading 'fault' on Instance uuid a8a13931-015d-423f-b259-4e8144372a42 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:17:49.116398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:49.181198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839074cc2587424fb04099307652919c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0172823b31a9411dbbd0067d7f70be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:49.194044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d9fa97b2-41ef-4db2-8f69-b1784dcbef98 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 200 len: 1232 microversion: 2.1 time: 0.130604 Sep 19 15:17:49.195170 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2676/5399] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:49 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 1232 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:50.219671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:50.221056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] [instance: a8a13931-015d-423f-b259-4e8144372a42] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:50.229693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:50.230308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:50.230995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:50.231777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:50.232271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:50.232818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:50.251705 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] HTTP exception thrown: Instance a8a13931-015d-423f-b259-4e8144372a42 could not be found. Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Request method failure captured: Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 HTTP/1.1 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIdArCNLws7lU2Gos-BLgGIhIvD6oLZ4mQXc_2wkXlFDzk6_ElBO3gcvFPnvBk3jl5qWUBBlQ4qlYwIVYsMJNIHZyQmVQKLKV5PmNZ-rB0VAJp7ORCjM1VJ2Wp0PMzQAHITFIwbQ7bdccucWEzDYbYrXoe5P77KVaQ1rg34m1hY50aE Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 0172823b31a9411dbbd0067d7f70be2b Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBackupRestore-1458616346 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0172823b31a9411dbbd0067d7f70be2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0172823b31a9411dbbd0067d7f70be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0172823b31a9411dbbd0067d7f70be2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0172823b31a9411dbbd0067d7f70be2b"}]}] Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBackupRestore-1458616346 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 0172823b31a9411dbbd0067d7f70be2b Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1458616346 Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBackupRestore-1458616346-project Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 839074cc2587424fb04099307652919c Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBackupRestore-1458616346-project Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a8a13931-015d-423f-b259-4e8144372a42 could not be found. Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a8a13931-015d-423f-b259-4e8144372a42'} Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a13931-015d-423f-b259-4e8144372a42 could not be found. Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a13931-015d-423f-b259-4e8144372a42 could not be found. Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:17:50.254006 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a13931-015d-423f-b259-4e8144372a42 could not be found. Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Returning 404 to user: Instance a8a13931-015d-423f-b259-4e8144372a42 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ef6d9f50-0063-4da1-8f74-2adc5d192841 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42" status: 404 len: 111 microversion: 2.1 time: 0.041704 Sep 19 15:17:50.262305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2724/5400] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:50 2022] GET /compute/v2.1/servers/a8a13931-015d-423f-b259-4e8144372a42 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:17:50.489114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c8a418a0-fbc3-4563-a291-fca59c9a54a7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] Calling method '.version_select at 0x7fde28917550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:50.511969 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c8a418a0-fbc3-4563-a291-fca59c9a54a7 tempest-TestVolumeBackupRestore-1458616346 tempest-TestVolumeBackupRestore-1458616346-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1221663127" status: 202 len: 0 microversion: 2.1 time: 0.028293 Sep 19 15:17:50.512562 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2677/5401] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 15:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1221663127 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:17:51.538267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "688862ac-1240-4fdf-958d-fcfff0129b89", "device": "/dev/sdb"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:51.540794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:51.548129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:51.548731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:51.549275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:51.549991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:51.550450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:51.551017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:51.903200 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b09164e-399d-48bf-a03b-55c427e0f55f tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "POST /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368570 Sep 19 15:17:51.904203 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2725/5402] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:17:51 2022] POST /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:17.128594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:17.129592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:17.134013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:17.134513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:17.143091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:17.143616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:17.144623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:17.145358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:17.145818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:17.146252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:17.231228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lazy-loading 'services' on Instance uuid 9980023f-c1d9-4744-8134-6ea45c77893c {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:18:17.307303 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a3507c0a-0a1f-47cf-94af-d2e631419aee tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c/os-volume_attachments/688862ac-1240-4fdf-958d-fcfff0129b89" status: 202 len: 0 microversion: 2.1 time: 0.180614 Sep 19 15:18:17.307902 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2678/5403] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:18:17 2022] DELETE /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c/os-volume_attachments/688862ac-1240-4fdf-958d-fcfff0129b89 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:18:21.517878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:21.518733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:21.523244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:21.523837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:21.531602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.532092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.532527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.533225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.533682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.534104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.561399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1aea1a7c-23ca-473c-bffb-263abf879234 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/ips" status: 200 len: 149 microversion: 2.1 time: 0.045483 Sep 19 15:18:21.561982 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2726/5404] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:18:21 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:21.870377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:21.871286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:21.880183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.880720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.881302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.882054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.882517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.882978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.912262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:18:22.001394 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b87d73ee-5041-484a-8eac-d4956aa9c6b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 204 len: 0 microversion: 2.1 time: 0.136164 Sep 19 15:18:22.002345 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2679/5405] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:18:21 2022] DELETE /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:18:22.011148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:22.011834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:22.018333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.018889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.019907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:22.020621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.021331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.021833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:22.158778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:22.167607 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-403c0975-eb68-4bd2-be7e-219554422d1e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1512 microversion: 2.1 time: 0.160382 Sep 19 15:18:22.168181 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2727/5406] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:22 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:22.982784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46f12275-092d-4e10-97df-a116548d0184"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:22.985438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:22.992819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.993256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.993695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:22.994381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.994868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.995292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:23.191908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:23.192917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:23.199759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:23.200245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:23.201128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:23.201828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:23.202279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:23.202821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:23.236367 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f5ed1c4-63a0-444d-a0bf-89a2c7dfbbf9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257849 Sep 19 15:18:23.237022 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2680/5407] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:18:22 2022] POST /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:23.352027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:23.360024 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b71b3a01-8190-470b-96f0-477403163b69 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1512 microversion: 2.1 time: 0.172799 Sep 19 15:18:23.360604 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2728/5408] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:23 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:23.897017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1e5542da-a0dd-4da7-af9c-f35dbfd2af79 req-92fa3533-c5d9-4e43-9085-9dc41d498fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9980023f-c1d9-4744-8134-6ea45c77893c", "name": "network-vif-deleted", "tag": "ef9106cf-300f-472e-a90d-c9126b537bf6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:23.908277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1e5542da-a0dd-4da7-af9c-f35dbfd2af79 req-92fa3533-c5d9-4e43-9085-9dc41d498fb4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:23.908754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1e5542da-a0dd-4da7-af9c-f35dbfd2af79 req-92fa3533-c5d9-4e43-9085-9dc41d498fb4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:23.909188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1e5542da-a0dd-4da7-af9c-f35dbfd2af79 req-92fa3533-c5d9-4e43-9085-9dc41d498fb4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:23.923571 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1e5542da-a0dd-4da7-af9c-f35dbfd2af79 req-92fa3533-c5d9-4e43-9085-9dc41d498fb4 service nova] Creating event network-vif-deleted:ef9106cf-300f-472e-a90d-c9126b537bf6 for instance 9980023f-c1d9-4744-8134-6ea45c77893c on n-h2-858384-1 Sep 19 15:18:23.929146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1e5542da-a0dd-4da7-af9c-f35dbfd2af79 req-92fa3533-c5d9-4e43-9085-9dc41d498fb4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037544 Sep 19 15:18:23.929764 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2681/5409] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:24.385050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:24.385765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:24.393573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.395521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.396187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.396889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.397442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.397987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.702135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.702735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.703315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.703906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lazy-loading 'fault' on Instance uuid 9980023f-c1d9-4744-8134-6ea45c77893c {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:18:24.751053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:24.759864 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73bf29ed-1700-442b-9ddb-afe3cf4e8275 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 200 len: 1308 microversion: 2.1 time: 0.379160 Sep 19 15:18:24.760675 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2729/5410] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:24 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:25.785940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:25.786628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 9980023f-c1d9-4744-8134-6ea45c77893c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:25.792835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:25.793349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:25.793778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:25.794472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:25.795034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:25.795454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:25.809509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] HTTP exception thrown: Instance 9980023f-c1d9-4744-8134-6ea45c77893c could not be found. Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Request method failure captured: Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c HTTP/1.1 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIfBoorydZemuGPVDXZvzr9UoXGYblNAX1sTbmz1alb7Z1gnAbd1uXQoemmPytieiNgbcYx_HcHRrj0N8S4fuVga7mLmsG8YY-kxAEoHjR06GBlb1Fy6cIwROv010CEDMOaFfN8WRxLT3uEfPLKiU0dtaT5uYemfHI6MHIdGPiSMHI0 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: c855da9e8d70492ea6a5f7dfe0954381 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-559582294 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c855da9e8d70492ea6a5f7dfe0954381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c855da9e8d70492ea6a5f7dfe0954381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c855da9e8d70492ea6a5f7dfe0954381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c855da9e8d70492ea6a5f7dfe0954381"}]}] Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesSnapshotTestJSON-559582294 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: c855da9e8d70492ea6a5f7dfe0954381 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-559582294 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesSnapshotTestJSON-559582294-project Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f44fcee816db480995cf3b7a80f2bbc4 Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesSnapshotTestJSON-559582294-project Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 9980023f-c1d9-4744-8134-6ea45c77893c could not be found. Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9980023f-c1d9-4744-8134-6ea45c77893c'} Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9980023f-c1d9-4744-8134-6ea45c77893c could not be found. Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9980023f-c1d9-4744-8134-6ea45c77893c could not be found. Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:18:25.811187 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9980023f-c1d9-4744-8134-6ea45c77893c could not be found. Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Returning 404 to user: Instance 9980023f-c1d9-4744-8134-6ea45c77893c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:18:25.816350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26ffa0e2-2447-423a-b7f5-569f10077b74 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c" status: 404 len: 111 microversion: 2.1 time: 0.032131 Sep 19 15:18:25.817337 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2682/5411] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:25 2022] GET /compute/v2.1/servers/9980023f-c1d9-4744-8134-6ea45c77893c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:18:32.680947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1376730883", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "2cb3053d-7429-42e6-a6df-ea5826ce4cf8"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:32.735419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] validate_networks() for [('2cb3053d-7429-42e6-a6df-ea5826ce4cf8', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:18:33.087655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:18:33.088078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:18:33.088551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:18:33.088961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:18:33.089397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:18:33.099197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:33.099680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:33.100113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:33.100833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:33.101285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:33.101702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:33.119074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Getting quotas for project c855da9e8d70492ea6a5f7dfe0954381. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:18:33.124329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Getting quotas for user f44fcee816db480995cf3b7a80f2bbc4 and project c855da9e8d70492ea6a5f7dfe0954381. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:18:33.136792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:18:33.139110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:18:33.185315 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6dc42d43-af30-4c8f-a2bb-4530049ce80d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508926 Sep 19 15:18:33.186028 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2730/5412] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:18:33.197279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24d273d4-4cc5-40ae-be67-aa15f835095b tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:33.197871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24d273d4-4cc5-40ae-be67-aa15f835095b tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:33.254442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-24d273d4-4cc5-40ae-be67-aa15f835095b tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:33.261511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24d273d4-4cc5-40ae-be67-aa15f835095b tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1219 microversion: 2.1 time: 0.068047 Sep 19 15:18:33.262108 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2683/5413] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:33 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:34.027198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-316e8e97-5eef-4e7c-92ab-9dd0437a510c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: .version_select at 0x7fde28dfd940>, body: {"keypair": {"name": "tempest-keypair-1422691134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyu5ydrShZmtYdGUdIACAoAOlg+qiO5XHhUYnvLWej8+AfNCS6/2rw1D+BrLSaB6sk2OBGwGIc63K/BBphmvc8AKGSmb76FtFO/NKpJ4fsCRMriyg9PZ/ai0CA3ABi4qQ=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:34.042997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-316e8e97-5eef-4e7c-92ab-9dd0437a510c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:18:34.048193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-316e8e97-5eef-4e7c-92ab-9dd0437a510c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:18:34.072046 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-316e8e97-5eef-4e7c-92ab-9dd0437a510c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049674 Sep 19 15:18:34.072633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2731/5414] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:18:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:34.292862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:34.294876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:34.306066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:34.306896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:34.307340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:34.308401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:34.309028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:34.309890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:34.430356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:34.442543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f9d561f-8850-4f85-9c9e-3f9c557dfaec tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1289 microversion: 2.1 time: 0.159706 Sep 19 15:18:34.443322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2684/5415] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:34 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1289 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:35.468693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:35.469396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:35.476401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:35.477213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:35.478021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:35.479135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:35.479948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:35.480489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:35.519150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2041352153", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46c10aad-0460-472f-a035-c74ef8a10be1"}], "security_groups": [{"name": "tempest-securitygroup--2092003602"}], "key_name": "tempest-keypair-1422691134", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:35.729508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] validate_networks() for [('46c10aad-0460-472f-a035-c74ef8a10be1', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:18:35.776405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:35.784629 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00548890-2595-4eea-9133-05ab63179022 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1319 microversion: 2.1 time: 0.321361 Sep 19 15:18:35.785277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2732/5416] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:35 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:36.172010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d737715e-df01-48e8-a89a-21834e0b12c4 req-fb823c80-9ba2-4007-8220-a3eecb686509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d03f2f8-3994-4d86-bda8-2a05b130db45", "tag": "14a2b565-5eb2-46fc-86c3-0a28ece0ef57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:36.183548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d737715e-df01-48e8-a89a-21834e0b12c4 req-fb823c80-9ba2-4007-8220-a3eecb686509 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.184155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d737715e-df01-48e8-a89a-21834e0b12c4 req-fb823c80-9ba2-4007-8220-a3eecb686509 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.184844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d737715e-df01-48e8-a89a-21834e0b12c4 req-fb823c80-9ba2-4007-8220-a3eecb686509 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:36.199106 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d737715e-df01-48e8-a89a-21834e0b12c4 req-fb823c80-9ba2-4007-8220-a3eecb686509 service nova] Creating event network-changed:14a2b565-5eb2-46fc-86c3-0a28ece0ef57 for instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 on n-h1-858384-1 Sep 19 15:18:36.203017 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d737715e-df01-48e8-a89a-21834e0b12c4 req-fb823c80-9ba2-4007-8220-a3eecb686509 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Sep 19 15:18:36.203794 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2733/5417] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:18:36.419249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:18:36.419667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:18:36.420197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:18:36.420603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:18:36.421013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:18:36.432440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.432924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.433356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:36.434077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.434811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.435235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:36.454284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:18:36.461146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:18:36.475335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:18:36.477650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:18:36.528538 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5139aabb-bc92-489a-8280-a18c6b7c546e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.014944 Sep 19 15:18:36.534927 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2685/5418] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:18:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:18:36.542139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3fb1fa6-e8b2-4342-9688-d14a0f0c64de tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:36.542866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b3fb1fa6-e8b2-4342-9688-d14a0f0c64de tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:36.645296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b3fb1fa6-e8b2-4342-9688-d14a0f0c64de tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:36.655537 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3fb1fa6-e8b2-4342-9688-d14a0f0c64de tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1242 microversion: 2.1 time: 0.117615 Sep 19 15:18:36.656233 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2734/5419] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:36 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:36.808698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:36.809574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:36.815941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.817277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.817790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:36.818696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.819243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.819737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:36.962646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:36.970837 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c420a123-e94d-4e23-a100-5e52010c3cae tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1319 microversion: 2.1 time: 0.166444 Sep 19 15:18:36.971496 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2686/5420] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:36 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:37.679072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:37.679761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:37.688106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:37.688600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:37.689044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:37.689755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:37.690401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:37.690896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:37.787610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:37.795475 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90f595c9-882d-4f30-9be5-455cb3335432 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1300 microversion: 2.1 time: 0.120752 Sep 19 15:18:37.796251 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2735/5421] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:37 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:37.993674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:37.994486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:38.001394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.001882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.002317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.003056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.003516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.003937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.282223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:38.290630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89f80b88-ec09-40e6-b043-9005d5d883c4 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1319 microversion: 2.1 time: 0.300979 Sep 19 15:18:38.291260 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2687/5422] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:37 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:38.819230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:38.819858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:38.826716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.827242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.827685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.828387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.828849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.829279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.897282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:38.906581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1aabb8d9-76c9-4270-934f-d9a8c9ea76a7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1300 microversion: 2.1 time: 0.091542 Sep 19 15:18:38.907211 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2736/5423] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:38 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:39.313605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:39.314230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:39.321402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.321898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.322329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.323062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.323515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.323936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.547336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:39.557265 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-719dc40a-6b37-414c-be70-34fe12076506 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1319 microversion: 2.1 time: 0.247674 Sep 19 15:18:39.557965 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2688/5424] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:39 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:39.802580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a1132659-25d5-4143-bce0-45cfc64594f4 req-c26443a5-e0a2-41d9-aec7-d38507a48c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4ecfab-0b57-4c74-b46e-8a532624aea6", "tag": "0e933d51-7da1-4238-8ae2-d19ffda98eac"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:39.814625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a1132659-25d5-4143-bce0-45cfc64594f4 req-c26443a5-e0a2-41d9-aec7-d38507a48c4c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.815498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a1132659-25d5-4143-bce0-45cfc64594f4 req-c26443a5-e0a2-41d9-aec7-d38507a48c4c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.816004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a1132659-25d5-4143-bce0-45cfc64594f4 req-c26443a5-e0a2-41d9-aec7-d38507a48c4c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.831679 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a1132659-25d5-4143-bce0-45cfc64594f4 req-c26443a5-e0a2-41d9-aec7-d38507a48c4c service nova] Creating event network-changed:0e933d51-7da1-4238-8ae2-d19ffda98eac for instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 on n-h2-858384-1 Sep 19 15:18:39.838224 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a1132659-25d5-4143-bce0-45cfc64594f4 req-c26443a5-e0a2-41d9-aec7-d38507a48c4c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039490 Sep 19 15:18:39.839181 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2737/5425] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:39.929687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:39.930487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:39.936861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.937389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.937823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.938632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.939121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.939544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.132481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:40.140174 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9a66bfb2-377d-473f-a345-39be437b20c6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.214507 Sep 19 15:18:40.140750 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2689/5426] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:39 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:40.582422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:40.583069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:40.589434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:40.589910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:40.590352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.591082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:40.591541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:40.591960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.733133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:40.741947 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d73246e3-a447-419b-adbd-9d6a66a90b7d tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1319 microversion: 2.1 time: 0.164115 Sep 19 15:18:40.742512 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2738/5427] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:40 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:41.167548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:41.168693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:41.175986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.176480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.176921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.177623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.178085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.178511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.401997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:41.412568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fd3cfc0-f1a2-4ad0-9480-9297d3e711d7 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.250315 Sep 19 15:18:41.416538 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2690/5428] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:41 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:41.505223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4ee7b771-d6f1-4dda-8910-194d12d38156 req-750aef0a-8585-4615-9ad0-9890810d0912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d03f2f8-3994-4d86-bda8-2a05b130db45", "name": "network-vif-plugged", "status": "completed", "tag": "14a2b565-5eb2-46fc-86c3-0a28ece0ef57"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:41.518801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4ee7b771-d6f1-4dda-8910-194d12d38156 req-750aef0a-8585-4615-9ad0-9890810d0912 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.519504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4ee7b771-d6f1-4dda-8910-194d12d38156 req-750aef0a-8585-4615-9ad0-9890810d0912 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.519938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4ee7b771-d6f1-4dda-8910-194d12d38156 req-750aef0a-8585-4615-9ad0-9890810d0912 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.532387 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4ee7b771-d6f1-4dda-8910-194d12d38156 req-750aef0a-8585-4615-9ad0-9890810d0912 service nova] Creating event network-vif-plugged:14a2b565-5eb2-46fc-86c3-0a28ece0ef57 for instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 on n-h1-858384-1 Sep 19 15:18:41.538219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4ee7b771-d6f1-4dda-8910-194d12d38156 req-750aef0a-8585-4615-9ad0-9890810d0912 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Sep 19 15:18:41.539112 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2739/5429] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:41.764783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:41.765512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:41.772169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.772660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.773098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.773814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.774274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.774712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.914702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:41.922398 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-451e36e2-5969-4e93-8854-9055ae45b8a6 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1319 microversion: 2.1 time: 0.161643 Sep 19 15:18:41.922995 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2691/5430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:41 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:42.439836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:42.440479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:42.447846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.448336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.448782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:42.449479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.449936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.450362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:42.583634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:42.591845 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c08cd7f-23c6-4115-b28a-5ab04306cc11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.156382 Sep 19 15:18:42.592433 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2740/5431] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:42 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:42.946068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:42.946677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:42.953574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.954054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.954483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:42.955331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.955784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.956205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.091486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:43.099231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14261015-210e-44c0-b854-181ecff7639e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1507 microversion: 2.1 time: 0.157694 Sep 19 15:18:43.099867 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2692/5432] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:42 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:43.122155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142344d2-3434-4ce9-830b-0fb1661590e2", "device": "/dev/sdb"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:43.125371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:43.126668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:43.133107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:43.133636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:43.134035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.134729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:43.135210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:43.135636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.377044 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d551766-ef12-4c67-b2c1-2da22cb2ca17 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "POST /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258675 Sep 19 15:18:43.377746 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2741/5433] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:18:43 2022] POST /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:43.615154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:43.616512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:43.623096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:43.623978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:43.624480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.625572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:43.626231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:43.626676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.763461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:43.767135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:43.773555 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cfd2c54f-fb5c-46f7-a783-c13664716789 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.162276 Sep 19 15:18:43.786784 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2693/5434] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:43 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:44.799768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:44.800519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:44.807646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:44.808138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:44.808576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:44.809277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:44.809995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:44.810449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:44.956822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:44.965297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-83eaddc0-54d1-49e2-b04d-fb484a7ec552 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.171091 Sep 19 15:18:44.965904 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2742/5435] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:44 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:45.988967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:45.989624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:45.997793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.998358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.998903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.999671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:46.000197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:46.000840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.033655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5d842482-0f4c-40b5-b227-6db3afc7d1f4 req-9eb6454d-4672-4722-a58d-c48ac0523336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4ecfab-0b57-4c74-b46e-8a532624aea6", "name": "network-vif-plugged", "status": "completed", "tag": "0e933d51-7da1-4238-8ae2-d19ffda98eac"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:46.044308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d842482-0f4c-40b5-b227-6db3afc7d1f4 req-9eb6454d-4672-4722-a58d-c48ac0523336 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:46.044878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d842482-0f4c-40b5-b227-6db3afc7d1f4 req-9eb6454d-4672-4722-a58d-c48ac0523336 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:46.045380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d842482-0f4c-40b5-b227-6db3afc7d1f4 req-9eb6454d-4672-4722-a58d-c48ac0523336 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.057639 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5d842482-0f4c-40b5-b227-6db3afc7d1f4 req-9eb6454d-4672-4722-a58d-c48ac0523336 service nova] Creating event network-vif-plugged:0e933d51-7da1-4238-8ae2-d19ffda98eac for instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 on n-h2-858384-1 Sep 19 15:18:46.063172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5d842482-0f4c-40b5-b227-6db3afc7d1f4 req-9eb6454d-4672-4722-a58d-c48ac0523336 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186214 Sep 19 15:18:46.064028 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2694/5436] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:46.176108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:46.185580 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a481550a-409e-43aa-a86c-8a643430d99b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.200690 Sep 19 15:18:46.186248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2743/5437] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:45 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:47.205941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:47.206717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:47.211958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:47.212677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:47.214532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:47.221516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.222018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.222461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.223196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.223664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.224095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.377308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:47.386592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-86fbe3e2-0fe8-48f4-b061-1fa7e16b0489 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1368 microversion: 2.1 time: 0.181528 Sep 19 15:18:47.387246 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2695/5438] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:47 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:48.410451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:48.411087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:48.414187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:48.419905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.420398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.420837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.421537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.421993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.422413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.559735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:48.567476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ed54080-9aca-4b7a-b4a7-c5c5dc3e933b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1558 microversion: 2.1 time: 0.160970 Sep 19 15:18:48.568048 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2744/5439] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:48 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:48.590101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:48.590622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:48.597609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.598095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.598535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.599271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.599858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.600848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.685456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5c0d7c8d-4a5a-4d88-87b0-f148dbffe018 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099240 Sep 19 15:18:48.686284 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2696/5440] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:18:48 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:18:49.657404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5d6a0a30-ac9a-4720-90f6-59560b7f387a req-c9dd0acb-0ee5-40df-926c-b1fda913fae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4ecfab-0b57-4c74-b46e-8a532624aea6", "tag": "0e933d51-7da1-4238-8ae2-d19ffda98eac"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:49.668754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5d6a0a30-ac9a-4720-90f6-59560b7f387a req-c9dd0acb-0ee5-40df-926c-b1fda913fae1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.669537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5d6a0a30-ac9a-4720-90f6-59560b7f387a req-c9dd0acb-0ee5-40df-926c-b1fda913fae1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.670047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5d6a0a30-ac9a-4720-90f6-59560b7f387a req-c9dd0acb-0ee5-40df-926c-b1fda913fae1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.684327 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5d6a0a30-ac9a-4720-90f6-59560b7f387a req-c9dd0acb-0ee5-40df-926c-b1fda913fae1 service nova] Creating event network-changed:0e933d51-7da1-4238-8ae2-d19ffda98eac for instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 on n-h2-858384-1 Sep 19 15:18:49.708159 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5d6a0a30-ac9a-4720-90f6-59560b7f387a req-c9dd0acb-0ee5-40df-926c-b1fda913fae1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054163 Sep 19 15:18:49.708680 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2745/5441] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:04.936446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:04.937197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:04.941863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:04.942354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:04.949146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:04.949630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:04.950068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:04.950773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:04.951232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:04.951655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:05.040745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lazy-loading 'services' on Instance uuid 6d03f2f8-3994-4d86-bda8-2a05b130db45 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:19:05.121645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-24f4b829-8e2e-49ce-980a-8975e0e45180 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45/os-volume_attachments/142344d2-3434-4ce9-830b-0fb1661590e2" status: 202 len: 0 microversion: 2.1 time: 0.186883 Sep 19 15:19:05.122360 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2697/5442] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:19:04 2022] DELETE /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45/os-volume_attachments/142344d2-3434-4ce9-830b-0fb1661590e2 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:19:10.604665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:10.605646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:10.609710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:10.610304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:10.618347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:10.618861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:10.619300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.619996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:10.620454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:10.620884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.647280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:19:10.726128 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-747ffc9a-5eae-42c7-9c84-5d203063b51e tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 204 len: 0 microversion: 2.1 time: 0.123813 Sep 19 15:19:10.726647 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2746/5443] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:19:10 2022] DELETE /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:19:10.737163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:10.737858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:10.745235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:10.745722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:10.746185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.747006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:10.747353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:10.747774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.882649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:10.892024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1bf50daf-d17b-4fee-9817-bd44da8b4eb3 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1513 microversion: 2.1 time: 0.160027 Sep 19 15:19:10.892605 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2698/5444] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:10 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:11.916530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:11.917265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:11.924390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:11.924890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:11.925330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:11.926040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:11.926492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:11.926953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:12.069163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:12.077832 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e9fc9a6b-5bbc-4335-bdbf-5cdba2e3f986 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1513 microversion: 2.1 time: 0.165942 Sep 19 15:19:12.078414 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2747/5445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:11 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:12.734406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8a8bd672-f2ea-4d9d-bfd6-750e562387e4 req-c426491d-a1df-476b-8ed7-da0f90aa8fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d03f2f8-3994-4d86-bda8-2a05b130db45", "name": "network-vif-deleted", "tag": "14a2b565-5eb2-46fc-86c3-0a28ece0ef57"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:12.750118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8a8bd672-f2ea-4d9d-bfd6-750e562387e4 req-c426491d-a1df-476b-8ed7-da0f90aa8fc9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:12.750516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8a8bd672-f2ea-4d9d-bfd6-750e562387e4 req-c426491d-a1df-476b-8ed7-da0f90aa8fc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:12.751201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8a8bd672-f2ea-4d9d-bfd6-750e562387e4 req-c426491d-a1df-476b-8ed7-da0f90aa8fc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:12.763802 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8a8bd672-f2ea-4d9d-bfd6-750e562387e4 req-c426491d-a1df-476b-8ed7-da0f90aa8fc9 service nova] Creating event network-vif-deleted:14a2b565-5eb2-46fc-86c3-0a28ece0ef57 for instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 on n-h1-858384-1 Sep 19 15:19:12.768653 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8a8bd672-f2ea-4d9d-bfd6-750e562387e4 req-c426491d-a1df-476b-8ed7-da0f90aa8fc9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037914 Sep 19 15:19:12.769265 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2699/5446] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:13.100760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:13.101327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:13.109047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.109540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.109986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.110691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.111185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.111613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.144768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.145234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.145778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.146293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lazy-loading 'fault' on Instance uuid 6d03f2f8-3994-4d86-bda8-2a05b130db45 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:19:13.193210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44fcee816db480995cf3b7a80f2bbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c855da9e8d70492ea6a5f7dfe0954381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:13.203349 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5c241deb-343f-4973-b82f-1461185c04b1 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 200 len: 1309 microversion: 2.1 time: 0.106556 Sep 19 15:19:13.203937 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2748/5447] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:13 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:14.228463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:14.229196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] [instance: 6d03f2f8-3994-4d86-bda8-2a05b130db45] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:14.235329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:14.235811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:14.236249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:14.236938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:14.237393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:14.237818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:14.251304 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] HTTP exception thrown: Instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 could not be found. Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Request method failure captured: Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 HTTP/1.1 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIfBoorydZemuGPVDXZvzr9UoXGYblNAX1sTbmz1alb7Z1gnAbd1uXQoemmPytieiNgbcYx_HcHRrj0N8S4fuVga7mLmsG8YY-kxAEoHjR06GBlb1Fy6cIwROv010CEDMOaFfN8WRxLT3uEfPLKiU0dtaT5uYemfHI6MHIdGPiSMHI0 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: c855da9e8d70492ea6a5f7dfe0954381 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-559582294 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c855da9e8d70492ea6a5f7dfe0954381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c855da9e8d70492ea6a5f7dfe0954381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c855da9e8d70492ea6a5f7dfe0954381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c855da9e8d70492ea6a5f7dfe0954381"}]}] Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesSnapshotTestJSON-559582294 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: c855da9e8d70492ea6a5f7dfe0954381 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-559582294 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesSnapshotTestJSON-559582294-project Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: f44fcee816db480995cf3b7a80f2bbc4 Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesSnapshotTestJSON-559582294-project Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 could not be found. Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6d03f2f8-3994-4d86-bda8-2a05b130db45'} Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 could not be found. Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 could not be found. Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:14.252922 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 could not be found. Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] Returning 404 to user: Instance 6d03f2f8-3994-4d86-bda8-2a05b130db45 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62396bda-24c3-4390-a165-27ab36692938 tempest-VolumesSnapshotTestJSON-559582294 tempest-VolumesSnapshotTestJSON-559582294-project] 10.222.0.81 "GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45" status: 404 len: 111 microversion: 2.1 time: 0.031655 Sep 19 15:19:14.257499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2700/5448] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:14 2022] GET /compute/v2.1/servers/6d03f2f8-3994-4d86-bda8-2a05b130db45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:19:23.941364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:23.941984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:23.946588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:23.946588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:23.953064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:23.953516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:23.954007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:23.954007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:23.957662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:23.957662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:23.986107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a51e66a0-304c-47ea-8255-babc4c95d3b9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/ips" status: 200 len: 148 microversion: 2.1 time: 0.048448 Sep 19 15:19:23.986398 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2749/5449] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:19:23 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:24.006230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46f12275-092d-4e10-97df-a116548d0184"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:24.009405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:24.017342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.017938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.018401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.019452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.019920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.020450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.108936 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Invalid volume: volume 46f12275-092d-4e10-97df-a116548d0184 is already attached to instances: 40515bb4-6996-4d2b-88c2-f943c1971312 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/os-volume_attachments HTTP/1.1 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 74 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: {"volumeAttachment": {"volumeId": "46f12275-092d-4e10-97df-a116548d0184"}} Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid volume: volume 46f12275-092d-4e10-97df-a116548d0184 is already attached to instances: 40515bb4-6996-4d2b-88c2-f943c1971312 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': '7d4ecfab-0b57-4c74-b46e-8a532624aea6', 'body': {'volumeAttachment': {'volumeId': '46f12275-092d-4e10-97df-a116548d0184'}}} Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 46f12275-092d-4e10-97df-a116548d0184 is already attached to instances: 40515bb4-6996-4d2b-88c2-f943c1971312 Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:19:24.110681 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 46f12275-092d-4e10-97df-a116548d0184 is already attached to instances: 40515bb4-6996-4d2b-88c2-f943c1971312 Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 46f12275-092d-4e10-97df-a116548d0184 is already attached to instances: 40515bb4-6996-4d2b-88c2-f943c1971312 Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 400 to user: Invalid volume: volume 46f12275-092d-4e10-97df-a116548d0184 is already attached to instances: 40515bb4-6996-4d2b-88c2-f943c1971312 {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-991edae2-300e-43ea-bebe-f19a7245dc8d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112659 Sep 19 15:19:24.118929 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2701/5450] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:19:23 2022] POST /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:19:24.120996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:24.121503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:24.128039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.128534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.128991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.129689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.130137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.130595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.160472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:19:24.249021 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f82c5f8e-39be-4a41-9fc7-18e81e480364 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 204 len: 0 microversion: 2.1 time: 0.131305 Sep 19 15:19:24.249812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2750/5451] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:19:24 2022] DELETE /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:19:24.258952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:24.259789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:24.266097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.266597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.267072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.267829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.268240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.268670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.417888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:24.426067 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-53203a8f-013b-4863-ba61-583c0f12505b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1681 microversion: 2.1 time: 0.171652 Sep 19 15:19:24.426660 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2702/5452] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:24 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:25.452881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:25.453621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:25.460430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:25.460920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:25.461391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:25.462148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:25.462604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:25.463069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:25.645804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:25.654352 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d9f2819f-23e2-4abe-a136-c297bd142834 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1681 microversion: 2.1 time: 0.205662 Sep 19 15:19:25.655193 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2751/5453] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:25 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:26.680778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:26.682276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:26.690519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.691293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.692043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.693019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.693590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.694126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.797874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:26.809878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-224a63af-83c9-4e80-bc54-e01a7eb2572e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 200 len: 1613 microversion: 2.1 time: 0.135875 Sep 19 15:19:26.814765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4077206c-304e-4761-a273-33017aff24f5 req-b680021f-9561-4a18-af0e-c603e34339c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4ecfab-0b57-4c74-b46e-8a532624aea6", "name": "network-vif-deleted", "tag": "0e933d51-7da1-4238-8ae2-d19ffda98eac"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:26.824957 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2703/5454] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:26 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 1613 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:26.846291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4077206c-304e-4761-a273-33017aff24f5 req-b680021f-9561-4a18-af0e-c603e34339c9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.850882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4077206c-304e-4761-a273-33017aff24f5 req-b680021f-9561-4a18-af0e-c603e34339c9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.854298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4077206c-304e-4761-a273-33017aff24f5 req-b680021f-9561-4a18-af0e-c603e34339c9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.874063 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4077206c-304e-4761-a273-33017aff24f5 req-b680021f-9561-4a18-af0e-c603e34339c9 service nova] Creating event network-vif-deleted:0e933d51-7da1-4238-8ae2-d19ffda98eac for instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 on n-h2-858384-1 Sep 19 15:19:26.889745 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4077206c-304e-4761-a273-33017aff24f5 req-b680021f-9561-4a18-af0e-c603e34339c9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080629 Sep 19 15:19:26.893316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2752/5455] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:27.839978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:27.840840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:27.849302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:27.850037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:27.850483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:27.851260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:27.851888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:27.853067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:27.873148 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 HTTP/1.1 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7d4ecfab-0b57-4c74-b46e-8a532624aea6'} Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:27.874949 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:19:27.880008 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:27.881754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:19:27.882863 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-955dfd3f-9afc-4e4f-9a11-b703c1c23d35 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 404 len: 111 microversion: 2.1 time: 0.048851 Sep 19 15:19:27.884461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2704/5456] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:27 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:19:27.896257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab0995f4-b165-4972-b254-491b34577e7b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '.version_select at 0x7fde28c0ef70>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:27.921768 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab0995f4-b165-4972-b254-491b34577e7b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422691134" status: 202 len: 0 microversion: 2.1 time: 0.032133 Sep 19 15:19:27.925975 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2753/5457] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 15:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422691134 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:19:29.062385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:29.063922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:29.074141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:29.074909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:29.075539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:29.077131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:29.077910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:29.078661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:29.203855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lazy-loading 'services' on Instance uuid 40515bb4-6996-4d2b-88c2-f943c1971312 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:19:29.304116 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a0ad63b-6152-4ae3-868d-26a018d7963c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments/46f12275-092d-4e10-97df-a116548d0184" status: 202 len: 0 microversion: 2.1 time: 0.246552 Sep 19 15:19:29.308369 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2705/5458] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:19:29 2022] DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments/46f12275-092d-4e10-97df-a116548d0184 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:19:29.314206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:29.318795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:29.333631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:29.334134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:29.334579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:29.335323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:29.335784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:29.336266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:29.379941 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26dbcf5c-6108-418e-84f0-54d05972ca1d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069078 Sep 19 15:19:29.379941 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2754/5459] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:19:29 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:30.395594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:30.398051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:30.405450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:30.406019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:30.406679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:30.407607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:30.408257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:30.408885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:30.444093 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c74072cb-fade-4173-b062-4baca806ed73 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053978 Sep 19 15:19:30.445595 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2706/5460] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:19:30 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:31.457231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:31.459821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:31.467907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:31.468505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:31.469048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:31.469878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:31.474159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:31.474912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:31.512530 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fac48f38-c7a7-464c-97a0-ae1a060c3e41 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058986 Sep 19 15:19:31.513078 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2755/5461] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:19:31 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:19:32.526313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:32.529128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:32.535910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:32.536506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:32.537008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:32.537813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:32.538660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:32.538660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:32.573739 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d077e952-cd25-4037-ae4b-1e02cd552098 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052377 Sep 19 15:19:32.574322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2707/5462] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:19:32 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:33.586683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:33.588898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:33.596143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:33.596646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:33.597123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:33.597903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:33.598415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:33.598863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:33.632249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f65329b-bef7-4bac-a0a7-ef477f56d136 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Sep 19 15:19:33.632906 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2756/5463] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:19:33 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:34.644576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:34.646733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:34.654832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:34.655319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:34.655751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:34.656445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:34.656891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:34.657311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:34.950616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:34.970487 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4aeae47b-0a8f-4673-b507-ad97bf87145c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.329802 Sep 19 15:19:34.971330 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2708/5464] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:19:34 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312/os-volume_attachments => generated 25 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:19:35.042469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:35.043165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:35.050967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.051390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.051829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.052575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.053032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.053456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.085185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:19:35.172696 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6dc68f4a-2e14-4285-9770-cbd958287440 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 204 len: 0 microversion: 2.1 time: 0.134251 Sep 19 15:19:35.173439 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2757/5465] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:19:35 2022] DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:19:35.182959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:35.183571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:35.185867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=25 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:35.191260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.191745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.192217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.193035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.193497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.193933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.332743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:35.341361 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d19e3c68-0cf2-425e-8c57-0de984909546 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1680 microversion: 2.1 time: 0.163398 Sep 19 15:19:35.341925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2709/5466] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:35 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:36.366259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:36.367731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:36.374838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:36.375336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:36.375774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:36.376476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:36.376927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:36.377357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:36.543720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:36.559124 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f2a7485-32b3-49a9-b767-20145c360858 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1680 microversion: 2.1 time: 0.197179 Sep 19 15:19:36.560894 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2758/5467] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:36 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:37.585162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:37.587447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:37.595111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.595322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.595725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.596854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.597480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.598071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.717373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-81fab763-f0f3-410a-914c-ee8cf5cfea78 req-cd9380b0-79a0-4d0c-a1e1-3857f94b47b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40515bb4-6996-4d2b-88c2-f943c1971312", "name": "network-vif-deleted", "tag": "f1a5b173-566f-4e4d-873e-9d8fdfa2ae63"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:37.741305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:37.741682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81fab763-f0f3-410a-914c-ee8cf5cfea78 req-cd9380b0-79a0-4d0c-a1e1-3857f94b47b7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.745559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81fab763-f0f3-410a-914c-ee8cf5cfea78 req-cd9380b0-79a0-4d0c-a1e1-3857f94b47b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.746071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-81fab763-f0f3-410a-914c-ee8cf5cfea78 req-cd9380b0-79a0-4d0c-a1e1-3857f94b47b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.752972 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-909d5390-1588-486a-94e4-9383ecfe04ef tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 200 len: 1612 microversion: 2.1 time: 0.171761 Sep 19 15:19:37.754237 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2710/5468] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:37 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 1612 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:37.762873 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-81fab763-f0f3-410a-914c-ee8cf5cfea78 req-cd9380b0-79a0-4d0c-a1e1-3857f94b47b7 service nova] Creating event network-vif-deleted:f1a5b173-566f-4e4d-873e-9d8fdfa2ae63 for instance 40515bb4-6996-4d2b-88c2-f943c1971312 on n-h1-858384-1 Sep 19 15:19:37.770820 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-81fab763-f0f3-410a-914c-ee8cf5cfea78 req-cd9380b0-79a0-4d0c-a1e1-3857f94b47b7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056630 Sep 19 15:19:37.775765 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2759/5469] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:19:38.782125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:38.784184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:38.791143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:38.791643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:38.792336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:38.793292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:38.794162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:38.794861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:38.810670 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 HTTP/1.1 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '40515bb4-6996-4d2b-88c2-f943c1971312'} Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:38.812464 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:19:38.816382 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:19:38.827766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:19:38.828777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6cbc915f-c0d4-4e2f-979f-b449c0b20cee tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 404 len: 111 microversion: 2.1 time: 0.051489 Sep 19 15:19:38.829485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2711/5470] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:38 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:19:38.840388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d10da336-1154-43b3-985d-b72f80e847ab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '.version_select at 0x7fde29dfe5e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:38.864584 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d10da336-1154-43b3-985d-b72f80e847ab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-778190934" status: 202 len: 0 microversion: 2.1 time: 0.030033 Sep 19 15:19:38.865562 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2760/5471] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 15:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-778190934 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:19:39.619390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-39eb328e-e340-4568-8c69-c1a7c42b9a11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: .version_select at 0x7fde28e1fe50>, body: {"keypair": {"name": "tempest-keypair-1986104086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEkzdbtgXszyK68uRzUlaxkJWH0ZUTumn6AAVWNugzOLbOOFop8AdDIQs613LroRn5m9N7+OG02NLTr5lntvEqNuuooZoYfb701URV51dz5UKOk5ETOyveBX7PKAmyIkg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:39.637247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-39eb328e-e340-4568-8c69-c1a7c42b9a11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:19:39.643345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-39eb328e-e340-4568-8c69-c1a7c42b9a11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:19:39.671915 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-39eb328e-e340-4568-8c69-c1a7c42b9a11 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057048 Sep 19 15:19:39.673163 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2712/5472] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:19:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:19:41.102938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1016323971", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46c10aad-0460-472f-a035-c74ef8a10be1"}], "security_groups": [{"name": "tempest-securitygroup--1760105347"}], "key_name": "tempest-keypair-1986104086", "user_data": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:41.215790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] validate_networks() for [('46c10aad-0460-472f-a035-c74ef8a10be1', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:19:41.606377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:19:41.606831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:19:41.607318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:19:41.607735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:19:41.608168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:19:41.618278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:41.618870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:41.619237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:41.619928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:41.620388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:41.620815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:41.638768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:19:41.644382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:19:41.657283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:19:41.659763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:19:41.708474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0db08937-a070-43d2-ae50-aa6ea83d5277 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609916 Sep 19 15:19:41.709127 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2761/5473] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:19:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:19:41.721035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2fe51f3e-040c-4f3a-8a32-a740e2db5fb6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:41.721900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2fe51f3e-040c-4f3a-8a32-a740e2db5fb6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:41.796545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2fe51f3e-040c-4f3a-8a32-a740e2db5fb6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:41.804652 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2fe51f3e-040c-4f3a-8a32-a740e2db5fb6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1242 microversion: 2.1 time: 0.087368 Sep 19 15:19:41.807133 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2713/5474] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:41 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:42.829642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:42.830872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:42.842850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:42.844080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:42.844741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:42.845700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:42.847387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:42.848093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:42.934622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:42.945306 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43d54987-be5f-4ef6-90ba-e74eebfc9b74 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1312 microversion: 2.1 time: 0.120124 Sep 19 15:19:42.945969 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2762/5475] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:42 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:43.969423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:43.970256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:43.978342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:43.979105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:43.979875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:43.980787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:43.981538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:43.982123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:44.282773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:44.296352 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a78ccd59-e4b8-48ce-96f8-bda5030c2b7e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1368 microversion: 2.1 time: 0.330495 Sep 19 15:19:44.297566 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2714/5476] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:43 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:44.543595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2d8bf394-7a8a-4969-856b-ac6f2227e720 req-6b6af1f4-c14c-4280-93de-b4cf403378ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfbf4fe1-c565-4023-bb97-0755c5eca3cf", "tag": "9c33477c-5485-462d-b1f5-a7ea92ada5d6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:44.558086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2d8bf394-7a8a-4969-856b-ac6f2227e720 req-6b6af1f4-c14c-4280-93de-b4cf403378ba service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:44.559001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2d8bf394-7a8a-4969-856b-ac6f2227e720 req-6b6af1f4-c14c-4280-93de-b4cf403378ba service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:44.559614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2d8bf394-7a8a-4969-856b-ac6f2227e720 req-6b6af1f4-c14c-4280-93de-b4cf403378ba service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:44.574780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2d8bf394-7a8a-4969-856b-ac6f2227e720 req-6b6af1f4-c14c-4280-93de-b4cf403378ba service nova] Creating event network-changed:9c33477c-5485-462d-b1f5-a7ea92ada5d6 for instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf on n-h1-858384-1 Sep 19 15:19:44.589762 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2d8bf394-7a8a-4969-856b-ac6f2227e720 req-6b6af1f4-c14c-4280-93de-b4cf403378ba service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050341 Sep 19 15:19:44.591073 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2763/5477] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:45.321367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:45.322972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:45.334201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:45.334976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:45.335532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:45.336496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:45.336955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:45.337549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:45.483781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:45.492861 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4657188e-1ad9-45e8-b040-2ebc09abe89f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1368 microversion: 2.1 time: 0.175581 Sep 19 15:19:45.493678 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2715/5478] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:45 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:46.520763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:46.525581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:46.532190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:46.532982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:46.533540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:46.534362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:46.535322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:46.535862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:46.758234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:46.766587 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70223cb7-5337-45e7-9d78-ddf25a4a6f68 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1368 microversion: 2.1 time: 0.253510 Sep 19 15:19:46.767261 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2764/5479] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:46 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:47.792690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:47.793537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:47.800810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:47.801564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:47.802104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:47.803068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:47.803583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:47.804283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:47.978003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:47.988511 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-45c9610c-9202-4f9c-b60b-fb2e8f14ea00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1368 microversion: 2.1 time: 0.201656 Sep 19 15:19:47.989224 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2716/5480] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:47 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:49.012611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:49.013559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:49.020895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:49.021358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:49.021796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:49.023366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:49.023995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:49.024427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:49.173073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:49.182371 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56be47eb-444e-4cab-b832-205e151fae2d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1368 microversion: 2.1 time: 0.173724 Sep 19 15:19:49.183159 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2765/5481] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:49 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:49.874797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-87083d43-e473-4216-bc4a-054064f60ad7 req-5cd8d064-2ba9-4db9-baa9-0390cdd4effd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfbf4fe1-c565-4023-bb97-0755c5eca3cf", "name": "network-vif-plugged", "status": "completed", "tag": "9c33477c-5485-462d-b1f5-a7ea92ada5d6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:49.895914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-87083d43-e473-4216-bc4a-054064f60ad7 req-5cd8d064-2ba9-4db9-baa9-0390cdd4effd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:49.896617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-87083d43-e473-4216-bc4a-054064f60ad7 req-5cd8d064-2ba9-4db9-baa9-0390cdd4effd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:49.897870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-87083d43-e473-4216-bc4a-054064f60ad7 req-5cd8d064-2ba9-4db9-baa9-0390cdd4effd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:49.910286 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-87083d43-e473-4216-bc4a-054064f60ad7 req-5cd8d064-2ba9-4db9-baa9-0390cdd4effd service nova] Creating event network-vif-plugged:9c33477c-5485-462d-b1f5-a7ea92ada5d6 for instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf on n-h1-858384-1 Sep 19 15:19:49.917359 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-87083d43-e473-4216-bc4a-054064f60ad7 req-5cd8d064-2ba9-4db9-baa9-0390cdd4effd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046599 Sep 19 15:19:49.918430 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2717/5482] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:50.205582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:50.206235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:50.213800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:50.214218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:50.214654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:50.215411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:50.215867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:50.216310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:50.353031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:50.361084 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98d24b31-21ce-43b9-a964-feb03793f318 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1368 microversion: 2.1 time: 0.159373 Sep 19 15:19:50.361656 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2766/5483] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:50 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:51.385456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:51.386100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:51.392502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.392982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.393418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.394103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.394559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.395004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.530880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:51.538918 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8629468e-e2ce-4037-8b6d-d1f6c47e2a50 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1557 microversion: 2.1 time: 0.159088 Sep 19 15:19:51.539488 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2718/5484] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:51 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:51.563289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:51.563868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:51.571676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.572177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.572620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.573402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.573776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.574560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.578648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:51.629464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:51.651363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:51.660129 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-984bb22d-8e67-4e7e-972e-c27b04cb197e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101203 Sep 19 15:19:51.660729 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2767/5485] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:19:51 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:19:52.669658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cbc49c44-e753-4076-93fe-0aef745de060 req-50a214bc-9ed3-4be1-8156-5ead9560649e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfbf4fe1-c565-4023-bb97-0755c5eca3cf", "tag": "9c33477c-5485-462d-b1f5-a7ea92ada5d6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:19:52.675704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:52.682361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cbc49c44-e753-4076-93fe-0aef745de060 req-50a214bc-9ed3-4be1-8156-5ead9560649e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:52.682904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cbc49c44-e753-4076-93fe-0aef745de060 req-50a214bc-9ed3-4be1-8156-5ead9560649e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:52.683360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cbc49c44-e753-4076-93fe-0aef745de060 req-50a214bc-9ed3-4be1-8156-5ead9560649e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:52.696989 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cbc49c44-e753-4076-93fe-0aef745de060 req-50a214bc-9ed3-4be1-8156-5ead9560649e service nova] Creating event network-changed:9c33477c-5485-462d-b1f5-a7ea92ada5d6 for instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf on n-h1-858384-1 Sep 19 15:19:52.702482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cbc49c44-e753-4076-93fe-0aef745de060 req-50a214bc-9ed3-4be1-8156-5ead9560649e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036521 Sep 19 15:19:52.706987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2719/5486] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:20:22.309394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:22.310296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:22.314650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:22.315183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:22.322898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:22.323443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:22.323864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:22.324558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:22.325018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:22.325452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:22.358780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5cb53ad1-d6a2-4b16-9edf-4bdf0ebe454c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/ips" status: 200 len: 149 microversion: 2.1 time: 0.051193 Sep 19 15:20:22.359506 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2768/5487] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:20:22 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:23.745864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15301740-e056-4fc3-83b8-25484403b590"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:23.748935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:23.755142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:23.755813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=45 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:23.758722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:23.759436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:23.759890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:23.760612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:23.761074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:23.761510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:24.056181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a80a11ea-3ff3-4fe7-a82c-e2b66234fb84 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316067 Sep 19 15:20:24.062685 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2720/5488] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:20:23 2022] POST /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:34.616660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1730626887", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d9532f9c-3f0c-4fa8-b4f7-edab614bccde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:34.627289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:34.627932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:34.683290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:20:35.068319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:20:35.068751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:20:35.069221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:20:35.069626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:20:35.070037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:20:35.079281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:35.079769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:35.080200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:35.080922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:35.081393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:35.081798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:35.102267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:20:35.106676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:20:35.173176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:20:35.175316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9532f9c-3f0c-4fa8-b4f7-edab614bccde',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:20:35.341293 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-956f4ccd-c280-40dd-a1c3-91868d925da4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729224 Sep 19 15:20:35.343995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2769/5489] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:20:35.354398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:35.355669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:35.361521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5554a090-f79c-47af-9c6b-bd2dcb437fc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:35.362515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5554a090-f79c-47af-9c6b-bd2dcb437fc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:35.455915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5554a090-f79c-47af-9c6b-bd2dcb437fc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:35.465208 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5554a090-f79c-47af-9c6b-bd2dcb437fc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1057 microversion: 2.1 time: 0.113642 Sep 19 15:20:35.467118 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2721/5490] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:35 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1057 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:36.202470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15301740-e056-4fc3-83b8-25484403b590"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:36.205345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:36.213146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.213654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.215069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.216167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.216642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.217084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.301973 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Invalid volume: volume 15301740-e056-4fc3-83b8-25484403b590 is already attached to instances: dfbf4fe1-c565-4023-bb97-0755c5eca3cf Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments HTTP/1.1 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 74 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: {"volumeAttachment": {"volumeId": "15301740-e056-4fc3-83b8-25484403b590"}} Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: exception: Invalid volume: volume 15301740-e056-4fc3-83b8-25484403b590 is already attached to instances: dfbf4fe1-c565-4023-bb97-0755c5eca3cf Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': 'dfbf4fe1-c565-4023-bb97-0755c5eca3cf', 'body': {'volumeAttachment': {'volumeId': '15301740-e056-4fc3-83b8-25484403b590'}}} Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 15301740-e056-4fc3-83b8-25484403b590 is already attached to instances: dfbf4fe1-c565-4023-bb97-0755c5eca3cf Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:20:36.303829 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 15301740-e056-4fc3-83b8-25484403b590 is already attached to instances: dfbf4fe1-c565-4023-bb97-0755c5eca3cf Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 15301740-e056-4fc3-83b8-25484403b590 is already attached to instances: dfbf4fe1-c565-4023-bb97-0755c5eca3cf Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 400 to user: Invalid volume: volume 15301740-e056-4fc3-83b8-25484403b590 is already attached to instances: dfbf4fe1-c565-4023-bb97-0755c5eca3cf {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd76c761-746a-4508-8c89-78c96121b9bb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107321 Sep 19 15:20:36.311920 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2770/5491] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:20:36 2022] POST /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:20:36.384103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:36.384636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:36.394076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.394598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.395526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.397498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.398247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.399009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.489548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:36.491293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:36.515724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.516136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.520272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.521363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.521946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.522573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.560923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lazy-loading 'services' on Instance uuid dfbf4fe1-c565-4023-bb97-0755c5eca3cf {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:20:36.657573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:36.665636 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-50f57ba9-7f33-4d31-870b-1f90cc8aa718 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments/15301740-e056-4fc3-83b8-25484403b590" status: 202 len: 0 microversion: 2.1 time: 0.287416 Sep 19 15:20:36.667207 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2722/5492] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:20:36 2022] DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments/15301740-e056-4fc3-83b8-25484403b590 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:20:36.668733 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0c14fc69-4fad-415a-b1dd-3bc7993e3d41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1163 microversion: 2.1 time: 0.183613 Sep 19 15:20:36.669321 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2771/5493] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:36 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1163 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:36.692507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:36.695736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:36.713088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.714496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.715688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.717731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.718883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.719953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.807013 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-29d7530c-12fc-4424-91f2-a45964e617d8 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120234 Sep 19 15:20:36.813150 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2723/5494] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:20:36 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:37.697447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:37.698101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:37.714545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.715363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.716008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.717157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.717846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.718286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.823224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:37.825606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:37.834785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.834785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.834785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.835469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.835878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.836419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.878323 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c4c7fa6e-7517-4099-8be5-8c92db54e795 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059636 Sep 19 15:20:37.882622 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2724/5495] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:20:37 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:37.974841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:37.983698 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b806f2c-a74d-42c7-9629-78bf1c37d0fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.295449 Sep 19 15:20:37.984868 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2772/5496] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:37 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:38.683536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3f402476-a36f-4795-b476-2ba3c8e66bb1 req-28ff8d8c-0be6-429e-865f-fc13760546cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6436827-4076-401c-a8b2-cfd80507f98f", "tag": "026a2651-9433-49f2-8fe8-b1947446f6ce"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:38.694567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3f402476-a36f-4795-b476-2ba3c8e66bb1 req-28ff8d8c-0be6-429e-865f-fc13760546cc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.695297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3f402476-a36f-4795-b476-2ba3c8e66bb1 req-28ff8d8c-0be6-429e-865f-fc13760546cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.695896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3f402476-a36f-4795-b476-2ba3c8e66bb1 req-28ff8d8c-0be6-429e-865f-fc13760546cc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.711770 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3f402476-a36f-4795-b476-2ba3c8e66bb1 req-28ff8d8c-0be6-429e-865f-fc13760546cc service nova] Creating event network-changed:026a2651-9433-49f2-8fe8-b1947446f6ce for instance d6436827-4076-401c-a8b2-cfd80507f98f on n-h1-858384-1 Sep 19 15:20:38.716816 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3f402476-a36f-4795-b476-2ba3c8e66bb1 req-28ff8d8c-0be6-429e-865f-fc13760546cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233524 Sep 19 15:20:38.717978 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2725/5497] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:38.889943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:38.892184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:38.899545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.900053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.900499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.901216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.901679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.902114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.935162 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-11d19cbd-2535-47c7-b5fd-bd1fd413ad77 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049366 Sep 19 15:20:38.936132 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2773/5498] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:20:38 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:20:39.012924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:39.013747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:39.020134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:39.020639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:39.021270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:39.022028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:39.022494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:39.023159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:39.585182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:39.595437 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e26f84f-3f80-4737-84a1-ef54927ff44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.587680 Sep 19 15:20:39.596029 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2726/5499] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:39 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:39.948604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:39.951058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:39.958252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:39.959460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:39.960074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:39.960884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:39.961419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:39.961919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:39.994363 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3a6fa434-bc9a-45b4-af4e-0e42c78d7245 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049755 Sep 19 15:20:39.994984 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2774/5500] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:20:39 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:20:40.618810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:40.619453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:40.626575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:40.627106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:40.627554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:40.628245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:40.628705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:40.629136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:40.759096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:40.766734 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0d0a9c2-199a-4766-b8f6-c52672800301 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.151862 Sep 19 15:20:40.767361 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2727/5501] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:40 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:41.007630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:41.009804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:41.016700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:41.017196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:41.017643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:41.018345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:41.018827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:41.019263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:41.050124 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ccd327f-761f-414e-8add-e51aeb7cf854 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Sep 19 15:20:41.050697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2775/5502] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:20:41 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:41.790285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:41.791153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:41.798714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:41.799351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:41.799792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:41.800496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:41.800957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:41.801526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:41.941731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:41.949770 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b8345ae-efd8-45ed-9cde-9426435c51a7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.164180 Sep 19 15:20:41.950448 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2728/5503] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:41 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:42.063989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:42.066164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:42.073537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.074023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.074465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.075196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.075657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.076087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.106395 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d5154b9-ff80-40ef-9785-5b926ba72897 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046532 Sep 19 15:20:42.107006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2776/5504] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:20:42 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:20:42.172052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:42.172562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:42.179257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.179759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.180208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.180913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.181376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.181808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.206959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:20:42.284799 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ac6e1903-1702-4206-930a-a4375eccd677 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 204 len: 0 microversion: 2.1 time: 0.116449 Sep 19 15:20:42.285424 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2729/5505] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:20:42 2022] DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:20:42.294365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:42.295184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:42.301333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.301824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.302870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.303572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.304028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.304641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.441301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:42.454812 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2600562-7233-4db9-8dd8-e4d75ff9ec6c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1682 microversion: 2.1 time: 0.163905 Sep 19 15:20:42.455095 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2777/5506] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:42 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:42.973951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:42.974706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:42.981518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.982014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.982451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:42.983176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:42.983636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:42.984068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:43.114147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:43.122877 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e9471c9-b6f9-43d0-8c0e-2b58d0b08afd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.153275 Sep 19 15:20:43.123475 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2730/5507] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:42 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:43.481426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:43.482093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:43.489156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:43.489658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:43.490106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:43.490842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:43.491310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:43.491745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:43.631762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:43.640361 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b9f64f2a-a41a-44fd-85fb-8fe8aefa6e2c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1682 microversion: 2.1 time: 0.162997 Sep 19 15:20:43.640935 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2778/5508] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:43 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:44.146065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:44.146948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:44.153609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:44.154418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:44.154956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:44.155879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:44.156645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:44.156835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:44.363775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:44.372423 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87e08f9a-ac97-4574-8797-c620ae2800a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.230293 Sep 19 15:20:44.373006 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2731/5509] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:44 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:44.665030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:44.666250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:44.674020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:44.675088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:44.675753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:44.676712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:44.677799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:44.678319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:44.716663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e7c7c5ad-d5cf-4ea9-a8c1-124a46f49b9b req-cc30de1a-8cfc-4b4f-a99d-90c643745d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfbf4fe1-c565-4023-bb97-0755c5eca3cf", "name": "network-vif-deleted", "tag": "9c33477c-5485-462d-b1f5-a7ea92ada5d6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:44.731208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e7c7c5ad-d5cf-4ea9-a8c1-124a46f49b9b req-cc30de1a-8cfc-4b4f-a99d-90c643745d9b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:44.731798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e7c7c5ad-d5cf-4ea9-a8c1-124a46f49b9b req-cc30de1a-8cfc-4b4f-a99d-90c643745d9b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:44.732471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e7c7c5ad-d5cf-4ea9-a8c1-124a46f49b9b req-cc30de1a-8cfc-4b4f-a99d-90c643745d9b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:44.745837 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e7c7c5ad-d5cf-4ea9-a8c1-124a46f49b9b req-cc30de1a-8cfc-4b4f-a99d-90c643745d9b service nova] Creating event network-vif-deleted:9c33477c-5485-462d-b1f5-a7ea92ada5d6 for instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf on n-h1-858384-1 Sep 19 15:20:44.755504 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e7c7c5ad-d5cf-4ea9-a8c1-124a46f49b9b req-cc30de1a-8cfc-4b4f-a99d-90c643745d9b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042666 Sep 19 15:20:44.756485 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2732/5510] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:20:44.803734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:44.826518 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75482513-8bba-4b16-ace5-319803390df2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 200 len: 1614 microversion: 2.1 time: 0.166038 Sep 19 15:20:44.827209 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2779/5511] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:44 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 1614 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:45.396979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:45.397890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:45.405836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:45.406457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:45.406985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:45.408077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:45.408801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:45.409402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:45.464520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:45.588043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:45.598450 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6269c55f-bea8-4f01-8a5c-78c7f189ea1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1215 microversion: 2.1 time: 0.207422 Sep 19 15:20:45.600699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2733/5512] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:45 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:45.850957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:45.851699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:45.853803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:45.854693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:45.861808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:45.862306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:45.862761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:45.863476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:45.863936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:45.864393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:45.882295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf HTTP/1.1 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'dfbf4fe1-c565-4023-bb97-0755c5eca3cf'} Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:20:45.883887 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b225ee96-2cae-48f3-b70b-5d9dad7100b2 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 404 len: 111 microversion: 2.1 time: 0.038842 Sep 19 15:20:45.888091 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2780/5513] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:45 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:20:45.894247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d79d03e6-4cf4-430d-b1db-e9847c89ced4 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '.version_select at 0x7fde2e290af0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:45.916657 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d79d03e6-4cf4-430d-b1db-e9847c89ced4 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986104086" status: 202 len: 0 microversion: 2.1 time: 0.026101 Sep 19 15:20:45.917706 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2734/5514] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 15:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986104086 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:20:46.558186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-837cd8bc-bc31-4afc-ba7a-94570dc00c1b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: .version_select at 0x7fde29e35a60>, body: {"keypair": {"name": "tempest-keypair-95192319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcbPjgTcokBY2UXiQ0a0LHvCwztKWYGbDGUasN1mqukmOwHE5wCZYRQlrj/gPNhGQYVdlS0ShHikq2ZPTS5yyY32/3rUltxkNJ/64YPCwcFXEjM3euR/WzKDvt85mmuyw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:46.574307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-837cd8bc-bc31-4afc-ba7a-94570dc00c1b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:20:46.579420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-837cd8bc-bc31-4afc-ba7a-94570dc00c1b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:20:46.604674 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-837cd8bc-bc31-4afc-ba7a-94570dc00c1b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050581 Sep 19 15:20:46.605565 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2781/5515] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:20:46 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:46.623320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:46.623984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:46.631920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:46.632534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:46.633158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:46.633873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:46.634346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:46.634820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:46.835246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:46.844645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d37326a1-b24d-46d7-8b6d-c1047e40ff31 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.226194 Sep 19 15:20:46.845254 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2735/5516] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:46 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:47.870274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:47.870885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:47.878142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:47.878642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:47.879152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:47.879901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:47.880461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:47.880961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:48.028097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:48.037698 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f0edfd75-8d71-4da1-a076-2e32632bf179 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.172551 Sep 19 15:20:48.038394 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2782/5517] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:47 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:48.279975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1280732502", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46c10aad-0460-472f-a035-c74ef8a10be1"}], "security_groups": [{"name": "tempest-securitygroup--1746100754"}], "key_name": "tempest-keypair-95192319", "user_data": "}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:48.394172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] validate_networks() for [('46c10aad-0460-472f-a035-c74ef8a10be1', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:20:48.780956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:20:48.781395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:20:48.781881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:20:48.782300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:20:48.782723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:20:48.792823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:48.793320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:48.793795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:48.794557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:48.795054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:48.795488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:48.812999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:20:48.818231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Getting quotas for user 6245f69bea8d46fbabaaa308b20fb9a2 and project cf8ff605201048c5be71d42ff51a0a67. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:20:48.830618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:20:48.833128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:20:48.879520 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcbbf79b-38f2-448b-bbcb-d6d43b00de61 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.603923 Sep 19 15:20:48.880441 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2736/5518] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:20:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:20:48.891596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9c86729-302d-4e70-90fe-6105fe556d05 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:48.892211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9c86729-302d-4e70-90fe-6105fe556d05 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:48.947431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9c86729-302d-4e70-90fe-6105fe556d05 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:48.954337 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9c86729-302d-4e70-90fe-6105fe556d05 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1240 microversion: 2.1 time: 0.066804 Sep 19 15:20:48.954937 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2783/5519] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:48 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:49.060947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:49.061598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:49.068201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:49.068691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:49.069136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:49.069824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:49.070288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:49.070732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:49.208994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:49.216965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c925dbb3-0425-448a-9473-7518250d5841 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.160203 Sep 19 15:20:49.217780 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2737/5520] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:49 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:49.976751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:49.977374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:49.985592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:49.986094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:49.986538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:49.987283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:49.987754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:49.988187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:50.073052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:50.081566 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e759630-20a9-4296-bf05-228687981efa tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1298 microversion: 2.1 time: 0.108930 Sep 19 15:20:50.082527 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2784/5521] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:49 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:50.241638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:50.243035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:50.250791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:50.251480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:50.252105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:50.252974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:50.253606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:50.254034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:50.471124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:50.479333 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f53d13a6-f76d-496b-a6dc-95768eb481fc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.242564 Sep 19 15:20:50.480023 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2738/5522] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:50 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:51.106738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:51.107377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:51.113353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:51.113843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:51.115186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:51.115925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:51.116386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:51.116843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:51.334767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:51.342658 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f89b255e-f915-40cf-a44a-3e40465806ec tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1366 microversion: 2.1 time: 0.241050 Sep 19 15:20:51.343270 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2785/5523] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:51 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:51.474930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f51773d2-177c-42e3-99cf-fedecd7c2084 req-5e360743-f074-42d8-9fd9-b7aaaecd045d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4e9913-fd4f-419e-b915-33e18236dd85", "tag": "799af685-62f2-4187-baf8-b58a93ef259a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:51.486209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f51773d2-177c-42e3-99cf-fedecd7c2084 req-5e360743-f074-42d8-9fd9-b7aaaecd045d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:51.486696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f51773d2-177c-42e3-99cf-fedecd7c2084 req-5e360743-f074-42d8-9fd9-b7aaaecd045d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:51.487157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f51773d2-177c-42e3-99cf-fedecd7c2084 req-5e360743-f074-42d8-9fd9-b7aaaecd045d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:51.491784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:51.500894 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f51773d2-177c-42e3-99cf-fedecd7c2084 req-5e360743-f074-42d8-9fd9-b7aaaecd045d service nova] Creating event network-changed:799af685-62f2-4187-baf8-b58a93ef259a for instance bd4e9913-fd4f-419e-b915-33e18236dd85 on n-h2-858384-1 Sep 19 15:20:51.502722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:51.503378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:51.506413 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f51773d2-177c-42e3-99cf-fedecd7c2084 req-5e360743-f074-42d8-9fd9-b7aaaecd045d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035312 Sep 19 15:20:51.507304 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2739/5524] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:51.516273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:51.516884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:51.517438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:51.518290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:51.518875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:51.519452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:51.745536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:51.753234 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f50519b7-f79b-4355-a240-25229f57b3ed tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.255156 Sep 19 15:20:51.753812 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2786/5525] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:51 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:52.367667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:52.368373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:52.374810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:52.375307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:52.375773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:52.376464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:52.376917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:52.377347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:52.510275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:52.517940 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-69f5893c-178f-4846-bbb5-fe717af3df52 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1366 microversion: 2.1 time: 0.156214 Sep 19 15:20:52.518510 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2740/5526] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:52 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:52.777225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:52.777855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:52.784804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:52.785307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:52.785789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:52.786594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:52.787090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:52.787532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:53.322045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:53.330180 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d0da046-1d26-4231-8af5-9bddbe9cd63c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.557091 Sep 19 15:20:53.330905 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2787/5527] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:52 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:53.541406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:53.542054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:53.548856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:53.549343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:53.549779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:53.550466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:53.550956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:53.551540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:53.698759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:53.707263 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ce0a7bc-5145-4f50-ba35-8118324c2667 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1366 microversion: 2.1 time: 0.169786 Sep 19 15:20:53.707849 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2741/5528] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:53 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:54.147576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6a3fd7bd-992c-4ad0-9240-5837000b6156 req-d47cf9df-42b4-4fd2-8ff4-d20794cc916f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6436827-4076-401c-a8b2-cfd80507f98f", "name": "network-vif-plugged", "status": "completed", "tag": "026a2651-9433-49f2-8fe8-b1947446f6ce"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:54.158082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6a3fd7bd-992c-4ad0-9240-5837000b6156 req-d47cf9df-42b4-4fd2-8ff4-d20794cc916f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:54.158617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6a3fd7bd-992c-4ad0-9240-5837000b6156 req-d47cf9df-42b4-4fd2-8ff4-d20794cc916f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:54.159083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6a3fd7bd-992c-4ad0-9240-5837000b6156 req-d47cf9df-42b4-4fd2-8ff4-d20794cc916f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:54.172763 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6a3fd7bd-992c-4ad0-9240-5837000b6156 req-d47cf9df-42b4-4fd2-8ff4-d20794cc916f service nova] Creating event network-vif-plugged:026a2651-9433-49f2-8fe8-b1947446f6ce for instance d6436827-4076-401c-a8b2-cfd80507f98f on n-h1-858384-1 Sep 19 15:20:54.178172 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6a3fd7bd-992c-4ad0-9240-5837000b6156 req-d47cf9df-42b4-4fd2-8ff4-d20794cc916f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035119 Sep 19 15:20:54.179016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2788/5529] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:54.353931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:54.354588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:54.360921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:54.361430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:54.361871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:54.362575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:54.363071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:54.363513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:54.500727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:54.509580 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b86ffb58-8a4a-4232-8720-ce6fb1865305 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1203 microversion: 2.1 time: 0.159694 Sep 19 15:20:54.510172 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2742/5530] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:54 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:54.730319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:54.731468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:54.738428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:54.739669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:54.740356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:54.741059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:54.741670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:54.742111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:54.762227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:54.879347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:54.887138 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d842687-52bb-4db2-87c8-414591c78039 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1366 microversion: 2.1 time: 0.161113 Sep 19 15:20:54.887708 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2789/5531] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:54 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:55.532439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:55.533060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:55.540522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.541013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.541458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.542159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.542624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.543094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.675450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:55.684609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a56131f-52c1-4a81-8c7f-17f777d400f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1391 microversion: 2.1 time: 0.156191 Sep 19 15:20:55.685187 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2743/5532] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:55 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:55.706973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:55.707649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:55.714588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.715127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.715569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.716434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.717291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.717751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.845852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:55.854360 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c17fd467-a13a-43ac-937b-763171d93d6f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1391 microversion: 2.1 time: 0.151355 Sep 19 15:20:55.854956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2790/5533] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:55 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:55.876617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:55.877177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:55.883273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.883774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.884223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.884933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.885435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.885874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.909707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:55.910324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:55.917046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.917537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.917973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:55.918679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:55.919167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:55.919608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:56.068723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:56.076489 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b7676dd-b23f-431b-b95a-3226d5b197e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1391 microversion: 2.1 time: 0.203854 Sep 19 15:20:56.077075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2744/5534] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:55 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:56.095178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:56.099389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:56.099896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:56.103976 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c80f41af-cee8-4c19-92ba-95cf8f4faccc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1366 microversion: 2.1 time: 0.198137 Sep 19 15:20:56.104789 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2791/5535] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:55 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:56.105752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:56.106244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:56.106687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:56.107417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:56.107873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:56.108306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:56.133277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:20:56.206634 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-50381128-0ca6-4333-ad40-11c4ccafff88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 204 len: 0 microversion: 2.1 time: 0.111681 Sep 19 15:20:56.207828 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2745/5536] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:20:56 2022] DELETE /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:20:56.216327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:56.216954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:56.223632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:56.224258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:56.224698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:56.225399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:56.225864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:56.226291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:56.355933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:56.364516 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c71f0061-96a6-4953-ba74-e54239732042 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1397 microversion: 2.1 time: 0.151752 Sep 19 15:20:56.365114 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2792/5537] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:56 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1397 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:56.450157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7300470b-95cd-4514-976b-cc7c2e77237a req-dd5cd21a-55b6-41bf-a9ee-cd70a115137d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4e9913-fd4f-419e-b915-33e18236dd85", "name": "network-vif-plugged", "status": "completed", "tag": "799af685-62f2-4187-baf8-b58a93ef259a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:56.461110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7300470b-95cd-4514-976b-cc7c2e77237a req-dd5cd21a-55b6-41bf-a9ee-cd70a115137d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:56.461634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7300470b-95cd-4514-976b-cc7c2e77237a req-dd5cd21a-55b6-41bf-a9ee-cd70a115137d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:56.462109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7300470b-95cd-4514-976b-cc7c2e77237a req-dd5cd21a-55b6-41bf-a9ee-cd70a115137d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:56.475705 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7300470b-95cd-4514-976b-cc7c2e77237a req-dd5cd21a-55b6-41bf-a9ee-cd70a115137d service nova] Creating event network-vif-plugged:799af685-62f2-4187-baf8-b58a93ef259a for instance bd4e9913-fd4f-419e-b915-33e18236dd85 on n-h2-858384-1 Sep 19 15:20:56.480982 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7300470b-95cd-4514-976b-cc7c2e77237a req-dd5cd21a-55b6-41bf-a9ee-cd70a115137d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034858 Sep 19 15:20:56.481607 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2746/5538] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:57.126321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:57.126977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:57.133922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:57.134423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:57.134902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:57.135611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:57.136076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:57.136513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:57.272985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:57.280898 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb654777-f6aa-44b5-91a1-ca7a28d78c00 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1366 microversion: 2.1 time: 0.158465 Sep 19 15:20:57.281613 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2793/5539] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:57 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:57.387970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:57.388677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:57.395705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:57.396192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:57.397317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:57.398165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:57.398627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:57.399087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:57.539658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:57.547665 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ee038a74-dbf6-4788-9430-5da1105301c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1397 microversion: 2.1 time: 0.164014 Sep 19 15:20:57.548243 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2747/5540] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:57 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:58.161807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d310867a-544a-48e1-bed2-a6818250f54a req-24e45dcf-bffa-46a5-82c2-955fdec18c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6436827-4076-401c-a8b2-cfd80507f98f", "name": "network-vif-deleted", "tag": "026a2651-9433-49f2-8fe8-b1947446f6ce"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:20:58.175419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d310867a-544a-48e1-bed2-a6818250f54a req-24e45dcf-bffa-46a5-82c2-955fdec18c8c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.175917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d310867a-544a-48e1-bed2-a6818250f54a req-24e45dcf-bffa-46a5-82c2-955fdec18c8c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.176364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d310867a-544a-48e1-bed2-a6818250f54a req-24e45dcf-bffa-46a5-82c2-955fdec18c8c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.190132 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d310867a-544a-48e1-bed2-a6818250f54a req-24e45dcf-bffa-46a5-82c2-955fdec18c8c service nova] Creating event network-vif-deleted:026a2651-9433-49f2-8fe8-b1947446f6ce for instance d6436827-4076-401c-a8b2-cfd80507f98f on n-h1-858384-1 Sep 19 15:20:58.195958 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d310867a-544a-48e1-bed2-a6818250f54a req-24e45dcf-bffa-46a5-82c2-955fdec18c8c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Sep 19 15:20:58.196663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2794/5541] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:58.305592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:58.306314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:58.312717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.313289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.313808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.314592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.315170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.315679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.452585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:58.460587 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4d1866a8-ac3a-45d5-a584-22a506a6d3c9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1556 microversion: 2.1 time: 0.159624 Sep 19 15:20:58.461413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2748/5542] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:58 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:58.484121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:58.484720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:58.491872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.492361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.492798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.493495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.493986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.494411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.571881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:58.572507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:58.573662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7b4d73b-f863-44bd-9fee-5299d43e011e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093768 Sep 19 15:20:58.574424 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2795/5543] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:20:58 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:20:58.586642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.587300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.587620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.588337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:58.588809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:58.589241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:58.690488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:58.699315 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04889256-48f8-4b74-8c8e-d89901ea5d23 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1188 microversion: 2.1 time: 0.131904 Sep 19 15:20:58.700295 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2749/5544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:58 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1188 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:59.719121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:59.725031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:59.725982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:59.732671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:59.733178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:59.733634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:59.734378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:59.734873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:59.735311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:59.806687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:59.816080 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eec6b94e-82b5-4808-9430-b9e657140f82 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1188 microversion: 2.1 time: 0.097791 Sep 19 15:20:59.816687 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2796/5545] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:59 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:00.211757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d4ad7e7e-bf33-4dfb-9eeb-952e576c53c3 req-ca5e61b6-5484-465b-9ead-7340681e3f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4e9913-fd4f-419e-b915-33e18236dd85", "tag": "799af685-62f2-4187-baf8-b58a93ef259a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:00.220762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:00.221575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:00.226446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4ad7e7e-bf33-4dfb-9eeb-952e576c53c3 req-ca5e61b6-5484-465b-9ead-7340681e3f43 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:00.227076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4ad7e7e-bf33-4dfb-9eeb-952e576c53c3 req-ca5e61b6-5484-465b-9ead-7340681e3f43 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:00.227611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4ad7e7e-bf33-4dfb-9eeb-952e576c53c3 req-ca5e61b6-5484-465b-9ead-7340681e3f43 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:00.241156 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d4ad7e7e-bf33-4dfb-9eeb-952e576c53c3 req-ca5e61b6-5484-465b-9ead-7340681e3f43 service nova] Creating event network-changed:799af685-62f2-4187-baf8-b58a93ef259a for instance bd4e9913-fd4f-419e-b915-33e18236dd85 on n-h2-858384-1 Sep 19 15:21:00.246714 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d4ad7e7e-bf33-4dfb-9eeb-952e576c53c3 req-ca5e61b6-5484-465b-9ead-7340681e3f43 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039144 Sep 19 15:21:00.247678 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2750/5546] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:00.841597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:00.842569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:00.850070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:00.850561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:00.851024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:00.851729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:00.852401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:00.852832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:00.916251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:00.924571 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b628af7-5582-4af1-b492-3140eb8616f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1188 microversion: 2.1 time: 0.088586 Sep 19 15:21:00.938772 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2797/5547] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:00 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:01.948991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:01.949701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:01.957043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:01.957534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:01.957973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:01.959381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:01.960137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:01.960574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:02.026390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:02.034529 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f840f9d-a789-4824-b16f-4f04c27834db tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 200 len: 1188 microversion: 2.1 time: 0.090098 Sep 19 15:21:02.035143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2751/5548] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:01 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:03.058354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:03.059013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: d6436827-4076-401c-a8b2-cfd80507f98f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:03.065819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:03.066312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:03.066773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:03.067484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:03.068601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:03.069057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:03.082474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance d6436827-4076-401c-a8b2-cfd80507f98f could not be found. Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f HTTP/1.1 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance d6436827-4076-401c-a8b2-cfd80507f98f could not be found. Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd6436827-4076-401c-a8b2-cfd80507f98f'} Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6436827-4076-401c-a8b2-cfd80507f98f could not be found. Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6436827-4076-401c-a8b2-cfd80507f98f could not be found. Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:03.084319 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6436827-4076-401c-a8b2-cfd80507f98f could not be found. Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance d6436827-4076-401c-a8b2-cfd80507f98f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-130e6988-fab0-4870-8c9d-58a690c806b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f" status: 404 len: 111 microversion: 2.1 time: 0.031735 Sep 19 15:21:03.089399 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2798/5549] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:03 2022] GET /compute/v2.1/servers/d6436827-4076-401c-a8b2-cfd80507f98f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:03.385076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:03.385627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:03.392569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:03.393064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:03.393504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:03.394233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:03.394694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:03.395187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:03.425260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:21:03.498030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:03.511444 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e1f937a3-0618-4b01-8471-ae61e8e5e80c tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 204 len: 0 microversion: 2.1 time: 0.130146 Sep 19 15:21:03.515681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2752/5550] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:21:03 2022] DELETE /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:21:03.520496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:03.525720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:03.532017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:03.532734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:03.532950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:03.533843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:03.534306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:03.534736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:03.673593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:03.681899 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-acd46c78-13e5-49c7-b364-ce45f98e60d1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1729 microversion: 2.1 time: 0.165011 Sep 19 15:21:03.682480 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2799/5551] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:03 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:04.708728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:04.709445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:04.717414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:04.717915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:04.718361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:04.719119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:04.719596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:04.720090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:04.948010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:04.959616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d874c615-8d0c-43ce-b654-4a1a4e93f8ed tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1729 microversion: 2.1 time: 0.256049 Sep 19 15:21:04.970148 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2753/5552] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:04 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:06.111279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:06.111953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:06.113891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:06.121074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:06.121925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:06.122617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:06.123981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:06.124656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:06.125300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:06.132439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f9d55b13-41d8-4263-aeb5-11279802a986 req-4fcc9886-fa0f-404f-a288-b81cd796e097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd70135-c3b7-429e-b35a-fd2b2ef08fde", "name": "network-vif-deleted", "tag": "00ffe343-20c5-4698-a9f1-6b5c9101ecd4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:06.145608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f9d55b13-41d8-4263-aeb5-11279802a986 req-4fcc9886-fa0f-404f-a288-b81cd796e097 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:06.148273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f9d55b13-41d8-4263-aeb5-11279802a986 req-4fcc9886-fa0f-404f-a288-b81cd796e097 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:06.148978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f9d55b13-41d8-4263-aeb5-11279802a986 req-4fcc9886-fa0f-404f-a288-b81cd796e097 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:06.167136 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f9d55b13-41d8-4263-aeb5-11279802a986 req-4fcc9886-fa0f-404f-a288-b81cd796e097 service nova] Creating event network-vif-deleted:00ffe343-20c5-4698-a9f1-6b5c9101ecd4 for instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde on n-h2-858384-1 Sep 19 15:21:06.174610 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f9d55b13-41d8-4263-aeb5-11279802a986 req-4fcc9886-fa0f-404f-a288-b81cd796e097 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046455 Sep 19 15:21:06.175757 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2754/5553] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:21:06.212786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed008147855d4176a6ff767950fd20ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e5e47ad91b489aba5d6595e70485d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:06.221470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c16d70c5-fb33-4b91-92ec-de82662598a1 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 200 len: 1662 microversion: 2.1 time: 0.239623 Sep 19 15:21:06.222912 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2800/5554] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:05 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 1662 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:07.250906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:07.252438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:07.263620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:07.264471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:07.265164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:07.266150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:07.266895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:07.267591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:07.273487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:07.287133 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] HTTP exception thrown: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Request method failure captured: Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde HTTP/1.1 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIes3llAacKYA0AGiH5mTovM5Ty-xo9ep0RqFDFt0cmr9n55KZ4Ybs_kyAD0cJBv0QJr9poKks6gQ_Pq_764dNuTm1aKDOsXcvzFpP3vVTnHhgcb7nyfQsmcxBtvtwlOvCL602EMoVQZGKu25oFESk7QNWcUs2UWKt5-tzn2qMqjNFM Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d8e5e47ad91b489aba5d6595e70485d8 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d8e5e47ad91b489aba5d6595e70485d8"}]}] Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d8e5e47ad91b489aba5d6595e70485d8 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestServerBasicOps-2129957880-project Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ed008147855d4176a6ff767950fd20ca Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestServerBasicOps-2129957880-project Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dfd70135-c3b7-429e-b35a-fd2b2ef08fde'} Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:07.289575 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.294315 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.295976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Returning 404 to user: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:07.297286 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fee723e0-709a-4678-aa83-126689fc99f9 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 404 len: 111 microversion: 2.1 time: 0.053348 Sep 19 15:21:07.298049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2755/5555] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:07 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:07.797296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:07.797878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:07.805844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:07.806350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:07.807096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:07.807817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:07.808279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:07.808711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:07.823456 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] HTTP exception thrown: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Request method failure captured: Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde HTTP/1.1 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIes3llAacKYA0AGiH5mTovM5Ty-xo9ep0RqFDFt0cmr9n55KZ4Ybs_kyAD0cJBv0QJr9poKks6gQ_Pq_764dNuTm1aKDOsXcvzFpP3vVTnHhgcb7nyfQsmcxBtvtwlOvCL602EMoVQZGKu25oFESk7QNWcUs2UWKt5-tzn2qMqjNFM Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d8e5e47ad91b489aba5d6595e70485d8 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d8e5e47ad91b489aba5d6595e70485d8"}]}] Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d8e5e47ad91b489aba5d6595e70485d8 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestServerBasicOps-2129957880-project Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: ed008147855d4176a6ff767950fd20ca Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestServerBasicOps-2129957880-project Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'dfd70135-c3b7-429e-b35a-fd2b2ef08fde'} Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:07.825076 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Returning 404 to user: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2788263c-632b-4876-8eaa-5757ac09f1dc tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 404 len: 111 microversion: 2.1 time: 0.033486 Sep 19 15:21:07.829054 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2801/5556] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:21:07 2022] DELETE /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:07.837057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:07.837741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] [instance: dfd70135-c3b7-429e-b35a-fd2b2ef08fde] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:07.844760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:07.845255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:07.845693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:07.846393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:07.846882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:07.847310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:07.862479 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] HTTP exception thrown: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Request method failure captured: Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde HTTP/1.1 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIes3llAacKYA0AGiH5mTovM5Ty-xo9ep0RqFDFt0cmr9n55KZ4Ybs_kyAD0cJBv0QJr9poKks6gQ_Pq_764dNuTm1aKDOsXcvzFpP3vVTnHhgcb7nyfQsmcxBtvtwlOvCL602EMoVQZGKu25oFESk7QNWcUs2UWKt5-tzn2qMqjNFM Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d8e5e47ad91b489aba5d6595e70485d8 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d8e5e47ad91b489aba5d6595e70485d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d8e5e47ad91b489aba5d6595e70485d8"}]}] Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d8e5e47ad91b489aba5d6595e70485d8 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestServerBasicOps-2129957880 Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestServerBasicOps-2129957880-project Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: ed008147855d4176a6ff767950fd20ca Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestServerBasicOps-2129957880-project Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dfd70135-c3b7-429e-b35a-fd2b2ef08fde'} Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:07.864011 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Returning 404 to user: Instance dfd70135-c3b7-429e-b35a-fd2b2ef08fde could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e4e256fe-00cc-486a-af3d-0cb50124d960 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde" status: 404 len: 111 microversion: 2.1 time: 0.034377 Sep 19 15:21:07.868688 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2756/5557] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:07 2022] GET /compute/v2.1/servers/dfd70135-c3b7-429e-b35a-fd2b2ef08fde => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:08.026865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c57bec0c-9448-4ec8-b17e-6cf1950be686 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] Calling method '.version_select at 0x7fde29a0fb80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:08.064617 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c57bec0c-9448-4ec8-b17e-6cf1950be686 tempest-TestServerBasicOps-2129957880 tempest-TestServerBasicOps-2129957880-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1114014386" status: 202 len: 0 microversion: 2.1 time: 0.041498 Sep 19 15:21:08.069307 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2802/5558] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 15:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1114014386 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:21:08.213577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1835169856", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e7386c37-ee62-4841-9dcc-615d7b90d6ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:08.280751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:21:08.977818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:21:08.978297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:21:08.978885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:21:08.979383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:21:08.979866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:21:08.988945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:08.989571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:08.990284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:08.991315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:08.991907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:08.992337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:09.010684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:21:09.016369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:21:09.080287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:21:09.082775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7386c37-ee62-4841-9dcc-615d7b90d6ed',volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:21:09.227572 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c8000dd4-09a3-4797-8d53-88b5df45c9cd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.017974 Sep 19 15:21:09.228184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2757/5559] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:21:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:21:09.240143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed755bc3-f3a1-4b53-81c2-963ee0692b60 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:09.240945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed755bc3-f3a1-4b53-81c2-963ee0692b60 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:09.309674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed755bc3-f3a1-4b53-81c2-963ee0692b60 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:09.323100 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed755bc3-f3a1-4b53-81c2-963ee0692b60 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1057 microversion: 2.1 time: 0.087301 Sep 19 15:21:09.338776 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2803/5560] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:09 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1057 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:10.351323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:10.353280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:10.372705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:10.375130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:10.375955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:10.381851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:10.382681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:10.383388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:10.506265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:10.519330 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2cb69549-1bfa-4852-bfd3-7c474ec44f19 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1163 microversion: 2.1 time: 0.173945 Sep 19 15:21:10.520326 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2758/5561] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:10 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1163 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:11.543729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:11.544691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:11.552697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:11.553311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:11.553754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:11.555790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:11.556276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:11.556980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:11.990756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:12.000392 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2f44cc4-7a13-4f7a-9db3-ba2bedce742c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1215 microversion: 2.1 time: 0.460475 Sep 19 15:21:12.003788 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2804/5562] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:11 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:13.027118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:13.028369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:13.035915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:13.036757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:13.037203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:13.037942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:13.038398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:13.039020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:13.217550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f3e9b86d-9504-4446-80d1-e1421dc5d864 req-e63d3cdd-61fd-4c66-9163-7cee769b03cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6385322f-3176-483c-9599-48b5c5295a2e", "tag": "1276864d-ce56-476b-b3c6-c67d59d3ed3b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:13.249777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f3e9b86d-9504-4446-80d1-e1421dc5d864 req-e63d3cdd-61fd-4c66-9163-7cee769b03cd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:13.250471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f3e9b86d-9504-4446-80d1-e1421dc5d864 req-e63d3cdd-61fd-4c66-9163-7cee769b03cd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:13.251051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f3e9b86d-9504-4446-80d1-e1421dc5d864 req-e63d3cdd-61fd-4c66-9163-7cee769b03cd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:13.267602 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f3e9b86d-9504-4446-80d1-e1421dc5d864 req-e63d3cdd-61fd-4c66-9163-7cee769b03cd service nova] Creating event network-changed:1276864d-ce56-476b-b3c6-c67d59d3ed3b for instance 6385322f-3176-483c-9599-48b5c5295a2e on n-h1-858384-1 Sep 19 15:21:13.274229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f3e9b86d-9504-4446-80d1-e1421dc5d864 req-e63d3cdd-61fd-4c66-9163-7cee769b03cd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064926 Sep 19 15:21:13.275713 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2805/5563] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:13.444203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:13.452390 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b25c2377-a5b8-4c92-bfa2-fdb3ca2e351f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1215 microversion: 2.1 time: 0.429351 Sep 19 15:21:13.453180 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2759/5564] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:13 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:14.477228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:14.477907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:14.485936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:14.486442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:14.486924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:14.487647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:14.488110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:14.488655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:15.032815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:15.043132 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f292e6e2-5bf3-461d-be82-ca6d326407fd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1215 microversion: 2.1 time: 0.570948 Sep 19 15:21:15.043723 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2806/5565] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:14 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1215 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:16.065584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:16.066920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:16.073855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:16.074357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:16.074823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:16.075532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:16.075996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:16.076433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:16.218926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:16.228537 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88cfe1ee-7cb6-4da5-9bd2-805565d143e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.166932 Sep 19 15:21:16.229131 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2760/5566] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:16 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:17.252511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:17.253256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:17.260413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:17.260907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:17.261357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:17.262117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:17.262582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:17.263042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:17.411564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:17.419801 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aa075fde-d078-4a4a-a51b-25f9f2b3db98 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.171202 Sep 19 15:21:17.420388 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2807/5567] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:17 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:18.444314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:18.445037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:18.452334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:18.452834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:18.453311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:18.454028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:18.454492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:18.454952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:18.586614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:18.594326 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2ff4b4ed-55dc-48d6-a8f1-910749452231 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.154958 Sep 19 15:21:18.594939 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2761/5568] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:18 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:19.617782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:19.618355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:19.621086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:19.626658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:19.627169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:19.627618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:19.628312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:19.628772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:19.629777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:19.759891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:19.767778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c56873da-e024-4e9f-86b0-9437c23c73ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.154506 Sep 19 15:21:19.768377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2808/5569] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:19 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:20.790419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:20.791221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:20.792899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:20.793569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:20.800171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:20.800660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:20.801188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:20.801880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:20.802337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:20.802794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:20.937626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:20.946162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e5b0c01-9ade-4858-a349-c4d69db9ba15 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.159732 Sep 19 15:21:20.946757 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2762/5570] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:20 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:21.969169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:21.969820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:21.976872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:21.977357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:21.977789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:21.978476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:21.978964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:21.979394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:22.106522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:22.114773 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0e44337f-05a8-4108-beaa-d46ebb6a2d6e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.149542 Sep 19 15:21:22.115342 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2809/5571] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:21 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:23.138028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:23.138577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:23.145494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:23.145980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:23.146454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:23.147175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:23.147636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:23.148070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:23.280888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:23.289420 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ed4f986-2dac-4dc8-a9d9-5f80cd7d030c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.155432 Sep 19 15:21:23.289994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2763/5572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:23 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:24.312140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:24.312794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:24.320570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:24.321067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:24.321508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:24.322212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:24.322974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:24.323585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:24.329395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7a4126db-0135-48ae-92a4-64d154c2f0b8 req-173f6e4d-d4db-4807-8964-46e95edc8ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6385322f-3176-483c-9599-48b5c5295a2e", "name": "network-vif-plugged", "status": "completed", "tag": "1276864d-ce56-476b-b3c6-c67d59d3ed3b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:24.341389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7a4126db-0135-48ae-92a4-64d154c2f0b8 req-173f6e4d-d4db-4807-8964-46e95edc8ceb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:24.341871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7a4126db-0135-48ae-92a4-64d154c2f0b8 req-173f6e4d-d4db-4807-8964-46e95edc8ceb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:24.342301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7a4126db-0135-48ae-92a4-64d154c2f0b8 req-173f6e4d-d4db-4807-8964-46e95edc8ceb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:24.356040 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7a4126db-0135-48ae-92a4-64d154c2f0b8 req-173f6e4d-d4db-4807-8964-46e95edc8ceb service nova] Creating event network-vif-plugged:1276864d-ce56-476b-b3c6-c67d59d3ed3b for instance 6385322f-3176-483c-9599-48b5c5295a2e on n-h1-858384-1 Sep 19 15:21:24.361647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7a4126db-0135-48ae-92a4-64d154c2f0b8 req-173f6e4d-d4db-4807-8964-46e95edc8ceb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037038 Sep 19 15:21:24.362325 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2764/5573] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:24.497100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:24.505866 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-80741078-14ae-43b7-8c3f-ce4601e2d869 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1203 microversion: 2.1 time: 0.197663 Sep 19 15:21:24.506472 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2810/5574] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:24 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1203 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:25.531182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:25.531905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:25.539540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:25.540032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:25.540477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:25.541241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:25.541793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:25.542226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:25.681311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:25.689064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94d65a81-1868-4262-802f-aa6d32f248ef tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1390 microversion: 2.1 time: 0.163312 Sep 19 15:21:25.689634 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2765/5575] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:25 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:25.711520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:25.712071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:25.718938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:25.719428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:25.719867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:25.720564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:25.721023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:25.721456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:25.726170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:25.852710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:25.860559 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-893ed328-42a0-4fbb-a723-a054951e50c8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1390 microversion: 2.1 time: 0.153735 Sep 19 15:21:25.861149 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2811/5576] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:25 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:21:25.882230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:25.882887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:25.888872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:25.889371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:25.889812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:25.890508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:25.891076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:25.891513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:26.021351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:26.029300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14d43722-0c6e-4ac0-a80a-f44a34a51ee0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1390 microversion: 2.1 time: 0.150973 Sep 19 15:21:26.029878 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2766/5577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:25 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:26.052295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:26.052793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:26.059141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:26.059639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:26.060081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:26.060777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:26.061235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:26.061663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:26.085592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:21:26.159909 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2be3bc65-8de2-45a5-b4cc-022a0e2cd649 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 204 len: 0 microversion: 2.1 time: 0.111740 Sep 19 15:21:26.164229 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2812/5578] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:21:26 2022] DELETE /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:21:26.169651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:26.170377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:26.177516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:26.178012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:26.178459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:26.179261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:26.179729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:26.180161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:26.307522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:26.315449 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a4c7a482-09d5-4b74-b613-0b1ace3a8718 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1396 microversion: 2.1 time: 0.149812 Sep 19 15:21:26.316027 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2767/5579] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:26 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1396 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:27.341595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:27.342496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:27.350286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:27.350801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:27.351250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:27.351958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:27.352415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:27.352844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:27.487253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:27.495184 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec99f330-7717-462b-87f1-5b9016b148b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1396 microversion: 2.1 time: 0.159756 Sep 19 15:21:27.495756 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2813/5580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:27 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:28.068847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d4d599a0-0940-44f4-a014-d9d099773564 req-eb834390-d75f-406b-80ee-6f3a5301c305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6385322f-3176-483c-9599-48b5c5295a2e", "name": "network-vif-deleted", "tag": "1276864d-ce56-476b-b3c6-c67d59d3ed3b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:28.080953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4d599a0-0940-44f4-a014-d9d099773564 req-eb834390-d75f-406b-80ee-6f3a5301c305 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:28.081416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4d599a0-0940-44f4-a014-d9d099773564 req-eb834390-d75f-406b-80ee-6f3a5301c305 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:28.082588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4d599a0-0940-44f4-a014-d9d099773564 req-eb834390-d75f-406b-80ee-6f3a5301c305 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:28.095823 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d4d599a0-0940-44f4-a014-d9d099773564 req-eb834390-d75f-406b-80ee-6f3a5301c305 service nova] Creating event network-vif-deleted:1276864d-ce56-476b-b3c6-c67d59d3ed3b for instance 6385322f-3176-483c-9599-48b5c5295a2e on n-h1-858384-1 Sep 19 15:21:28.101468 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d4d599a0-0940-44f4-a014-d9d099773564 req-eb834390-d75f-406b-80ee-6f3a5301c305 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036766 Sep 19 15:21:28.102111 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2768/5581] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:28.518838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:28.520150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:28.527298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:28.527792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:28.528233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:28.528935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:28.529395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:28.529833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:28.596133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:28.604119 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fcb3a09e-e7c2-4596-91d2-98fa2d86c087 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1188 microversion: 2.1 time: 0.089374 Sep 19 15:21:28.604690 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2814/5582] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:28 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:29.629327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:29.629976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:29.636404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:29.636897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:29.637332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:29.638034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:29.638617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:29.638963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:29.709713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:29.719569 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-50e68355-d0dc-4643-8b9c-dad54801eda3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1188 microversion: 2.1 time: 0.095171 Sep 19 15:21:29.734674 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2769/5583] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:29 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:29.939191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:29.939757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:29.947427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:29.947928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:29.948371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:29.949084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:29.949548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:29.949982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:29.974605 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9dc7cc57-a44c-43b9-ac1e-52c87c77039f tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/ips" status: 200 len: 149 microversion: 2.1 time: 0.039369 Sep 19 15:21:29.975142 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2815/5584] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 15:21:29 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:30.743109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:30.744371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:30.768107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:30.768875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:30.770181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:30.772120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:30.772764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:30.773413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:30.850294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:30.861506 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f91cfbb-6c93-4ac3-ad49-248c5aa68e25 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1188 microversion: 2.1 time: 0.123558 Sep 19 15:21:30.865022 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2770/5585] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:30 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:31.313032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d87000-939f-484a-81d7-b1fd3f22129e"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:31.315485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:31.322535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:31.323060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:31.323532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:31.324241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:31.324695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:31.325118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:31.581055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e952400-ab3b-47f6-af22-c83173f5469e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "POST /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271619 Sep 19 15:21:31.582233 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2816/5586] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:21:31 2022] POST /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:31.886066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:31.886932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:31.894642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:31.895245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:31.895753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:31.896551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:31.897217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:31.897719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:31.968362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:31.977044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b442b76-430f-42bc-a069-9d7abc993f66 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 200 len: 1188 microversion: 2.1 time: 0.095110 Sep 19 15:21:31.977690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2771/5587] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:31 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:33.001551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:33.002237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 6385322f-3176-483c-9599-48b5c5295a2e] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:33.008854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:33.009352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:33.009799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:33.010519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:33.011017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:33.011452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:33.025411 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance 6385322f-3176-483c-9599-48b5c5295a2e could not be found. Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e HTTP/1.1 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6385322f-3176-483c-9599-48b5c5295a2e could not be found. Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6385322f-3176-483c-9599-48b5c5295a2e'} Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6385322f-3176-483c-9599-48b5c5295a2e could not be found. Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6385322f-3176-483c-9599-48b5c5295a2e could not be found. Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:33.027188 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6385322f-3176-483c-9599-48b5c5295a2e could not be found. Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance 6385322f-3176-483c-9599-48b5c5295a2e could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f44760d9-f351-4cf6-b514-720e72465882 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e" status: 404 len: 111 microversion: 2.1 time: 0.032435 Sep 19 15:21:33.032183 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2817/5588] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:32 2022] GET /compute/v2.1/servers/6385322f-3176-483c-9599-48b5c5295a2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:43.517839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:43.518466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:43.521002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:43.521663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=80 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:43.528098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:43.528669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:43.529106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:43.529813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:43.530276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:43.530767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:43.621213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lazy-loading 'services' on Instance uuid bd4e9913-fd4f-419e-b915-33e18236dd85 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:21:43.696817 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0138d8a-756a-4a59-a65a-e8c984f5a25e tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments/77d87000-939f-484a-81d7-b1fd3f22129e" status: 202 len: 0 microversion: 2.1 time: 0.183137 Sep 19 15:21:43.697414 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2772/5589] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:21:43 2022] DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments/77d87000-939f-484a-81d7-b1fd3f22129e => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:21:43.707434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:43.710010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:43.714739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:43.715823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:43.724071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:43.724590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:43.725232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:43.725965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:43.726435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:43.726904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:43.769664 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abd25d4e-42fe-4021-b952-396a23ac16cb tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067329 Sep 19 15:21:43.770857 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2818/5590] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:21:43 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:44.783251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:44.789553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:44.797534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:44.799787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:44.799787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:44.799787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:44.800122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:44.800548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:44.837100 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3a53d18-f0f5-4327-863b-e482a94167ba tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059171 Sep 19 15:21:44.837954 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2773/5591] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:21:44 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:45.851443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:45.854778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:45.862380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:45.863505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:45.863949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:45.864654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:45.865110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:45.865533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:45.898682 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7748c07c-005e-400d-88a2-bb31e256598b tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Sep 19 15:21:45.899652 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2819/5592] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:21:45 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:46.920360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:46.923684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:46.932142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:46.932643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:46.933090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:46.933791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:46.934257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:46.934690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:46.967477 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21ef31f3-832e-492d-bb32-efc099046f80 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058394 Sep 19 15:21:46.968059 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2774/5593] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:21:46 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:47.980859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:47.983124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:47.990177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:47.990668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:47.991138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:47.991847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:47.992305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:47.992737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:48.025510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-58a610da-8cca-45af-a27d-278db498042d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Sep 19 15:21:48.027350 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2820/5594] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:21:47 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:49.038458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:49.040655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:49.047532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:49.048030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:49.048477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:49.049379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:49.049948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:49.050382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:49.079853 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0165faf5-5759-459f-b14f-c86c238b5fab tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046122 Sep 19 15:21:49.081277 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2775/5595] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:21:49 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:21:49.147788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:49.148341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:49.155223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:49.155720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:49.156167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:49.156877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:49.157341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:49.157776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:49.184265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:21:49.263010 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-693123f6-3a03-4713-aec6-fffae4e0e124 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 204 len: 0 microversion: 2.1 time: 0.119513 Sep 19 15:21:49.263619 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2821/5596] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:21:49 2022] DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:21:49.273303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:49.273923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:49.280022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:49.280529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:49.280954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:49.281643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:49.282100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:49.282525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:49.421740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:49.430098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32e1e785-6806-4894-9b59-7671c365c358 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1680 microversion: 2.1 time: 0.161650 Sep 19 15:21:49.430960 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2776/5597] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:49 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:50.454592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:50.455978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:50.463312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:50.464025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:50.464844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:50.465719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:50.466332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:50.466969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:50.632575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:50.641152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b7474b6-2023-47c5-8d2f-760062d3e47d tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1680 microversion: 2.1 time: 0.191162 Sep 19 15:21:50.651223 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2822/5598] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:50 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:51.652392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f55dd4b8-7fe2-42c7-816b-4a2954a4c34d req-eaf1ba0f-2f15-4d13-8052-6b927923af02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4e9913-fd4f-419e-b915-33e18236dd85", "name": "network-vif-deleted", "tag": "799af685-62f2-4187-baf8-b58a93ef259a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:51.666012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:51.666639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:51.691621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:51.692205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:51.695237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f55dd4b8-7fe2-42c7-816b-4a2954a4c34d req-eaf1ba0f-2f15-4d13-8052-6b927923af02 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:51.695985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:51.698187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:51.698597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:51.700009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f55dd4b8-7fe2-42c7-816b-4a2954a4c34d req-eaf1ba0f-2f15-4d13-8052-6b927923af02 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:51.700009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f55dd4b8-7fe2-42c7-816b-4a2954a4c34d req-eaf1ba0f-2f15-4d13-8052-6b927923af02 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:51.700523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:51.729015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f55dd4b8-7fe2-42c7-816b-4a2954a4c34d req-eaf1ba0f-2f15-4d13-8052-6b927923af02 service nova] Creating event network-vif-deleted:799af685-62f2-4187-baf8-b58a93ef259a for instance bd4e9913-fd4f-419e-b915-33e18236dd85 on n-h2-858384-1 Sep 19 15:21:51.744809 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f55dd4b8-7fe2-42c7-816b-4a2954a4c34d req-eaf1ba0f-2f15-4d13-8052-6b927923af02 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096111 Sep 19 15:21:51.747603 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2777/5599] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:51.808962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6245f69bea8d46fbabaaa308b20fb9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ff605201048c5be71d42ff51a0a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:51.825935 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4eb50baa-24c7-40b9-8979-165d7618603c tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 200 len: 1325 microversion: 2.1 time: 0.162664 Sep 19 15:21:51.828797 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2823/5600] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:51 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:52.851210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:52.852021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:52.858217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:52.858708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:52.859175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:52.859864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:52.860378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:52.860808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:52.874493 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 HTTP/1.1 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'bd4e9913-fd4f-419e-b915-33e18236dd85'} Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:52.876179 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-05aa0850-cb94-44a9-9762-d8aeeb56f6e9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 404 len: 111 microversion: 2.1 time: 0.032856 Sep 19 15:21:52.880979 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2778/5601] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:52 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:52.887300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9485a647-c48f-4af0-86ff-e281f95f83a9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '.version_select at 0x7fde29a5fee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:52.911574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9485a647-c48f-4af0-86ff-e281f95f83a9 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95192319" status: 202 len: 0 microversion: 2.1 time: 0.028093 Sep 19 15:21:52.912356 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2824/5602] 10.222.0.81 () {58 vars in 1215 bytes} [Mon Sep 19 15:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95192319 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:21:55.263393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-166970587", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b939d243-0745-4292-aaec-2e0b0f1ed2da", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:55.357152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:21:56.040327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:21:56.040793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:21:56.041279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:21:56.041696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:21:56.042120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:21:56.051809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:56.052307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:56.052752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:56.053491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:56.053955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:56.054386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:56.071930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:21:56.077201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:21:56.089744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:21:56.091831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b939d243-0745-4292-aaec-2e0b0f1ed2da',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:21:56.168825 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-132afbd8-4843-4e10-b63b-156b794d527a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908305 Sep 19 15:21:56.176711 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2779/5603] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:21:56.190381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b6e47e6-cd82-4af7-8231-01c4d6d12671 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:56.195297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b6e47e6-cd82-4af7-8231-01c4d6d12671 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:56.250655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b6e47e6-cd82-4af7-8231-01c4d6d12671 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:56.258704 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b6e47e6-cd82-4af7-8231-01c4d6d12671 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1056 microversion: 2.1 time: 0.073632 Sep 19 15:21:56.274694 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2825/5604] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:56 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1056 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:56.816957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:56.817617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:56.825767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:56.826491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:56.827034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:56.827971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:56.828355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:56.828860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:56.845862 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 HTTP/1.1 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'bd4e9913-fd4f-419e-b915-33e18236dd85'} Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:56.847865 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7e5a602f-27f6-44ce-a5fe-d916a4f60843 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 404 len: 111 microversion: 2.1 time: 0.040357 Sep 19 15:21:56.852244 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2780/5605] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:21:56 2022] DELETE /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:56.858233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:56.858890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: bd4e9913-fd4f-419e-b915-33e18236dd85] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:56.865292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:56.865774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:56.866211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:56.867022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:56.867480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:56.867906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:56.882492 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 HTTP/1.1 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'bd4e9913-fd4f-419e-b915-33e18236dd85'} Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:21:56.884212 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance bd4e9913-fd4f-419e-b915-33e18236dd85 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d342ff3b-0d1a-44f6-a192-5af3b240d9f1 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85" status: 404 len: 111 microversion: 2.1 time: 0.031312 Sep 19 15:21:56.893412 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2826/5606] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:56 2022] GET /compute/v2.1/servers/bd4e9913-fd4f-419e-b915-33e18236dd85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:21:57.282291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:57.284277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:57.299746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:57.301206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:57.301907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:57.307788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:57.308817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:57.310261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:57.436455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:57.446543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2552c1c-0d7e-4dbb-91a6-832383c813cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1126 microversion: 2.1 time: 0.168790 Sep 19 15:21:57.450940 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2781/5607] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:57 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1126 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:58.473983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:58.475244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:58.482503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:58.483223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:58.483678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:58.484523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:58.485003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:58.485424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:58.731291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:21:58.750319 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcc97a91-12d9-40c0-b8d5-7dde45210b5c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.283580 Sep 19 15:21:58.751402 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2827/5608] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:58 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:21:58.974428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1189d919-78e0-4a2f-8a5d-0f60725598cd req-2b65da2f-9034-4fb8-bf5a-dd56fc15b066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ebb7c8-ffa3-40a2-900f-ee789d276dfc", "tag": "46c4d8bf-8df3-47c1-b9fa-d0e888f31213"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:21:58.985145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1189d919-78e0-4a2f-8a5d-0f60725598cd req-2b65da2f-9034-4fb8-bf5a-dd56fc15b066 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:58.985936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1189d919-78e0-4a2f-8a5d-0f60725598cd req-2b65da2f-9034-4fb8-bf5a-dd56fc15b066 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:58.986619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1189d919-78e0-4a2f-8a5d-0f60725598cd req-2b65da2f-9034-4fb8-bf5a-dd56fc15b066 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:59.008765 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1189d919-78e0-4a2f-8a5d-0f60725598cd req-2b65da2f-9034-4fb8-bf5a-dd56fc15b066 service nova] Creating event network-changed:46c4d8bf-8df3-47c1-b9fa-d0e888f31213 for instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc on n-h1-858384-1 Sep 19 15:21:59.014672 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1189d919-78e0-4a2f-8a5d-0f60725598cd req-2b65da2f-9034-4fb8-bf5a-dd56fc15b066 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044135 Sep 19 15:21:59.015544 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2782/5609] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:21:59.775674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:21:59.776996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:21:59.787896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:59.788747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:59.789430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:21:59.790209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:21:59.790935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:21:59.791601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.040745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:00.054536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41b204fc-95ab-404b-8644-ea13dcfb4e4d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.282605 Sep 19 15:22:00.070537 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2828/5610] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:21:59 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:00.183939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:00.185286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:00.193383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.194294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.195145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.196142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.196845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.197496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.213173 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf HTTP/1.1 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dfbf4fe1-c565-4023-bb97-0755c5eca3cf'} Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:00.215473 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:00.220488 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-011af209-60c4-4985-a311-6df676af5d27 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 404 len: 111 microversion: 2.1 time: 0.041736 Sep 19 15:22:00.223087 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2783/5611] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:22:00 2022] DELETE /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:00.229751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:00.231123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: dfbf4fe1-c565-4023-bb97-0755c5eca3cf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:00.240325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.241183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.241865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.242878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.243923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.244575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.260026 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf HTTP/1.1 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'dfbf4fe1-c565-4023-bb97-0755c5eca3cf'} Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.262061 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. Sep 19 15:22:00.266641 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.271666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance dfbf4fe1-c565-4023-bb97-0755c5eca3cf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:00.272765 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-22f339b4-fbeb-4673-8510-d479a377bb94 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf" status: 404 len: 111 microversion: 2.1 time: 0.048391 Sep 19 15:22:00.273995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2829/5612] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:00 2022] GET /compute/v2.1/servers/dfbf4fe1-c565-4023-bb97-0755c5eca3cf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:00.285333 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:00.285974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:00.292779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.293380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.293923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.294692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.295246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.295732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.310313 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 HTTP/1.1 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '7d4ecfab-0b57-4c74-b46e-8a532624aea6'} Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:00.312018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:00.317130 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9536f33f-5372-4787-be23-b4f322835447 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 404 len: 111 microversion: 2.1 time: 0.036101 Sep 19 15:22:00.322894 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2784/5613] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:22:00 2022] DELETE /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:00.324237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:00.324956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 7d4ecfab-0b57-4c74-b46e-8a532624aea6] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:00.331839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.332447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.333028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.333831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:00.334395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:00.334980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:00.349089 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 HTTP/1.1 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '7d4ecfab-0b57-4c74-b46e-8a532624aea6'} Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:00.350920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. Sep 19 15:22:00.355652 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:00.356983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance 7d4ecfab-0b57-4c74-b46e-8a532624aea6 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:00.357907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d48b78e5-dc42-4a8c-99ad-75bdc39865bc tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6" status: 404 len: 111 microversion: 2.1 time: 0.038135 Sep 19 15:22:00.358528 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2830/5614] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:00 2022] GET /compute/v2.1/servers/7d4ecfab-0b57-4c74-b46e-8a532624aea6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:01.078368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:01.080240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:01.088680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:01.090207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:01.091144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:01.092103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:01.092878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:01.093532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:01.328891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:01.349962 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01764543-07f2-4a84-818a-0c1f55b13cdf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.276067 Sep 19 15:22:01.351076 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2785/5615] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:01 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:02.375316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:02.375861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:02.385189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:02.385684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:02.386132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:02.386869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:02.387333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:02.387764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:02.648453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:02.658215 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38b2c78b-194a-4de8-a749-0a048bedb453 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.286394 Sep 19 15:22:02.671874 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2831/5616] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:02 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:03.684044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:03.685344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:03.692485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:03.693293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:03.694101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:03.695590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:03.696705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:03.697806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:03.770650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:03.771730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:03.780569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:03.781109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:03.781848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:03.783593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:03.784418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:03.785037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:03.805321 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 HTTP/1.1 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '40515bb4-6996-4d2b-88c2-f943c1971312'} Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:03.807922 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94b4a9f1-b787-4390-a1c1-bba88516e9d6 tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 404 len: 111 microversion: 2.1 time: 0.042614 Sep 19 15:22:03.816155 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2832/5617] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:22:03 2022] DELETE /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:22:03.821725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:03.822600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] [instance: 40515bb4-6996-4d2b-88c2-f943c1971312] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:03.831797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:03.833715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:03.834346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:03.835381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:03.836174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:03.837410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:03.876091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] HTTP exception thrown: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Request method failure captured: Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 HTTP/1.1 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIgKaiQc6DZJnzF7if6MPxYk9kPbM1h4SVz2ylXYS7VKBs_sRfnw4ZKA-1m2QAlnznF9cNyj1vbCmtXNnzWrVFDUnHHeFHw0TkMZb6eU9Va9UcFNAIWbfN9dzc87IRrQdrYkfjg4cGaknBH88ljcTdRfscgBP0cM5BkZll4WJc4WsrM Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf8ff605201048c5be71d42ff51a0a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf8ff605201048c5be71d42ff51a0a67"}]}] Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: cf8ff605201048c5be71d42ff51a0a67 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1054514086 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 6245f69bea8d46fbabaaa308b20fb9a2 Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-AttachVolumeNegativeTest-1054514086-project Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '40515bb4-6996-4d2b-88c2-f943c1971312'} Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:03.878174 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. Sep 19 15:22:03.882389 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:03.884224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] Returning 404 to user: Instance 40515bb4-6996-4d2b-88c2-f943c1971312 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:03.885231 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9fbd8d2e-2c41-40b8-a40b-05c63b0f62db tempest-AttachVolumeNegativeTest-1054514086 tempest-AttachVolumeNegativeTest-1054514086-project] 10.222.0.81 "GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312" status: 404 len: 111 microversion: 2.1 time: 0.068861 Sep 19 15:22:03.885946 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2833/5618] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:03 2022] GET /compute/v2.1/servers/40515bb4-6996-4d2b-88c2-f943c1971312 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:03.936505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:03.945636 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6326008c-1582-4cb0-915a-1daae4bc9fcf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.265652 Sep 19 15:22:03.946998 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2786/5619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:03 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:22:04.969555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:04.971533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:04.982804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:04.983588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:04.984233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:04.985019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:04.986251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:04.987287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:05.230990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:05.245316 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6db70e98-1f3f-423a-97bb-4f9c21e0398e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.279751 Sep 19 15:22:05.246678 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2834/5620] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:04 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:06.269866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:06.270535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:06.273771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:06.276635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:06.291805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:06.292589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:06.293194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:06.294226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:06.295083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:06.295808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:06.517354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:06.526368 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74eddcc7-6002-479e-b22b-4945b46889a5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.261179 Sep 19 15:22:06.527891 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2787/5621] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:06 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:07.551887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:07.552510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:07.555826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:07.561100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:07.561603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:07.562258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:07.563170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:07.564198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:07.564637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:07.745600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:07.755355 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0179aa2-43c6-4358-a356-54d1ccabacde tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.207920 Sep 19 15:22:07.757008 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2835/5622] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:07 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:08.780548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:08.781750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:08.808309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:08.808824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:08.809280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:08.810007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:08.810472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:08.811138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:08.972190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:08.982039 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0505a43a-1858-4633-9634-14234a92e366 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.206293 Sep 19 15:22:08.994845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2788/5623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:08 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:10.009876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:10.010572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:10.018234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:10.018877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:10.019525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:10.020366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:10.020934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:10.021474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:10.166146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:10.174805 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b2f247e-5528-4364-b3f7-d2f51514a5c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.169104 Sep 19 15:22:10.175590 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2836/5624] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:10 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:10.549591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74a752b2-ae2b-41a1-bbda-64f43bc4ab08 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde2999a3a0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:10.598977 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74a752b2-ae2b-41a1-bbda-64f43bc4ab08 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/bc6fbf21-a907-4891-b5a2-3f2666d39258" status: 200 len: 351 microversion: 2.1 time: 0.054043 Sep 19 15:22:10.599562 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2789/5625] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:22:10 2022] GET /compute/v2.1/os-volumes/bc6fbf21-a907-4891-b5a2-3f2666d39258 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:11.199486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:11.202938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:11.211742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:11.212243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:11.212688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:11.213398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:11.213866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:11.214298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:11.362820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:11.371356 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c632862-ca38-40eb-ad30-85e6d9e63d11 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1168 microversion: 2.1 time: 0.175658 Sep 19 15:22:11.371948 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2837/5626] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:11 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:11.949985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e91f5605-81da-4c43-86cc-e79fcc0088e7 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde28b30550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:11.998471 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e91f5605-81da-4c43-86cc-e79fcc0088e7 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/23da2968-4d7a-441f-9e94-d67161b36f4f" status: 200 len: 350 microversion: 2.1 time: 0.053253 Sep 19 15:22:11.999111 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2790/5627] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:22:11 2022] GET /compute/v2.1/os-volumes/23da2968-4d7a-441f-9e94-d67161b36f4f => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:12.396903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:12.398648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:12.405551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:12.406045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:12.406662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:12.408135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:12.408632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:12.409059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:12.413519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:12.545163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:12.553683 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d1d9d24-50a6-43ce-a29c-09b43cbc102d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1214 microversion: 2.1 time: 0.162563 Sep 19 15:22:12.554275 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2838/5628] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:12 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:13.352055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6bd56963-eaec-4e00-933f-7eac81a2b75b tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde292aa430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.399043 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6bd56963-eaec-4e00-933f-7eac81a2b75b tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/32c6f1ef-039b-4730-84c2-4258d1a5f83c" status: 200 len: 351 microversion: 2.1 time: 0.051729 Sep 19 15:22:13.399662 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2791/5629] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes/32c6f1ef-039b-4730-84c2-4258d1a5f83c => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:13.415717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8fef19a-2eed-4dde-b079-cb08e23897e1 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde29b04280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.498503 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8fef19a-2eed-4dde-b079-cb08e23897e1 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086564 Sep 19 15:22:13.499202 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2839/5630] 10.222.0.81 () {58 vars in 1134 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:13.515007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c78af92a-28b0-4573-8879-93b54521f5ce tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde2e2371f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.577301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.577916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:13.585429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:13.585919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:13.586358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:13.587084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:13.587546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:13.587977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:13.599856 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c78af92a-28b0-4573-8879-93b54521f5ce tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088605 Sep 19 15:22:13.600438 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2792/5631] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:13.615185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a68f52c-1008-493a-81b1-24695fff3bf1 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde28a0c430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.699281 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a68f52c-1008-493a-81b1-24695fff3bf1 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088823 Sep 19 15:22:13.699868 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2793/5632] 10.222.0.81 () {58 vars in 1134 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:22:13.712962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e285da87-d40e-44e8-9b45-d0913df8a5b9 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde2999a1f0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.722804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:13.730646 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca817987-edb4-485f-9aac-1b0ad368020d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.157165 Sep 19 15:22:13.731118 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2840/5633] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:22:13.795284 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e285da87-d40e-44e8-9b45-d0913df8a5b9 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085890 Sep 19 15:22:13.795865 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2794/5634] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:22:13.810146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7a6743d0-49e6-440c-801f-c590e0ed3006 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde29dfe820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.892440 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7a6743d0-49e6-440c-801f-c590e0ed3006 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086030 Sep 19 15:22:13.893187 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2841/5635] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:13.906486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f007bde7-4306-4bb4-9653-461676403771 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde2e290430>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:13.988834 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f007bde7-4306-4bb4-9653-461676403771 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086042 Sep 19 15:22:13.989416 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2795/5636] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:14.003158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2ced4333-b91f-4c83-8541-3818e0d21fd1 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde2a1ef670>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:14.083193 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2ced4333-b91f-4c83-8541-3818e0d21fd1 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083726 Sep 19 15:22:14.083906 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2842/5637] 10.222.0.81 () {58 vars in 1188 bytes} [Mon Sep 19 15:22:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:14.097973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed7b1de8-af21-4521-b28f-9dd2cc3a34b6 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] Calling method '.version_select at 0x7fde28965670>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:14.182266 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed7b1de8-af21-4521-b28f-9dd2cc3a34b6 tempest-VolumesTestJSON-1417294680 tempest-VolumesTestJSON-1417294680-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088884 Sep 19 15:22:14.182878 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2796/5638] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 15:22:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:14.758922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:14.759469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:14.761563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:14.768044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:14.768579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:14.769190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:14.769903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:14.770367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:14.770822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:14.906201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:14.914780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8dd7b21f-7356-429c-b035-e228c874d95f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.164719 Sep 19 15:22:14.915476 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2843/5639] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:14 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:15.939155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:15.939900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:15.941766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:15.948184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:15.948674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:15.949111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:15.949801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:15.950262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:15.950692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:15.953430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:16.092866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:16.102866 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81f0952d-8b7b-4aae-8708-0cd584e5ad50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.167330 Sep 19 15:22:16.102866 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2797/5640] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:15 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:17.124135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:17.124867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:17.132317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:17.132893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:17.133405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:17.134181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:17.134709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:17.135226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:17.276234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:17.285435 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-95ff6f08-e965-4a1b-9b0c-c42f6e9d69d0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.165169 Sep 19 15:22:17.286026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2844/5641] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:17 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:18.308735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:18.309360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:18.316467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:18.316963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:18.317410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:18.318110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:18.318573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:18.319038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:18.465594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:18.473535 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8919cf99-d7c0-4fd6-9061-a64d31380217 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.169101 Sep 19 15:22:18.474121 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2798/5642] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:18 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:19.496899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:19.497522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:19.504799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:19.505292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:19.505739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:19.506445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:19.506943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:19.507379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:19.659146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:19.667209 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-655326c6-f19a-4c38-b36d-a18927a8c1e4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.174262 Sep 19 15:22:19.667964 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2845/5643] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:19 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:20.690821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:20.691458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:20.699043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:20.699473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:20.699921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:20.700637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:20.701107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:20.701547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:20.718517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b0bfbd94-9ebb-49ce-96a6-8e7025c751b8 req-7dd081e6-b611-401c-bbfa-3834113d2d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ebb7c8-ffa3-40a2-900f-ee789d276dfc", "name": "network-vif-plugged", "status": "completed", "tag": "46c4d8bf-8df3-47c1-b9fa-d0e888f31213"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:22:20.736534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b0bfbd94-9ebb-49ce-96a6-8e7025c751b8 req-7dd081e6-b611-401c-bbfa-3834113d2d7f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:20.737360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b0bfbd94-9ebb-49ce-96a6-8e7025c751b8 req-7dd081e6-b611-401c-bbfa-3834113d2d7f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:20.738020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b0bfbd94-9ebb-49ce-96a6-8e7025c751b8 req-7dd081e6-b611-401c-bbfa-3834113d2d7f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:20.778801 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b0bfbd94-9ebb-49ce-96a6-8e7025c751b8 req-7dd081e6-b611-401c-bbfa-3834113d2d7f service nova] Creating event network-vif-plugged:46c4d8bf-8df3-47c1-b9fa-d0e888f31213 for instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc on n-h1-858384-1 Sep 19 15:22:20.786689 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b0bfbd94-9ebb-49ce-96a6-8e7025c751b8 req-7dd081e6-b611-401c-bbfa-3834113d2d7f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073525 Sep 19 15:22:20.787332 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2846/5644] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:20.901655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:20.910351 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f1e7caed-12bf-4424-9791-21f3c1504233 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.223599 Sep 19 15:22:20.911113 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2799/5645] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:20 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:21.935029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:21.935744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:21.942718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:21.943313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:21.943857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:21.944602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:21.945130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:21.945624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:22.096416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:22.104623 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f28ac09-fe54-453e-a480-304a238b70fb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1202 microversion: 2.1 time: 0.174957 Sep 19 15:22:22.105192 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2847/5646] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:21 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:23.128541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:23.129132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:23.136596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.137189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.137635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.138330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.138869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.139300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.280679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:23.289079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e75801fa-2db4-4350-a83c-38fb919ed05f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1390 microversion: 2.1 time: 0.165335 Sep 19 15:22:23.289655 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2800/5647] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:23 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:23.311778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:23.312442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:23.320042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.320532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.321039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.321791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.322256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.322684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.692990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:23.700706 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfbac826-d6cb-4e17-8fc5-f8031f298a7d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1390 microversion: 2.1 time: 0.392776 Sep 19 15:22:23.701285 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2848/5648] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:23 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:23.723671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:23.724324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:23.730270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.730781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.731228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.731931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.732391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.732825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.873892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:23.882039 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-80972c20-0f7a-4e3c-9c58-16978f3bc868 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1390 microversion: 2.1 time: 0.162746 Sep 19 15:22:23.882615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2801/5649] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:23 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:23.967933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:23.969207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:23.975178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.975776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.976099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:23.976794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:23.977255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:23.977657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:24.002868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:22:24.085310 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-345b084a-56f8-4964-8d7c-f5d7cb2bfc34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 204 len: 0 microversion: 2.1 time: 0.120928 Sep 19 15:22:24.086216 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2849/5650] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:22:23 2022] DELETE /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:22:24.095412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:24.096177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:24.105216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:24.105715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:24.106203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:24.106947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:24.107406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:24.107879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:24.243883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:24.252218 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f6d81a2-c8a9-4bb9-aa63-56c740383141 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1396 microversion: 2.1 time: 0.161467 Sep 19 15:22:24.252958 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2802/5651] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:24 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:25.276124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:25.276937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:25.283576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:25.284070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:25.284584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:25.285218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:25.285691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:25.286153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:25.436929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:25.446366 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-778594e4-8dfd-4665-afe0-4a5206ae1b62 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1396 microversion: 2.1 time: 0.174593 Sep 19 15:22:25.447168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2850/5652] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:25 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1396 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:26.039508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-06d4cf58-afc0-4aea-b856-a5e1867d1281 req-982c94bb-24d2-4b9f-be64-12a74be2f34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ebb7c8-ffa3-40a2-900f-ee789d276dfc", "name": "network-vif-deleted", "tag": "46c4d8bf-8df3-47c1-b9fa-d0e888f31213"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:22:26.054654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06d4cf58-afc0-4aea-b856-a5e1867d1281 req-982c94bb-24d2-4b9f-be64-12a74be2f34f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:26.055410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06d4cf58-afc0-4aea-b856-a5e1867d1281 req-982c94bb-24d2-4b9f-be64-12a74be2f34f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:26.055970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06d4cf58-afc0-4aea-b856-a5e1867d1281 req-982c94bb-24d2-4b9f-be64-12a74be2f34f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:26.070223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-06d4cf58-afc0-4aea-b856-a5e1867d1281 req-982c94bb-24d2-4b9f-be64-12a74be2f34f service nova] Creating event network-vif-deleted:46c4d8bf-8df3-47c1-b9fa-d0e888f31213 for instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc on n-h1-858384-1 Sep 19 15:22:26.075875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-06d4cf58-afc0-4aea-b856-a5e1867d1281 req-982c94bb-24d2-4b9f-be64-12a74be2f34f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040195 Sep 19 15:22:26.076771 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2803/5653] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:26.470073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:26.470697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:26.477969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:26.479729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:26.480272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:26.482397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:26.483013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:26.483582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:26.567673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:26.576915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-019e38be-92a0-42ae-9c3a-8617af27f3cf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1187 microversion: 2.1 time: 0.110789 Sep 19 15:22:26.577568 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2851/5654] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:26 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:27.605160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:27.606112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:27.612447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:27.612980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:27.613429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:27.614139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:27.614789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:27.615501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:27.889625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:27.898189 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbbab252-439a-4f01-9746-8923ced192cb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1187 microversion: 2.1 time: 0.298208 Sep 19 15:22:27.898798 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2804/5655] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:27 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1187 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:22:28.921496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:28.923056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:28.929936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:28.930428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:28.930919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:28.931620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:28.932072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:28.932494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:29.005111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:29.013744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa626b32-95fd-49e0-a3c2-67580b14a75d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1187 microversion: 2.1 time: 0.096222 Sep 19 15:22:29.027002 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2852/5656] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:28 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:30.038123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:30.038764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:30.049752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:30.050323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:30.051030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:30.051804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:30.052328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:30.053005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:30.129100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:30.137644 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06f9cfc2-9838-4deb-915d-6dada06034f5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 200 len: 1187 microversion: 2.1 time: 0.103536 Sep 19 15:22:30.138331 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2805/5657] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:30 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:31.163102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:31.163854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:31.171480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:31.172000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:31.172768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:31.173548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:31.174022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:31.174465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:31.189997 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc HTTP/1.1 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '27ebb7c8-ffa3-40a2-900f-ee789d276dfc'} Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:31.192008 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:31.196902 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:31.198273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:31.199412 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a2bd2b81-7be8-49c0-960c-dbdfd8d27915 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 404 len: 111 microversion: 2.1 time: 0.041377 Sep 19 15:22:31.200167 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2853/5658] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:31 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:22:33.367410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:33.368564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:33.376943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:33.377708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:33.378159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:33.378990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:33.379471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:33.379910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:33.394260 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc HTTP/1.1 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '27ebb7c8-ffa3-40a2-900f-ee789d276dfc'} Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:33.395984 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8149eb0e-c3e2-4d42-90b5-1da44447dd17 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 404 len: 111 microversion: 2.1 time: 0.034633 Sep 19 15:22:33.400336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2806/5659] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:22:33 2022] DELETE /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:33.406734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:33.408264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 27ebb7c8-ffa3-40a2-900f-ee789d276dfc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:33.415732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:33.416555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:33.417000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:33.417854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:33.418322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:33.418786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:33.435185 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc HTTP/1.1 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '27ebb7c8-ffa3-40a2-900f-ee789d276dfc'} Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:22:33.435826 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. Sep 19 15:22:33.439920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:22:33.441039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance 27ebb7c8-ffa3-40a2-900f-ee789d276dfc could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:22:33.442073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1a324321-1ee7-475e-8cbc-de9efefc499c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc" status: 404 len: 111 microversion: 2.1 time: 0.039895 Sep 19 15:22:33.442883 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2854/5660] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:33 2022] GET /compute/v2.1/servers/27ebb7c8-ffa3-40a2-900f-ee789d276dfc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:22:54.609923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1252334172", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fef9e6b7-b235-40e6-a549-230a778fd53a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:22:54.620698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=19 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:54.621409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=51 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:54.686720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:22:54.846279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:54.847524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:54.974639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Calling method '.version_select at 0x7fde29a9d160>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:54.976753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:54.977343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:54.978078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:54.997584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:54.998140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:54.998589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:55.008797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:55.009279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:55.009718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:55.016269 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e660eb9-f5c6-44ab-a4d7-6e5fef9bfb34 tempest-PortsAdminExtendedAttrsTestJSON-1380093884 tempest-PortsAdminExtendedAttrsTestJSON-1380093884-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.177218 Sep 19 15:22:55.016849 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2855/5661] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 15:22:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:22:55.302727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:22:55.303259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:22:55.304106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:22:55.304586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:22:55.305104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:22:55.314917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:55.315476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:55.316002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:55.316807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:55.317337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:55.317836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:55.335926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:22:55.341179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:22:55.404332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:22:55.406632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fef9e6b7-b235-40e6-a549-230a778fd53a',volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:22:55.540086 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31e74244-2ea6-45c0-8053-2ec3ededeb7a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934836 Sep 19 15:22:55.541521 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2807/5662] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:22:55.553673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21f37293-2800-41b6-8b48-20fde3f28a94 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:55.554292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21f37293-2800-41b6-8b48-20fde3f28a94 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:55.644488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21f37293-2800-41b6-8b48-20fde3f28a94 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:55.668297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21f37293-2800-41b6-8b48-20fde3f28a94 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1071 microversion: 2.1 time: 0.118681 Sep 19 15:22:55.684558 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2856/5663] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:55 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1071 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:56.696391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:56.697795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:56.705934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:56.706676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:56.707632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:56.708502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:56.709327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:56.710099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:56.789065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:56.798173 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2055c789-b189-4bdd-8db0-2763f0c61828 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1187 microversion: 2.1 time: 0.106792 Sep 19 15:22:56.803769 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2808/5664] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:56 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:57.825314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:57.826342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:57.834720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:57.835459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:57.836127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:57.836933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:57.837569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:57.838089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:58.210025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:58.219314 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c5b1545b-423d-48de-bd2e-f8fda68d5e2e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1229 microversion: 2.1 time: 0.400013 Sep 19 15:22:58.220081 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2857/5665] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:57 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1229 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:22:58.552170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b07f1ffa-4cea-4d6c-b552-520641755966 req-13d11870-47a9-4957-86c4-76206bd0ef76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace", "tag": "681de1be-1976-41a7-b65e-16b2098eaeaa"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:22:58.565173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b07f1ffa-4cea-4d6c-b552-520641755966 req-13d11870-47a9-4957-86c4-76206bd0ef76 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:58.566087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b07f1ffa-4cea-4d6c-b552-520641755966 req-13d11870-47a9-4957-86c4-76206bd0ef76 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:58.566534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b07f1ffa-4cea-4d6c-b552-520641755966 req-13d11870-47a9-4957-86c4-76206bd0ef76 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:58.584142 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b07f1ffa-4cea-4d6c-b552-520641755966 req-13d11870-47a9-4957-86c4-76206bd0ef76 service nova] Creating event network-changed:681de1be-1976-41a7-b65e-16b2098eaeaa for instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace on n-h1-858384-1 Sep 19 15:22:58.589807 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b07f1ffa-4cea-4d6c-b552-520641755966 req-13d11870-47a9-4957-86c4-76206bd0ef76 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042916 Sep 19 15:22:58.591019 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2809/5666] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:22:59.241887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:22:59.243842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:22:59.252147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:59.252875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:59.253535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:59.254775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:22:59.255476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:22:59.256132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:22:59.622173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:22:59.635987 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4eb41d7a-05f2-4396-9758-03187070c4e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1229 microversion: 2.1 time: 0.398039 Sep 19 15:22:59.637370 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2858/5667] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:22:59 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1229 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:00.665890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:00.666781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:00.676100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:00.676930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:00.677760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:00.678961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:00.679493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:00.680080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:00.833848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:00.842802 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1045702e-b076-4560-b10e-121690206fdc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1229 microversion: 2.1 time: 0.184906 Sep 19 15:23:00.843412 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2810/5668] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:00 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1229 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:01.866497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:01.867189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:01.875840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:01.876590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:01.877098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:01.877811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:01.878429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:01.878889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:02.015590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:02.023388 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5f1b1f0-74b0-4c22-a05f-c1bc2eb1b0f2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1229 microversion: 2.1 time: 0.161700 Sep 19 15:23:02.023974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2859/5669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:01 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1229 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:03.048693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:03.049390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:03.056461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:03.056946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:03.057387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:03.058081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:03.058533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:03.058984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:03.255367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:03.264518 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3d0903a8-881b-45b6-b307-7d76033fccbb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1217 microversion: 2.1 time: 0.220109 Sep 19 15:23:03.266386 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2811/5670] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:03 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:04.288827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:04.289857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:04.297962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:04.298454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:04.298939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:04.299712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:04.300191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:04.300604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:04.436192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:04.444870 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-caa78b02-9279-4e99-b84d-92e833a6e7fe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1217 microversion: 2.1 time: 0.160068 Sep 19 15:23:04.445626 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2860/5671] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:04 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:05.467978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:05.468705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:05.471256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:05.472063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:05.478656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:05.479186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:05.479635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:05.480346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:05.480812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:05.481248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:05.613711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:05.621770 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-34310dc4-df9a-46d4-be03-4104ae445a3b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1217 microversion: 2.1 time: 0.157865 Sep 19 15:23:05.622384 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2812/5672] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:05 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:06.651282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:06.654161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:06.663172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:06.665346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.665842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.666494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.667261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.667741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.668179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.826571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:06.835074 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-783cf190-571a-4cd1-9be7-965e1ea99ee2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1217 microversion: 2.1 time: 0.192278 Sep 19 15:23:06.835840 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2861/5673] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:06 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:07.346932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6e581a22-1d00-4d2c-b60f-fde8db24ebf9 req-4ebfc47e-9d03-4823-950e-500ea7e6c947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace", "name": "network-vif-plugged", "status": "completed", "tag": "681de1be-1976-41a7-b65e-16b2098eaeaa"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:07.361099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6e581a22-1d00-4d2c-b60f-fde8db24ebf9 req-4ebfc47e-9d03-4823-950e-500ea7e6c947 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.362430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6e581a22-1d00-4d2c-b60f-fde8db24ebf9 req-4ebfc47e-9d03-4823-950e-500ea7e6c947 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.363434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6e581a22-1d00-4d2c-b60f-fde8db24ebf9 req-4ebfc47e-9d03-4823-950e-500ea7e6c947 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.380775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6e581a22-1d00-4d2c-b60f-fde8db24ebf9 req-4ebfc47e-9d03-4823-950e-500ea7e6c947 service nova] Creating event network-vif-plugged:681de1be-1976-41a7-b65e-16b2098eaeaa for instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace on n-h1-858384-1 Sep 19 15:23:07.387252 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6e581a22-1d00-4d2c-b60f-fde8db24ebf9 req-4ebfc47e-9d03-4823-950e-500ea7e6c947 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044197 Sep 19 15:23:07.387937 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2813/5674] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:23:07.865266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:07.865977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:07.873324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.873900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.874352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.875091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.875555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.875991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:08.040860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:08.050131 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b0803a3-12ad-4cf9-8b84-9d3e5059ae5f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1217 microversion: 2.1 time: 0.188908 Sep 19 15:23:08.050791 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2862/5675] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:07 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:09.076045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:09.077005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:09.083813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:09.084608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:09.085159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:09.085970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:09.086685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:09.087238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:09.328438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:09.337171 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a051ca30-6bff-4343-9f0e-41b0b1fff0a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1404 microversion: 2.1 time: 0.267196 Sep 19 15:23:09.337882 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2814/5676] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:09 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1404 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:09.360952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:09.361587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:09.370284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:09.370809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:09.371262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:09.372028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:09.372783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:09.372996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:09.596857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:09.604766 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb6942db-8d38-42e3-864d-0a7de462e9a0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1404 microversion: 2.1 time: 0.248293 Sep 19 15:23:09.605346 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2863/5677] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:09 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:09.627468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1449842158"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:09.629745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:09.635715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:09.636212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:09.636655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:09.637352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:09.638450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:09.638912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:09.738636 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Attempting to quiesce instance before volume snapshot. Sep 19 15:23:09.803501 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 19 15:23:10.032318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Creating snapshot from volume fef9e6b7-b235-40e6-a549-230a778fd53a. {{(pid=128731) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 19 15:23:11.009020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94208281-f964-49e2-8d97-5b9cb124927b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace/action" status: 202 len: 0 microversion: 2.1 time: 1.385482 Sep 19 15:23:11.010097 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2815/5678] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:23:09 2022] POST /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace/action => generated 0 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 15:23:12.368041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1328035646", "imageRef": "6c0a6470-ba53-4acb-b51d-65e103f8f779", "flavorRef": "452", "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:12.438441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:23:13.190441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:23:13.190894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:23:13.191371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:23:13.191781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:23:13.192194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:23:13.202027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:13.202511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:13.202979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:13.203704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:13.204157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:13.204580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:13.221559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:23:13.226798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:23:13.239319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:23:13.242537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e5e7538f-5bd0-414b-bbe7-73af65c91860',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:23:13.320383 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a4f16d91-5058-49b8-9e1b-be8b29fd1def tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956574 Sep 19 15:23:13.321401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2864/5679] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:23:13.334262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7c7237ec-dc12-40ed-95e7-14035563093a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:13.335025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7c7237ec-dc12-40ed-95e7-14035563093a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:13.431731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7c7237ec-dc12-40ed-95e7-14035563093a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:13.441592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7c7237ec-dc12-40ed-95e7-14035563093a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1230 microversion: 2.1 time: 0.112242 Sep 19 15:23:13.442402 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2816/5680] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:13 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:14.466302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:14.468311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:14.492808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:14.495003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:14.497816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:14.498927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:14.499627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:14.500890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:14.642024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:14.659182 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b31593dd-a069-488b-98ab-f9808d9e4c32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1300 microversion: 2.1 time: 0.196079 Sep 19 15:23:14.678834 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2865/5681] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:14 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:15.686946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:15.688647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:15.696828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:15.697696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:15.698411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:15.699414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:15.700893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:15.701596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:16.036484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:16.047323 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb8b31d1-871f-4931-a03f-983716b7a517 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.364878 Sep 19 15:23:16.048179 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2817/5682] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:15 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:16.594711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-817e56e5-2fa4-4104-adff-bc28fbd8549d req-802917ac-4bd8-4a2e-97a1-8ecdb878640d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0795245-3833-4956-af2b-d3765ff304fc", "tag": "d6c7b6d2-c96e-46df-a754-708a20d51d32"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:16.611325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-817e56e5-2fa4-4104-adff-bc28fbd8549d req-802917ac-4bd8-4a2e-97a1-8ecdb878640d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:16.617822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-817e56e5-2fa4-4104-adff-bc28fbd8549d req-802917ac-4bd8-4a2e-97a1-8ecdb878640d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:16.618297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-817e56e5-2fa4-4104-adff-bc28fbd8549d req-802917ac-4bd8-4a2e-97a1-8ecdb878640d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:16.640575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-817e56e5-2fa4-4104-adff-bc28fbd8549d req-802917ac-4bd8-4a2e-97a1-8ecdb878640d service nova] Creating event network-changed:d6c7b6d2-c96e-46df-a754-708a20d51d32 for instance a0795245-3833-4956-af2b-d3765ff304fc on n-h2-858384-1 Sep 19 15:23:16.651930 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-817e56e5-2fa4-4104-adff-bc28fbd8549d req-802917ac-4bd8-4a2e-97a1-8ecdb878640d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061104 Sep 19 15:23:16.656498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2866/5683] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:23:17.080664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:17.081848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:17.104278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:17.104930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:17.105416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:17.106227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:17.106715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:17.107270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:17.508335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:17.533568 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ef2a518b-5b93-4aa4-bec5-6aa6c3ffeb06 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.460340 Sep 19 15:23:17.535207 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2818/5684] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:17 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:18.558801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:18.560402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:18.568666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:18.569464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:18.569942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:18.570776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:18.571240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:18.571676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:18.896001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:18.905844 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c2ded923-7c56-4fa8-b4a8-d7bfbcaa7ceb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.351534 Sep 19 15:23:18.906945 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2867/5685] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:18 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:19.930784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:19.931844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:19.940313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:19.940313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:19.940916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:19.942288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:19.942797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:19.943257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:20.201264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:20.217775 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be7f78be-0b7e-4d6a-aad8-a12611f36a79 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.291220 Sep 19 15:23:20.219351 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2819/5686] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:19 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:21.248590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:21.249921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:21.260698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:21.262546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:21.263241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:21.264062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:21.264603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:21.265125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:21.488309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:21.497636 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be73f53a-8d79-419d-b65c-b465c59b8b0f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.252482 Sep 19 15:23:21.498524 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2868/5687] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:21 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:22.524125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:22.525029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:22.534038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:22.534870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:22.535598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:22.536542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:22.537171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:22.537963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:23.090698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:23.099265 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-119467ef-7a5b-41cf-850d-bf557c91e759 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.578766 Sep 19 15:23:23.114653 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2820/5688] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:22 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:24.122702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:24.123393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:24.126233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:24.126941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:24.133264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:24.133761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:24.134209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:24.134944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:24.135411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:24.135855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:24.375244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:24.383288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1401ad13-c9ab-4408-8913-69652c13a5bd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.265105 Sep 19 15:23:24.384218 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2869/5689] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:24 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:25.408753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:25.409385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:25.415086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:25.416853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:25.418589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:25.419271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:25.419728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:25.420474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:25.420932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:25.421416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:25.425426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:25.571916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:25.580144 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-44026d95-cb8c-47de-97b6-0d77656306b9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.175965 Sep 19 15:23:25.581405 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2821/5690] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:25 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:26.605635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:26.607349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:26.615097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:26.618002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:26.619099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:26.619931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:26.621086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:26.621879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:26.622605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:26.627130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=77 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:26.908990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:26.919464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6902dc32-ca80-4763-b4a6-0e8deee452dc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.319225 Sep 19 15:23:26.920070 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2870/5691] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:26 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:27.943509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:27.944319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:27.951861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:27.952508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:27.953066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:27.953920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:27.954605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:27.955171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:28.188926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:28.197205 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c496fb7c-b600-4862-b4a9-4fea43ced591 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.258611 Sep 19 15:23:28.197703 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2822/5692] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:27 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:29.220366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:29.221404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:29.229941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:29.230715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:29.231365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:29.232238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:29.232769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:29.233278 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:29.391936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:29.401037 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2acf992f-2221-4fa6-8522-2ec5d458b188 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1342 microversion: 2.1 time: 0.184808 Sep 19 15:23:29.402499 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2871/5693] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:29 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:30.429904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:30.430622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:30.438554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:30.439271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:30.439839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:30.440708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:30.441411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:30.442255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:30.727489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:30.736707 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7a61ffda-26a6-4e9f-9adb-da90b08e2516 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.310951 Sep 19 15:23:30.737475 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2823/5694] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:30 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:31.764312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:31.764972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:31.772833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:31.773457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:31.773956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:31.775072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:31.776002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:31.776472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:32.001912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:32.009744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48b77ab2-d0a2-4f13-91d5-16bb007cc594 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.250650 Sep 19 15:23:32.010334 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2872/5695] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:31 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:33.033747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:33.034620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:33.042324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:33.043400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:33.043840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:33.044717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:33.045417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:33.045826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:33.335948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:33.343953 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e857090-84c7-42c0-aca0-7bbc55120d51 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.314729 Sep 19 15:23:33.344548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2824/5696] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:33 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:23:34.369282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:34.369949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:34.377715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:34.378201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:34.378637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:34.379352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:34.379808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:34.380237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:34.539634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:34.548509 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f3774ea9-7752-48fc-a590-e47979e2ee05 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.182992 Sep 19 15:23:34.549325 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2873/5697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:34 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:35.572550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:35.573187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:35.580729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:35.581248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:35.581711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:35.582444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:35.582949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:35.583399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:35.727692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:35.736596 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0d55942d-15b3-4aee-8334-1755bf1b6afe tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.168051 Sep 19 15:23:35.737420 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2825/5698] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:35 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:36.760017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:36.760669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:36.768796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:36.769364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:36.769746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:36.770652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:36.771378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:36.771696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:36.929720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:36.947340 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eab4d1b6-70e3-4373-8db2-793c815114ad tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.191297 Sep 19 15:23:36.948187 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2874/5699] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:36 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:37.978165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:37.980598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:37.988365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:37.989004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:37.989472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:37.990226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:37.990690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:37.991326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:38.169117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:38.178063 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a158f6d7-7725-4ca5-b2bf-e556e99cf7f6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.204401 Sep 19 15:23:38.178805 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2826/5700] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:37 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:23:39.204248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:39.205500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:39.212130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:39.212863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:39.213310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:39.214796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:39.217463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:39.218093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:39.264708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7c5cc975-e0ae-412a-aeb3-5d0276f49d56 req-5c87ce21-a9aa-4356-91f0-f5000e80b178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0795245-3833-4956-af2b-d3765ff304fc", "name": "network-vif-plugged", "status": "completed", "tag": "d6c7b6d2-c96e-46df-a754-708a20d51d32"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:39.290826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c5cc975-e0ae-412a-aeb3-5d0276f49d56 req-5c87ce21-a9aa-4356-91f0-f5000e80b178 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:39.291671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c5cc975-e0ae-412a-aeb3-5d0276f49d56 req-5c87ce21-a9aa-4356-91f0-f5000e80b178 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:39.292742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c5cc975-e0ae-412a-aeb3-5d0276f49d56 req-5c87ce21-a9aa-4356-91f0-f5000e80b178 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:39.317353 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7c5cc975-e0ae-412a-aeb3-5d0276f49d56 req-5c87ce21-a9aa-4356-91f0-f5000e80b178 service nova] Creating event network-vif-plugged:d6c7b6d2-c96e-46df-a754-708a20d51d32 for instance a0795245-3833-4956-af2b-d3765ff304fc on n-h2-858384-1 Sep 19 15:23:39.327466 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7c5cc975-e0ae-412a-aeb3-5d0276f49d56 req-5c87ce21-a9aa-4356-91f0-f5000e80b178 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066957 Sep 19 15:23:39.328853 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2827/5701] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:23:39.414186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:39.424022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86ea32ed-f47e-4038-8032-971ae8b18607 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.224227 Sep 19 15:23:39.425275 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2875/5702] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:39 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:40.452615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:40.453490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:40.460709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:40.461498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:40.461984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:40.462940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:40.464797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:40.465299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:40.638544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:40.647601 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb9b71a8-1abf-4ef2-8b81-1009cd35aca4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1376 microversion: 2.1 time: 0.201099 Sep 19 15:23:40.648136 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2828/5703] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:40 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1376 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:41.672945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:41.673582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:41.681235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:41.681729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:41.682161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:41.683449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:41.683902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:41.684362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:41.819739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:41.827940 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d33405a-5c73-4b4e-b8ab-3a667ccc70f3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1563 microversion: 2.1 time: 0.158913 Sep 19 15:23:41.828523 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2876/5704] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:41 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:41.850642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:41.851370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:41.859110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:41.859656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:41.860988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:41.861732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:41.862216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:41.862668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:41.998262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:42.007534 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6255ce8c-e141-43c2-9829-ecfac5cd628f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1563 microversion: 2.1 time: 0.160580 Sep 19 15:23:42.007996 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2829/5705] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:41 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:42.091115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:42.091635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:42.097902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:42.098489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:42.098970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:42.099713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:42.100187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:42.100654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:42.130274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:23:42.212301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eb9b6fa9-eb56-4f0b-8700-e2a36f1ff987 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 204 len: 0 microversion: 2.1 time: 0.125741 Sep 19 15:23:42.213326 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2877/5706] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:23:42 2022] DELETE /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:23:42.222092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:42.222729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:42.228690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:42.229558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:42.229905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:42.230822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:42.231300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:42.231745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:42.363873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:42.373131 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b473b728-66da-4e9c-82ab-4fcfe15dc835 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1569 microversion: 2.1 time: 0.154919 Sep 19 15:23:42.373721 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2830/5707] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:42 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:43.397691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:43.398420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:43.406721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:43.407459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:43.408046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:43.409170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:43.409782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:43.410374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:43.740881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:43.749965 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d58c01d2-9ef3-4f72-803c-6719a0d3db36 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1569 microversion: 2.1 time: 0.356489 Sep 19 15:23:43.750723 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2878/5708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:43 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:44.508445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-19b8a7d0-4197-4309-852f-700419d73aa5 req-b63cc6be-adb7-46de-ab4f-8b78e3ebc881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0795245-3833-4956-af2b-d3765ff304fc", "name": "network-vif-deleted", "tag": "d6c7b6d2-c96e-46df-a754-708a20d51d32"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:44.536320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19b8a7d0-4197-4309-852f-700419d73aa5 req-b63cc6be-adb7-46de-ab4f-8b78e3ebc881 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:44.536866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19b8a7d0-4197-4309-852f-700419d73aa5 req-b63cc6be-adb7-46de-ab4f-8b78e3ebc881 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:44.537317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-19b8a7d0-4197-4309-852f-700419d73aa5 req-b63cc6be-adb7-46de-ab4f-8b78e3ebc881 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:44.569030 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-19b8a7d0-4197-4309-852f-700419d73aa5 req-b63cc6be-adb7-46de-ab4f-8b78e3ebc881 service nova] Creating event network-vif-deleted:d6c7b6d2-c96e-46df-a754-708a20d51d32 for instance a0795245-3833-4956-af2b-d3765ff304fc on n-h2-858384-1 Sep 19 15:23:44.589876 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-19b8a7d0-4197-4309-852f-700419d73aa5 req-b63cc6be-adb7-46de-ab4f-8b78e3ebc881 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086765 Sep 19 15:23:44.591044 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2831/5709] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:23:44.772838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:44.773478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:44.789722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:44.791349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:44.792972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:44.794636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:44.795381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:44.796253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:44.869224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:44.878579 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae771557-54a2-46a3-8de2-dd5f3b265b4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1361 microversion: 2.1 time: 0.109652 Sep 19 15:23:44.879996 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2879/5710] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:44 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:45.903052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:45.904636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:45.913239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:45.914328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:45.914451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:45.915169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:45.915649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:45.916089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:46.021682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:46.031432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-492ddd24-513d-411b-bd26-80ec81865adf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1361 microversion: 2.1 time: 0.132510 Sep 19 15:23:46.032589 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2832/5711] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:45 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1361 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:47.059791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:47.061308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:47.069394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:47.069996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:47.070500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:47.071497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:47.072038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:47.072531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:47.153196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:47.163485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a5edae9c-2f39-4d87-a5e0-8ee24d6f2ccb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1361 microversion: 2.1 time: 0.108246 Sep 19 15:23:47.181690 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2880/5712] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:47 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1361 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:48.189629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:48.190267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:48.199326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:48.199844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:48.200311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:48.201259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:48.201963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:48.202589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:48.275285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:48.285727 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-25a1c06f-29d2-4056-83ea-9497d5d94c1d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1361 microversion: 2.1 time: 0.100316 Sep 19 15:23:48.287139 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2833/5713] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:48 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:49.310708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:49.311396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:49.318844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:49.319466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:49.319975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:49.321141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:49.321834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:49.323251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:49.359344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:49.359910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:49.360416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:49.360812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lazy-loading 'fault' on Instance uuid a0795245-3833-4956-af2b-d3765ff304fc {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:23:49.427044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:49.442472 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4aff5028-f39f-4c81-9579-e093d4c9f51e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 200 len: 1366 microversion: 2.1 time: 0.135834 Sep 19 15:23:49.457033 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2881/5714] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:49 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:50.469768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:50.470439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:50.479824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:50.480716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:50.481373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:50.482277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:50.482918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:50.483381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:50.500490 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc HTTP/1.1 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'a0795245-3833-4956-af2b-d3765ff304fc'} Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:23:50.502522 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f0da77f-3dee-4687-89e8-a026db92d1c0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 404 len: 111 microversion: 2.1 time: 0.039424 Sep 19 15:23:50.508783 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2834/5715] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:50 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:23:54.861660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:54.862295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:54.870379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:54.871006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:54.871458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:54.872297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:54.872898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:54.873334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:54.899851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:23:54.983028 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-abc8f951-b158-4408-a8a1-87e6e70ae8b7 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 204 len: 0 microversion: 2.1 time: 0.124920 Sep 19 15:23:54.983921 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2882/5716] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:23:54 2022] DELETE /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:23:54.992091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:54.992755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:54.999815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:55.000323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:55.000794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:55.001480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:55.001950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:55.002394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:55.139056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:55.150379 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13c3b75a-3bb1-48a6-957b-b0451c875cb6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1410 microversion: 2.1 time: 0.162128 Sep 19 15:23:55.151590 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2835/5717] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:54 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:56.174463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:56.175849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:56.183298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:56.183874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:56.184380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:56.185296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:56.185832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:56.186352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:56.190803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:56.328419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:56.337098 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c558364-1030-4888-8e4a-e65c0e4037b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1410 microversion: 2.1 time: 0.166783 Sep 19 15:23:56.337700 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2883/5718] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:56 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1410 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:56.964197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cfca9c5e-7b71-4ab5-9a6a-142966dc8f1a req-437d5692-033b-4556-9a8e-542acad4c63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace", "name": "network-vif-deleted", "tag": "681de1be-1976-41a7-b65e-16b2098eaeaa"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:23:56.974986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=30 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:56.980221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cfca9c5e-7b71-4ab5-9a6a-142966dc8f1a req-437d5692-033b-4556-9a8e-542acad4c63d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:56.980809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cfca9c5e-7b71-4ab5-9a6a-142966dc8f1a req-437d5692-033b-4556-9a8e-542acad4c63d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:56.981258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cfca9c5e-7b71-4ab5-9a6a-142966dc8f1a req-437d5692-033b-4556-9a8e-542acad4c63d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:56.986364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=78 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:56.997730 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cfca9c5e-7b71-4ab5-9a6a-142966dc8f1a req-437d5692-033b-4556-9a8e-542acad4c63d service nova] Creating event network-vif-deleted:681de1be-1976-41a7-b65e-16b2098eaeaa for instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace on n-h1-858384-1 Sep 19 15:23:57.004016 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cfca9c5e-7b71-4ab5-9a6a-142966dc8f1a req-437d5692-033b-4556-9a8e-542acad4c63d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044012 Sep 19 15:23:57.004898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2836/5719] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:23:57.360715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:57.361966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:57.398730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:57.403800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:57.407538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:57.408580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:57.409756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:57.410335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:57.411043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:57.548812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:57.557927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e677ddbd-35bb-4ab7-a758-d6c2b0084741 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1202 microversion: 2.1 time: 0.201376 Sep 19 15:23:57.558651 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2884/5720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:57 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:58.582119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:58.583791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:58.592363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:58.593124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:58.593459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:58.594287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:58.594789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:58.595301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:58.726998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:58.735999 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b6ae5c0-2206-4fb2-8e73-981fbb1fe6b2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1202 microversion: 2.1 time: 0.158463 Sep 19 15:23:58.736718 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2837/5721] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:58 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:59.761235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:59.761936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:59.769404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:59.770021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:59.770590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:59.771452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:59.771994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:59.773250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:59.861816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:59.871427 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03bf8278-00a7-42e9-b889-434eadbf20e1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1202 microversion: 2.1 time: 0.114946 Sep 19 15:23:59.872023 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2885/5722] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:59 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1202 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:00.897712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:00.899392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:00.907224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:00.907958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:00.908418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:00.909513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:00.909997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:00.910441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:00.985161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:00.994661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ec2e4cdd-bb8d-4bf4-a424-11d8ab006952 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 200 len: 1202 microversion: 2.1 time: 0.100865 Sep 19 15:24:00.995479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2838/5723] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:00 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 1202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:02.017751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:02.018371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:02.025732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:02.026255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:02.026701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:02.027442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:02.027903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:02.028336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:02.044130 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace HTTP/1.1 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace'} Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:02.045742 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d30d419-48a7-464e-928c-47a00e0342a2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 404 len: 111 microversion: 2.1 time: 0.034012 Sep 19 15:24:02.052907 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2886/5724] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:02 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:24:04.199734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:04.200343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:04.209179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.210570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.211507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.218315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.219051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.219511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.237496 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc HTTP/1.1 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'a0795245-3833-4956-af2b-d3765ff304fc'} Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:24:04.239395 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57f246ce-0d51-4c9e-b4ad-e0a274e0da6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 404 len: 111 microversion: 2.1 time: 0.047117 Sep 19 15:24:04.247892 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2839/5725] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:24:04 2022] DELETE /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:24:04.252074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:04.252649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: a0795245-3833-4956-af2b-d3765ff304fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:04.259311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.260592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.261884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.262602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.263086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.263514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.278519 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc HTTP/1.1 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a0795245-3833-4956-af2b-d3765ff304fc'} Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.280225 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance a0795245-3833-4956-af2b-d3765ff304fc could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1689899-aa5f-4e0a-af1d-cc72807858bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc" status: 404 len: 111 microversion: 2.1 time: 0.034207 Sep 19 15:24:04.286787 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2887/5726] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:04 2022] GET /compute/v2.1/servers/a0795245-3833-4956-af2b-d3765ff304fc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:24:04.816140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:04.816814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:04.824572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.825431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.825965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.826778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.827364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.827876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.843358 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace HTTP/1.1 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace'} Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:24:04.845240 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e97aa4b-41f4-43d9-8b3a-d3122229d815 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 404 len: 111 microversion: 2.1 time: 0.034964 Sep 19 15:24:04.849762 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2840/5727] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:24:04 2022] DELETE /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:24:04.856183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:04.856818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:04.863321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.863868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.864266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.865220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:04.865685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:04.866118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:04.881317 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace HTTP/1.1 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace'} Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:24:04.882854 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dd5f36f1-794c-4539-8c21-28cfb9140862 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace" status: 404 len: 111 microversion: 2.1 time: 0.032613 Sep 19 15:24:04.889349 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2888/5728] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:04 2022] GET /compute/v2.1/servers/ea4b2ff0-e6ed-464a-a779-60fe7f1e3ace => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:24:04.960001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4990213f-70a8-4cee-8921-bcb854ca4cce tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: .version_select at 0x7fde2a61d700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1897289911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWZ8mrd6WZ08s4f8Yso0UOROxaHf1HVYnlRPbEcPxTNOssXI3wPTI2IMlX36UtQ9pUWiUBCQI4liWIs6rcav7h2B0Ub5QoEazmY16+TmQUBGl2g0okHRSn+qxsziT9Xeg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:24:04.976766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-4990213f-70a8-4cee-8921-bcb854ca4cce tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:24:04.982673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-4990213f-70a8-4cee-8921-bcb854ca4cce tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:24:05.007817 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4990213f-70a8-4cee-8921-bcb854ca4cce tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052111 Sep 19 15:24:05.008589 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2841/5729] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:24:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:24:24.024158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1651548353", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1897289911", "security_groups": [{"name": "tempest-secgroup-smoke-2084711474"}], "block_device_mapping_v2": [{"uuid": "fed3a634-8b45-46b8-9c2a-9b3e92cf7ac0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:24:24.038836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=9 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:24.040172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=23 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:24.166877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:24:24.591180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:24:24.591707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:24:24.592565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:24:24.593186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:24:24.593816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:24:24.605397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:24.605880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:24.606320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:24.607207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:24.607664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:24.608086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:24.625974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:24:24.631261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:24:24.693360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:24:24.695898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fed3a634-8b45-46b8-9c2a-9b3e92cf7ac0',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:24:24.830903 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-66ec05e0-3c07-4beb-bb2a-cfcf2efaf73b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811239 Sep 19 15:24:24.831779 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2889/5730] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:24:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:24:24.843630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9d1c54e2-ff01-4443-bb61-b28eb557840d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:24.844255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9d1c54e2-ff01-4443-bb61-b28eb557840d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:24.852220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=17 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:24.852220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:24.853258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:24.912403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9d1c54e2-ff01-4443-bb61-b28eb557840d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:24.921229 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9d1c54e2-ff01-4443-bb61-b28eb557840d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1095 microversion: 2.1 time: 0.081729 Sep 19 15:24:24.922023 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2842/5731] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:24 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:25.944508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:25.945833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:25.952599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:25.953486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:25.954242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:25.955044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:25.955501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:25.955920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:26.087005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:26.095758 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-edc7558f-d0a9-428f-83dc-5fa2eca09334 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1211 microversion: 2.1 time: 0.155866 Sep 19 15:24:26.096516 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2890/5732] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:25 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:27.122124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:27.123031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:27.130057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:27.130830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:27.131385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:27.132484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:27.133153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:27.133695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:27.230815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:27.239241 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ea0ddaf0-cefc-4de3-896a-4e9474586bc3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1211 microversion: 2.1 time: 0.122433 Sep 19 15:24:27.239835 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2843/5733] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:27 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:28.268129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:28.270517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:28.281099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:28.281914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:28.282528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:28.283501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:28.284139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:28.284905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:28.515773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:28.536374 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a0a4142-ba50-4a83-b51a-c8d7835bc0bf tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1279 microversion: 2.1 time: 0.276542 Sep 19 15:24:28.553678 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2891/5734] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:28 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:28.569405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0a54d4b6-04dd-45ec-9b87-1de1b33e270f req-cdeaff17-c09c-4dc0-aa94-7d0ba05aa78c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22d8ac3-3ac5-402b-baa0-25023166d87a", "tag": "5eb7807b-6261-4288-92f0-5914879d9973"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:24:28.590821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a54d4b6-04dd-45ec-9b87-1de1b33e270f req-cdeaff17-c09c-4dc0-aa94-7d0ba05aa78c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:28.591330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a54d4b6-04dd-45ec-9b87-1de1b33e270f req-cdeaff17-c09c-4dc0-aa94-7d0ba05aa78c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:28.591785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0a54d4b6-04dd-45ec-9b87-1de1b33e270f req-cdeaff17-c09c-4dc0-aa94-7d0ba05aa78c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:28.614470 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0a54d4b6-04dd-45ec-9b87-1de1b33e270f req-cdeaff17-c09c-4dc0-aa94-7d0ba05aa78c service nova] Creating event network-changed:5eb7807b-6261-4288-92f0-5914879d9973 for instance e22d8ac3-3ac5-402b-baa0-25023166d87a on n-h1-858384-1 Sep 19 15:24:28.622259 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0a54d4b6-04dd-45ec-9b87-1de1b33e270f req-cdeaff17-c09c-4dc0-aa94-7d0ba05aa78c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056264 Sep 19 15:24:28.622923 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2844/5735] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:24:29.567073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:29.567688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:29.574851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:29.575574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:29.576194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:29.576934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:29.577590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:29.578164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:29.770991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:29.780008 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eaaad8fb-025b-45cb-bf05-e8bfa70c66a9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1279 microversion: 2.1 time: 0.216877 Sep 19 15:24:29.780721 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2892/5736] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:29 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:24:30.809275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:30.811147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:30.819440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:30.820099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:30.820691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:30.821592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:30.822398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:30.823530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:31.038979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:31.046992 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-971171ec-48e7-44a6-b38f-e6e9412b4d6a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1279 microversion: 2.1 time: 0.246747 Sep 19 15:24:31.048530 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2845/5737] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:30 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:32.071629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:32.072258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:32.079246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:32.079746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:32.080194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:32.080906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:32.081499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:32.081934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:32.231489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:32.239271 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25e88786-509c-4d38-82a3-0653609b389a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.172190 Sep 19 15:24:32.239844 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2893/5738] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:32 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:33.262802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:33.264085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:33.271797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:33.272308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:33.272763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:33.274063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:33.275073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:33.275533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:33.480301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:33.488153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-67a3e6ed-c8ca-4408-89e4-8c2685b3f1b6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.230057 Sep 19 15:24:33.488941 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2846/5739] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:33 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:34.512665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:34.513318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:34.520194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:34.520913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:34.521541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:34.522246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:34.522903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:34.523359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:34.620339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:34.639660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:34.697699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:34.706184 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-33a520f5-1ff8-4410-b6dc-b498d434d541 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.198471 Sep 19 15:24:34.706867 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2894/5740] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:34 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:35.730983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:35.731563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:35.734873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:35.741048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:35.741815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:35.742640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:35.743728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:35.744361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:35.745098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:35.886364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:35.894499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f50020ac-731c-433a-99e3-b1d37f407fc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.168475 Sep 19 15:24:35.895204 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2847/5741] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:35 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:36.919190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:36.919947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:36.922085 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:24:36.922428 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a (ip 10.222.0.81) !!! Sep 19 15:24:36.930316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:36.930989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:36.931432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:36.932165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:36.932619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:36.933047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:37.068422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:37.077289 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35d0a2d0-db30-4f5b-b080-5d42f5a1e73a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.162122 Sep 19 15:24:37.078316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2895/5742] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:36 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:38.100211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:38.100844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:38.109043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:38.109043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:38.109043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:38.109307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:38.109764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:38.110200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:38.260187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:38.268724 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df752a56-2add-449e-9bf2-ab0d4ca97e65 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.172515 Sep 19 15:24:38.269402 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2848/5743] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:38 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:24:39.291236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:39.292020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:39.298887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:39.299376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:39.299818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:39.300512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:39.300965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:39.301653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:39.440650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:39.449556 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09448ef1-75d4-4be8-a978-288bffed425e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.162509 Sep 19 15:24:39.450139 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2896/5744] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:39 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:40.473214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:40.473774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:40.481057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:40.481567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:40.482024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:40.482739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:40.483242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:40.483684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:40.616322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:40.624762 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f914e1a-83fe-4146-8648-de43e225077c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.155576 Sep 19 15:24:40.625345 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2849/5745] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:40 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:41.531761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-708b24d5-4ea0-422d-93c2-b53f05fd0e6b req-a65cbb7d-d63e-431c-87ec-007e9386ca73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22d8ac3-3ac5-402b-baa0-25023166d87a", "name": "network-vif-plugged", "status": "completed", "tag": "5eb7807b-6261-4288-92f0-5914879d9973"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:24:41.542950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-708b24d5-4ea0-422d-93c2-b53f05fd0e6b req-a65cbb7d-d63e-431c-87ec-007e9386ca73 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:41.543498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-708b24d5-4ea0-422d-93c2-b53f05fd0e6b req-a65cbb7d-d63e-431c-87ec-007e9386ca73 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:41.543934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-708b24d5-4ea0-422d-93c2-b53f05fd0e6b req-a65cbb7d-d63e-431c-87ec-007e9386ca73 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:41.556454 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-708b24d5-4ea0-422d-93c2-b53f05fd0e6b req-a65cbb7d-d63e-431c-87ec-007e9386ca73 service nova] Creating event network-vif-plugged:5eb7807b-6261-4288-92f0-5914879d9973 for instance e22d8ac3-3ac5-402b-baa0-25023166d87a on n-h1-858384-1 Sep 19 15:24:41.561612 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-708b24d5-4ea0-422d-93c2-b53f05fd0e6b req-a65cbb7d-d63e-431c-87ec-007e9386ca73 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196476 Sep 19 15:24:41.562298 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2897/5746] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:24:41.647700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:41.649693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:41.656665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:41.657171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:41.657620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:41.658330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:41.658824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:41.659263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:41.811513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:41.819625 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7b4d835b-d927-4ec2-8e11-5a3553b137bb tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1267 microversion: 2.1 time: 0.176221 Sep 19 15:24:41.820378 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2850/5747] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:41 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:42.846312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:42.847244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:42.855452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:42.856051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:42.856605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:42.857490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:42.858130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:42.858627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:42.995701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:43.003612 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dcfa0dc8-0f5d-4f58-8e1c-ecfb1034895b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1454 microversion: 2.1 time: 0.163972 Sep 19 15:24:43.004185 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2898/5748] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:42 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:24:43.026001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:24:43.026644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:24:43.033724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:43.034244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:43.034704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:43.035443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:43.035924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:43.036375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:43.167454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:24:43.175367 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f747fa34-b6b6-49ba-a364-9f804af6c2d1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1454 microversion: 2.1 time: 0.153605 Sep 19 15:24:43.175950 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2851/5749] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:24:43 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:24:44.939841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-55fc298e-eb8f-44e1-8e33-cdf6c0d551ae req-11e9c7ad-3ad6-4be7-9447-4c82b006ecb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22d8ac3-3ac5-402b-baa0-25023166d87a", "tag": "5eb7807b-6261-4288-92f0-5914879d9973"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:24:44.950166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55fc298e-eb8f-44e1-8e33-cdf6c0d551ae req-11e9c7ad-3ad6-4be7-9447-4c82b006ecb9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:24:44.950668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55fc298e-eb8f-44e1-8e33-cdf6c0d551ae req-11e9c7ad-3ad6-4be7-9447-4c82b006ecb9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:24:44.951143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55fc298e-eb8f-44e1-8e33-cdf6c0d551ae req-11e9c7ad-3ad6-4be7-9447-4c82b006ecb9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:24:44.963559 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-55fc298e-eb8f-44e1-8e33-cdf6c0d551ae req-11e9c7ad-3ad6-4be7-9447-4c82b006ecb9 service nova] Creating event network-changed:5eb7807b-6261-4288-92f0-5914879d9973 for instance e22d8ac3-3ac5-402b-baa0-25023166d87a on n-h1-858384-1 Sep 19 15:24:44.969050 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-55fc298e-eb8f-44e1-8e33-cdf6c0d551ae req-11e9c7ad-3ad6-4be7-9447-4c82b006ecb9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100165 Sep 19 15:24:44.969878 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2899/5750] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:26:26.031756 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 15:26:26.032621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=22 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:26.033527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=50 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:26.034884 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:26:26.035052 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:26:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! Sep 19 15:26:26.040359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1883799914", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:26.095410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:26:26.362497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:26:26.362981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:26:26.363477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:26:26.363907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:26:26.364338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:26:26.374202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:26.374729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:26.375207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:26.375949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:26.376420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:26.376861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:26.393417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Getting quotas for project 4898518f38164f1f831b839fd7042ebc. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:26:26.398805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Getting quotas for user 74bd2558dcc6466d8de35e442bb28683 and project 4898518f38164f1f831b839fd7042ebc. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:26:26.411908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:26:26.414243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:26:26.461600 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5487792-090c-4600-b28e-e073de87a437 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431784 Sep 19 15:26:26.462262 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2852/5751] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:26:26.473070 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 15:26:26.473985 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 15:26:26.474611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:26.475372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=54 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:26.484135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-becdc78d-4f4e-4913-9d55-f7317e1405e9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:26.484861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-becdc78d-4f4e-4913-9d55-f7317e1405e9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:26.548681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-becdc78d-4f4e-4913-9d55-f7317e1405e9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:26.556068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-becdc78d-4f4e-4913-9d55-f7317e1405e9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1214 microversion: 2.1 time: 0.085355 Sep 19 15:26:26.556656 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2900/5752] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:26 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:27.581071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:27.581710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:27.589665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:27.590160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:27.590659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:27.591421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:27.591891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:27.592334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:27.597952 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 35188. Sep 19 15:26:27.690728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:27.698776 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1700a43a-4e13-43fa-9505-3c5cc088f571 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1274 microversion: 2.1 time: 0.123202 Sep 19 15:26:27.699598 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2853/5753] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:27 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:28.722719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:28.723444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:28.734100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:28.734893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:28.735351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:28.736042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:28.736501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:28.736932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:28.743598 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 35196. Sep 19 15:26:28.745286 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 35198. Sep 19 15:26:28.961948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:28.970531 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e82e6956-5857-4b52-82a2-20617fb90635 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1314 microversion: 2.1 time: 0.251740 Sep 19 15:26:28.971150 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2901/5754] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:28 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:29.427402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d6d2a53d-f6f6-42f6-9bbf-1eef1e4b78d2 req-d6dea490-deab-417a-8c13-2d186325024e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d12fbb-26ff-4ab3-8c53-05c78e6d2855", "tag": "adaae5c8-014a-4871-9c7b-e64134be99be"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:29.437795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6d2a53d-f6f6-42f6-9bbf-1eef1e4b78d2 req-d6dea490-deab-417a-8c13-2d186325024e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:29.438289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6d2a53d-f6f6-42f6-9bbf-1eef1e4b78d2 req-d6dea490-deab-417a-8c13-2d186325024e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:29.438727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6d2a53d-f6f6-42f6-9bbf-1eef1e4b78d2 req-d6dea490-deab-417a-8c13-2d186325024e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:29.451051 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d6d2a53d-f6f6-42f6-9bbf-1eef1e4b78d2 req-d6dea490-deab-417a-8c13-2d186325024e service nova] Creating event network-changed:adaae5c8-014a-4871-9c7b-e64134be99be for instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 on n-h2-858384-1 Sep 19 15:26:29.456019 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d6d2a53d-f6f6-42f6-9bbf-1eef1e4b78d2 req-d6dea490-deab-417a-8c13-2d186325024e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173554 Sep 19 15:26:29.456971 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2854/5755] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:26:29.993590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:29.994215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:30.001765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:30.002255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:30.002696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:30.003415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:30.003874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:30.004305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:30.137657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:30.145391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13df9957-0572-4dc9-8db0-b3a3564e9559 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1314 microversion: 2.1 time: 0.155834 Sep 19 15:26:30.145967 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2902/5756] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:29 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:31.170177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:31.171003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:31.177412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:31.177908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:31.178358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:31.179085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:31.179556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:31.179992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:31.312774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:31.320627 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1be6367-8d84-4a30-a77c-b62bf3f4ddf0 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1314 microversion: 2.1 time: 0.155713 Sep 19 15:26:31.321208 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2855/5757] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:31 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:32.344253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:32.344905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:32.351735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:32.352221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:32.352659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:32.353352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:32.353809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:32.354242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:32.482285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:32.489986 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6e597a5f-52b8-457d-9943-99e987216c40 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1314 microversion: 2.1 time: 0.150261 Sep 19 15:26:32.490560 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2903/5758] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:32 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:33.513828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:33.514466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:33.521503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:33.522003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:33.522455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:33.523202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:33.523677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:33.524117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:33.658429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:33.666397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-241a3454-9b6b-4f20-a02f-6084912e2cc4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1314 microversion: 2.1 time: 0.157195 Sep 19 15:26:33.667076 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2856/5759] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:33 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:33.727210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d38443c5-ab1e-4033-a4e4-da80661a683f req-ae3af625-d5ac-45f8-8838-2fddd8cdfb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d12fbb-26ff-4ab3-8c53-05c78e6d2855", "name": "network-vif-plugged", "status": "completed", "tag": "adaae5c8-014a-4871-9c7b-e64134be99be"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:33.738488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d38443c5-ab1e-4033-a4e4-da80661a683f req-ae3af625-d5ac-45f8-8838-2fddd8cdfb51 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:33.739085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d38443c5-ab1e-4033-a4e4-da80661a683f req-ae3af625-d5ac-45f8-8838-2fddd8cdfb51 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:33.739589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d38443c5-ab1e-4033-a4e4-da80661a683f req-ae3af625-d5ac-45f8-8838-2fddd8cdfb51 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:33.754696 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d38443c5-ab1e-4033-a4e4-da80661a683f req-ae3af625-d5ac-45f8-8838-2fddd8cdfb51 service nova] Creating event network-vif-plugged:adaae5c8-014a-4871-9c7b-e64134be99be for instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 on n-h2-858384-1 Sep 19 15:26:33.759749 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d38443c5-ab1e-4033-a4e4-da80661a683f req-ae3af625-d5ac-45f8-8838-2fddd8cdfb51 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036403 Sep 19 15:26:33.760357 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2904/5760] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:26:34.693545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:34.694123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:34.700980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:34.701476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:34.701933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:34.702634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:34.703147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:34.703687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:34.838310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:34.847590 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d0b85a5-6f1a-43dc-9ea3-69680540acd6 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1314 microversion: 2.1 time: 0.158005 Sep 19 15:26:34.848203 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2857/5761] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:34 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:35.875817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:35.876438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:35.882716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:35.883227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:35.883665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:35.884350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:35.884807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:35.885234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:36.013908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:36.021650 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9754b137-0fe3-450e-92b3-e7ac31e6178d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1463 microversion: 2.1 time: 0.151831 Sep 19 15:26:36.022219 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2905/5762] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:35 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:36.044759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee18bb33-1786-4861-af49-a3dc4e7bd9a9", "device": "/dev/sdb"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:36.047327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:36.054734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:36.055273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:36.055733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:36.056442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:36.057048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:36.057502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:36.291619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5689cd3f-81a6-49ff-9828-75d8f46635bf tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "POST /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251218 Sep 19 15:26:36.292228 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2858/5763] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:26:36 2022] POST /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:26:42.257249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:42.362627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:42.363158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:42.369157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:42.369639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:42.370075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:42.370766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:42.371235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:42.371954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:42.396506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:26:42.473522 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ae26dd4d-b63a-4802-bb45-e91ad5b4938d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 204 len: 0 microversion: 2.1 time: 0.220650 Sep 19 15:26:42.474189 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2906/5764] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:26:42 2022] DELETE /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:26:42.481837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:42.482632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:42.487297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:42.488052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:42.495310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:42.495815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:42.496293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:42.497103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:42.497580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:42.498024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:42.632769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:42.641239 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-786572d9-c206-41ff-8f92-4693650fc58a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1579 microversion: 2.1 time: 0.161747 Sep 19 15:26:42.641833 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2859/5765] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:42 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:43.666896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:43.667797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:43.675960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:43.676519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:43.677292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:43.677989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:43.678447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:43.678901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:43.815215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:43.823030 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c1780419-ee99-487d-9f9e-c98256ebee5e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1579 microversion: 2.1 time: 0.161050 Sep 19 15:26:43.823611 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2907/5766] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:43 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:44.846314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:44.846999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:44.853620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:44.854137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:44.854593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:44.855339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:44.856036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:44.856525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:44.964325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:44.973048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-486e0a51-86b1-470f-91e7-585f14da6bd2 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1511 microversion: 2.1 time: 0.130543 Sep 19 15:26:44.973777 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2860/5767] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:44 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1511 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:45.196595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d1ffd536-659b-494f-bd08-ad82ce9944c3 req-0e9c1008-208e-4a22-9344-f5b919eb7a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22d8ac3-3ac5-402b-baa0-25023166d87a", "name": "network-vif-deleted", "tag": "5eb7807b-6261-4288-92f0-5914879d9973"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:45.209113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1ffd536-659b-494f-bd08-ad82ce9944c3 req-0e9c1008-208e-4a22-9344-f5b919eb7a30 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:45.209601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1ffd536-659b-494f-bd08-ad82ce9944c3 req-0e9c1008-208e-4a22-9344-f5b919eb7a30 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:45.210095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1ffd536-659b-494f-bd08-ad82ce9944c3 req-0e9c1008-208e-4a22-9344-f5b919eb7a30 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:45.227736 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d1ffd536-659b-494f-bd08-ad82ce9944c3 req-0e9c1008-208e-4a22-9344-f5b919eb7a30 service nova] Creating event network-vif-deleted:5eb7807b-6261-4288-92f0-5914879d9973 for instance e22d8ac3-3ac5-402b-baa0-25023166d87a on n-h1-858384-1 Sep 19 15:26:45.238962 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d1ffd536-659b-494f-bd08-ad82ce9944c3 req-0e9c1008-208e-4a22-9344-f5b919eb7a30 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046039 Sep 19 15:26:45.240012 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2908/5768] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:26:45.997911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:45.999272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:46.007150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:46.007672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:46.008136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:46.008889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:46.009374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:46.009827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:46.084884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:46.094153 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5f01f53b-e3c9-469a-9498-9ba65ebe7247 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1226 microversion: 2.1 time: 0.100666 Sep 19 15:26:46.094775 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2861/5769] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:45 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:47.119108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:47.119839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:47.138959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:47.139466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:47.139916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:47.140628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:47.141114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:47.141526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:47.215212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:47.223796 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c9e7d4c3-f026-442c-b232-a39b051755ca tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1226 microversion: 2.1 time: 0.109772 Sep 19 15:26:47.224663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2909/5770] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:47 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:48.248357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:48.249702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:48.256775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:48.257283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:48.257736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:48.258449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:48.258984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:48.259424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:48.333351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:48.343583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79c36685-c6d7-4322-8f6d-935ffea8afbd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1226 microversion: 2.1 time: 0.099600 Sep 19 15:26:48.344713 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2862/5771] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:48 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:49.366583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:49.367239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:49.375042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:49.375531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:49.375968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:49.376671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:49.377126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:49.377555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:49.451217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:49.460497 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-65060b9a-af34-4d9d-9545-b0e1a9cabd18 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 200 len: 1226 microversion: 2.1 time: 0.097718 Sep 19 15:26:49.461157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2910/5772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:49 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:50.485887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:50.486524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:50.493464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:50.494007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:50.494462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:50.495206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:50.495683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:50.496134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:50.509466 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a HTTP/1.1 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'e22d8ac3-3ac5-402b-baa0-25023166d87a'} Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:26:50.511174 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3499f3a3-e60b-4d42-a255-02083427d1ff tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 404 len: 111 microversion: 2.1 time: 0.031028 Sep 19 15:26:50.524843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2863/5773] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:50 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:26:50.571774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1704068093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1897289911", "security_groups": [{"name": "tempest-secgroup-smoke-2084711474"}], "block_device_mapping_v2": [{"uuid": "fed3a634-8b45-46b8-9c2a-9b3e92cf7ac0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:50.690114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:26:51.078896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:26:51.079401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:26:51.079889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:26:51.080309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:26:51.080725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:26:51.089864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:51.090406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:51.090903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:51.091642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:51.092101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:51.092528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:51.109792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:26:51.115030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:26:51.175109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:26:51.177261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fed3a634-8b45-46b8-9c2a-9b3e92cf7ac0',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:26:51.317597 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b31135eb-ffb9-42ab-8fc0-e62e20a54b03 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749623 Sep 19 15:26:51.318452 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2911/5774] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:26:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:26:51.330721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbf4c1da-8049-4005-890f-241d7a52ae24 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:51.331827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbf4c1da-8049-4005-890f-241d7a52ae24 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:51.401650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbf4c1da-8049-4005-890f-241d7a52ae24 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:51.410450 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbf4c1da-8049-4005-890f-241d7a52ae24 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1095 microversion: 2.1 time: 0.083861 Sep 19 15:26:51.411589 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2864/5775] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:51 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:52.434444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:52.435824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:52.448829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:52.450108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:52.450389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:52.451012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:52.451723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:52.453036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:52.543687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:52.557880 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-498fb38b-c5ad-4e2b-b6aa-adb500111a8f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1193 microversion: 2.1 time: 0.128103 Sep 19 15:26:52.559192 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2912/5776] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:52 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:53.586195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:53.587465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:53.598428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:53.599122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:53.602841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:53.603941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:53.604696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:53.608604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:54.007365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:54.016322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01472b3c-f81d-4aac-9aa9-6ed29f9c4f01 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1279 microversion: 2.1 time: 0.434490 Sep 19 15:26:54.018600 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2865/5777] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:53 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1279 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:54.413081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4e99fe0e-0859-46e5-ab56-d5bc73d1fd24 req-6ca824e9-2983-427d-9cb7-208323b7a8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce18a175-2ec8-4a7d-a212-dc83c95a6424", "tag": "79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:26:54.437151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4e99fe0e-0859-46e5-ab56-d5bc73d1fd24 req-6ca824e9-2983-427d-9cb7-208323b7a8bb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:54.437937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4e99fe0e-0859-46e5-ab56-d5bc73d1fd24 req-6ca824e9-2983-427d-9cb7-208323b7a8bb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:54.438397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4e99fe0e-0859-46e5-ab56-d5bc73d1fd24 req-6ca824e9-2983-427d-9cb7-208323b7a8bb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:54.465823 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4e99fe0e-0859-46e5-ab56-d5bc73d1fd24 req-6ca824e9-2983-427d-9cb7-208323b7a8bb service nova] Creating event network-changed:79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5 for instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 on n-h1-858384-1 Sep 19 15:26:54.479068 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4e99fe0e-0859-46e5-ab56-d5bc73d1fd24 req-6ca824e9-2983-427d-9cb7-208323b7a8bb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065205 Sep 19 15:26:54.480803 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2913/5778] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:26:55.044850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:55.046123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:55.054126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:55.054724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:55.055376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:55.056290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:55.056934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:55.057692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:55.291021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:55.301948 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-747ee87e-500c-4dbb-8de7-9c34b7ad49d4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1279 microversion: 2.1 time: 0.262482 Sep 19 15:26:55.319870 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2866/5779] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:55 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:56.328969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:56.329930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:56.336428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:56.336912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:56.337343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:56.338032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:56.338481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:56.338935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:56.490230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:56.497991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:56.500563 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0920b940-f5af-4bab-bacd-ef9a2fe3c712 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1279 microversion: 2.1 time: 0.177658 Sep 19 15:26:56.502194 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2914/5780] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:56 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:57.523798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:57.527541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:57.530546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:57.537053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:57.537718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:57.538371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:57.539166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:57.539923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:57.540624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:57.544948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:57.694390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:57.705269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-195fc199-797b-4f91-9705-5f180bacc35e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1279 microversion: 2.1 time: 0.186106 Sep 19 15:26:57.706075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2867/5781] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:57 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:26:58.728215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:58.728934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:58.732005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:26:58.738451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:58.738978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:58.739424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:58.740134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:58.741198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:58.741637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:58.884321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:26:58.892987 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1cada07-6eda-4fa4-8813-b31c149896c6 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.168686 Sep 19 15:26:58.893576 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2915/5782] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:58 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:26:59.916447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:26:59.917155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:26:59.925356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:59.925875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:59.926361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:26:59.927157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:26:59.927640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:26:59.928094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:00.068139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:00.076601 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f9bddbcb-2e52-4ccf-bee0-d9235214fb0d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.164227 Sep 19 15:27:00.077205 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2868/5783] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:26:59 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:01.100401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:01.100927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:01.103773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:01.109901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:01.110399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:01.110872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:01.111607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:01.112066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:01.112494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:01.127890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:01.252049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:01.259957 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2fa06a7f-246d-4c32-984f-7f2a03fcad0b tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.163658 Sep 19 15:27:01.260639 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2916/5784] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:01 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:02.283647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:02.284372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:02.287637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:02.294182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:02.294705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:02.295302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:02.296023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:02.296499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:02.296953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:02.438190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:02.446592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61883996-5418-4995-94f8-6bbdb407d142 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.166851 Sep 19 15:27:02.452833 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2869/5785] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:02 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:03.469848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:03.470469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:03.477390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:03.477909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:03.478352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:03.479082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:03.479542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:03.480595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:03.616679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:03.624534 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-541daeee-bf39-4078-8211-8f6e510bd18f tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.158632 Sep 19 15:27:03.625110 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2917/5786] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:03 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:04.649128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:04.649929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:04.657761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:04.658281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:04.658740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:04.659526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:04.660142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:04.660589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:04.798107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:04.806238 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fc80e1be-925a-49e3-b4a9-f15c16cd4a4a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.162155 Sep 19 15:27:04.806832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2870/5787] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:04 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:05.829888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:05.830511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:05.837490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:05.837977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:05.838420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:05.839799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:05.840308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:05.840738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:05.977880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:05.985863 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d5bf7ebe-c981-43ed-aef9-521467d571a8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.159909 Sep 19 15:27:05.986438 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2918/5788] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:05 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:07.008771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:07.009417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:07.017506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:07.018147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:07.018600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:07.019347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:07.019820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:07.020269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:07.165103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:07.173922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8895af06-8ac1-4b67-a6cb-306fda819408 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.169152 Sep 19 15:27:07.174785 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2871/5789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:07 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:08.130977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-564c5576-acb8-416f-a6cd-2330aa4c27ce req-b51b1e5e-caa1-4304-b58c-5a71f3a9a70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce18a175-2ec8-4a7d-a212-dc83c95a6424", "name": "network-vif-plugged", "status": "completed", "tag": "79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:27:08.143660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-564c5576-acb8-416f-a6cd-2330aa4c27ce req-b51b1e5e-caa1-4304-b58c-5a71f3a9a70c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:08.144915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-564c5576-acb8-416f-a6cd-2330aa4c27ce req-b51b1e5e-caa1-4304-b58c-5a71f3a9a70c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:08.146113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-564c5576-acb8-416f-a6cd-2330aa4c27ce req-b51b1e5e-caa1-4304-b58c-5a71f3a9a70c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:08.160382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-564c5576-acb8-416f-a6cd-2330aa4c27ce req-b51b1e5e-caa1-4304-b58c-5a71f3a9a70c service nova] Creating event network-vif-plugged:79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5 for instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 on n-h1-858384-1 Sep 19 15:27:08.166468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-564c5576-acb8-416f-a6cd-2330aa4c27ce req-b51b1e5e-caa1-4304-b58c-5a71f3a9a70c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039699 Sep 19 15:27:08.167654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2919/5790] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:27:08.199907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:08.201205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:08.209468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:08.210042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:08.210637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:08.211552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:08.212132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:08.212776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:08.438846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:08.448230 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a4169f1a-c10e-4a25-b079-c25c379dfe59 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1267 microversion: 2.1 time: 0.255292 Sep 19 15:27:08.449135 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2872/5791] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:08 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:09.472693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:09.473415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:09.482165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:09.482903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:09.483356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:09.484071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:09.484540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:09.484977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:09.627008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:09.634851 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f2e15082-b4d5-4310-a13c-af21912b5e22 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1455 microversion: 2.1 time: 0.166657 Sep 19 15:27:09.635428 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2920/5792] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:09 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:09.658332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:09.659043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:09.666489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:09.667579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:09.668549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:09.669300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:09.669779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:09.670406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:09.808849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:09.816750 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41eae002-d1a1-4e1a-b369-de3da2a98dec tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1455 microversion: 2.1 time: 0.163840 Sep 19 15:27:09.817322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2873/5793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:09 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:12.003516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5f0db5ac-5ed3-4fae-9934-308e6606ab74 req-cf48129c-0a1d-4a75-bfb9-2b6e75ba0fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce18a175-2ec8-4a7d-a212-dc83c95a6424", "tag": "79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:27:12.014524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5f0db5ac-5ed3-4fae-9934-308e6606ab74 req-cf48129c-0a1d-4a75-bfb9-2b6e75ba0fd2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:12.015041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5f0db5ac-5ed3-4fae-9934-308e6606ab74 req-cf48129c-0a1d-4a75-bfb9-2b6e75ba0fd2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:12.015474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5f0db5ac-5ed3-4fae-9934-308e6606ab74 req-cf48129c-0a1d-4a75-bfb9-2b6e75ba0fd2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:12.027249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5f0db5ac-5ed3-4fae-9934-308e6606ab74 req-cf48129c-0a1d-4a75-bfb9-2b6e75ba0fd2 service nova] Creating event network-changed:79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5 for instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 on n-h1-858384-1 Sep 19 15:27:12.033010 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5f0db5ac-5ed3-4fae-9934-308e6606ab74 req-cf48129c-0a1d-4a75-bfb9-2b6e75ba0fd2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Sep 19 15:27:12.034147 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2921/5794] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:27:39.900254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:39.900757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:39.902953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=13 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:39.903741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=41 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:39.909609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:39.910106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:39.910552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:39.911277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:39.911749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:39.912186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:40.075859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lazy-loading 'services' on Instance uuid 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:27:40.152059 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7a6f6a15-ad27-40c2-85bb-e03e16c2abf9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "DELETE /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855/os-volume_attachments/ee18bb33-1786-4861-af49-a3dc4e7bd9a9" status: 202 len: 0 microversion: 2.1 time: 0.255713 Sep 19 15:27:40.152681 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2874/5795] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:27:39 2022] DELETE /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855/os-volume_attachments/ee18bb33-1786-4861-af49-a3dc4e7bd9a9 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:27:45.526070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=13 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:45.526865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=35 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:45.531149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:45.531750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:45.538829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:45.539261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:45.539704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:45.540397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:45.540870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:45.541276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:45.567983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:27:45.640434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc132d78-e229-4919-a6a2-51445c02637d tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "DELETE /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 204 len: 0 microversion: 2.1 time: 0.116288 Sep 19 15:27:45.641016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2922/5796] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:27:45 2022] DELETE /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:27:45.651026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:45.651726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:45.658137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:45.658646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:45.659131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:45.659840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:45.660315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:45.660774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:45.797465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:45.805616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-345e3644-71c7-4ab4-85ae-39984931fae4 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1469 microversion: 2.1 time: 0.160027 Sep 19 15:27:45.806220 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2875/5797] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:45 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:46.831209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:46.831836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:46.839253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:46.839787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:46.840276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:46.840987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:46.841449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:46.841884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:47.051333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:47.060163 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-987db276-4c5a-456d-a61a-e7e9bf94b1fc tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1469 microversion: 2.1 time: 0.233405 Sep 19 15:27:47.060748 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2923/5798] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:46 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:47.680619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-31b59933-cacc-411f-9f69-c7ee770d59f1 req-7f838e8d-4140-46be-b53f-0443c3cf868f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d12fbb-26ff-4ab3-8c53-05c78e6d2855", "name": "network-vif-deleted", "tag": "adaae5c8-014a-4871-9c7b-e64134be99be"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:27:47.691622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-31b59933-cacc-411f-9f69-c7ee770d59f1 req-7f838e8d-4140-46be-b53f-0443c3cf868f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:47.692124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-31b59933-cacc-411f-9f69-c7ee770d59f1 req-7f838e8d-4140-46be-b53f-0443c3cf868f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:47.692576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-31b59933-cacc-411f-9f69-c7ee770d59f1 req-7f838e8d-4140-46be-b53f-0443c3cf868f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:47.706349 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-31b59933-cacc-411f-9f69-c7ee770d59f1 req-7f838e8d-4140-46be-b53f-0443c3cf868f service nova] Creating event network-vif-deleted:adaae5c8-014a-4871-9c7b-e64134be99be for instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 on n-h2-858384-1 Sep 19 15:27:47.713271 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-31b59933-cacc-411f-9f69-c7ee770d59f1 req-7f838e8d-4140-46be-b53f-0443c3cf868f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036746 Sep 19 15:27:47.713894 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2876/5799] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:27:48.083912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:48.085042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:48.093242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:48.093742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:48.094334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:48.095085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:48.095551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:48.095972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:48.129152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:48.129642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:48.130075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:48.130527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lazy-loading 'fault' on Instance uuid 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:27:48.176746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bd2558dcc6466d8de35e442bb28683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4898518f38164f1f831b839fd7042ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:27:48.184648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b3829c89-8043-46b5-bf25-18ba9444e5f9 tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 200 len: 1304 microversion: 2.1 time: 0.104408 Sep 19 15:27:48.185595 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2924/5800] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:48 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:27:49.211528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:49.212444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] [instance: 18d12fbb-26ff-4ab3-8c53-05c78e6d2855] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:49.220268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:49.220777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:49.221295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:49.222162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:49.222735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:49.223263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:49.238235 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] HTTP exception thrown: Instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 could not be found. Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Request method failure captured: Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 HTTP/1.1 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIog7kGvE3Wx_Au0NBtbGIMfTJ76QMB4JRhpzSO4qL0lg_bUAUOlfkALY7FqULLvwdp3DTLuCB7JkxE7hhnFHqrveinkTLXrbp6-u0c2jNlCUqnnfXpS4HfVSl295zDt5aSdyNPLJraijSehYCQpP2G10Ba1jFZJyuws5kIxzCFgBAU Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 4898518f38164f1f831b839fd7042ebc Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-VolumesBackupsTest-1423023936 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4898518f38164f1f831b839fd7042ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4898518f38164f1f831b839fd7042ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4898518f38164f1f831b839fd7042ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4898518f38164f1f831b839fd7042ebc"}]}] Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-VolumesBackupsTest-1423023936 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 4898518f38164f1f831b839fd7042ebc Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-VolumesBackupsTest-1423023936 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-VolumesBackupsTest-1423023936-project Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 74bd2558dcc6466d8de35e442bb28683 Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-VolumesBackupsTest-1423023936-project Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 could not be found. Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '18d12fbb-26ff-4ab3-8c53-05c78e6d2855'} Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 could not be found. Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 could not be found. Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:49.240230 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 could not be found. Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] Returning 404 to user: Instance 18d12fbb-26ff-4ab3-8c53-05c78e6d2855 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f8b13965-0dfe-4e8c-be96-88789e316b0f tempest-VolumesBackupsTest-1423023936 tempest-VolumesBackupsTest-1423023936-project] 10.222.0.81 "GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855" status: 404 len: 111 microversion: 2.1 time: 0.035919 Sep 19 15:27:49.246481 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2877/5801] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:27:49 2022] GET /compute/v2.1/servers/18d12fbb-26ff-4ab3-8c53-05c78e6d2855 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:28:51.027376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:28:51.028143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:28:51.029667 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:28:51.029809 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:28:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! Sep 19 15:28:51.034841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-776385726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1897289911", "security_groups": [{"name": "tempest-secgroup-smoke-2084711474"}], "block_device_mapping_v2": [{"uuid": "0ad639c9-e677-41a7-af11-e6050ca39ccc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a03fd177-61e2-4c4c-97b6-a7642499ffd9"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:28:51.162623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] validate_networks() for [('a03fd177-61e2-4c4c-97b6-a7642499ffd9', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:28:51.595394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:28:51.595897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:28:51.596456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:28:51.596885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:28:51.597308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:28:51.606448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:51.606990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:51.607438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:51.608177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:51.608649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:51.609070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:51.626334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:28:51.631731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Getting quotas for user c59cbf382b7440cb913c671016217f58 and project 52d61aef820546418b2d47ed2577eb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:28:51.691323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:28:51.693510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ad639c9-e677-41a7-af11-e6050ca39ccc',volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:28:51.821900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-526bd06f-f1b6-44cb-a615-eb32148b9922 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.796756 Sep 19 15:28:51.823790 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2925/5802] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:28:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:28:51.833127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:28:51.834936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:28:51.842030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9890c0c1-380e-4f3a-8bab-36ae90eb5570 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:51.843056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9890c0c1-380e-4f3a-8bab-36ae90eb5570 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:51.900831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9890c0c1-380e-4f3a-8bab-36ae90eb5570 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:51.908015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9890c0c1-380e-4f3a-8bab-36ae90eb5570 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1094 microversion: 2.1 time: 0.077059 Sep 19 15:28:51.908590 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2878/5803] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:51 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:28:52.931631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f2172e1-70e5-43f5-89f4-3efcc443862a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:52.939208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f2172e1-70e5-43f5-89f4-3efcc443862a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:53.007881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3f2172e1-70e5-43f5-89f4-3efcc443862a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:53.015813 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f2172e1-70e5-43f5-89f4-3efcc443862a tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1094 microversion: 2.1 time: 0.089802 Sep 19 15:28:53.016418 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2926/5804] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:52 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:28:54.039461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c990c964-46b5-4941-9f3c-9487a7309f13 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:54.040281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c990c964-46b5-4941-9f3c-9487a7309f13 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:54.129978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c990c964-46b5-4941-9f3c-9487a7309f13 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:54.144136 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c990c964-46b5-4941-9f3c-9487a7309f13 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1094 microversion: 2.1 time: 0.105402 Sep 19 15:28:54.144797 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2879/5805] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:54 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:28:55.167701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:55.168430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:55.175711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:55.176195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:55.176630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:55.177316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:55.177767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:55.178240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:55.239921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:55.248681 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb6f0e3d-9e34-46f1-acb4-2e1f5c405431 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1144 microversion: 2.1 time: 0.085645 Sep 19 15:28:55.249343 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2927/5806] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:55 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:28:56.272798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:56.274012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:56.282704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:56.283862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:56.284548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:56.285477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:56.286108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:56.286721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:56.369201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:56.379237 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08800a2c-948e-4a49-900e-9cc8f3dd9151 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1210 microversion: 2.1 time: 0.110726 Sep 19 15:28:56.380456 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2880/5807] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:56 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:28:57.410938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:57.414578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:57.427015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:57.427820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:57.428465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:57.429424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:57.430418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:57.431091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:57.624988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-34ec7647-e567-4734-8894-99f60669dbbb req-e1610380-472f-4033-8ee0-5e15e51f41d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e36a90c-570e-48ed-90c2-464c9656c3bd", "tag": "5e830856-ee9c-4b82-8776-d771b2581877"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:28:57.657586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-34ec7647-e567-4734-8894-99f60669dbbb req-e1610380-472f-4033-8ee0-5e15e51f41d2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:57.658274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-34ec7647-e567-4734-8894-99f60669dbbb req-e1610380-472f-4033-8ee0-5e15e51f41d2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:57.658947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-34ec7647-e567-4734-8894-99f60669dbbb req-e1610380-472f-4033-8ee0-5e15e51f41d2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:57.676023 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-34ec7647-e567-4734-8894-99f60669dbbb req-e1610380-472f-4033-8ee0-5e15e51f41d2 service nova] Creating event network-changed:5e830856-ee9c-4b82-8776-d771b2581877 for instance 2e36a90c-570e-48ed-90c2-464c9656c3bd on n-h2-858384-1 Sep 19 15:28:57.681372 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-34ec7647-e567-4734-8894-99f60669dbbb req-e1610380-472f-4033-8ee0-5e15e51f41d2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060518 Sep 19 15:28:57.682058 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2881/5808] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:28:57.773251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:57.781411 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a2867f48-a636-4f18-b3f2-57490a0f6ac5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1278 microversion: 2.1 time: 0.377982 Sep 19 15:28:57.798453 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2928/5809] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:57 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1278 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:28:58.805344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:28:58.806079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:28:58.813476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:58.813991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:58.814448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:58.815289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:28:58.815769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:28:58.816216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:28:59.335288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:28:59.345169 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-63f10327-bb81-42d5-936e-d9056fa279dd tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1278 microversion: 2.1 time: 0.544153 Sep 19 15:28:59.359370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2882/5810] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:28:58 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1278 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:00.368908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:00.369740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:00.384889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:00.387081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:00.387534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:00.388269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:00.388736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:00.389234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:00.559081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:00.570048 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43e9c307-a446-4601-95a1-50f6934cd44c tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1278 microversion: 2.1 time: 0.205291 Sep 19 15:29:00.584953 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2929/5811] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:00 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:01.596258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:01.597041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:01.606892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:01.607341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:01.607922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:01.608651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:01.609127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:01.609585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:01.761580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:01.769536 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6747d82e-0b56-4f2c-9395-4eb9d2d3515e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.178065 Sep 19 15:29:01.770144 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2883/5812] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:01 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:02.794474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:02.795189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:02.798099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:02.804240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:02.804728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:02.805167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:02.805894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:02.806348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:02.807412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:02.962375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:02.971869 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-02ac88d7-bfdd-4dfc-8dff-6b074ae40106 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.181928 Sep 19 15:29:02.972655 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2930/5813] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:02 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:03.999103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:03.999822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:04.008175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:04.008779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:04.009344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:04.010472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:04.011056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:04.011505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:04.135435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:04.146982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:04.155330 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-93874844-25ad-4f0d-9e80-5b499881218d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.161715 Sep 19 15:29:04.155952 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2884/5814] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:03 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:05.179482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:05.180103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:05.182345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:05.188921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:05.189407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:05.189850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:05.190544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:05.191020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:05.191446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:05.334120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:05.342474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23d75fc5-98f7-402f-93cd-4499e7ac5729 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.167083 Sep 19 15:29:05.343097 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2931/5815] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:05 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:06.366262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:06.366924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:06.373597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:06.374110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:06.374565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:06.375304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:06.375778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:06.376222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:06.513149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:06.521065 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bc96ac43-d76f-47b3-bf0d-382e0a046f88 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.159251 Sep 19 15:29:06.521649 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2885/5816] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:06 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:07.544518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:07.545255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:07.552497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:07.552990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:07.553422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:07.554122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:07.554608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:07.555088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:07.697910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:07.705850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-207d67e6-fc88-4cad-a4d1-1d901c2b7f32 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.165981 Sep 19 15:29:07.706421 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2932/5817] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:07 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:08.729904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:08.730536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:08.740103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.740886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.741352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.742079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.742554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.743025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.914951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:08.926129 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a9e6a4b-d85e-461e-ae8f-1fb7aaaee625 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.200602 Sep 19 15:29:08.931553 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2886/5818] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:08 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:09.954120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:09.954910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:09.961844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:09.962336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:09.962802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:09.963605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:09.964075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:09.964511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:10.102141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:10.110643 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc0b59fa-06b8-4538-8631-1a97b95fb9cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.160437 Sep 19 15:29:10.111391 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2933/5819] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:09 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:10.475830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d4862804-8a89-4b32-8be9-2d7f67b2b23d req-bbad3a52-00c6-454c-b764-07b22e270c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e36a90c-570e-48ed-90c2-464c9656c3bd", "name": "network-vif-plugged", "status": "completed", "tag": "5e830856-ee9c-4b82-8776-d771b2581877"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:10.489652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4862804-8a89-4b32-8be9-2d7f67b2b23d req-bbad3a52-00c6-454c-b764-07b22e270c3b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:10.490277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4862804-8a89-4b32-8be9-2d7f67b2b23d req-bbad3a52-00c6-454c-b764-07b22e270c3b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:10.491806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d4862804-8a89-4b32-8be9-2d7f67b2b23d req-bbad3a52-00c6-454c-b764-07b22e270c3b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:10.505860 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d4862804-8a89-4b32-8be9-2d7f67b2b23d req-bbad3a52-00c6-454c-b764-07b22e270c3b service nova] Creating event network-vif-plugged:5e830856-ee9c-4b82-8776-d771b2581877 for instance 2e36a90c-570e-48ed-90c2-464c9656c3bd on n-h2-858384-1 Sep 19 15:29:10.512115 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d4862804-8a89-4b32-8be9-2d7f67b2b23d req-bbad3a52-00c6-454c-b764-07b22e270c3b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040128 Sep 19 15:29:10.513214 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2887/5820] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:11.133573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:11.134274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:11.141805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:11.142399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:11.142964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:11.143737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:11.144275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:11.144815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:11.280988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:11.289158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2bf3dc9f-a8e3-4ecf-a56e-ffd07b8addc9 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1266 microversion: 2.1 time: 0.159469 Sep 19 15:29:11.289790 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2934/5821] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:11 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:12.312586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:12.313381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:12.320500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:12.321006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:12.321461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:12.322818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:12.323301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:12.323746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:12.466964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:12.475098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-db65917e-db7d-4f47-95dc-4f436eb178d3 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1454 microversion: 2.1 time: 0.166810 Sep 19 15:29:12.475750 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2888/5822] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:12 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:12.498047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:12.498660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:12.505674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:12.506161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:12.506601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:12.507342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:12.507799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:12.508227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:12.641619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:12.649607 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec9ba621-ec2b-439d-97e5-90c3e32f5d43 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1454 microversion: 2.1 time: 0.155602 Sep 19 15:29:12.662770 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2935/5823] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:12 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:14.722368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-db24aca7-107a-4594-a283-5afac771dbe0 req-e0cdc880-3ebb-4c4a-a31c-945cba848732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e36a90c-570e-48ed-90c2-464c9656c3bd", "tag": "5e830856-ee9c-4b82-8776-d771b2581877"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:14.734284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db24aca7-107a-4594-a283-5afac771dbe0 req-e0cdc880-3ebb-4c4a-a31c-945cba848732 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:14.734807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db24aca7-107a-4594-a283-5afac771dbe0 req-e0cdc880-3ebb-4c4a-a31c-945cba848732 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:14.735259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-db24aca7-107a-4594-a283-5afac771dbe0 req-e0cdc880-3ebb-4c4a-a31c-945cba848732 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:14.747171 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-db24aca7-107a-4594-a283-5afac771dbe0 req-e0cdc880-3ebb-4c4a-a31c-945cba848732 service nova] Creating event network-changed:5e830856-ee9c-4b82-8776-d771b2581877 for instance 2e36a90c-570e-48ed-90c2-464c9656c3bd on n-h2-858384-1 Sep 19 15:29:14.752442 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-db24aca7-107a-4594-a283-5afac771dbe0 req-e0cdc880-3ebb-4c4a-a31c-945cba848732 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033839 Sep 19 15:29:14.753202 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2889/5824] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:45.173348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:45.174218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=56 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:45.175279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=28 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:45.175798 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:30:45.175798 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd (ip 10.222.0.81) !!! Sep 19 15:30:45.176438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=48 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:45.179089 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:30:45.179432 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 15:30:45.180030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:45.180536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:45.181567 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:30:45.183291 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 15:30:45.188246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.188745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.189182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.190089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.190717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.191658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.228715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:30:45.296275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-092e9fb1-f164-4401-84c0-36aa2be97e3e req-2cf2416e-5ff4-4fe8-a214-c85bd7db67b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e36a90c-570e-48ed-90c2-464c9656c3bd", "tag": "5e830856-ee9c-4b82-8776-d771b2581877"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:45.307413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-092e9fb1-f164-4401-84c0-36aa2be97e3e req-2cf2416e-5ff4-4fe8-a214-c85bd7db67b7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.308946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-092e9fb1-f164-4401-84c0-36aa2be97e3e req-2cf2416e-5ff4-4fe8-a214-c85bd7db67b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.309572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-092e9fb1-f164-4401-84c0-36aa2be97e3e req-2cf2416e-5ff4-4fe8-a214-c85bd7db67b7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.322020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-092e9fb1-f164-4401-84c0-36aa2be97e3e req-2cf2416e-5ff4-4fe8-a214-c85bd7db67b7 service nova] Creating event network-changed:5e830856-ee9c-4b82-8776-d771b2581877 for instance 2e36a90c-570e-48ed-90c2-464c9656c3bd on n-h2-858384-1 Sep 19 15:30:45.328273 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-092e9fb1-f164-4401-84c0-36aa2be97e3e req-2cf2416e-5ff4-4fe8-a214-c85bd7db67b7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156384 Sep 19 15:30:45.329892 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2890/5825] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:45.379320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e74f12c-c295-4411-b2d7-4a0971a4433d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 204 len: 0 microversion: 2.1 time: 0.210834 Sep 19 15:30:45.380757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2936/5826] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:30:45 2022] DELETE /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:30:45.389926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:45.390995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:45.399927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.400631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.401719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.402842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.403513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.403971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.584334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:45.592694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ce4605d-4130-4758-abd9-ef27b7d03c34 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1579 microversion: 2.1 time: 0.207578 Sep 19 15:30:45.593607 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2891/5827] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:45 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:46.619744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:46.621343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:46.628872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:46.629364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:46.629837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:46.630540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:46.631072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:46.631497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:46.815230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:46.824104 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5e2e8a93-82e8-464f-b221-5f7c89a44c6d tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1579 microversion: 2.1 time: 0.209985 Sep 19 15:30:46.827126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2937/5828] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:46 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:47.480330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b8108f62-419b-4008-b23d-c4b868753339 req-4737c88b-320b-4d34-ae23-6e0a514116ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e36a90c-570e-48ed-90c2-464c9656c3bd", "name": "network-vif-deleted", "tag": "5e830856-ee9c-4b82-8776-d771b2581877"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:47.496519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b8108f62-419b-4008-b23d-c4b868753339 req-4737c88b-320b-4d34-ae23-6e0a514116ea service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.508763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b8108f62-419b-4008-b23d-c4b868753339 req-4737c88b-320b-4d34-ae23-6e0a514116ea service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.509502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b8108f62-419b-4008-b23d-c4b868753339 req-4737c88b-320b-4d34-ae23-6e0a514116ea service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.531886 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b8108f62-419b-4008-b23d-c4b868753339 req-4737c88b-320b-4d34-ae23-6e0a514116ea service nova] Creating event network-vif-deleted:5e830856-ee9c-4b82-8776-d771b2581877 for instance 2e36a90c-570e-48ed-90c2-464c9656c3bd on n-h2-858384-1 Sep 19 15:30:47.540958 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b8108f62-419b-4008-b23d-c4b868753339 req-4737c88b-320b-4d34-ae23-6e0a514116ea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065288 Sep 19 15:30:47.542901 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2892/5829] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:47.849215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:47.849883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:47.859740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.860243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.860687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.861434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.861892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.865084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.951977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:47.961844 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eae25484-fde3-453a-9745-4bce8953c19e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1225 microversion: 2.1 time: 0.116311 Sep 19 15:30:47.962846 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2938/5830] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:47 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:48.987983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:48.988729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:48.997200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:48.997884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:49.002306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:49.003587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:49.004072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:49.004705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:49.077723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:49.086373 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71e05e4a-163e-4a7e-9873-209a86aec3a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1225 microversion: 2.1 time: 0.104276 Sep 19 15:30:49.086991 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2893/5831] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:48 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:50.109450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:50.110070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:50.116995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:50.117486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:50.117930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:50.118629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:50.119245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:50.119677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:50.182801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:50.190918 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8945ec6-1b9d-40ba-ba4c-f1544507b6cc tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1225 microversion: 2.1 time: 0.085431 Sep 19 15:30:50.191518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2939/5832] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:50 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:51.213562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:51.214572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:51.221527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:51.222036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:51.222490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:51.223222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:51.223690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:51.224130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:51.290351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:51.299455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-795a24d2-4a00-4fbe-8b27-0f239975fc41 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 200 len: 1225 microversion: 2.1 time: 0.089828 Sep 19 15:30:51.300038 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2894/5833] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:51 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:52.322439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:52.323638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: 2e36a90c-570e-48ed-90c2-464c9656c3bd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:52.330513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:52.331039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:52.331472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:52.332163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:52.332615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:52.333034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:52.347472 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance 2e36a90c-570e-48ed-90c2-464c9656c3bd could not be found. Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd HTTP/1.1 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 2e36a90c-570e-48ed-90c2-464c9656c3bd could not be found. Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '2e36a90c-570e-48ed-90c2-464c9656c3bd'} Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e36a90c-570e-48ed-90c2-464c9656c3bd could not be found. Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e36a90c-570e-48ed-90c2-464c9656c3bd could not be found. Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:30:52.349162 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e36a90c-570e-48ed-90c2-464c9656c3bd could not be found. Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance 2e36a90c-570e-48ed-90c2-464c9656c3bd could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2cfcecec-7b6e-4760-a8b3-fa783e89b8e8 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd" status: 404 len: 111 microversion: 2.1 time: 0.032062 Sep 19 15:30:52.354157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2940/5834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:52 2022] GET /compute/v2.1/servers/2e36a90c-570e-48ed-90c2-464c9656c3bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:30:59.729443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:59.730890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:59.734035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8fedf7ac-6ddf-4915-a707-7dbbedf4a6bb req-45cf5d09-4c53-4dc6-9a0e-dfdbf4ec6b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce18a175-2ec8-4a7d-a212-dc83c95a6424", "tag": "79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:59.738511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.739232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.739862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.740759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.741398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.742002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.757586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8fedf7ac-6ddf-4915-a707-7dbbedf4a6bb req-45cf5d09-4c53-4dc6-9a0e-dfdbf4ec6b7b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.759248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8fedf7ac-6ddf-4915-a707-7dbbedf4a6bb req-45cf5d09-4c53-4dc6-9a0e-dfdbf4ec6b7b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.759908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8fedf7ac-6ddf-4915-a707-7dbbedf4a6bb req-45cf5d09-4c53-4dc6-9a0e-dfdbf4ec6b7b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.772202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:30:59.783482 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8fedf7ac-6ddf-4915-a707-7dbbedf4a6bb req-45cf5d09-4c53-4dc6-9a0e-dfdbf4ec6b7b service nova] Creating event network-changed:79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5 for instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 on n-h1-858384-1 Sep 19 15:30:59.803951 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8fedf7ac-6ddf-4915-a707-7dbbedf4a6bb req-45cf5d09-4c53-4dc6-9a0e-dfdbf4ec6b7b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074676 Sep 19 15:30:59.805483 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2941/5835] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:59.875529 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32068ee3-22d9-4b44-8085-7f1416c9b705 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 204 len: 0 microversion: 2.1 time: 0.149869 Sep 19 15:30:59.876309 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2895/5836] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:30:59 2022] DELETE /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:30:59.886703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:59.890575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:59.899782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.900276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.900767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.901983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.902611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.903113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:00.081607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:00.090032 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-61dfbb02-b2ab-410b-aa6d-b649cc9a9fa4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1580 microversion: 2.1 time: 0.209176 Sep 19 15:31:00.090628 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2942/5837] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:59 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1580 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:01.116532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:01.117172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:01.126113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.126639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.127260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.128454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.129317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.129763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.276787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:01.285354 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ae073c24-a420-4db9-9e9f-d47a1a81c4a4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1580 microversion: 2.1 time: 0.173595 Sep 19 15:31:01.286339 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2896/5838] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:01 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1580 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:01.894314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5dc2682d-f840-4946-a821-91a33537da5c req-8c02b067-c46d-473f-a477-902453678c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce18a175-2ec8-4a7d-a212-dc83c95a6424", "name": "network-vif-deleted", "tag": "79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:31:01.906452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5dc2682d-f840-4946-a821-91a33537da5c req-8c02b067-c46d-473f-a477-902453678c41 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.906867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5dc2682d-f840-4946-a821-91a33537da5c req-8c02b067-c46d-473f-a477-902453678c41 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.907231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5dc2682d-f840-4946-a821-91a33537da5c req-8c02b067-c46d-473f-a477-902453678c41 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.924209 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5dc2682d-f840-4946-a821-91a33537da5c req-8c02b067-c46d-473f-a477-902453678c41 service nova] Creating event network-vif-deleted:79219d91-01e8-4ad0-8fb6-50bdb5bdb2c5 for instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 on n-h1-858384-1 Sep 19 15:31:01.930320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5dc2682d-f840-4946-a821-91a33537da5c req-8c02b067-c46d-473f-a477-902453678c41 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039401 Sep 19 15:31:01.931238 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2943/5839] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:02.311788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:02.312552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:02.321720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:02.322645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:02.323168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:02.324617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:02.325361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:02.325979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:02.443417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:02.456077 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-619c1d59-7d64-457f-8bcf-338f4a235fd4 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1226 microversion: 2.1 time: 0.150661 Sep 19 15:31:02.469143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2897/5840] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:02 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:03.483251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:03.483877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:03.491086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:03.491621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:03.492036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:03.492731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:03.493183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:03.493606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:03.561613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:03.570394 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-63bd5425-62e4-4553-bbb0-a3dc46ad8465 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1226 microversion: 2.1 time: 0.092087 Sep 19 15:31:03.571033 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2944/5841] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:03 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:04.594324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:04.594957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:04.601811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:04.602380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:04.602870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:04.603595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:04.604074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:04.604529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:04.666693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:04.675777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eda386fe-5760-4935-a6ba-caaa4a3e76b5 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1226 microversion: 2.1 time: 0.086175 Sep 19 15:31:04.676370 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2898/5842] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:04 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:31:05.699424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:05.700401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:05.707320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:05.707813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:05.708246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:05.708938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:05.709395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:05.709819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:05.775312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59cbf382b7440cb913c671016217f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d61aef820546418b2d47ed2577eb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:05.784013 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09ce954b-7a14-40ff-9b78-6dedc8ecae8e tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 200 len: 1226 microversion: 2.1 time: 0.089358 Sep 19 15:31:05.784817 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2945/5843] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:05 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:06.807841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:06.809139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: ce18a175-2ec8-4a7d-a212-dc83c95a6424] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:06.816071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:06.816565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:06.817029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:06.817706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:06.818172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:06.818607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:06.833552 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 could not be found. Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 HTTP/1.1 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 could not be found. Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ce18a175-2ec8-4a7d-a212-dc83c95a6424'} Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 could not be found. Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 could not be found. Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:31:06.835258 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 could not be found. Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance ce18a175-2ec8-4a7d-a212-dc83c95a6424 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59ae69be-d148-4f17-a7b8-06a2827190a1 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424" status: 404 len: 111 microversion: 2.1 time: 0.032956 Sep 19 15:31:06.841619 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2899/5844] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:06 2022] GET /compute/v2.1/servers/ce18a175-2ec8-4a7d-a212-dc83c95a6424 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:31:07.285113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:07.285851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:07.293942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.294547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.295019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.296128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.296584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.297011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.312936 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a HTTP/1.1 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e22d8ac3-3ac5-402b-baa0-25023166d87a'} Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:31:07.314645 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5cfade09-0030-4a44-8314-09f80a68ed95 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 404 len: 111 microversion: 2.1 time: 0.035094 Sep 19 15:31:07.320623 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2946/5845] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:31:07 2022] DELETE /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:31:07.325372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:07.326001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] [instance: e22d8ac3-3ac5-402b-baa0-25023166d87a] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:07.332153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.332654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.333107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.333823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.334580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.334776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.349414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] HTTP exception thrown: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Request method failure captured: Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a HTTP/1.1 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIi6-uXzCbmYqP_Dzm3bSxv26dOvvPbt1JE4k8kBnU3NpvH1M4ca8B9vHwP4OmMRK3oWMgXd8ZL6ke07GrtUJvzKBnSAb2gqpqhUeXTVfuMb2K42UaZnbcFDo7ewVwWaqS20ELpRkwNLb2oHgEoWy4y01LMLDgJafvbMHcRULlNPGpU Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d61aef820546418b2d47ed2577eb6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d61aef820546418b2d47ed2577eb6c"}]}] Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 52d61aef820546418b2d47ed2577eb6c Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1406092148 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: c59cbf382b7440cb913c671016217f58 Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestVolumeBootPattern-1406092148-project Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'e22d8ac3-3ac5-402b-baa0-25023166d87a'} Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:31:07.351010 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Returning 404 to user: Instance e22d8ac3-3ac5-402b-baa0-25023166d87a could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5d836e24-73aa-4939-ba92-9cd7fef9bd50 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a" status: 404 len: 111 microversion: 2.1 time: 0.031398 Sep 19 15:31:07.356986 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2900/5846] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:07 2022] GET /compute/v2.1/servers/e22d8ac3-3ac5-402b-baa0-25023166d87a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:31:10.810577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3295c16-12db-4679-9a08-2aba5aee8fb0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] Calling method '.version_select at 0x7fde299983a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:10.876195 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3295c16-12db-4679-9a08-2aba5aee8fb0 tempest-TestVolumeBootPattern-1406092148 tempest-TestVolumeBootPattern-1406092148-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1897289911" status: 202 len: 0 microversion: 2.1 time: 0.070062 Sep 19 15:31:10.877277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2947/5847] 10.222.0.81 () {58 vars in 1263 bytes} [Mon Sep 19 15:31:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1897289911 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:32:15.314066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:15.314848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:15.482284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5917db97-d539-4fd2-91d5-64ef6292856e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: .version_select at 0x7fde29babd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1109409767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOZhyOpceRqEm5qPgC1S6q23rqsfo2b2dTZq3OK+pOk9PnKKaD3V8Q87WMidGBGQn2vWX1S/Vgw250fcbWM5agXLGND1JxIPMXuiW5LECej/TuG/nzwQaqvTJoOpdh6sw=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:32:15.497565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5917db97-d539-4fd2-91d5-64ef6292856e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:32:15.502619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5917db97-d539-4fd2-91d5-64ef6292856e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:32:15.531754 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5917db97-d539-4fd2-91d5-64ef6292856e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.219604 Sep 19 15:32:15.532362 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2901/5848] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:32:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:21.728417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:21.729788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:21.737886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-256647392", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "bc3a2dcd-a00e-4bbe-800c-fb9edbd4541c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1109409767", "security_groups": [{"name": "tempest-secgroup-smoke-2114695332"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:32:21.876075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] validate_networks() for [('bc3a2dcd-a00e-4bbe-800c-fb9edbd4541c', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:32:22.299157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:32:22.299592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:32:22.300077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:32:22.300652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:32:22.301079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:32:22.311717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:22.312235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:22.312681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:22.313424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:22.314026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:22.314613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:22.344193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:32:22.351574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:32:22.368609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:32:22.372130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:32:22.428326 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:32:23.436143 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 39944. Sep 19 15:32:23.445778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3b692681-b0f9-4cfe-b09f-26c303f6a0bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.724065 Sep 19 15:32:23.446437 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2948/5849] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:32:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:32:23.459693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-480cc204-cc95-4430-8e13-b6ae764c17c7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:23.460326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-480cc204-cc95-4430-8e13-b6ae764c17c7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:23.536756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-480cc204-cc95-4430-8e13-b6ae764c17c7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:23.545432 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-480cc204-cc95-4430-8e13-b6ae764c17c7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1266 microversion: 2.1 time: 0.090727 Sep 19 15:32:23.546023 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2902/5850] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:23 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:24.570222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:24.571735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:24.579542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:24.580164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:24.580806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:24.581726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:24.582220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:24.582646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:24.670060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:24.681278 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9655991c-8199-490d-a25d-89391e2ecda7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1318 microversion: 2.1 time: 0.115677 Sep 19 15:32:24.682721 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2949/5851] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:24 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:25.706015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:25.706706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:25.715427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:25.715935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:25.716394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:25.717110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:25.717587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:25.718037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:25.855513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:25.864341 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4042304-7375-460f-a81f-60f33924ea78 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.162660 Sep 19 15:32:25.864942 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2903/5852] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:25 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:26.117980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6bd48863-3166-4f96-b7e0-d871f0cec1d8 req-fec20bf7-1df9-44d8-9f6c-db3b5088a6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:32:26.132432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6bd48863-3166-4f96-b7e0-d871f0cec1d8 req-fec20bf7-1df9-44d8-9f6c-db3b5088a6c4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.133083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6bd48863-3166-4f96-b7e0-d871f0cec1d8 req-fec20bf7-1df9-44d8-9f6c-db3b5088a6c4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.133643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6bd48863-3166-4f96-b7e0-d871f0cec1d8 req-fec20bf7-1df9-44d8-9f6c-db3b5088a6c4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:26.145404 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6bd48863-3166-4f96-b7e0-d871f0cec1d8 req-fec20bf7-1df9-44d8-9f6c-db3b5088a6c4 service nova] Creating event network-changed:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h1-858384-1 Sep 19 15:32:26.150963 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6bd48863-3166-4f96-b7e0-d871f0cec1d8 req-fec20bf7-1df9-44d8-9f6c-db3b5088a6c4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036612 Sep 19 15:32:26.151573 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2950/5853] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:26.888059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:26.888609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:26.896164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.896669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.897125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:26.897833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.898304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.898765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:27.029244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:27.036930 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-980720b0-411e-47c9-ab44-4395c0347479 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.152937 Sep 19 15:32:27.037512 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2904/5854] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:26 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:28.062042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:28.062741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:28.069002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:28.069493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:28.069960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:28.070641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:28.071125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:28.071723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:28.211433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:28.220193 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f7a3999c-6b36-43fe-8fde-9707a4d0afa9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.163270 Sep 19 15:32:28.220775 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2951/5855] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:28 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:29.243786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:29.244413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:29.250939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:29.251545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:29.252011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:29.252722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:29.253208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:29.253657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:29.383616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:29.391856 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3bacd28-2ebc-432f-9c95-36e0788ad116 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.152353 Sep 19 15:32:29.392447 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2905/5856] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:29 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:30.416931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:30.417710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:30.424027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:30.424518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:30.424970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:30.425646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:30.426290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:30.426725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:30.561996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:30.569915 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7aeee55a-e90c-42e8-8444-a61d6672ab23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.157276 Sep 19 15:32:30.570503 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2952/5857] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:30 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:31.592720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:31.593347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:31.600090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.600596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.601046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.601752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.602239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.603395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.754236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:31.763291 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ba67a00-5d80-4e51-97a1-13c038efbd70 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.174331 Sep 19 15:32:31.765758 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2906/5858] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:31 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:31.807095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bede5740-9b98-481d-a480-21b02b382cfd req-48bca33b-3908-425d-987f-56601d94a598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "name": "network-vif-plugged", "status": "completed", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:32:31.816882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bede5740-9b98-481d-a480-21b02b382cfd req-48bca33b-3908-425d-987f-56601d94a598 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.817296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bede5740-9b98-481d-a480-21b02b382cfd req-48bca33b-3908-425d-987f-56601d94a598 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.817722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bede5740-9b98-481d-a480-21b02b382cfd req-48bca33b-3908-425d-987f-56601d94a598 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.828855 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bede5740-9b98-481d-a480-21b02b382cfd req-48bca33b-3908-425d-987f-56601d94a598 service nova] Creating event network-vif-plugged:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h1-858384-1 Sep 19 15:32:31.834052 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bede5740-9b98-481d-a480-21b02b382cfd req-48bca33b-3908-425d-987f-56601d94a598 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105297 Sep 19 15:32:31.834658 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2953/5859] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:32:32.788187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:32.788737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:32.796640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:32.797143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:32.797869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:32.798577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:32.799087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:32.799526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:32.931746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:32.940102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74965f54-9541-422a-930c-52b11e41b4cc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1392 microversion: 2.1 time: 0.156044 Sep 19 15:32:32.940675 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2907/5860] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:32 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:32:33.964648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:33.965358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:33.967333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:33.968131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:33.975262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:33.975757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:33.976202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:33.976902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:33.977428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:33.977832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:34.118514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:34.126662 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86997c11-0f7c-4b76-b206-33c6ada5d9a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1563 microversion: 2.1 time: 0.166930 Sep 19 15:32:34.127265 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2954/5861] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:33 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:34.149225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:34.149858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:34.151749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:34.158161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:34.158669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:34.159159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:34.159868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:34.160345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:34.161075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:34.293671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:34.301842 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5ea9fb22-6874-4f95-813f-5444a4c94f40 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1563 microversion: 2.1 time: 0.156456 Sep 19 15:32:34.302348 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2908/5862] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:34 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:35.865063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:35.866055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:35.873957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:35.874458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:35.875565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:35.876524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:35.876998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:35.877432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:35.937101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0fae4192-cff3-4a7e-8457-b47b38cc94b7 req-68157693-f472-45b6-a071-8b6924823465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:32:35.948648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0fae4192-cff3-4a7e-8457-b47b38cc94b7 req-68157693-f472-45b6-a071-8b6924823465 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:35.949077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0fae4192-cff3-4a7e-8457-b47b38cc94b7 req-68157693-f472-45b6-a071-8b6924823465 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:35.949533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0fae4192-cff3-4a7e-8457-b47b38cc94b7 req-68157693-f472-45b6-a071-8b6924823465 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:35.961256 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0fae4192-cff3-4a7e-8457-b47b38cc94b7 req-68157693-f472-45b6-a071-8b6924823465 service nova] Creating event network-changed:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h1-858384-1 Sep 19 15:32:35.967120 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0fae4192-cff3-4a7e-8457-b47b38cc94b7 req-68157693-f472-45b6-a071-8b6924823465 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107582 Sep 19 15:32:35.967994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2909/5863] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:36.027144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:36.036865 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6361a898-01e3-4fec-b044-a8ddbbaf579d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1563 microversion: 2.1 time: 0.182441 Sep 19 15:32:36.037740 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2955/5864] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:35 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:57.298176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:32:57.300615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:57.303579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:57.304395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=38 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:57.310436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:57.310976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:57.311439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:57.312155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:57.312643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:57.313089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:57.366216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e5720f2f-eff3-4c4c-8069-229914c4534c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action" status: 200 len: 24568 microversion: 2.1 time: 0.072531 Sep 19 15:32:57.366873 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2910/5865] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:32:57 2022] POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:33:08.383282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:08.383874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:08.386197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:08.386896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:08.393476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.393970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.394419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.395149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.395614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.396046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.694611 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d46d204-2db9-45a2-8321-e1d63e537aa1 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1833 microversion: 2.1 time: 0.315155 Sep 19 15:33:08.695337 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2956/5866] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:08 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1833 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:08.719798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:08.720588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:08.723662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:08.724457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:08.730950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.731605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.732144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.732998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.733574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.734101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.951105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:08.959868 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e68ba89-e090-43bf-b20b-e0b8116ac6d4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1682 microversion: 2.1 time: 0.245243 Sep 19 15:33:08.960464 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2911/5867] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:08 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:09.058675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:09.061056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:09.067783 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.068282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.068722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.069456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.069912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.070341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.123139 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f80df399-1a19-43da-bcb2-86f44ab4aee7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action" status: 200 len: 32644 microversion: 2.1 time: 0.068225 Sep 19 15:33:09.124029 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2957/5868] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:33:09 2022] POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action => generated 32644 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:33:09.298649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:09.299275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:09.305783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.306291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.306753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.307489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.307968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.308417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.401143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5003882cebc14c59b0a5d9785a2ad0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38b10d47415440280ec3d8f2efc37a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:09.401788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] flavor_id is None. Assuming migration. {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 19 15:33:09.402253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:33:09.588952 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-38394f7f-1c65-4e7d-b979-f34eda6a41a2 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action" status: 202 len: 0 microversion: 2.1 time: 0.294995 Sep 19 15:33:09.589561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2912/5869] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:33:09 2022] POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:33:09.599690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:09.600408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:09.608181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.608670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.609141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.610526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.611185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.611586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.781296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:09.790391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7814539d-3323-4d2b-8e45-9a637aa6b9df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1691 microversion: 2.1 time: 0.195371 Sep 19 15:33:09.791108 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2958/5870] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:09 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1691 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:10.817449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:10.818076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:10.825316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:10.825828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:10.826287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:10.827030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:10.827507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:10.827956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:10.961459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:10.969730 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-078cff7b-2c5f-4cd7-8d55-a9eec807c97a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1691 microversion: 2.1 time: 0.157218 Sep 19 15:33:10.970488 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2913/5871] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:10 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:11.994206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:11.994876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:12.003867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:12.004394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:12.004870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:12.005612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:12.006093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:12.006574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:12.140218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:12.150061 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-60c0b3ee-e2a3-41dd-ba0c-523a8dfaefd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1691 microversion: 2.1 time: 0.159830 Sep 19 15:33:12.151093 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2959/5872] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:11 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:13.177025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:13.177681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:13.184616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:13.185125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:13.185584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:13.186296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:13.186865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:13.187319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:13.319931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:13.327653 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87f6d570-0d35-48b2-bfdc-d0b32ad5f4c9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1691 microversion: 2.1 time: 0.155392 Sep 19 15:33:13.328226 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2914/5873] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:13 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:14.351460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:14.352120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:14.359414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:14.359912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:14.360359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:14.361072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:14.361540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:14.362540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:14.506432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:14.514653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd31bed5-c1c9-462e-a09e-b624b1da1ea0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1691 microversion: 2.1 time: 0.167047 Sep 19 15:33:14.515302 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2960/5874] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:14 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:15.539551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:15.540189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:15.547126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:15.547919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:15.548393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:15.549752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:15.550237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:15.550716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:15.687132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:15.695004 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3ba35ad2-7cd1-486f-a7fe-b48e32e4a7bd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.159289 Sep 19 15:33:15.695522 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2915/5875] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:15 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:16.718204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:16.718843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:16.726437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:16.726966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:16.727411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:16.728103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:16.728562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:16.728991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:16.857560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:16.865347 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a26ecde-97c3-4ccf-8cf3-5eb1a9e8ba05 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.151044 Sep 19 15:33:16.865920 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2961/5876] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:16 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:17.888728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:17.889275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:17.899295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:17.899803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:17.900256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:17.900981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:17.901445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:17.901882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:18.055429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:18.064525 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d625b2ea-c5ed-441f-a1dd-77d2bdf48607 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.179894 Sep 19 15:33:18.066113 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2916/5877] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:17 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:19.089838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:19.090533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:19.097963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:19.098451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:19.098942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:19.099865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:19.100381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:19.100808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:19.261135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:19.269367 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-76dec364-90f6-4f16-bcb5-ac3a3aeff938 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.183449 Sep 19 15:33:19.269951 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2962/5878] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:19 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:20.293474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:20.295252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:20.302098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:20.302608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:20.303091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:20.303802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:20.304278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:20.304728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:20.437882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:20.446306 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba596ade-9461-4292-982b-528c756b4ec4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.156827 Sep 19 15:33:20.446921 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2917/5879] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:20 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:21.470132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:21.471380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:21.478374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:21.478901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:21.479348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:21.480048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:21.480513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:21.480941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:21.615969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:21.623864 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-428ad121-6af6-4c54-93f1-cc640d280a15 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.157687 Sep 19 15:33:21.624448 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2963/5880] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:21 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:22.648900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:22.649468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:22.656338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:22.656842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:22.657296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:22.657998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:22.658530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:22.659082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:22.794229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:22.802800 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9bf04011-3e50-4759-ba41-edcb1bd07321 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.157946 Sep 19 15:33:22.803396 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2918/5881] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:22 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:23.826718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:23.827304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:23.834268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:23.834766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:23.835227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:23.835920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:23.836379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:23.836808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:23.969124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:23.977117 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d651587-2b1d-41b3-8839-94d0bd30bcbb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.154394 Sep 19 15:33:23.977689 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2964/5882] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:23 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:25.000660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:25.001363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:25.009030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:25.009535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:25.010015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:25.010721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:25.011249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:25.011689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:25.166692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:25.174968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08c81f43-727f-43c2-aae3-7b8395edc414 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.178295 Sep 19 15:33:25.175548 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2919/5883] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:24 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:26.199289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:26.199896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:26.206897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:26.207379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:26.207815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:26.208497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:26.208953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:26.209373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:26.341774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:26.349870 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6aa058aa-7164-4fc6-a1b8-2c521c909a45 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1696 microversion: 2.1 time: 0.154465 Sep 19 15:33:26.350460 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2965/5884] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:26 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:27.373839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:27.374431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:27.382043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:27.382560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:27.383053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:27.383788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:27.384268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:27.384718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:27.821395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:27.829250 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-74403d68-fc41-400c-ac4d-d04890f57e51 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1695 microversion: 2.1 time: 0.459455 Sep 19 15:33:27.830402 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2920/5885] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:27 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1695 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:28.099839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "name": "network-vif-unplugged", "status": "completed", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:28.111717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.112204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.112644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:28.128565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] Creating event network-vif-unplugged:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h2-858384-1 Sep 19 15:33:28.134059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:33:28.146091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-4a9e31ba-0ae2-45c3-8871-033603db3610 req-24f85331-5dde-4939-88af-dc1a5ad0c0ce service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050985 Sep 19 15:33:28.146713 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2966/5886] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:28.854330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:28.855000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:28.862038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.862549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.863063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:28.863777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.864259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.864707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:29.065683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:29.073523 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76a3b063-6c7e-427f-951a-35c32204c39d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1695 microversion: 2.1 time: 0.223174 Sep 19 15:33:29.074105 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2921/5887] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:28 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:30.100272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:30.100966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:30.107717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:30.108201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:30.108642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:30.109328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:30.109779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:30.110204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:30.169601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:30.188047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:30.188995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:30.190424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:30.207381 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] Creating event network-changed:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h2-858384-1 Sep 19 15:33:30.213163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:33:30.225974 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-9cdde93b-4a64-4c7b-9ae9-bf42690af04f req-0f9d374d-f261-4e95-9167-ca689fabf7d3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062174 Sep 19 15:33:30.226613 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2922/5888] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:30.259260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:30.267402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91ae96aa-d1da-4f55-b68d-c93f47e879f0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1693 microversion: 2.1 time: 0.171961 Sep 19 15:33:30.267991 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2967/5889] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:30 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:31.292991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:31.293720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:31.301041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.301598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.302056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.302790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.303274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.303723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.439433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:31.447592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-96dbca44-b076-445a-ada2-5f487e1a7704 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1690 microversion: 2.1 time: 0.159931 Sep 19 15:33:31.448185 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2923/5890] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:31 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:31.471603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:31.472349 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:31.479255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.479748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.480194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.480930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.481389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.481828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.539872 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-197e80f0-a274-41c6-9fc7-3ca4b4fad71a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action" status: 204 len: 0 microversion: 2.1 time: 0.072452 Sep 19 15:33:31.540423 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2968/5891] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:33:31 2022] POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:33:31.549030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:31.549663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:31.555654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.556272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.556744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.557837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.558293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.558962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.704136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:31.713752 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c2164f1-76c7-47af-ac54-efb1025eff7c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1690 microversion: 2.1 time: 0.168986 Sep 19 15:33:31.714451 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2924/5892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:31 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:32.741195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:32.741915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:32.749201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:32.749693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:32.750160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:32.750890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:32.751425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:32.752434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:32.889935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:32.899179 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-81b0afe9-cee8-4365-aee5-06b9eea92a0b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1690 microversion: 2.1 time: 0.163099 Sep 19 15:33:32.899757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2969/5893] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:32 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:33.923174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:33.923819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:33.931435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:33.931942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:33.932397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:33.933102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:33.933578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:33.934023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:34.069555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:34.077422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-342e5b51-a211-4ba1-9a7d-7052809b6cd5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1682 microversion: 2.1 time: 0.158528 Sep 19 15:33:34.078017 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2925/5894] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:33 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:35.580315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d77d305e-880f-4757-9bb4-100c8fd260f0 req-fa79d59f-7837-496f-a69b-95cef503579c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "name": "network-vif-plugged", "status": "completed", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:35.591550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d77d305e-880f-4757-9bb4-100c8fd260f0 req-fa79d59f-7837-496f-a69b-95cef503579c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:35.592031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d77d305e-880f-4757-9bb4-100c8fd260f0 req-fa79d59f-7837-496f-a69b-95cef503579c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:35.592464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d77d305e-880f-4757-9bb4-100c8fd260f0 req-fa79d59f-7837-496f-a69b-95cef503579c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:35.604906 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d77d305e-880f-4757-9bb4-100c8fd260f0 req-fa79d59f-7837-496f-a69b-95cef503579c service nova] Creating event network-vif-plugged:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h2-858384-1 Sep 19 15:33:35.610003 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d77d305e-880f-4757-9bb4-100c8fd260f0 req-fa79d59f-7837-496f-a69b-95cef503579c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Sep 19 15:33:35.610614 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2970/5895] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:56.273081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:33:56.275379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:56.278059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:56.278760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:56.284667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:56.285181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:56.285643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:56.286360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:56.286878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:56.287329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:56.341359 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28be58d0-b7a0-4e44-81d4-ba6daf03ac56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action" status: 200 len: 24577 microversion: 2.1 time: 0.072237 Sep 19 15:33:56.342310 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2926/5896] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:33:56 2022] POST /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:34:02.578764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=30 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:02.579652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:02.584831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:02.585564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:02.593373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:02.593858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:02.594295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:02.595075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:02.595530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:02.595956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:02.726081 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9e503603-a1b0-4fbf-a737-931d3d21d87a tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1833 microversion: 2.1 time: 0.149501 Sep 19 15:34:02.726644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2971/5897] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:02 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:03.566211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:03.571544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-80b43e38-e133-4c70-9ebc-0fe043496b50 req-a675d04f-89e8-462d-88e7-8a843ecfa4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:03.581717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-80b43e38-e133-4c70-9ebc-0fe043496b50 req-a675d04f-89e8-462d-88e7-8a843ecfa4df service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.582308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-80b43e38-e133-4c70-9ebc-0fe043496b50 req-a675d04f-89e8-462d-88e7-8a843ecfa4df service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.582560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:03.582730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-80b43e38-e133-4c70-9ebc-0fe043496b50 req-a675d04f-89e8-462d-88e7-8a843ecfa4df service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.589894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.590400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.591189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.591590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.592203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.592655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.594272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-80b43e38-e133-4c70-9ebc-0fe043496b50 req-a675d04f-89e8-462d-88e7-8a843ecfa4df service nova] Creating event network-changed:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h2-858384-1 Sep 19 15:34:03.604437 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-80b43e38-e133-4c70-9ebc-0fe043496b50 req-a675d04f-89e8-462d-88e7-8a843ecfa4df service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036391 Sep 19 15:34:03.605237 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2972/5898] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:03.621307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:34:03.710552 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0fe384d9-9c31-4025-9bcb-78b18805be1c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 204 len: 0 microversion: 2.1 time: 0.148969 Sep 19 15:34:03.715003 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2927/5899] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:34:03 2022] DELETE /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:34:03.721871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:03.722777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:03.730471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.731007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.731458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.732171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.732801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.733243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.885508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:03.893642 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91b61a38-5240-4b45-849d-f2d47f430aa4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1688 microversion: 2.1 time: 0.176709 Sep 19 15:34:03.894228 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2973/5900] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:03 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:04.918812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:04.919655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:04.928410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:04.928916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:04.929371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:04.930093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:04.930703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:04.931178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:05.235325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:05.244102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2506ccb2-c930-4e63-91f7-3c1d4bd370a4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 200 len: 1688 microversion: 2.1 time: 0.329555 Sep 19 15:34:05.244700 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2928/5901] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:04 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 1688 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:05.619525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-255cbab2-8a3c-4b3c-b1ca-2761e12b4613 req-b6d48102-c487-4782-83df-68b94215a5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121956c8-3581-49e0-9fcf-f9e4635672f0", "name": "network-vif-deleted", "tag": "8c40ce65-68ad-4ac3-b3fa-13e948ff61f4"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:05.629881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-255cbab2-8a3c-4b3c-b1ca-2761e12b4613 req-b6d48102-c487-4782-83df-68b94215a5d3 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:05.630424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-255cbab2-8a3c-4b3c-b1ca-2761e12b4613 req-b6d48102-c487-4782-83df-68b94215a5d3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:05.631292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-255cbab2-8a3c-4b3c-b1ca-2761e12b4613 req-b6d48102-c487-4782-83df-68b94215a5d3 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:05.643104 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-255cbab2-8a3c-4b3c-b1ca-2761e12b4613 req-b6d48102-c487-4782-83df-68b94215a5d3 service nova] Creating event network-vif-deleted:8c40ce65-68ad-4ac3-b3fa-13e948ff61f4 for instance 121956c8-3581-49e0-9fcf-f9e4635672f0 on n-h2-858384-1 Sep 19 15:34:05.647846 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-255cbab2-8a3c-4b3c-b1ca-2761e12b4613 req-b6d48102-c487-4782-83df-68b94215a5d3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033016 Sep 19 15:34:05.648448 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2974/5902] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:06.268622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:06.269207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 121956c8-3581-49e0-9fcf-f9e4635672f0] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:06.277508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:06.277994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:06.278443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:06.279173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:06.279675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:06.280110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:06.294789 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] HTTP exception thrown: Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 could not be found. Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Request method failure captured: Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 HTTP/1.1 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIt-VlMM_8Y4XykJA2AsX3VKYUuHcUKVervCnkDgIjYpgdCC-naMCUUSRGDwF4cUeX1gYw6H7IhuSB2kjLw5v5pQ2vtwYgdUVboUCxIXDBXe-J9ej_gOmr396TwN600sfFU9YIhZAbUBFAKi5AE-Zjlscc1JJ_trc3lJCL94A2lKM9o Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}] Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 0fb4f5f68f5b4c9182b28bd7b1ba973b Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 could not be found. Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '121956c8-3581-49e0-9fcf-f9e4635672f0'} Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 could not be found. Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 could not be found. Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:34:06.296470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 could not be found. Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Returning 404 to user: Instance 121956c8-3581-49e0-9fcf-f9e4635672f0 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b6b3c8d7-0f29-4122-8058-2314aecc4b90 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0" status: 404 len: 111 microversion: 2.1 time: 0.033281 Sep 19 15:34:06.302957 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2929/5903] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:06 2022] GET /compute/v2.1/servers/121956c8-3581-49e0-9fcf-f9e4635672f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:34:09.375809 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:34:09.376332 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1109409767 (ip 10.222.0.81) !!! Sep 19 15:34:09.382711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2563c63a-564c-4f71-bad9-8589c2a044dd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '.version_select at 0x7fde2e136dc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:09.417865 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2563c63a-564c-4f71-bad9-8589c2a044dd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1109409767" status: 202 len: 0 microversion: 2.1 time: 0.040880 Sep 19 15:34:09.420593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2975/5904] 10.222.0.81 () {58 vars in 1284 bytes} [Mon Sep 19 15:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1109409767 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:34:09.450419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0e2bb38-1030-41fe-a2dd-37efe4c2bce2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: .version_select at 0x7fde2a9e3c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1593628756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGphw5O4Z4OW2QfKuq6lbjuNN8OLA06yq1AYARLbe4ssg0G1LNz1rIWxg686ckhK/vL38KoStpqZmo6BRjQYJJHXTCmVQex6TiKL2f7aF5sUd18x/nYwpKAWs0vf51zrbQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:09.468256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f0e2bb38-1030-41fe-a2dd-37efe4c2bce2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:34:09.473378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f0e2bb38-1030-41fe-a2dd-37efe4c2bce2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:34:09.501447 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0e2bb38-1030-41fe-a2dd-37efe4c2bce2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054716 Sep 19 15:34:09.508330 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2930/5905] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:34:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:15.761002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=16 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:15.765979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1234093853", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "bc305596-9c6a-4580-b627-9629c8d52220"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1593628756", "security_groups": [{"name": "tempest-secgroup-smoke-325228692"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:15.884438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] validate_networks() for [('bc305596-9c6a-4580-b627-9629c8d52220', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:34:16.331115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:34:16.331543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:34:16.332053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:34:16.332466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:34:16.332893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:34:16.341975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:16.342457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:16.342934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:16.343667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:16.344126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:16.344561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:16.363490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:34:16.369716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:34:16.382621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:34:16.385126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:34:16.436409 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-59e3dcd3-36b2-4d78-8361-a73550770cf6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.677059 Sep 19 15:34:16.437888 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2976/5906] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:34:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:34:16.450845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:16.459041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88404d08-908e-48bd-8e70-4010298a82c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:16.460630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88404d08-908e-48bd-8e70-4010298a82c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:16.526984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88404d08-908e-48bd-8e70-4010298a82c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:16.535220 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88404d08-908e-48bd-8e70-4010298a82c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1267 microversion: 2.1 time: 0.086085 Sep 19 15:34:16.539090 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2931/5907] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:16 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:17.561132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:17.561746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:17.581588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:17.585503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:17.586230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:17.587807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:17.588933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:17.589368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:17.679872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:17.690390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70eb6050-115d-4d84-8cb6-e79134b3c6a3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1337 microversion: 2.1 time: 0.134017 Sep 19 15:34:17.691044 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2977/5908] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:17 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1337 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:18.714529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:18.715858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:18.725135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:18.725674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:18.726295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:18.726964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:18.727437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:18.728535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:18.872083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:18.881103 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-86e0fc36-2cfa-4639-aacc-2acebf3fcfdc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1392 microversion: 2.1 time: 0.169730 Sep 19 15:34:18.881841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2932/5909] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:18 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:19.125357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c9a8fb38-dae9-4738-89f9-f7fa0b7c38f7 req-46eab621-4c80-46d0-9df2-bdfdc606e081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:19.138884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c9a8fb38-dae9-4738-89f9-f7fa0b7c38f7 req-46eab621-4c80-46d0-9df2-bdfdc606e081 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:19.139379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c9a8fb38-dae9-4738-89f9-f7fa0b7c38f7 req-46eab621-4c80-46d0-9df2-bdfdc606e081 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:19.139798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c9a8fb38-dae9-4738-89f9-f7fa0b7c38f7 req-46eab621-4c80-46d0-9df2-bdfdc606e081 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:19.152769 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c9a8fb38-dae9-4738-89f9-f7fa0b7c38f7 req-46eab621-4c80-46d0-9df2-bdfdc606e081 service nova] Creating event network-changed:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:34:19.158070 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c9a8fb38-dae9-4738-89f9-f7fa0b7c38f7 req-46eab621-4c80-46d0-9df2-bdfdc606e081 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037041 Sep 19 15:34:19.158683 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2978/5910] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:19.905750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:19.906330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:19.913818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:19.914325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:19.914799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:19.915509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:19.915983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:19.916425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:20.047398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:20.056335 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f99b94b-9b0f-40ef-a2ea-ad3bd9f775bf tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1392 microversion: 2.1 time: 0.154685 Sep 19 15:34:20.056910 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2933/5911] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:19 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:21.082529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:21.083490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:21.090517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:21.091034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:21.091469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:21.092171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:21.092621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:21.093050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:21.242092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:21.250493 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-880fe738-d89e-47d9-8af6-ba0ca3751fd9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1392 microversion: 2.1 time: 0.174938 Sep 19 15:34:21.251104 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2979/5912] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:21 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:22.274164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:22.274742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:22.282374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:22.282938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:22.283402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:22.284124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:22.284603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:22.285055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:22.416923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:22.424901 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68f4da0f-5b1f-444c-b297-17cbbbd94c42 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1392 microversion: 2.1 time: 0.154890 Sep 19 15:34:22.425481 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2934/5913] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:22 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:23.449306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:23.449943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:23.456813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:23.457310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:23.457824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:23.458661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:23.459151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:23.459588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:23.593957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:23.602434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e60d4f3-ab54-466f-9f17-9718f616198a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1392 microversion: 2.1 time: 0.157041 Sep 19 15:34:23.603037 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2980/5914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:23 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:24.177562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-aa0d8047-12db-46ff-8447-224a34e7e059 req-1a1c149c-3e22-4dce-aac8-93663c53e3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "name": "network-vif-plugged", "status": "completed", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:24.190091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aa0d8047-12db-46ff-8447-224a34e7e059 req-1a1c149c-3e22-4dce-aac8-93663c53e3ee service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.190958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aa0d8047-12db-46ff-8447-224a34e7e059 req-1a1c149c-3e22-4dce-aac8-93663c53e3ee service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.191425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aa0d8047-12db-46ff-8447-224a34e7e059 req-1a1c149c-3e22-4dce-aac8-93663c53e3ee service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.203834 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-aa0d8047-12db-46ff-8447-224a34e7e059 req-1a1c149c-3e22-4dce-aac8-93663c53e3ee service nova] Creating event network-vif-plugged:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:34:24.209098 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-aa0d8047-12db-46ff-8447-224a34e7e059 req-1a1c149c-3e22-4dce-aac8-93663c53e3ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036481 Sep 19 15:34:24.209968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2935/5915] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:24.624952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:24.625522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:24.632330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.632818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.633260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.633960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.634419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.634873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.767475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:24.775853 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c3ef56b-0a14-42cf-80e0-fcaf6e9f172c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1392 microversion: 2.1 time: 0.155009 Sep 19 15:34:24.776450 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2981/5916] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:24 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:25.799496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:25.800161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:25.808067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.808571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.809020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.809723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.810194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.810636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.941391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:25.949370 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7275ed76-3f46-491c-a63e-b1f7de216c56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1564 microversion: 2.1 time: 0.154564 Sep 19 15:34:25.949947 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2936/5917] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:25 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:25.972239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:25.972864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:25.980228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.980717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.981177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.981854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.982314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.982796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:26.116639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:26.124682 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-38d8eaf6-41f8-44f6-9e50-db24ea4a4802 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1564 microversion: 2.1 time: 0.156414 Sep 19 15:34:26.125261 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2982/5918] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:25 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:27.725859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:27.726496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:27.728701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:27.728968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e4b19da1-aae9-4fc9-b946-05a496ff7c3e req-20c71b43-1183-49af-9d9a-ceabb5b32fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:27.730256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:27.734685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:27.735685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:27.736466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.737440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.738118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.740053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.740581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.741024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.743842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e4b19da1-aae9-4fc9-b946-05a496ff7c3e req-20c71b43-1183-49af-9d9a-ceabb5b32fdc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.744322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e4b19da1-aae9-4fc9-b946-05a496ff7c3e req-20c71b43-1183-49af-9d9a-ceabb5b32fdc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.744752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e4b19da1-aae9-4fc9-b946-05a496ff7c3e req-20c71b43-1183-49af-9d9a-ceabb5b32fdc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.756816 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e4b19da1-aae9-4fc9-b946-05a496ff7c3e req-20c71b43-1183-49af-9d9a-ceabb5b32fdc service nova] Creating event network-changed:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:34:27.762604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e4b19da1-aae9-4fc9-b946-05a496ff7c3e req-20c71b43-1183-49af-9d9a-ceabb5b32fdc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037372 Sep 19 15:34:27.763663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2983/5919] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:27.887394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:27.896414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2695beac-edc2-4dd5-980b-41fd8fe19d57 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1564 microversion: 2.1 time: 0.174821 Sep 19 15:34:27.897154 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2937/5920] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:27 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:49.147463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:49.148315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:49.152743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:34:49.155115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:49.163367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:49.163790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:49.164227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:49.164922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:49.165374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:49.165797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:49.313992 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eee5f35e-9a0d-4285-b74d-fc73bf4af10c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action" status: 200 len: 24565 microversion: 2.1 time: 0.169057 Sep 19 15:34:49.314672 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2984/5921] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:34:49 2022] POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action => generated 24565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:35:00.315458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:00.316097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:00.319237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:00.320034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:00.326161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.326669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.327151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.327861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.328336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.328780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.459854 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-425a15c2-17ab-4835-91d8-e86e91c7cc4d tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1834 microversion: 2.1 time: 0.148145 Sep 19 15:35:00.460446 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2938/5922] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:00 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1834 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:00.484279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:00.484973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:00.487627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:00.488831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:00.495136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.495623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.496069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.496760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.497216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.497640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.635328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:00.643087 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f67a3681-3e9b-43b2-9953-06fe4ea29acd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1683 microversion: 2.1 time: 0.163002 Sep 19 15:35:00.643663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2985/5923] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:00 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:00.741306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:00.743590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:00.749580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.750088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.750540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.751280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.751750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.752192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.804312 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c45057a6-b06b-416f-a522-33cb33d3bce6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action" status: 200 len: 32636 microversion: 2.1 time: 0.067161 Sep 19 15:35:00.804630 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2939/5924] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:35:00 2022] POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action => generated 32636 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:35:00.960798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:00.961387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:00.967794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.968288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.968728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.969424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.969886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.970316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.012001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5003882cebc14c59b0a5d9785a2ad0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38b10d47415440280ec3d8f2efc37a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:01.012001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] flavor_id is None. Assuming migration. {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 19 15:35:01.012001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:35:01.185656 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc41feb0-bfa9-40e9-b368-07198086fbbd tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action" status: 202 len: 0 microversion: 2.1 time: 0.228707 Sep 19 15:35:01.186443 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2986/5925] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:35:00 2022] POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:35:01.196243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:01.196969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:01.204909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:01.205829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:01.206289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.207158 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:01.207857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:01.208426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.391743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:01.400451 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c3ae58d-c463-4a36-9d0d-9bb8f53c964e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1692 microversion: 2.1 time: 0.209648 Sep 19 15:35:01.401049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2940/5926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:01 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1692 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:02.425910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:02.426647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:02.433808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:02.434316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:02.436077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:02.436077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:02.436077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:02.436449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:02.587727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:02.596510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-788668fc-00e6-4311-83a3-9182332eac39 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1692 microversion: 2.1 time: 0.175897 Sep 19 15:35:02.597208 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2987/5927] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:02 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:03.620694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:03.621350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:03.628122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:03.628617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:03.629269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:03.630059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:03.630532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:03.630996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:03.766278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:03.774823 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bb56c6a-ac81-4bd7-b2dc-f916d3e0bf1b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.157919 Sep 19 15:35:03.775393 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2941/5928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:03 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:04.799029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:04.799625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:04.807322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:04.807812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:04.808250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:04.808932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:04.809383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:04.809805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:04.941401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:04.949197 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebd98389-b092-41a7-80f5-f3b8d56847e7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.154366 Sep 19 15:35:04.949776 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2988/5929] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:04 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:05.975418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:05.976052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:05.982901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:05.983403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:05.983854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:05.984552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:05.985047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:05.985490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:06.117186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:06.124988 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-872e6612-075a-4392-9304-08eee5e76834 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.155352 Sep 19 15:35:06.125568 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2942/5930] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:05 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:07.148544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:07.149770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:07.156111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:07.156599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:07.157038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:07.157735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:07.158186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:07.158611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:07.295044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:07.303772 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-050bea08-700d-4ab5-8466-e8c06162b640 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.159386 Sep 19 15:35:07.304347 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2989/5931] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:07 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:08.327823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:08.328589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:08.336223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:08.336726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:08.337180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:08.337881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:08.338351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:08.338964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:08.474059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:08.481875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83dd497c-944b-480a-a75a-8d1f2077d3a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.158035 Sep 19 15:35:08.482447 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2943/5932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:08 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:09.506445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:09.507344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:09.514102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:09.514588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:09.515059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:09.515746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:09.516200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:09.516624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:09.654368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:09.662689 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebae5e84-07fc-4829-a930-e757b7df2325 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.161198 Sep 19 15:35:09.663290 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2990/5933] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:09 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:10.687028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:10.687687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:10.695367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:10.695972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:10.696432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:10.697161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:10.697707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:10.698196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:10.833287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:10.841040 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83900e32-c172-4c2e-ab86-2d9ca87c498b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.158309 Sep 19 15:35:10.841619 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2944/5934] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:10 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:11.865770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:11.866391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:11.873400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:11.873891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:11.874330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:11.875129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:11.875590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:11.876015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:12.149026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:12.157066 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a40230ac-5ae5-4c5a-9bfb-33b6056166f6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.295979 Sep 19 15:35:12.157647 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2991/5935] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:11 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:13.182237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:13.182900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:13.189846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:13.190351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:13.190826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:13.191534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:13.192034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:13.193252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:13.449571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:13.457312 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bec94720-bbc8-4d9a-a574-bd7459c6101b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.279069 Sep 19 15:35:13.457921 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2945/5936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:13 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:14.480838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:14.481460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:14.488423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:14.488919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:14.489362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:14.490259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:14.490720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:14.491183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:14.623244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:14.631575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e3281b48-635a-4b66-a0dd-3b3a2556029b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.154775 Sep 19 15:35:14.632157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2992/5937] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:14 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:15.655059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:15.655697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:15.663136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:15.663644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:15.664102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:15.664811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:15.665289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:15.665736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:15.804623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:15.812463 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7065193a-e002-4d7b-8aad-a11cfcd2ffe5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.161347 Sep 19 15:35:15.813061 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2946/5938] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:15 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:16.836730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:16.837346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:16.844196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:16.844686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:16.845132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:16.845824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:16.846281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:16.846711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:16.979975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:16.987750 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-284dd94b-9447-432a-a461-8e4cfb193d4c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.155518 Sep 19 15:35:16.988336 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2993/5939] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:16 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:18.011930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:18.012562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:18.019491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:18.020008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:18.021137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:18.021870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:18.022347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:18.022816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:18.156197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:18.164522 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7582b1cf-af11-4d4a-a9f3-064547f0b9f1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.156645 Sep 19 15:35:18.165110 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2947/5940] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:18 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:19.189030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:19.189588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:19.196441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:19.196930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:19.197364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:19.198048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:19.198500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:19.198959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:19.331471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:19.339388 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6d525b0-3f10-4ac0-b9d6-924e0e858440 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1697 microversion: 2.1 time: 0.154403 Sep 19 15:35:19.339964 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2994/5941] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:19 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:20.313264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "name": "network-vif-unplugged", "status": "completed", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:20.324630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:20.325273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:20.325794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:20.339699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] Creating event network-vif-unplugged:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h2-858384-1 Sep 19 15:35:20.345377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:35:20.357195 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7bb3ca2d-bca6-4661-9be6-ab3249ef90a8 req-accf4d2d-b475-4c69-87c5-dc3c19c840a9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047167 Sep 19 15:35:20.358319 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2948/5942] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:20.361739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:20.362364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:20.369295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:20.370038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:20.370486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:20.371224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:20.371687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:20.372121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:20.623088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:20.631558 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bba12478-86a1-4890-a9ba-efd2e74667eb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1696 microversion: 2.1 time: 0.273111 Sep 19 15:35:20.632158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2995/5943] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:20 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:21.656074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:21.656717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:21.662949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:21.663459 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:21.663929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:21.664639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:21.665118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:21.665570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:21.804714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:21.812543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0861a4a2-e800-4099-a207-97a0da9c9041 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1694 microversion: 2.1 time: 0.161905 Sep 19 15:35:21.813121 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2949/5944] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:21 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:22.394302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:22.405591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.406074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.406506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:22.420005 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] Creating event network-changed:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h2-858384-1 Sep 19 15:35:22.426080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:35:22.439919 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-775c950f-5caf-4f8e-b6ac-262f8951fec2 req-4834631a-2545-4284-9b54-fb359b15cdf7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049421 Sep 19 15:35:22.441485 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2996/5945] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:22.839380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:22.841052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:22.851507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.852016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.852480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:22.853207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.853679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.854169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:23.100830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:23.110545 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d15be0e5-63c3-438b-ac76-03193ffe885c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1694 microversion: 2.1 time: 0.278208 Sep 19 15:35:23.111525 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2950/5946] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:22 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1694 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:24.136694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:24.137387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:24.143655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.144137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.144573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.145257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.145708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.146139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.281241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:24.289678 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20edcb7b-bde0-4a22-b976-e3beae742665 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1691 microversion: 2.1 time: 0.158065 Sep 19 15:35:24.290262 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2997/5947] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:24 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:24.314710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:24.315350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:24.322441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.323021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.323485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.324208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.324690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.325138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.464272 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e07f756-e64c-4746-9324-807877bf6781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action" status: 202 len: 0 microversion: 2.1 time: 0.153305 Sep 19 15:35:24.464956 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2951/5948] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:35:24 2022] POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:35:24.473100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:24.473772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:24.480685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.481183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.481668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.482587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.483208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.483677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.741257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:24.749155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ccc3ce39-fa6a-49ec-9488-0d57a76739a5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1690 microversion: 2.1 time: 0.279969 Sep 19 15:35:24.749767 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2998/5949] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:24 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1690 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:25.773990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:25.774773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:25.780868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.781373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.781824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:25.782532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.783033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.783473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:25.922110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:25.934553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "name": "network-vif-plugged", "status": "completed", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:25.946086 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f666d78c-b0f0-45df-991d-8c45232a89d1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1690 microversion: 2.1 time: 0.177110 Sep 19 15:35:25.946707 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2952/5950] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:25 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:25.950565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.951073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.951519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:25.964463 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] Creating event network-vif-plugged:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h2-858384-1 Sep 19 15:35:25.970774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:35:25.983334 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-60db7fad-ba59-4bc8-8f9c-48b7823a0fa5 req-b535b8c9-efb8-4afb-a963-ed8d4f2c55de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052449 Sep 19 15:35:25.984034 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 2999/5951] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:26.969917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:26.970543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:26.977780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:26.978285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:26.978737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:26.979462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:26.980081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:26.980520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:26.996573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:27.119238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:27.127539 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e2bc8a23-a5c1-4797-92a4-f56714febbfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1690 microversion: 2.1 time: 0.161483 Sep 19 15:35:27.128246 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2953/5952] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:26 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:27.738497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "name": "network-vif-unplugged", "status": "completed", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:27.749486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:27.750055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:27.750561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:27.763715 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] Creating event network-vif-unplugged:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:35:27.766867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:27.770928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:35:27.784077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-235ce0da-23fd-4d8c-b839-a2ae88ab29e7 req-70cfdd25-f609-41fe-918c-373efdfe9492 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101333 Sep 19 15:35:27.784841 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3000/5953] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:28.152396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:28.153027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:28.159856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:28.160372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:28.160832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:28.161555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:28.162033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:28.162544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:28.303622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:28.311609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-73ebeba7-12f1-4e40-a0d9-1bffc3498261 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1690 microversion: 2.1 time: 0.163230 Sep 19 15:35:28.312200 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2954/5954] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:28 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:29.337548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:29.338281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:29.344746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.345241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.345677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.346367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.346856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.347286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.485742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:29.493996 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ada0cf4-510e-4eab-9c42-d26657c9cd53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1690 microversion: 2.1 time: 0.162212 Sep 19 15:35:29.494624 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3001/5955] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:29 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:29.800779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:29.811685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.812180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.812623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.829145 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] Creating event network-changed:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:35:29.837813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:35:29.854073 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-81d1880b-c593-475f-9317-e3e7a6794160 req-755fcd1f-c886-46c7-8240-d9f3410344ad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057494 Sep 19 15:35:29.854960 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2955/5956] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:30.517822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:30.519171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:30.526293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=37 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:30.528189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:30.528916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:30.529579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:30.531111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:30.531761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:30.532573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:30.765842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:30.774292 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f7f06d8-8157-4d02-a510-d7a30d4d0804 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1683 microversion: 2.1 time: 0.260426 Sep 19 15:35:30.775110 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3002/5957] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:30 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1683 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:32.588390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-991494eb-b4ca-40be-af95-fe804afbc656 req-7999954d-271d-42b2-b96e-bcb52a3d3044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "name": "network-vif-plugged", "status": "completed", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:32.594575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=41 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:32.601984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-991494eb-b4ca-40be-af95-fe804afbc656 req-7999954d-271d-42b2-b96e-bcb52a3d3044 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:32.602484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-991494eb-b4ca-40be-af95-fe804afbc656 req-7999954d-271d-42b2-b96e-bcb52a3d3044 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:32.602960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-991494eb-b4ca-40be-af95-fe804afbc656 req-7999954d-271d-42b2-b96e-bcb52a3d3044 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:32.614079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-991494eb-b4ca-40be-af95-fe804afbc656 req-7999954d-271d-42b2-b96e-bcb52a3d3044 service nova] Creating event network-vif-plugged:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:35:32.619837 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-991494eb-b4ca-40be-af95-fe804afbc656 req-7999954d-271d-42b2-b96e-bcb52a3d3044 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035725 Sep 19 15:35:32.620459 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2956/5958] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:54.983412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:54.985814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:54.988869 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:54.989527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:54.996658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:54.997148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:54.997587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:54.998283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:54.998740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:54.999193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:55.055107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a50069e2-197f-49dc-bcbb-13fc44766464 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action" status: 200 len: 63071 microversion: 2.1 time: 0.075471 Sep 19 15:35:55.055798 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3003/5959] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:35:54 2022] POST /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5/action => generated 63071 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:36:01.356912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:01.357677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=15 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:01.359099 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:36:01.359336 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 (ip 10.222.0.81) !!! Sep 19 15:36:01.364478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:01.365850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:01.374287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:01.374833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:01.375297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:01.376013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:01.376570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:01.376942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:01.507970 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ecfc432-8600-472d-b5de-811ed80eac4e tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1834 microversion: 2.1 time: 0.153189 Sep 19 15:36:01.508549 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2957/5960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:01 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1834 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:03.099574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:03.100307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:03.100517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2ad7e745-b601-4ed6-9ade-9e90d57ff00e req-e9cc2a83-dc6d-4033-a9bc-792c7c599a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:03.108583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.110259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.110794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.110993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2ad7e745-b601-4ed6-9ade-9e90d57ff00e req-e9cc2a83-dc6d-4033-a9bc-792c7c599a68 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.111310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2ad7e745-b601-4ed6-9ade-9e90d57ff00e req-e9cc2a83-dc6d-4033-a9bc-792c7c599a68 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.111652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.112152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2ad7e745-b601-4ed6-9ade-9e90d57ff00e req-e9cc2a83-dc6d-4033-a9bc-792c7c599a68 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.112302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.112741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.124881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2ad7e745-b601-4ed6-9ade-9e90d57ff00e req-e9cc2a83-dc6d-4033-a9bc-792c7c599a68 service nova] Creating event network-changed:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:36:03.131590 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2ad7e745-b601-4ed6-9ade-9e90d57ff00e req-e9cc2a83-dc6d-4033-a9bc-792c7c599a68 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Sep 19 15:36:03.133205 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2958/5961] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:36:03.142167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:36:03.233244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-db76d380-a078-48fa-b938-1921ece1987a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 204 len: 0 microversion: 2.1 time: 0.138141 Sep 19 15:36:03.245428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:03.246518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:03.246833 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3004/5962] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:36:03 2022] DELETE /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:36:03.254262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.255028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.256453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.257429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.258151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.258601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.408527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:03.414521 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d7504fb-1b57-474f-b20e-cf38bedfbd7d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1570 microversion: 2.1 time: 0.174323 Sep 19 15:36:03.415156 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2959/5963] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:03 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:04.440083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:04.441145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:04.448694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:04.449480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:04.449932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:04.450635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:04.451126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:04.451552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:04.623379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:04.631545 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-45cc51ad-c6ba-44ce-8699-dae9e9cc8a74 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 200 len: 1570 microversion: 2.1 time: 0.196119 Sep 19 15:36:04.632138 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3005/5964] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:04 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:05.155728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4f1f7d41-62cc-44a9-9b08-10bc2cdc91f1 req-10120540-c97a-4437-9302-95b27813da26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9482953-1b26-4a1d-890c-49e1adb07bf5", "name": "network-vif-deleted", "tag": "ff6147fc-0f3d-462e-98ed-cf011f54ed73"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:05.166081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4f1f7d41-62cc-44a9-9b08-10bc2cdc91f1 req-10120540-c97a-4437-9302-95b27813da26 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:05.166692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4f1f7d41-62cc-44a9-9b08-10bc2cdc91f1 req-10120540-c97a-4437-9302-95b27813da26 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:05.167380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4f1f7d41-62cc-44a9-9b08-10bc2cdc91f1 req-10120540-c97a-4437-9302-95b27813da26 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:05.179763 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4f1f7d41-62cc-44a9-9b08-10bc2cdc91f1 req-10120540-c97a-4437-9302-95b27813da26 service nova] Creating event network-vif-deleted:ff6147fc-0f3d-462e-98ed-cf011f54ed73 for instance e9482953-1b26-4a1d-890c-49e1adb07bf5 on n-h1-858384-1 Sep 19 15:36:05.184938 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4f1f7d41-62cc-44a9-9b08-10bc2cdc91f1 req-10120540-c97a-4437-9302-95b27813da26 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088518 Sep 19 15:36:05.185612 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2960/5965] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:36:05.654267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:05.654827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: e9482953-1b26-4a1d-890c-49e1adb07bf5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:05.661933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:05.662429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:05.662906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:05.663636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:05.664098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:05.664525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:05.679097 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] HTTP exception thrown: Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 could not be found. Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Request method failure captured: Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 HTTP/1.1 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIt-VlMM_8Y4XykJA2AsX3VKYUuHcUKVervCnkDgIjYpgdCC-naMCUUSRGDwF4cUeX1gYw6H7IhuSB2kjLw5v5pQ2vtwYgdUVboUCxIXDBXe-J9ej_gOmr396TwN600sfFU9YIhZAbUBFAKi5AE-Zjlscc1JJ_trc3lJCL94A2lKM9o Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}] Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 0fb4f5f68f5b4c9182b28bd7b1ba973b Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 could not be found. Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e9482953-1b26-4a1d-890c-49e1adb07bf5'} Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 could not be found. Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 could not be found. Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:36:05.680748 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 could not be found. Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Returning 404 to user: Instance e9482953-1b26-4a1d-890c-49e1adb07bf5 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0804bf34-239a-4adb-bc1c-15a4ea188876 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5" status: 404 len: 111 microversion: 2.1 time: 0.031900 Sep 19 15:36:05.686716 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3006/5966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:05 2022] GET /compute/v2.1/servers/e9482953-1b26-4a1d-890c-49e1adb07bf5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:36:08.844192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ec1be301-b29e-4178-87f6-61e93ee4f214 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '.version_select at 0x7fde299f4e50>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:08.865959 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ec1be301-b29e-4178-87f6-61e93ee4f214 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1593628756" status: 202 len: 0 microversion: 2.1 time: 0.032936 Sep 19 15:36:08.866825 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2961/5967] 10.222.0.81 () {58 vars in 1284 bytes} [Mon Sep 19 15:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1593628756 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:36:08.900097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aab134fb-463f-47fc-a09e-1f27c34995f9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: .version_select at 0x7fde29d1e0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-183293435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyKM1o5JJFVTe8Bgv5W+vAp6uBb59p9HFHCvlBRGZIG1LAhswaSFK34G+/KAUDvSt7gWTJGFnom8b9+EXNDlppk35fRw05+0rmVuhKEWRgne5GTMvo5Isg27mdkheenVA=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:08.921258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-aab134fb-463f-47fc-a09e-1f27c34995f9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:36:08.926818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-aab134fb-463f-47fc-a09e-1f27c34995f9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:36:08.954619 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aab134fb-463f-47fc-a09e-1f27c34995f9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058558 Sep 19 15:36:08.955504 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3007/5968] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:36:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:36:14.878496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-256132126", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "49a1f332-8703-4494-9051-c4e620ecd3d2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-183293435", "security_groups": [{"name": "tempest-secgroup-smoke-1287501926"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:14.993220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] validate_networks() for [('49a1f332-8703-4494-9051-c4e620ecd3d2', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:36:15.172148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:15.536808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:36:15.537260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:36:15.537761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:36:15.538281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:36:15.538633 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:36:15.551312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:15.552343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:15.553013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:15.554345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:15.555363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:15.556018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:15.580134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:36:15.587155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:36:15.603047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:36:15.605819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:36:15.661006 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2616765-0131-4ed9-807f-bf7f77a49e17 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787465 Sep 19 15:36:15.662291 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2962/5969] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:36:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:36:15.671577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:15.677486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a08a4b41-af17-43e0-9e6e-d992b083c2fd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:15.678423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a08a4b41-af17-43e0-9e6e-d992b083c2fd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:15.747032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a08a4b41-af17-43e0-9e6e-d992b083c2fd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:15.754464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a08a4b41-af17-43e0-9e6e-d992b083c2fd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1265 microversion: 2.1 time: 0.084629 Sep 19 15:36:15.757267 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3008/5970] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:15 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:16.781608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:16.783132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:16.791681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:16.792458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:16.793125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:16.794027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:16.794674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:16.795326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:16.905499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:16.916688 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cba7714d-b608-4e4f-971e-1e7999c4719a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1335 microversion: 2.1 time: 0.140594 Sep 19 15:36:16.918143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2963/5971] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:16 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:17.946385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:17.947639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:17.957516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:17.959087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:17.959546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:17.960290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:17.960760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:17.961201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:18.220281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:18.229400 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c668f828-57b4-411a-b4f1-2a64fab0631c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.287717 Sep 19 15:36:18.230207 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3009/5972] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:17 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:18.450055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0ce3647e-0ef5-42e3-9613-78d6336397a5 req-d7092ecc-0039-4a63-925a-e3ae6352cbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:18.467755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ce3647e-0ef5-42e3-9613-78d6336397a5 req-d7092ecc-0039-4a63-925a-e3ae6352cbdf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:18.470462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ce3647e-0ef5-42e3-9613-78d6336397a5 req-d7092ecc-0039-4a63-925a-e3ae6352cbdf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:18.472441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0ce3647e-0ef5-42e3-9613-78d6336397a5 req-d7092ecc-0039-4a63-925a-e3ae6352cbdf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:18.489915 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0ce3647e-0ef5-42e3-9613-78d6336397a5 req-d7092ecc-0039-4a63-925a-e3ae6352cbdf service nova] Creating event network-changed:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h2-858384-1 Sep 19 15:36:18.496404 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0ce3647e-0ef5-42e3-9613-78d6336397a5 req-d7092ecc-0039-4a63-925a-e3ae6352cbdf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054734 Sep 19 15:36:18.497201 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2964/5973] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:36:19.252838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:19.253484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:19.260989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:19.261478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:19.261932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:19.262628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:19.263124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:19.263553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:19.407333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:19.416160 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-717028ab-97e7-4a50-9241-ee54a331928d tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.167276 Sep 19 15:36:19.416755 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3010/5974] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:19 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:20.440064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:20.441157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:20.448504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:20.449010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:20.449469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:20.450187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:20.450659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:20.451136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:20.584160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:20.592041 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df46652e-b14f-4e35-bf27-6e46ee07f3e3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.156455 Sep 19 15:36:20.592623 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2965/5975] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:20 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:21.617072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:21.617745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:21.624572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:21.625127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:21.625673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:21.626648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:21.627177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:21.627615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:21.762170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:21.769936 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea2c9201-8eda-415b-b2d9-cf6661878bc4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.157157 Sep 19 15:36:21.770514 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3011/5976] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:21 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:22.793262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:22.793922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:22.801293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:22.801795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:22.802245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:22.802993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:22.803465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:22.803903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:23.177092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:23.185289 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4d24c8c2-53b3-4588-9869-5bc97373b429 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.396413 Sep 19 15:36:23.185873 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2966/5977] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:22 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:24.207866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:24.208628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:24.217157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:24.217896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:24.218707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:24.219524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:24.219997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:24.220431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:24.367512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:24.375500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25f67353-86c2-4a9f-b7e0-a51438ef5d7b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.171583 Sep 19 15:36:24.376090 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3012/5978] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:24 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:24.551416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8d59a1d3-fdda-4169-be10-b86a592abe06 req-f8ec3c98-d35c-44dd-877d-10264d3995e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "name": "network-vif-plugged", "status": "completed", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:24.562265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8d59a1d3-fdda-4169-be10-b86a592abe06 req-f8ec3c98-d35c-44dd-877d-10264d3995e7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:24.562698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8d59a1d3-fdda-4169-be10-b86a592abe06 req-f8ec3c98-d35c-44dd-877d-10264d3995e7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:24.563175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8d59a1d3-fdda-4169-be10-b86a592abe06 req-f8ec3c98-d35c-44dd-877d-10264d3995e7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:24.574458 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8d59a1d3-fdda-4169-be10-b86a592abe06 req-f8ec3c98-d35c-44dd-877d-10264d3995e7 service nova] Creating event network-vif-plugged:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h2-858384-1 Sep 19 15:36:24.579531 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8d59a1d3-fdda-4169-be10-b86a592abe06 req-f8ec3c98-d35c-44dd-877d-10264d3995e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087875 Sep 19 15:36:24.580144 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2967/5979] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:36:25.398079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:25.398827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:25.401452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:25.407169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:25.407668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:25.408120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:25.408832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:25.409296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:25.409736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:25.541824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:25.549777 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-12481f05-c28f-4514-ba1e-1a85197695cd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1391 microversion: 2.1 time: 0.155647 Sep 19 15:36:25.550352 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3013/5980] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:25 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:26.572394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:26.573239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:26.577796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:26.578507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:26.585475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:26.586151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:26.586603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:26.587327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:26.587795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:26.588232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:26.730412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:26.738270 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b7a99b8-3480-4b9d-834c-8e08125f399b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1562 microversion: 2.1 time: 0.168489 Sep 19 15:36:26.738881 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2968/5981] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:26 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:26.761273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:26.761894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:26.763825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:26.769895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:26.770382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:26.770865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:26.771563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:26.772020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:26.772447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:26.905048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:26.912866 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-639ed6be-8e60-41ba-8b9d-bf5a6a5399e9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1562 microversion: 2.1 time: 0.155647 Sep 19 15:36:26.913447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3014/5982] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:26 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:28.509720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:28.510921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:28.517138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e1a8c983-30a9-4897-be2c-177cde1fc5f7 req-58195c3a-fb6e-486f-a37a-38d0a374b392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:28.528690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e1a8c983-30a9-4897-be2c-177cde1fc5f7 req-58195c3a-fb6e-486f-a37a-38d0a374b392 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:28.529420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e1a8c983-30a9-4897-be2c-177cde1fc5f7 req-58195c3a-fb6e-486f-a37a-38d0a374b392 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:28.529954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e1a8c983-30a9-4897-be2c-177cde1fc5f7 req-58195c3a-fb6e-486f-a37a-38d0a374b392 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:28.530899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:28.531420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:28.532133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:28.532863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:28.533319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:28.533756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:28.546283 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e1a8c983-30a9-4897-be2c-177cde1fc5f7 req-58195c3a-fb6e-486f-a37a-38d0a374b392 service nova] Creating event network-changed:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h2-858384-1 Sep 19 15:36:28.551883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e1a8c983-30a9-4897-be2c-177cde1fc5f7 req-58195c3a-fb6e-486f-a37a-38d0a374b392 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051351 Sep 19 15:36:28.552613 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3015/5983] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:36:28.761937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:28.769821 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b8d995b-df32-49a5-8624-5068f63f314f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1562 microversion: 2.1 time: 0.272428 Sep 19 15:36:28.770591 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2969/5984] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:28 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:50.062922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=5 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:50.063680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=38 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:50.067872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:36:50.070155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:50.077399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:50.077888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:50.078327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:50.079074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:50.079538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:50.079970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:50.131249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-864ffda0-33c2-498b-b1af-8313b51413c6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action" status: 200 len: 24573 microversion: 2.1 time: 0.070075 Sep 19 15:36:50.131907 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3016/5985] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:36:50 2022] POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:37:01.201029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:01.201665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:01.204047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:01.204720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=36 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:01.211110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.211615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.212065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.212769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.213239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.213676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.346571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:01.354382 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3cceaf37-b55d-4234-a4a6-71f5a9cd1ed2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1681 microversion: 2.1 time: 0.158319 Sep 19 15:37:01.354989 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2970/5986] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:01 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:01.463115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:01.465481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:01.468223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:01.468887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:01.475068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.475558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.476003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.476699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.477156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.477583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.528410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f2c611a-37ad-417b-9b84-087ff7f78aea tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action" status: 200 len: 32649 microversion: 2.1 time: 0.069378 Sep 19 15:37:01.529046 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3017/5987] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:37:01 2022] POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action => generated 32649 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:37:01.669782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:01.670419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:01.676658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.677170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.677629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.678334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.678836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.679287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.806425 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd0cb823-296f-4a0f-9f4f-47b31db3f6d7 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1832 microversion: 2.1 time: 0.140953 Sep 19 15:37:01.807247 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2971/5988] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:01 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1832 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:01.837846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:01.840436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:01.847548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.848038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.848479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.849207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.849668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.850096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.876074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lazy-loading 'flavor' on Instance uuid 45e84508-ad68-44bc-a4e3-94115c2043b5 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:37:01.888050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Going to try to live migrate instance to another host {{(pid=128730) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 19 15:37:03.390213 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cbe01d32-bf51-4835-9a41-3b3a8e165654 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action" status: 202 len: 0 microversion: 2.1 time: 1.556479 Sep 19 15:37:03.390983 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3018/5989] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:37:01 2022] POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action => generated 0 bytes in 1558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:37:03.401714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:03.402489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:03.410900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:03.411483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:03.412079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:03.412824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:03.413526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:03.414053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:03.591517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:03.599284 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c26b0521-5444-44e3-a64e-0cfa426f89b1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.202793 Sep 19 15:37:03.599868 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2972/5990] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:03 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:04.448945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3c367127-785a-434c-977d-374b10d37a7a req-7aac3d57-fffd-4e7f-8a3c-0a2f946ea852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "name": "network-vif-unplugged", "status": "completed", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:04.461003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3c367127-785a-434c-977d-374b10d37a7a req-7aac3d57-fffd-4e7f-8a3c-0a2f946ea852 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:04.461479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3c367127-785a-434c-977d-374b10d37a7a req-7aac3d57-fffd-4e7f-8a3c-0a2f946ea852 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:04.461906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3c367127-785a-434c-977d-374b10d37a7a req-7aac3d57-fffd-4e7f-8a3c-0a2f946ea852 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:04.473775 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3c367127-785a-434c-977d-374b10d37a7a req-7aac3d57-fffd-4e7f-8a3c-0a2f946ea852 service nova] Creating event network-vif-unplugged:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h2-858384-1 Sep 19 15:37:04.478727 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3c367127-785a-434c-977d-374b10d37a7a req-7aac3d57-fffd-4e7f-8a3c-0a2f946ea852 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034041 Sep 19 15:37:04.479563 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3019/5991] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:37:04.625304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:04.625861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:04.632087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:04.632626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:04.633095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:04.633802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:04.634272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:04.634736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:04.833821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:04.843093 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4632463-80be-4d31-8c47-f09d045317ec tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.222579 Sep 19 15:37:04.843679 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2973/5992] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:04 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:05.868246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:05.868878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:05.875122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:05.875615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:05.876061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:05.876762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:05.877226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:05.877657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:06.008352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:06.017250 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-72317bef-7f46-48d2-85a1-20a37d0926b4 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.154198 Sep 19 15:37:06.017835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3020/5993] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:05 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:06.515347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e30851d4-d831-4da2-b354-c5681c8445f0 req-582150d3-40c3-4f40-9b79-ba08cc2f6062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:06.525450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e30851d4-d831-4da2-b354-c5681c8445f0 req-582150d3-40c3-4f40-9b79-ba08cc2f6062 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:06.525941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e30851d4-d831-4da2-b354-c5681c8445f0 req-582150d3-40c3-4f40-9b79-ba08cc2f6062 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:06.526381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e30851d4-d831-4da2-b354-c5681c8445f0 req-582150d3-40c3-4f40-9b79-ba08cc2f6062 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:06.537855 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e30851d4-d831-4da2-b354-c5681c8445f0 req-582150d3-40c3-4f40-9b79-ba08cc2f6062 service nova] Creating event network-changed:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h2-858384-1 Sep 19 15:37:06.543600 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e30851d4-d831-4da2-b354-c5681c8445f0 req-582150d3-40c3-4f40-9b79-ba08cc2f6062 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031555 Sep 19 15:37:06.544438 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2974/5994] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:37:07.041460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:07.042306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:07.049628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:07.050125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:07.050571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:07.051302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:07.052003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:07.052523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:07.195820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:07.204468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-570d0b53-e3fe-4faa-9fae-86a547e26556 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.166917 Sep 19 15:37:07.205054 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3021/5995] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:07 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:08.231368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:08.232265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:08.238719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:08.239374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:08.239830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:08.240535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:08.241007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:08.241453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:08.377465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:08.385339 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f1bd51f3-a1f6-48a2-8b1b-63bfdf63dc53 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.160336 Sep 19 15:37:08.385861 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2975/5996] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:08 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:09.408912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:09.409528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:09.416728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:09.417220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:09.418393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:09.419144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:09.419601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:09.420029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:09.555519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:09.563861 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-130296a8-4ed3-4ce2-9098-5ca0e6a04bcb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.158932 Sep 19 15:37:09.564438 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3022/5997] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:09 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:10.587137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:10.587781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:10.594995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:10.595518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:10.595977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:10.596705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:10.597181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:10.597629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:11.037166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:11.045181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d57146e6-62bb-4681-8c14-64a79f2b95df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1691 microversion: 2.1 time: 0.462041 Sep 19 15:37:11.046125 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2976/5998] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:10 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1691 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:12.073406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:12.074583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:12.081597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.082108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.082543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.083281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.083752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.084185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.222082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:12.231144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87352adf-6149-47be-8958-b8fc855dc3c3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1681 microversion: 2.1 time: 0.161614 Sep 19 15:37:12.231734 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3023/5999] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:12 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:12.253770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:12.254412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:12.262042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.262556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.263246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.263986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.264443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.264892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.398597 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4ceaa20b-58c4-4594-90f9-9c63058bb266 tempest-TestNetworkAdvancedServerOps-2004402399 tempest-TestNetworkAdvancedServerOps-2004402399-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1832 microversion: 2.1 time: 0.148614 Sep 19 15:37:12.399347 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2977/6000] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:12 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1832 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:12.430502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:12.431151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:12.437179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.437673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.438111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.438847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.439306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.439734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.575089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:12.582904 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-caac6f37-86d4-41e8-a54d-06639220c76e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1681 microversion: 2.1 time: 0.156683 Sep 19 15:37:12.583475 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3024/6001] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:12 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:12.678736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:12.681000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:12.687882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.688392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.688848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.689561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.690042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.690490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.741692 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-53275980-6917-4df8-b9e3-e361e31638d3 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action" status: 200 len: 38677 microversion: 2.1 time: 0.066760 Sep 19 15:37:12.742664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2978/6002] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:37:12 2022] POST /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5/action => generated 38677 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:37:13.710111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:13.710632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:13.718378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.718903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.719352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:13.720798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.720953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-465fc81c-d5e8-4469-b023-5167edcb5644 req-7551d4ac-dbb6-461b-99dd-c8d4e2543fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:13.721385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.721385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:13.733240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-465fc81c-d5e8-4469-b023-5167edcb5644 req-7551d4ac-dbb6-461b-99dd-c8d4e2543fcf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.733739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-465fc81c-d5e8-4469-b023-5167edcb5644 req-7551d4ac-dbb6-461b-99dd-c8d4e2543fcf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.734184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-465fc81c-d5e8-4469-b023-5167edcb5644 req-7551d4ac-dbb6-461b-99dd-c8d4e2543fcf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:13.745811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-465fc81c-d5e8-4469-b023-5167edcb5644 req-7551d4ac-dbb6-461b-99dd-c8d4e2543fcf service nova] Creating event network-changed:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h1-858384-1 Sep 19 15:37:13.750488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:37:13.751489 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-465fc81c-d5e8-4469-b023-5167edcb5644 req-7551d4ac-dbb6-461b-99dd-c8d4e2543fcf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034939 Sep 19 15:37:13.752446 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2979/6003] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:37:13.839931 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-744862ee-c968-4496-b530-04ecea6cb0df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 204 len: 0 microversion: 2.1 time: 0.133388 Sep 19 15:37:13.841273 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3025/6004] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:37:13 2022] DELETE /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:37:13.850738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:13.851533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:13.861613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.862140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.862601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:13.863381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.863867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.864312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:14.089578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:14.099032 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b8c6eb6-1d4c-4f57-a4e5-5f86a1fc2953 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1687 microversion: 2.1 time: 0.253108 Sep 19 15:37:14.099617 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2980/6005] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:13 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1687 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:15.096303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-83eaf375-045e-4495-8ca4-98a631248ce3 req-76688cc9-dc64-4529-a321-626478395cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e84508-ad68-44bc-a4e3-94115c2043b5", "name": "network-vif-deleted", "tag": "d2ccc7ba-8bc2-47c3-8f38-aae3151f7883"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:15.108515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-83eaf375-045e-4495-8ca4-98a631248ce3 req-76688cc9-dc64-4529-a321-626478395cfb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:15.109649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-83eaf375-045e-4495-8ca4-98a631248ce3 req-76688cc9-dc64-4529-a321-626478395cfb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:15.110078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-83eaf375-045e-4495-8ca4-98a631248ce3 req-76688cc9-dc64-4529-a321-626478395cfb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:15.122158 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-83eaf375-045e-4495-8ca4-98a631248ce3 req-76688cc9-dc64-4529-a321-626478395cfb service nova] Creating event network-vif-deleted:d2ccc7ba-8bc2-47c3-8f38-aae3151f7883 for instance 45e84508-ad68-44bc-a4e3-94115c2043b5 on n-h1-858384-1 Sep 19 15:37:15.126955 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-83eaf375-045e-4495-8ca4-98a631248ce3 req-76688cc9-dc64-4529-a321-626478395cfb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034749 Sep 19 15:37:15.127558 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3026/6006] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:37:15.175349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:15.176006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:15.185697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:15.186229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:15.186919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:15.187429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:15.188152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:15.188639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:15.224563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:15.225078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:15.225539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:15.226160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lazy-loading 'fault' on Instance uuid 45e84508-ad68-44bc-a4e3-94115c2043b5 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:37:15.271783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:15.280397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5cd60c8c-d9d3-43e7-94cc-23fb4efc91c1 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 200 len: 1355 microversion: 2.1 time: 0.160511 Sep 19 15:37:15.280981 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2981/6007] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:15 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 1355 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:37:16.306979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:16.307691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 45e84508-ad68-44bc-a4e3-94115c2043b5] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:16.314061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:16.314551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:16.315019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:16.315715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:16.316177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:16.316606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:16.330043 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] HTTP exception thrown: Instance 45e84508-ad68-44bc-a4e3-94115c2043b5 could not be found. Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Request method failure captured: Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 HTTP/1.1 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKIt-VlMM_8Y4XykJA2AsX3VKYUuHcUKVervCnkDgIjYpgdCC-naMCUUSRGDwF4cUeX1gYw6H7IhuSB2kjLw5v5pQ2vtwYgdUVboUCxIXDBXe-J9ej_gOmr396TwN600sfFU9YIhZAbUBFAKi5AE-Zjlscc1JJ_trc3lJCL94A2lKM9o Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}] Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 0fb4f5f68f5b4c9182b28bd7b1ba973b Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 45e84508-ad68-44bc-a4e3-94115c2043b5 could not be found. Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '45e84508-ad68-44bc-a4e3-94115c2043b5'} Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e84508-ad68-44bc-a4e3-94115c2043b5 could not be found. Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e84508-ad68-44bc-a4e3-94115c2043b5 could not be found. Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:37:16.331694 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e84508-ad68-44bc-a4e3-94115c2043b5 could not be found. Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Returning 404 to user: Instance 45e84508-ad68-44bc-a4e3-94115c2043b5 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86dfd59b-7ebe-4f1a-a66e-ec865be2fcfa tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5" status: 404 len: 111 microversion: 2.1 time: 0.031315 Sep 19 15:37:16.337354 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3027/6008] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:16 2022] GET /compute/v2.1/servers/45e84508-ad68-44bc-a4e3-94115c2043b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:37:19.650109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8af19ec7-fc5d-4cc8-a973-498a47be6e60 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '.version_select at 0x7fde2a88c0d0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:19.678884 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8af19ec7-fc5d-4cc8-a973-498a47be6e60 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-183293435" status: 202 len: 0 microversion: 2.1 time: 0.032626 Sep 19 15:37:19.679715 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2982/6009] 10.222.0.81 () {58 vars in 1281 bytes} [Mon Sep 19 15:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-183293435 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:37:19.706562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-be78637c-8f3b-4ace-bfae-94c9617260a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: .version_select at 0x7fde2e183940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1453243926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7klsEhRlxg9V9vAkwpMJPWOp2r/qpI1tsE1GOMuTkf1TqtW74e4+T4C/3aNRppdGHRDoUmTCW71JbnD2iVKIpeXST4p5AM+/wANXY7s7Gy/IwPNunVp9Nz4ZL5lXdeiw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:19.740714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-be78637c-8f3b-4ace-bfae-94c9617260a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:37:19.746850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-be78637c-8f3b-4ace-bfae-94c9617260a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:37:19.773594 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-be78637c-8f3b-4ace-bfae-94c9617260a2 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070969 Sep 19 15:37:19.774220 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3028/6010] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:37:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:37:25.355142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=64 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:25.360651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1341405245", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "fcdfdbe9-11bd-4e9d-a227-b15c9dffa73d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1453243926", "security_groups": [{"name": "tempest-secgroup-smoke-2041642902"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:25.492569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] validate_networks() for [('fcdfdbe9-11bd-4e9d-a227-b15c9dffa73d', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:37:25.937369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:37:25.937959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:37:25.938674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:37:25.939228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:37:25.939938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:37:25.953650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:25.954272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:25.954859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:25.955689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:25.956244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:25.956764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:25.984028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:37:25.989588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Getting quotas for user 0fb4f5f68f5b4c9182b28bd7b1ba973b and project 5eecdd3d4cfe46afbd13c6c0224bfb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:37:26.004629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:37:26.007056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:37:26.056178 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c29e8cac-65ee-4bbb-ae64-25d3e26625db tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702713 Sep 19 15:37:26.056975 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2983/6011] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:37:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:37:26.072583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2a083604-a455-4b5a-9ff1-29f347957a3a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:26.074075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2a083604-a455-4b5a-9ff1-29f347957a3a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:26.153277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2a083604-a455-4b5a-9ff1-29f347957a3a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:26.161778 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2a083604-a455-4b5a-9ff1-29f347957a3a tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1267 microversion: 2.1 time: 0.096015 Sep 19 15:37:26.162370 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3029/6012] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:26 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:27.190848 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:27.192126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:27.198729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:27.199331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:27.199797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:27.200505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:27.200979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:27.201630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:27.273098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:27.284929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-afdf3f1f-b16c-4bc3-8c90-98b39d7fb51e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1327 microversion: 2.1 time: 0.098866 Sep 19 15:37:27.286009 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2984/6013] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:27 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:28.312221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:28.312946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:28.319555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:28.323431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:28.324934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:28.325914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:28.327077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:28.328377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:28.329256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:28.502193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:28.513642 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f197d507-3213-4811-867d-4a67c04c0b91 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1393 microversion: 2.1 time: 0.207434 Sep 19 15:37:28.515221 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3030/6014] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:28 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:28.821905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e44ae1a0-40cc-4097-9df6-4ced45205c6c req-198fb8ea-377a-4612-8b76-4a5ebb535cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b047a8-062c-44de-b657-7af09774015c", "tag": "21347b23-e60e-43b7-afc9-78c1fbeca2db"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:28.837877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e44ae1a0-40cc-4097-9df6-4ced45205c6c req-198fb8ea-377a-4612-8b76-4a5ebb535cc1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:28.839214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e44ae1a0-40cc-4097-9df6-4ced45205c6c req-198fb8ea-377a-4612-8b76-4a5ebb535cc1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:28.839704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e44ae1a0-40cc-4097-9df6-4ced45205c6c req-198fb8ea-377a-4612-8b76-4a5ebb535cc1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:28.851956 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e44ae1a0-40cc-4097-9df6-4ced45205c6c req-198fb8ea-377a-4612-8b76-4a5ebb535cc1 service nova] Creating event network-changed:21347b23-e60e-43b7-afc9-78c1fbeca2db for instance 28b047a8-062c-44de-b657-7af09774015c on n-h1-858384-1 Sep 19 15:37:28.858307 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e44ae1a0-40cc-4097-9df6-4ced45205c6c req-198fb8ea-377a-4612-8b76-4a5ebb535cc1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040145 Sep 19 15:37:28.859531 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2985/6015] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:37:29.537989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:29.538649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:29.545803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:29.546285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:29.546720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:29.547434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:29.547889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:29.548315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:29.682529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:29.691109 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6740be29-b9db-489b-bacb-4f38f620e4d7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1393 microversion: 2.1 time: 0.157021 Sep 19 15:37:29.691684 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3031/6016] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:29 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:30.715748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:30.716524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:30.722884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:30.723394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:30.723847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:30.724551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:30.725026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:30.725470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:30.859810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:30.867646 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1892e38d-79c0-4574-816f-220c9cd3f2a7 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1393 microversion: 2.1 time: 0.157112 Sep 19 15:37:30.868458 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2986/6017] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:30 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:31.891644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:31.892220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:31.894885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:31.900181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:31.900670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:31.901114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:31.901807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:31.902268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:31.902696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:32.044031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:32.052279 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c7f1d08-5f01-4076-9130-7930ebcfb17f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1393 microversion: 2.1 time: 0.164695 Sep 19 15:37:32.052860 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3032/6018] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:31 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:33.076157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:33.076862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:33.080141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:33.086691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:33.087246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:33.087714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:33.088442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:33.088926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:33.089378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:33.230815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:33.239328 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-38addb61-d7bd-414a-aba5-4b9284298efd tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1393 microversion: 2.1 time: 0.167405 Sep 19 15:37:33.239917 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2987/6019] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:33 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:33.259650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9bf0e4c8-25d6-48db-a93f-c33b4d83a5fb req-16283b5e-08e5-47a6-b236-3c1f7a522371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b047a8-062c-44de-b657-7af09774015c", "name": "network-vif-plugged", "status": "completed", "tag": "21347b23-e60e-43b7-afc9-78c1fbeca2db"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:33.270244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9bf0e4c8-25d6-48db-a93f-c33b4d83a5fb req-16283b5e-08e5-47a6-b236-3c1f7a522371 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:33.270689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9bf0e4c8-25d6-48db-a93f-c33b4d83a5fb req-16283b5e-08e5-47a6-b236-3c1f7a522371 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:33.271147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9bf0e4c8-25d6-48db-a93f-c33b4d83a5fb req-16283b5e-08e5-47a6-b236-3c1f7a522371 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:33.282691 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9bf0e4c8-25d6-48db-a93f-c33b4d83a5fb req-16283b5e-08e5-47a6-b236-3c1f7a522371 service nova] Creating event network-vif-plugged:21347b23-e60e-43b7-afc9-78c1fbeca2db for instance 28b047a8-062c-44de-b657-7af09774015c on n-h1-858384-1 Sep 19 15:37:33.287728 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9bf0e4c8-25d6-48db-a93f-c33b4d83a5fb req-16283b5e-08e5-47a6-b236-3c1f7a522371 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032177 Sep 19 15:37:33.288326 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3033/6020] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:37:34.262255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:34.262920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:34.269989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:34.270491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:34.271001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:34.271720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:34.272203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:34.272646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:34.414329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:34.423044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b242fca2-938c-41bc-ae65-e565f2a9cbb6 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1393 microversion: 2.1 time: 0.164699 Sep 19 15:37:34.423862 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2988/6021] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:34 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:35.447598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:35.448304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:35.455555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:35.456041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:35.456484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:35.457173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:35.457631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:35.458059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:35.595205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:35.603220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-066808e3-06e2-46e5-b2c5-43cb1389f683 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1566 microversion: 2.1 time: 0.161153 Sep 19 15:37:35.603795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3034/6022] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:35 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:35.626582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:35.627253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:35.634029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:35.634539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:35.635025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:35.635737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:35.636217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:35.636664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:35.768484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:35.776299 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc8a3c8c-04b7-4c5d-8ac2-7cc4d41c8f6f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1566 microversion: 2.1 time: 0.154270 Sep 19 15:37:35.776876 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2989/6023] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:35 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:37.383934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:37.384560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:37.386136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-c6d24b15-5777-49fc-9d5c-e2ffb2a669cc req-627b073a-df3e-44a7-9589-25cff35fe2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b047a8-062c-44de-b657-7af09774015c", "tag": "21347b23-e60e-43b7-afc9-78c1fbeca2db"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:37.386563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:37.393068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:37.394220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:37.400399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c6d24b15-5777-49fc-9d5c-e2ffb2a669cc req-627b073a-df3e-44a7-9589-25cff35fe2e4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:37.400899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c6d24b15-5777-49fc-9d5c-e2ffb2a669cc req-627b073a-df3e-44a7-9589-25cff35fe2e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:37.401563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-c6d24b15-5777-49fc-9d5c-e2ffb2a669cc req-627b073a-df3e-44a7-9589-25cff35fe2e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:37.402482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:37.403008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:37.403454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:37.404501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:37.405339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:37.405953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:37.423576 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-c6d24b15-5777-49fc-9d5c-e2ffb2a669cc req-627b073a-df3e-44a7-9589-25cff35fe2e4 service nova] Creating event network-changed:21347b23-e60e-43b7-afc9-78c1fbeca2db for instance 28b047a8-062c-44de-b657-7af09774015c on n-h1-858384-1 Sep 19 15:37:37.429526 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-c6d24b15-5777-49fc-9d5c-e2ffb2a669cc req-627b073a-df3e-44a7-9589-25cff35fe2e4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047046 Sep 19 15:37:37.430254 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2990/6024] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:37:37.559565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:37.580581 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-46a3e88e-6181-4ebd-9fb5-4eabd7edcdae tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1566 microversion: 2.1 time: 0.200339 Sep 19 15:37:37.592170 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3035/6025] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:37 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:58.839641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:58.840506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=36 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:58.845007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:37:58.847322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:58.854444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:58.854978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:58.855432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:58.856132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:58.856605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:58.857102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:58.908856 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6208a60e-97a1-4aac-95db-d660fdfae83c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c/action" status: 200 len: 24568 microversion: 2.1 time: 0.071396 Sep 19 15:37:58.909713 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2991/6026] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:37:58 2022] POST /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:38:10.022081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:38:10.024868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:10.026908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=7 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:10.027701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=32 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:10.033801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.034296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.034740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.035496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.036020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.036452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.118494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:38:10.118966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:38:10.119447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:38:10.119864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:38:10.120300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:38:10.180331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:10.186173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.186779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.187259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.187982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.188437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.188871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.219538 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-077f95b1-2a50-4881-a066-22b6b21561d0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c/action" status: 202 len: 1139 microversion: 2.1 time: 0.201685 Sep 19 15:38:10.220216 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3036/6027] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:38:10 2022] POST /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c/action => generated 1139 bytes in 203 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 19 15:38:10.241587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:10.242375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:10.245659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:10.246363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:10.252599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.253175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.253644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.254500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.255009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.255471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.395828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:10.405466 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e2b79be-f671-4f31-9c21-0576ef76268f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.168275 Sep 19 15:38:10.406258 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2992/6028] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:10 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:11.431159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:11.431854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:11.440424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:11.440939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:11.441932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:11.442146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:11.442601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:11.443072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:11.579842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:11.588377 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-daecae46-6f97-4198-9334-e6e56f627acb tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.161252 Sep 19 15:38:11.588996 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3037/6029] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:11 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:12.613554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:12.614099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:12.621136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:12.621637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:12.622099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:12.623089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:12.623569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:12.624014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:12.758662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:12.767326 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f8e98828-ae54-45d8-ab55-492bfa95447b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.157794 Sep 19 15:38:12.767903 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2993/6030] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:12 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:13.791478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:13.792167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:13.799245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:13.799733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:13.800168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:13.800860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:13.801316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:13.801745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:13.948473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:13.959372 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0544c034-389d-4089-9861-da25cf43dcfc tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.171693 Sep 19 15:38:13.960044 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3038/6031] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:13 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:14.986439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:14.987097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:14.993965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:14.994472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:14.994972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:14.995677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:14.996153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:14.996607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:15.135663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:15.144082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79c67382-f2ae-477a-ad6f-882f1287e781 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.163237 Sep 19 15:38:15.144664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2994/6032] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:14 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:38:16.168046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:16.168690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:16.176446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:16.176932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:16.177374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:16.178064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:16.178521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:16.178980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:16.312850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:16.320647 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-85da4cf6-168b-4ed6-9b15-fb9906a2e557 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.156569 Sep 19 15:38:16.321231 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3039/6033] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:16 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:17.344941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:17.345554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:17.352494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:17.352995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:17.353448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:17.354151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:17.354623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:17.355106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:17.489879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:17.498418 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-be93a143-d7f0-4ead-9e77-d901b265d90e tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.157466 Sep 19 15:38:17.499033 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2995/6034] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:17 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:18.522545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:18.523188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:18.530964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:18.531452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:18.531896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:18.532589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:18.533042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:18.533467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:18.669682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:18.677884 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55932455-fe11-4f52-b138-505aaa331455 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.159518 Sep 19 15:38:18.678456 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3040/6035] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:18 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:19.702387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:19.702983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:19.709741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:19.710246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:19.710702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:19.711433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:19.711907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:19.712360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:19.844739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:19.852516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a4d77fe-488a-445e-b231-6f3610adde19 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.154281 Sep 19 15:38:19.853101 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2996/6036] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:19 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:20.876893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:20.877490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:20.884461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:20.884947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:20.885388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:20.886181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:20.886650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:20.887098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:21.036193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:21.044134 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0557825b-f7ed-4e56-baec-59cf94830d23 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.171240 Sep 19 15:38:21.045042 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3041/6037] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:20 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:22.067389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:22.068044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:22.074986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:22.076206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:22.076668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:22.077428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:22.077938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:22.078394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:22.216152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:22.224105 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e950a15a-10be-4937-ae91-1fab12ef9bf0 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.160656 Sep 19 15:38:22.224701 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2997/6038] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:22 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:23.248493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:23.249271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:23.256045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:23.256535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:23.256976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:23.257672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:23.258136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:23.258564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:23.393655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:23.401585 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62e5ccf6-1d48-4de7-89d7-2640bcf17381 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.157121 Sep 19 15:38:23.402162 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3042/6039] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:23 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:24.425968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:24.426598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:24.433586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:24.434094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:24.434555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:24.435304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:24.435784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:24.436230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:24.572320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:24.580937 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3e9c01b-e564-421b-8585-02caf8dd7f56 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.159273 Sep 19 15:38:24.581513 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2998/6040] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:24 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:25.604302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:25.604920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:25.611845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:25.612336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:25.612780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:25.613486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:25.613949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:25.614382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:25.744116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:25.752416 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ce1e5388-b661-4f44-855c-f2ae96a1b7ad tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.152061 Sep 19 15:38:25.752990 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3043/6041] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:25 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:26.776661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:26.777365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:26.785567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:26.786086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:26.786546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:26.787307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:26.787784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:26.788235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:26.939804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:26.951968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b8c922d7-c423-42d7-ac37-64bfd00ae2df tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1694 microversion: 2.1 time: 0.180051 Sep 19 15:38:26.953241 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 2999/6042] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:26 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:27.977149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:27.977764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:27.985219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:27.985722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:27.986165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:27.986891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:27.987358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:27.987786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:28.124390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:28.132244 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e5eebe8-bf24-4300-9692-97802b8cd158 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1700 microversion: 2.1 time: 0.159041 Sep 19 15:38:28.132817 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3044/6043] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:27 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:29.156320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:29.156963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:29.163422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:29.163936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:29.164393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:29.165107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:29.165586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:29.166081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:29.300398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:29.308322 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f31ab617-2bbf-46b8-bdf0-fde1f6cad93c tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1685 microversion: 2.1 time: 0.156382 Sep 19 15:38:29.308909 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3000/6044] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:29 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:31.407430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-08c56ba9-0678-40be-9880-f572edc1178f req-5091e140-7d88-4333-b285-0e5c6fa90483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b047a8-062c-44de-b657-7af09774015c", "name": "network-vif-plugged", "status": "completed", "tag": "21347b23-e60e-43b7-afc9-78c1fbeca2db"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:38:31.419080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-08c56ba9-0678-40be-9880-f572edc1178f req-5091e140-7d88-4333-b285-0e5c6fa90483 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:31.419588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-08c56ba9-0678-40be-9880-f572edc1178f req-5091e140-7d88-4333-b285-0e5c6fa90483 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:31.420061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-08c56ba9-0678-40be-9880-f572edc1178f req-5091e140-7d88-4333-b285-0e5c6fa90483 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:31.433604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-08c56ba9-0678-40be-9880-f572edc1178f req-5091e140-7d88-4333-b285-0e5c6fa90483 service nova] Creating event network-vif-plugged:21347b23-e60e-43b7-afc9-78c1fbeca2db for instance 28b047a8-062c-44de-b657-7af09774015c on n-h1-858384-1 Sep 19 15:38:31.440763 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-08c56ba9-0678-40be-9880-f572edc1178f req-5091e140-7d88-4333-b285-0e5c6fa90483 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037638 Sep 19 15:38:31.441585 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3045/6045] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:38:53.518061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:38:53.520365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:53.523127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=18 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:53.523799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=54 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:53.530186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:53.531156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:53.531634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:53.532358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:53.532831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:53.533276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:53.590615 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-04d74864-5b32-4756-9558-e30f9f71c73b tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "POST /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c/action" status: 200 len: 24559 microversion: 2.1 time: 0.077157 Sep 19 15:38:53.591306 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3001/6046] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:38:53 2022] POST /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c/action => generated 24559 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:39:00.814945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=24 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:00.815796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:00.819885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:00.820477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:00.820789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5301f5ce-06a3-407d-ba3c-f3188a264f66 req-d11c3c68-1c4a-4ee6-ba37-c44518b67ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b047a8-062c-44de-b657-7af09774015c", "tag": "21347b23-e60e-43b7-afc9-78c1fbeca2db"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:00.829022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.829795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.830236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:00.830969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.831572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.831995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:00.833046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5301f5ce-06a3-407d-ba3c-f3188a264f66 req-d11c3c68-1c4a-4ee6-ba37-c44518b67ffc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.833555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5301f5ce-06a3-407d-ba3c-f3188a264f66 req-d11c3c68-1c4a-4ee6-ba37-c44518b67ffc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.834038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5301f5ce-06a3-407d-ba3c-f3188a264f66 req-d11c3c68-1c4a-4ee6-ba37-c44518b67ffc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:00.847042 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5301f5ce-06a3-407d-ba3c-f3188a264f66 req-d11c3c68-1c4a-4ee6-ba37-c44518b67ffc service nova] Creating event network-changed:21347b23-e60e-43b7-afc9-78c1fbeca2db for instance 28b047a8-062c-44de-b657-7af09774015c on n-h1-858384-1 Sep 19 15:39:00.852189 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5301f5ce-06a3-407d-ba3c-f3188a264f66 req-d11c3c68-1c4a-4ee6-ba37-c44518b67ffc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037238 Sep 19 15:39:00.852806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3002/6047] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:39:00.861504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:39:00.966114 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-620ec917-45b2-417b-b640-087b4712e0ac tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 204 len: 0 microversion: 2.1 time: 0.153059 Sep 19 15:39:00.970085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3046/6048] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:39:00 2022] DELETE /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:39:00.976405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:00.977751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:00.983981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.984501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.984964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:00.986042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.986177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.986595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:01.126175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:01.134015 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8ba5db5-4670-4e08-bfed-e705a92d911f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1691 microversion: 2.1 time: 0.162373 Sep 19 15:39:01.139112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3003/6049] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:00 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:02.160279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:02.160983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:02.167747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:02.168229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:02.168662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:02.169347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:02.169798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:02.170219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:02.313206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:02.321223 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2300c695-e916-4794-b8b5-710ded480bf9 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1691 microversion: 2.1 time: 0.166119 Sep 19 15:39:02.321979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3047/6050] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:02 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:03.042980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-244fb8a9-b605-44f2-84c4-a48295ae8a5c req-bcf425cd-f875-446a-98cf-ff44e7d180bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b047a8-062c-44de-b657-7af09774015c", "name": "network-vif-deleted", "tag": "21347b23-e60e-43b7-afc9-78c1fbeca2db"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:03.056417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-244fb8a9-b605-44f2-84c4-a48295ae8a5c req-bcf425cd-f875-446a-98cf-ff44e7d180bd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:03.056923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-244fb8a9-b605-44f2-84c4-a48295ae8a5c req-bcf425cd-f875-446a-98cf-ff44e7d180bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:03.057380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-244fb8a9-b605-44f2-84c4-a48295ae8a5c req-bcf425cd-f875-446a-98cf-ff44e7d180bd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:03.073211 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-244fb8a9-b605-44f2-84c4-a48295ae8a5c req-bcf425cd-f875-446a-98cf-ff44e7d180bd service nova] Creating event network-vif-deleted:21347b23-e60e-43b7-afc9-78c1fbeca2db for instance 28b047a8-062c-44de-b657-7af09774015c on n-h1-858384-1 Sep 19 15:39:03.079122 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-244fb8a9-b605-44f2-84c4-a48295ae8a5c req-bcf425cd-f875-446a-98cf-ff44e7d180bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040289 Sep 19 15:39:03.079735 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3004/6051] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:39:03.346287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:03.346944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:03.353782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:03.354277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:03.354721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:03.355472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:03.355930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:03.356358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:03.390793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:03.391298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:03.391776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:03.392233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lazy-loading 'fault' on Instance uuid 28b047a8-062c-44de-b657-7af09774015c {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:39:03.440236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb4f5f68f5b4c9182b28bd7b1ba973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eecdd3d4cfe46afbd13c6c0224bfb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:03.451382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-72d2a9f7-4ad8-4b61-8116-dd2d1fc298b5 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 200 len: 1357 microversion: 2.1 time: 0.109525 Sep 19 15:39:03.453848 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3048/6052] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:03 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 1357 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:04.476324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:04.477049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] [instance: 28b047a8-062c-44de-b657-7af09774015c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:04.483955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:04.484495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:04.484986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:04.485690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:04.486166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:04.486612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:04.500833 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] HTTP exception thrown: Instance 28b047a8-062c-44de-b657-7af09774015c could not be found. Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Request method failure captured: Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c HTTP/1.1 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKIt-VlMM_8Y4XykJA2AsX3VKYUuHcUKVervCnkDgIjYpgdCC-naMCUUSRGDwF4cUeX1gYw6H7IhuSB2kjLw5v5pQ2vtwYgdUVboUCxIXDBXe-J9ej_gOmr396TwN600sfFU9YIhZAbUBFAKi5AE-Zjlscc1JJ_trc3lJCL94A2lKM9o Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eecdd3d4cfe46afbd13c6c0224bfb1d"}]}] Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5eecdd3d4cfe46afbd13c6c0224bfb1d Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1864317713 Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 0fb4f5f68f5b4c9182b28bd7b1ba973b Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1864317713-project Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 28b047a8-062c-44de-b657-7af09774015c could not be found. Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '28b047a8-062c-44de-b657-7af09774015c'} Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b047a8-062c-44de-b657-7af09774015c could not be found. Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b047a8-062c-44de-b657-7af09774015c could not be found. Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:39:04.502470 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b047a8-062c-44de-b657-7af09774015c could not be found. Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Returning 404 to user: Instance 28b047a8-062c-44de-b657-7af09774015c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bbf5546a-d031-4943-a659-e8705d69947f tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c" status: 404 len: 111 microversion: 2.1 time: 0.032965 Sep 19 15:39:04.509018 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3005/6053] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:04 2022] GET /compute/v2.1/servers/28b047a8-062c-44de-b657-7af09774015c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:39:07.524311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ede031e2-0d6d-4e24-a782-67eea4f8f252 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] Calling method '.version_select at 0x7fde28c523a0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:07.547087 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ede031e2-0d6d-4e24-a782-67eea4f8f252 tempest-TestNetworkAdvancedServerOps-1864317713 tempest-TestNetworkAdvancedServerOps-1864317713-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1453243926" status: 202 len: 0 microversion: 2.1 time: 0.026614 Sep 19 15:39:07.547620 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3049/6054] 10.222.0.81 () {58 vars in 1284 bytes} [Mon Sep 19 15:39:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1453243926 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:39:10.481141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1904518-bc1d-4a71-81e9-1162912e9484 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Action: 'create', calling method: .version_select at 0x7fde2a4e4b80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2097382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkyOjMIWvrYBSLstVczzRjj4aIHMtrggjqgNgJWEODDmpnzuGj0cya1XoOdQsFW+K0sw9/4xbdFZb3ZyLLYQoATCF6s4LXjbdLF4j8yseQ+xVDZKlRmVD+u5An9SfFkFA=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:10.497761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c1904518-bc1d-4a71-81e9-1162912e9484 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Getting quotas for project 3a84008414d147cfbf690f1b2ed7a145. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:39:10.504671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c1904518-bc1d-4a71-81e9-1162912e9484 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Getting quotas for user bad0d683f16d4a9191cee654e516de5f and project 3a84008414d147cfbf690f1b2ed7a145. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:39:10.531803 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1904518-bc1d-4a71-81e9-1162912e9484 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.243862 Sep 19 15:39:10.532561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3006/6055] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:39:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:39:16.352760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:16.359948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1142337669-access_point-437493158", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "69439d3c-c30d-4801-9aec-08262ecf530f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2097382", "security_groups": [{"name": "tempest-secgroup_access--1654719527"}, {"name": "tempest-secgroup_general--693708844"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:16.523302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] validate_networks() for [('69439d3c-c30d-4801-9aec-08262ecf530f', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:39:17.041543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:39:17.042036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:39:17.042393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:39:17.042859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:39:17.043399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:39:17.052639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:17.053131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:17.053700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:17.054465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:17.054954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:17.055382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:17.076354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Getting quotas for project 3a84008414d147cfbf690f1b2ed7a145. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:39:17.082341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Getting quotas for user bad0d683f16d4a9191cee654e516de5f and project 3a84008414d147cfbf690f1b2ed7a145. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:39:17.095510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:39:17.097560 n-d-858384-1 devstack@n-api.service[128730]: WARNING nova.utils [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1142337669-access_point-437493158 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1142337669-ac Sep 19 15:39:17.098310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:39:17.148511 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e182c02-eb18-47e6-8ebf-3a5b8f58ceaa tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.798314 Sep 19 15:39:17.149424 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3050/6056] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:39:16 2022] POST /compute/v2.1/servers => generated 457 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:39:17.162311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8a672bf7-5539-4651-9fa6-dbb741cce730 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:17.163776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8a672bf7-5539-4651-9fa6-dbb741cce730 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:17.172624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:17.242134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8a672bf7-5539-4651-9fa6-dbb741cce730 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:17.251716 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8a672bf7-5539-4651-9fa6-dbb741cce730 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1291 microversion: 2.1 time: 0.094464 Sep 19 15:39:17.252634 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3007/6057] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:17 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1291 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:18.275641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:18.276262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:18.283754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:18.284247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:18.284692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:18.285396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:18.285858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:18.286384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:18.355277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:18.365295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70574a5b-a6a9-4522-804a-6f28735df2f4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1343 microversion: 2.1 time: 0.094377 Sep 19 15:39:18.365880 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3051/6058] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:18 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:19.388257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:19.390200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:19.398619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:19.399345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:19.399971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:19.400839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:19.401450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:19.402058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:19.623111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:19.631873 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-91754145-3b3a-471e-82e7-61db0ac38fb3 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1468 microversion: 2.1 time: 0.247571 Sep 19 15:39:19.632456 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3008/6059] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:19 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:19.963265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-54a4d669-598a-49d1-8f87-c8d3233b436e req-cb48fd83-d739-4735-9a3c-b0fac6c9b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e7d543-41e0-4b03-9e54-899ec43a4986", "tag": "7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:19.975050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-54a4d669-598a-49d1-8f87-c8d3233b436e req-cb48fd83-d739-4735-9a3c-b0fac6c9b5ae service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:19.975533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-54a4d669-598a-49d1-8f87-c8d3233b436e req-cb48fd83-d739-4735-9a3c-b0fac6c9b5ae service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:19.975962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-54a4d669-598a-49d1-8f87-c8d3233b436e req-cb48fd83-d739-4735-9a3c-b0fac6c9b5ae service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:19.988485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-54a4d669-598a-49d1-8f87-c8d3233b436e req-cb48fd83-d739-4735-9a3c-b0fac6c9b5ae service nova] Creating event network-changed:7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98 for instance 72e7d543-41e0-4b03-9e54-899ec43a4986 on n-h2-858384-1 Sep 19 15:39:19.993543 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-54a4d669-598a-49d1-8f87-c8d3233b436e req-cb48fd83-d739-4735-9a3c-b0fac6c9b5ae service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033998 Sep 19 15:39:19.994149 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3052/6060] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:39:20.655086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:20.655728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:20.662588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:20.663131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:20.663589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:20.664292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:20.664774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:20.665217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:20.806944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:20.815350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-85071f95-662c-4572-8645-10d7a564bc08 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1468 microversion: 2.1 time: 0.164452 Sep 19 15:39:20.815928 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3009/6061] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:20 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1468 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:21.839975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:21.840616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:21.847460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:21.847952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:21.848397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:21.849093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:21.849556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:21.849988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:21.989736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:21.997575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e651eea2-8892-449a-9a58-9736eb6b9a59 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1468 microversion: 2.1 time: 0.162830 Sep 19 15:39:21.998148 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3053/6062] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:21 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:23.021433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:23.022080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:23.028928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:23.029430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:23.029890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:23.030640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:23.031216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:23.031693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:23.172815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:23.180892 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-39b535e8-f1d3-415a-8897-00a38958effd tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1468 microversion: 2.1 time: 0.163513 Sep 19 15:39:23.181478 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3010/6063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:23 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:24.205136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:24.205777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:24.212642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:24.213123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:24.213556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:24.214242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:24.214695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:24.215153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:24.361420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:24.369078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a493a26c-62b2-4195-9bc0-00cd49b13dff tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1468 microversion: 2.1 time: 0.168286 Sep 19 15:39:24.369665 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3054/6064] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:24 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:25.242374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-710a779d-c582-4546-8c1c-f0b341c6205e req-62906dbf-1934-487c-be83-1057b273dc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7d543-41e0-4b03-9e54-899ec43a4986", "name": "network-vif-plugged", "status": "completed", "tag": "7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:25.248457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:25.255479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-710a779d-c582-4546-8c1c-f0b341c6205e req-62906dbf-1934-487c-be83-1057b273dc3e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:25.255981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-710a779d-c582-4546-8c1c-f0b341c6205e req-62906dbf-1934-487c-be83-1057b273dc3e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:25.256427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-710a779d-c582-4546-8c1c-f0b341c6205e req-62906dbf-1934-487c-be83-1057b273dc3e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:25.269112 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-710a779d-c582-4546-8c1c-f0b341c6205e req-62906dbf-1934-487c-be83-1057b273dc3e service nova] Creating event network-vif-plugged:7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98 for instance 72e7d543-41e0-4b03-9e54-899ec43a4986 on n-h2-858384-1 Sep 19 15:39:25.274345 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-710a779d-c582-4546-8c1c-f0b341c6205e req-62906dbf-1934-487c-be83-1057b273dc3e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Sep 19 15:39:25.274979 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3011/6065] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:39:25.392338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:25.393007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:25.399952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:25.400443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:25.401058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:25.401768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:25.402247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:25.402968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:25.544837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:25.553675 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8f41572-6891-43fd-92ec-a5dee8d34bf5 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1468 microversion: 2.1 time: 0.165416 Sep 19 15:39:25.554254 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3055/6066] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:25 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:26.580910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:26.581552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:26.589142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.589653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.590118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.590874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.591358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.591810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.747469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:26.755932 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a60802dc-4bfb-4d07-ae60-da084834693b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1638 microversion: 2.1 time: 0.182462 Sep 19 15:39:26.756520 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3012/6067] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:26 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1638 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:26.779915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:26.780631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:26.788958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.789456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.789899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.790610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.791100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.791529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.950122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:26.959402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7ed125bf-d9fb-4a61-b237-92fbf99c1fb6 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1638 microversion: 2.1 time: 0.183467 Sep 19 15:39:26.960005 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3056/6068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:26 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1638 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:26.982323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:26.982988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:26.990268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.990792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.991247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.991972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.992427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.992892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:27.247959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:27.281516 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-48842e5a-43e3-488f-8023-179bb01143b6 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1789 microversion: 2.1 time: 0.303212 Sep 19 15:39:27.282272 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3013/6069] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:26 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1789 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:28.978547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ffe79aec-e2e7-402b-b141-8646020e8f3c req-cc4f8c69-5f6b-456c-9597-530d3940ed7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e7d543-41e0-4b03-9e54-899ec43a4986", "tag": "7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:28.984962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:28.986286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:28.993216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ffe79aec-e2e7-402b-b141-8646020e8f3c req-cc4f8c69-5f6b-456c-9597-530d3940ed7e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:28.993704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ffe79aec-e2e7-402b-b141-8646020e8f3c req-cc4f8c69-5f6b-456c-9597-530d3940ed7e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:28.994316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ffe79aec-e2e7-402b-b141-8646020e8f3c req-cc4f8c69-5f6b-456c-9597-530d3940ed7e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:29.006530 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ffe79aec-e2e7-402b-b141-8646020e8f3c req-cc4f8c69-5f6b-456c-9597-530d3940ed7e service nova] Creating event network-changed:7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98 for instance 72e7d543-41e0-4b03-9e54-899ec43a4986 on n-h2-858384-1 Sep 19 15:39:29.012115 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ffe79aec-e2e7-402b-b141-8646020e8f3c req-cc4f8c69-5f6b-456c-9597-530d3940ed7e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037766 Sep 19 15:39:29.013140 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3057/6070] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:08.657754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-891400997", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a16e0614-75ba-4432-8651-b4b97f5e2c4f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2097382", "security_groups": []}, "os:scheduler_hints": {"different_host": ["72e7d543-41e0-4b03-9e54-899ec43a4986"]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:08.667519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:08.668313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:08.669437 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:40:08.669587 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! Sep 19 15:40:08.727265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] validate_networks() for [('a16e0614-75ba-4432-8651-b4b97f5e2c4f', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:40:09.246168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:40:09.246615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:40:09.247135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:40:09.247725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:40:09.248370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:40:09.265029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:09.265862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:09.266619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:09.267527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:09.268265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:09.268721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:09.298214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Getting quotas for project 3a84008414d147cfbf690f1b2ed7a145. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:40:09.307267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Getting quotas for user bad0d683f16d4a9191cee654e516de5f and project 3a84008414d147cfbf690f1b2ed7a145. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:40:09.323008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:40:09.325491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:40:09.378339 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1930356-2dbe-448f-ad43-ff3e1852e63d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.724628 Sep 19 15:40:09.381326 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3014/6071] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:40:08 2022] POST /compute/v2.1/servers => generated 361 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:40:09.388925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:09.390239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:09.396690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac3899c8-f61e-4503-9cd7-7c175fb713ee tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:09.397760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac3899c8-f61e-4503-9cd7-7c175fb713ee tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:09.463271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ac3899c8-f61e-4503-9cd7-7c175fb713ee tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:09.471747 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac3899c8-f61e-4503-9cd7-7c175fb713ee tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1238 microversion: 2.1 time: 0.084840 Sep 19 15:40:09.472343 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3058/6072] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:09 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:10.496052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:10.497278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:10.509250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:10.512893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:10.515340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:10.522081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:10.523038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:10.526165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:10.730278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:10.744283 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c6bb91a-62e5-4760-932f-68bfa1840db2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1298 microversion: 2.1 time: 0.252625 Sep 19 15:40:10.748422 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3015/6073] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:10 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1298 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:11.769509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:11.770137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:11.780733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:11.781306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:11.781872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:11.782829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:11.785287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:11.785735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:11.971569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:11.980225 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8162bfba-e042-4748-8c5a-9b91d791fdd4 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.215124 Sep 19 15:40:11.980948 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3059/6074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:11 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:12.008676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-94a2de35-b10c-42d0-8e4d-085d49c83de5 req-99195bcb-7a9b-4170-841c-b6c9dcdd415b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fadcc45-798b-4945-8379-cefd832dc5dd", "tag": "5d2680cf-b946-498c-bd5b-0362cb8aa7bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:12.030455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-94a2de35-b10c-42d0-8e4d-085d49c83de5 req-99195bcb-7a9b-4170-841c-b6c9dcdd415b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:12.030995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-94a2de35-b10c-42d0-8e4d-085d49c83de5 req-99195bcb-7a9b-4170-841c-b6c9dcdd415b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:12.031456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-94a2de35-b10c-42d0-8e4d-085d49c83de5 req-99195bcb-7a9b-4170-841c-b6c9dcdd415b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:12.053929 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-94a2de35-b10c-42d0-8e4d-085d49c83de5 req-99195bcb-7a9b-4170-841c-b6c9dcdd415b service nova] Creating event network-changed:5d2680cf-b946-498c-bd5b-0362cb8aa7bf for instance 4fadcc45-798b-4945-8379-cefd832dc5dd on n-h1-858384-1 Sep 19 15:40:12.061710 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-94a2de35-b10c-42d0-8e4d-085d49c83de5 req-99195bcb-7a9b-4170-841c-b6c9dcdd415b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056638 Sep 19 15:40:12.062334 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3016/6075] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:13.004088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:13.004702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:13.011675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:13.012156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:13.012592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:13.013277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:13.013727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:13.014147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:13.096225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:13.104216 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b0b1d58b-a926-452a-96b0-2db5547cb7af tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.104367 Sep 19 15:40:13.104800 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3060/6076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:12 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:14.129595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:14.130244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:14.136393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:14.136895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:14.137349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:14.138051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:14.138523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:14.139004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:14.273677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:14.281422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d03930e8-4e73-42ea-9fe6-f242b58e2185 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.157676 Sep 19 15:40:14.281997 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3017/6077] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:14 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:15.304930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:15.305587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:15.312422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:15.312911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:15.313346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:15.314123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:15.314661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:15.315224 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:15.395162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:15.402859 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b7e25b8-f6d3-43c2-bae8-7d08dc614252 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.101919 Sep 19 15:40:15.403434 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3061/6078] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:15 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:40:16.426080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:16.426710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:16.433637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:16.434137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:16.434596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:16.435341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:16.435806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:16.436245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:16.520661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:16.528438 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d1a6e748-c097-444c-a48c-a2c69d9dd91d tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.106916 Sep 19 15:40:16.529004 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3018/6079] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:16 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:17.553220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:17.553831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:17.560665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:17.561150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:17.561584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:17.562261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:17.562714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:17.563162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:17.649201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:17.656927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a67e1674-2cc6-4fc9-94b3-df9355c68271 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.108765 Sep 19 15:40:17.657489 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3062/6080] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:17 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:17.976342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0d9b8e05-2435-48b4-b752-5dbdfe67d5dc req-259b48e7-2b7f-4cfd-94e6-0388c34a473b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fadcc45-798b-4945-8379-cefd832dc5dd", "name": "network-vif-plugged", "status": "completed", "tag": "5d2680cf-b946-498c-bd5b-0362cb8aa7bf"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:17.987288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0d9b8e05-2435-48b4-b752-5dbdfe67d5dc req-259b48e7-2b7f-4cfd-94e6-0388c34a473b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:17.987785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0d9b8e05-2435-48b4-b752-5dbdfe67d5dc req-259b48e7-2b7f-4cfd-94e6-0388c34a473b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:17.988229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0d9b8e05-2435-48b4-b752-5dbdfe67d5dc req-259b48e7-2b7f-4cfd-94e6-0388c34a473b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:17.999691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0d9b8e05-2435-48b4-b752-5dbdfe67d5dc req-259b48e7-2b7f-4cfd-94e6-0388c34a473b service nova] Creating event network-vif-plugged:5d2680cf-b946-498c-bd5b-0362cb8aa7bf for instance 4fadcc45-798b-4945-8379-cefd832dc5dd on n-h1-858384-1 Sep 19 15:40:18.005247 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0d9b8e05-2435-48b4-b752-5dbdfe67d5dc req-259b48e7-2b7f-4cfd-94e6-0388c34a473b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 Sep 19 15:40:18.005933 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3019/6081] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:18.680847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:18.681454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:18.688405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:18.688885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:18.690185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:18.691496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:18.692256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:18.693012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:18.775487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:18.783286 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b72574c1-01cc-4c82-bea4-6b67a9936ded tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1296 microversion: 2.1 time: 0.106232 Sep 19 15:40:18.783854 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3063/6082] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:18 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:19.804962 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:19.805751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:19.809921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:19.810644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:19.818246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:19.818768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:19.819241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:19.819947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:19.820422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:19.820869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:19.906597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:19.914419 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fb389bcb-dd9d-41df-a868-a5bc0cbff444 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1468 microversion: 2.1 time: 0.111442 Sep 19 15:40:19.915036 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3020/6083] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:19 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1468 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:19.937619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:19.938213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:19.941952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:19.947962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:19.948452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:19.948890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:19.949585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:19.950044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:19.950470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.033845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:20.041679 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23b54aeb-1ad4-4d22-b166-ee4a2d95b211 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1468 microversion: 2.1 time: 0.108025 Sep 19 15:40:20.042246 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3064/6084] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:19 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1468 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:20.065147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:20.065701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:20.072913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.073410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.073887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.074581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.075079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.075516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.164258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e7e2fd2a-deae-4b30-9151-00ad91afaf9d tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1619 microversion: 2.1 time: 0.103507 Sep 19 15:40:20.165006 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3021/6085] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:20 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1619 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:20.187088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:20.187699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:20.194624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.195138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.195576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.196264 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.196716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.197139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.331604 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-741d05fd-3bbe-4ebc-bce9-d8f78678a258 tempest-TestSecurityGroupsBasicOps-1683660841 tempest-TestSecurityGroupsBasicOps-1683660841-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1907 microversion: 2.1 time: 0.148112 Sep 19 15:40:20.332173 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3065/6086] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:20 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1907 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:20.398812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:20.399332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:20.405327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.406265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.406720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.407445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.408433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.408910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.435062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:40:20.509901 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-205e87ea-ed0b-4375-8ffd-1755e538149f tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 204 len: 0 microversion: 2.1 time: 0.114676 Sep 19 15:40:20.510615 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3022/6087] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:40:20 2022] DELETE /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:40:20.522171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:20.522979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:20.529128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.529613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.530049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.531042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.531499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.531936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.616911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:20.624624 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7c4c5a37-da96-41c3-9011-d93287f08351 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1474 microversion: 2.1 time: 0.109135 Sep 19 15:40:20.625194 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3066/6088] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:20 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1474 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:21.648845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:21.649568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:21.656371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:21.656871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:21.657324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:21.658032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:21.658502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:21.658977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:21.745334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:21.754791 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b3e85d4-598d-41df-a6d2-e671695f0b64 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 200 len: 1474 microversion: 2.1 time: 0.110292 Sep 19 15:40:21.755369 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3023/6089] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:21 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 1474 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:22.261500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8e5920be-ee5d-4de6-a64d-4716f66105e1 req-6e27f5f6-96e5-495c-8d7c-0e914c424526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fadcc45-798b-4945-8379-cefd832dc5dd", "name": "network-vif-deleted", "tag": "5d2680cf-b946-498c-bd5b-0362cb8aa7bf"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:22.274049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e5920be-ee5d-4de6-a64d-4716f66105e1 req-6e27f5f6-96e5-495c-8d7c-0e914c424526 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:22.274533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e5920be-ee5d-4de6-a64d-4716f66105e1 req-6e27f5f6-96e5-495c-8d7c-0e914c424526 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:22.275202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e5920be-ee5d-4de6-a64d-4716f66105e1 req-6e27f5f6-96e5-495c-8d7c-0e914c424526 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:22.290467 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8e5920be-ee5d-4de6-a64d-4716f66105e1 req-6e27f5f6-96e5-495c-8d7c-0e914c424526 service nova] Creating event network-vif-deleted:5d2680cf-b946-498c-bd5b-0362cb8aa7bf for instance 4fadcc45-798b-4945-8379-cefd832dc5dd on n-h1-858384-1 Sep 19 15:40:22.296458 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8e5920be-ee5d-4de6-a64d-4716f66105e1 req-6e27f5f6-96e5-495c-8d7c-0e914c424526 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038885 Sep 19 15:40:22.297077 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3067/6090] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:22.777516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:22.778155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 4fadcc45-798b-4945-8379-cefd832dc5dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:22.786441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:22.787065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:22.787540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:22.788269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:22.788750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:22.789198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:22.803911 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] HTTP exception thrown: Instance 4fadcc45-798b-4945-8379-cefd832dc5dd could not be found. Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Request method failure captured: Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd HTTP/1.1 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI0dEzIaI0KUZOVoI2RVUG4cb78QNF1x_s7YCGYFVgArbrN_RxZfXvmkrf4J5USz2D3zYIjc598t7_EqNxIPapubYDbSB2LpGi6bGgSasbZZudIq5c78Hm76Hn2GxXVcE7Mk9Mt_jRGEYh0JQhzQMapvKdAciB6G83aA065-cs4hNaU Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 3a84008414d147cfbf690f1b2ed7a145 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1142337669 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3a84008414d147cfbf690f1b2ed7a145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a84008414d147cfbf690f1b2ed7a145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a84008414d147cfbf690f1b2ed7a145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3a84008414d147cfbf690f1b2ed7a145"}]}] Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1142337669 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 3a84008414d147cfbf690f1b2ed7a145 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1142337669 Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestSecurityGroupsBasicOps-1142337669-project Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: bad0d683f16d4a9191cee654e516de5f Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1142337669-project Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4fadcc45-798b-4945-8379-cefd832dc5dd could not be found. Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4fadcc45-798b-4945-8379-cefd832dc5dd'} Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fadcc45-798b-4945-8379-cefd832dc5dd could not be found. Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fadcc45-798b-4945-8379-cefd832dc5dd could not be found. Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:40:22.805523 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fadcc45-798b-4945-8379-cefd832dc5dd could not be found. Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Returning 404 to user: Instance 4fadcc45-798b-4945-8379-cefd832dc5dd could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-79255b9c-bb15-469f-9617-949ef14856a2 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd" status: 404 len: 111 microversion: 2.1 time: 0.033426 Sep 19 15:40:22.809553 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3024/6091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:22 2022] GET /compute/v2.1/servers/4fadcc45-798b-4945-8379-cefd832dc5dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:40:26.880113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-598ea4dc-9daa-411c-b23e-f5f770546bca req-140a3298-1c83-401b-9491-e6edc21d72f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e7d543-41e0-4b03-9e54-899ec43a4986", "tag": "7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:26.888826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:26.889432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:26.892774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-598ea4dc-9daa-411c-b23e-f5f770546bca req-140a3298-1c83-401b-9491-e6edc21d72f6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:26.893535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-598ea4dc-9daa-411c-b23e-f5f770546bca req-140a3298-1c83-401b-9491-e6edc21d72f6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:26.894218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-598ea4dc-9daa-411c-b23e-f5f770546bca req-140a3298-1c83-401b-9491-e6edc21d72f6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:26.897551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:26.898215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:26.898855 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:26.899747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:26.900212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:26.900646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:26.908756 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-598ea4dc-9daa-411c-b23e-f5f770546bca req-140a3298-1c83-401b-9491-e6edc21d72f6 service nova] Creating event network-changed:7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98 for instance 72e7d543-41e0-4b03-9e54-899ec43a4986 on n-h2-858384-1 Sep 19 15:40:26.914595 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-598ea4dc-9daa-411c-b23e-f5f770546bca req-140a3298-1c83-401b-9491-e6edc21d72f6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037984 Sep 19 15:40:26.915519 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3025/6092] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:26.930578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:40:27.015059 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dce15dab-c3d2-4056-a464-a0c9d0f2824b tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "DELETE /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 204 len: 0 microversion: 2.1 time: 0.142108 Sep 19 15:40:27.015661 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3068/6093] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:40:26 2022] DELETE /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:40:27.025354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:27.026416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:27.033989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:27.034820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:27.035546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:27.036485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:27.037168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:27.037833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:27.207374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:27.215455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-461c31f4-be1a-45d8-9e89-d0f8487f71e9 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1762 microversion: 2.1 time: 0.194592 Sep 19 15:40:27.215969 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3026/6094] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:27 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1762 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:40:28.239720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:28.240433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:28.247256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:28.247754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:28.248201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:28.248904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:28.249375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:28.249868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:28.636306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bad0d683f16d4a9191cee654e516de5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84008414d147cfbf690f1b2ed7a145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:28.645874 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-14815669-f6dc-4f68-b42b-fc2d45224568 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 200 len: 1762 microversion: 2.1 time: 0.410894 Sep 19 15:40:28.649608 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3069/6095] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:28 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 1762 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:28.987828 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6530e54d-6306-44bc-a90f-5dbe1b2e40e2 req-da15e174-cc87-4559-82d5-e3b58b2e946a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7d543-41e0-4b03-9e54-899ec43a4986", "name": "network-vif-deleted", "tag": "7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:29.006913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6530e54d-6306-44bc-a90f-5dbe1b2e40e2 req-da15e174-cc87-4559-82d5-e3b58b2e946a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:29.007498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6530e54d-6306-44bc-a90f-5dbe1b2e40e2 req-da15e174-cc87-4559-82d5-e3b58b2e946a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:29.008029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6530e54d-6306-44bc-a90f-5dbe1b2e40e2 req-da15e174-cc87-4559-82d5-e3b58b2e946a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:29.023382 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6530e54d-6306-44bc-a90f-5dbe1b2e40e2 req-da15e174-cc87-4559-82d5-e3b58b2e946a service nova] Creating event network-vif-deleted:7ec2a1bd-7941-4f4d-af82-a8b3ea8eab98 for instance 72e7d543-41e0-4b03-9e54-899ec43a4986 on n-h2-858384-1 Sep 19 15:40:29.030923 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6530e54d-6306-44bc-a90f-5dbe1b2e40e2 req-da15e174-cc87-4559-82d5-e3b58b2e946a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047609 Sep 19 15:40:29.031656 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3027/6096] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:29.677531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:29.678284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] [instance: 72e7d543-41e0-4b03-9e54-899ec43a4986] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:29.684421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:29.684908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:29.685352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:29.686044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:29.686516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:29.686965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:29.700853 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] HTTP exception thrown: Instance 72e7d543-41e0-4b03-9e54-899ec43a4986 could not be found. Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Request method failure captured: Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 HTTP/1.1 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI0dEzIaI0KUZOVoI2RVUG4cb78QNF1x_s7YCGYFVgArbrN_RxZfXvmkrf4J5USz2D3zYIjc598t7_EqNxIPapubYDbSB2LpGi6bGgSasbZZudIq5c78Hm76Hn2GxXVcE7Mk9Mt_jRGEYh0JQhzQMapvKdAciB6G83aA065-cs4hNaU Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 3a84008414d147cfbf690f1b2ed7a145 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1142337669 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3a84008414d147cfbf690f1b2ed7a145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a84008414d147cfbf690f1b2ed7a145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a84008414d147cfbf690f1b2ed7a145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3a84008414d147cfbf690f1b2ed7a145"}]}] Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1142337669 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 3a84008414d147cfbf690f1b2ed7a145 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1142337669 Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestSecurityGroupsBasicOps-1142337669-project Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: bad0d683f16d4a9191cee654e516de5f Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1142337669-project Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 72e7d543-41e0-4b03-9e54-899ec43a4986 could not be found. Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '72e7d543-41e0-4b03-9e54-899ec43a4986'} Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e7d543-41e0-4b03-9e54-899ec43a4986 could not be found. Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e7d543-41e0-4b03-9e54-899ec43a4986 could not be found. Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:40:29.702537 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e7d543-41e0-4b03-9e54-899ec43a4986 could not be found. Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Returning 404 to user: Instance 72e7d543-41e0-4b03-9e54-899ec43a4986 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-083aa6ae-de14-4065-ae78-9dd69106edb1 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986" status: 404 len: 111 microversion: 2.1 time: 0.031445 Sep 19 15:40:29.706732 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3070/6097] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:29 2022] GET /compute/v2.1/servers/72e7d543-41e0-4b03-9e54-899ec43a4986 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:40:33.053495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7283359c-deeb-4081-a64c-b6a3f9abe971 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] Calling method '.version_select at 0x7fde299cf700>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:33.074275 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7283359c-deeb-4081-a64c-b6a3f9abe971 tempest-TestSecurityGroupsBasicOps-1142337669 tempest-TestSecurityGroupsBasicOps-1142337669-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2097382" status: 202 len: 0 microversion: 2.1 time: 0.026865 Sep 19 15:40:33.074981 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3028/6098] 10.222.0.81 () {58 vars in 1269 bytes} [Mon Sep 19 15:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2097382 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:40:44.631139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:44.632428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:44.766975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:44.768679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:44.769170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:44.769613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:44.770346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:44.770831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:44.771265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:44.798320 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4972d9a4-9e38-420a-8cd5-52b89db60247 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.173190 Sep 19 15:40:44.798956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3071/6099] 10.222.0.81 () {58 vars in 1185 bytes} [Mon Sep 19 15:40:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:44.938814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-776456316", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "availability_zone": "nova:n-h2-858384-1", "networks": [{"uuid": "628cacaa-3f48-4f78-942c-f6ec26f5826e"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:44.955026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:44.956034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:45.011232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] validate_networks() for [('628cacaa-3f48-4f78-942c-f6ec26f5826e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:40:45.412461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:40:45.412910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:40:45.413404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:40:45.413840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:40:45.414304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:40:45.423356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:45.423866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:45.424324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:45.425340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:45.425816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:45.426267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:45.444438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Getting quotas for project 9872c9e09c894bcfa0533ab7b001ed74. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:40:45.449710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Getting quotas for user 565853307dd04c39ba9e5dbfb486599d and project 9872c9e09c894bcfa0533ab7b001ed74. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:40:45.462554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:40:45.465044 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:40:45.511203 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a4665c5-5a5f-4df7-9c1e-ee174b0e8ce7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576324 Sep 19 15:40:45.511785 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3029/6100] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:40:45.523052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f7489e50-f920-4d56-b00b-0714194d017b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:45.523683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f7489e50-f920-4d56-b00b-0714194d017b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:45.585179 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f7489e50-f920-4d56-b00b-0714194d017b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1328 microversion: 2.1 time: 0.065774 Sep 19 15:40:45.585763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3072/6101] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:45 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1328 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:46.608102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:46.608751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:46.617418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:46.617933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:46.618394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:46.619149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:46.620717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:46.621609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:46.770738 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ba7ebb82-2e33-4486-b94b-cde40beabeb4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1415 microversion: 2.1 time: 0.166350 Sep 19 15:40:46.771612 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3030/6102] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:46 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1415 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:47.804051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:47.804704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:47.819716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:47.820707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:47.821350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:47.822287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:47.822990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:47.823875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:48.069299 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd480df7-26d8-4ead-b5ad-2379efb0f914 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1463 microversion: 2.1 time: 0.277894 Sep 19 15:40:48.082772 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3073/6103] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:47 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1463 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:48.221954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-498800be-7cb5-40fb-9c03-2cbdfaa0d245 req-5e6116cb-8288-4836-b392-e32e1f423571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77b9295-d50b-4ded-990b-64ccec4a5e8b", "tag": "25cc1d54-6db6-4965-8b11-4238ae076f6a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:48.235055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-498800be-7cb5-40fb-9c03-2cbdfaa0d245 req-5e6116cb-8288-4836-b392-e32e1f423571 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:48.235716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-498800be-7cb5-40fb-9c03-2cbdfaa0d245 req-5e6116cb-8288-4836-b392-e32e1f423571 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:48.236262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-498800be-7cb5-40fb-9c03-2cbdfaa0d245 req-5e6116cb-8288-4836-b392-e32e1f423571 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:48.258894 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-498800be-7cb5-40fb-9c03-2cbdfaa0d245 req-5e6116cb-8288-4836-b392-e32e1f423571 service nova] Creating event network-changed:25cc1d54-6db6-4965-8b11-4238ae076f6a for instance a77b9295-d50b-4ded-990b-64ccec4a5e8b on n-h2-858384-1 Sep 19 15:40:48.265758 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-498800be-7cb5-40fb-9c03-2cbdfaa0d245 req-5e6116cb-8288-4836-b392-e32e1f423571 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049336 Sep 19 15:40:48.267700 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3031/6104] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:49.092904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:49.094490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:49.101461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:49.102242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:49.102845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:49.103627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:49.104154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:49.104817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:49.252475 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-101bff1f-0fee-487d-8aa6-02004ad99644 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1463 microversion: 2.1 time: 0.163273 Sep 19 15:40:49.253149 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3074/6105] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:49 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:50.278108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:50.278897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:50.285846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:50.286353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:50.286835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:50.287553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:50.288030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:50.288473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:50.417657 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2982a901-fd72-4652-9cbc-9c19e1796390 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1463 microversion: 2.1 time: 0.144534 Sep 19 15:40:50.418237 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3032/6106] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:50 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:51.443809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:51.444431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:51.450389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:51.450915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:51.451350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:51.452064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:51.452493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:51.452913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:51.583793 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8940fe6-4c2f-48f1-ab3e-c61f36c46a32 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1463 microversion: 2.1 time: 0.145965 Sep 19 15:40:51.585047 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3075/6107] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:51 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:52.607003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:52.607645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:52.614469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:52.615014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:52.615474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:52.616182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:52.616657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:52.617100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:52.742263 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78ee9bfe-da30-485f-be44-c0c38c89c97d tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1463 microversion: 2.1 time: 0.138894 Sep 19 15:40:52.742711 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3033/6108] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:52 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:53.597370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-3b32e4e4-6c96-4986-aba0-b91828e8f24e req-6045aa1e-982c-42b8-b68f-dcf15fb8aa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77b9295-d50b-4ded-990b-64ccec4a5e8b", "name": "network-vif-plugged", "status": "completed", "tag": "25cc1d54-6db6-4965-8b11-4238ae076f6a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:53.608556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3b32e4e4-6c96-4986-aba0-b91828e8f24e req-6045aa1e-982c-42b8-b68f-dcf15fb8aa98 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:53.609047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3b32e4e4-6c96-4986-aba0-b91828e8f24e req-6045aa1e-982c-42b8-b68f-dcf15fb8aa98 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:53.609482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-3b32e4e4-6c96-4986-aba0-b91828e8f24e req-6045aa1e-982c-42b8-b68f-dcf15fb8aa98 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:53.620719 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-3b32e4e4-6c96-4986-aba0-b91828e8f24e req-6045aa1e-982c-42b8-b68f-dcf15fb8aa98 service nova] Creating event network-vif-plugged:25cc1d54-6db6-4965-8b11-4238ae076f6a for instance a77b9295-d50b-4ded-990b-64ccec4a5e8b on n-h2-858384-1 Sep 19 15:40:53.625908 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-3b32e4e4-6c96-4986-aba0-b91828e8f24e req-6045aa1e-982c-42b8-b68f-dcf15fb8aa98 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Sep 19 15:40:53.626695 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3076/6109] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:53.767817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:53.768458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:53.775253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:53.775791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:53.776248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:53.776964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:53.777441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:53.777887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:53.908662 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-619a5245-629c-4e6b-86ba-76ca79ef5c3b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1463 microversion: 2.1 time: 0.145099 Sep 19 15:40:53.909249 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3034/6110] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:53 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:54.929732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:54.933835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:54.934542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:54.941110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:54.941600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:54.942038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:54.942732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:54.943218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:54.943651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.072297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c58e190-3804-4bb5-91be-da26b9902edb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1647 microversion: 2.1 time: 0.144248 Sep 19 15:40:55.072882 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3077/6111] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:54 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1647 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:55.095824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:55.096466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:55.103256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.103768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.104228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.104942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.105427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.105877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.233399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-029c2bec-4ca7-41b9-b8fd-38670f64547f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1647 microversion: 2.1 time: 0.141888 Sep 19 15:40:55.233982 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3035/6112] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:55 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1647 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:55.255340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:55.255957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:55.262191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.262682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.263179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.263886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.264341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.264769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.388502 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d950e55b-8ee3-4345-9469-545480406a33 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1647 microversion: 2.1 time: 0.136847 Sep 19 15:40:55.389071 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3078/6113] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:55 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1647 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:55.455392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-498403637", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "availability_zone": "nova:n-h1-858384-1", "networks": [{"uuid": "628cacaa-3f48-4f78-942c-f6ec26f5826e"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:55.466419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:55.467290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:55.520904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] validate_networks() for [('628cacaa-3f48-4f78-942c-f6ec26f5826e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:40:55.872166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:40:55.872618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:40:55.873110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:40:55.873570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:40:55.874002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:40:55.883085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.883591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.884041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.884780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.885251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.885691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.902879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Getting quotas for project 9872c9e09c894bcfa0533ab7b001ed74. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:40:55.908771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Getting quotas for user 565853307dd04c39ba9e5dbfb486599d and project 9872c9e09c894bcfa0533ab7b001ed74. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:40:55.920932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:40:55.923443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:40:55.967747 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b5fe049-81e8-42c2-be20-5fdb8c788fb5 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517134 Sep 19 15:40:55.968407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3036/6114] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:40:55.980077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d86b8a6-5c4b-4fe1-8a54-c305e4d00414 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:55.980694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d86b8a6-5c4b-4fe1-8a54-c305e4d00414 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:55.982568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:56.042227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d86b8a6-5c4b-4fe1-8a54-c305e4d00414 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1328 microversion: 2.1 time: 0.065871 Sep 19 15:40:56.042957 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3079/6115] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:55 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1328 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:57.067938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:57.068569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:57.078115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:57.079371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:57.080150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:57.080914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:57.081393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:57.081834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:57.161471 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f5b170b8-181e-49c7-87f7-3c435bb6f1f7 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1421 microversion: 2.1 time: 0.099601 Sep 19 15:40:57.177824 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3037/6116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:57 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:58.185948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:58.186534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:58.197970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:58.198475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:58.198976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:58.199692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:58.200159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:58.200593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:58.416758 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-609c625c-3058-4887-bb9e-509832809154 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.234573 Sep 19 15:40:58.417271 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3080/6117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:58 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:58.556301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-71c42579-2522-44ff-b2f4-c1ac56d20623 req-005bc9b0-c849-4391-b9e7-d8801f123429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6511ae74-192f-4180-9957-b40b94156779", "tag": "5d6c6bf5-89d6-4cd1-855e-cd46f733a402"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:40:58.572577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-71c42579-2522-44ff-b2f4-c1ac56d20623 req-005bc9b0-c849-4391-b9e7-d8801f123429 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:58.573245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-71c42579-2522-44ff-b2f4-c1ac56d20623 req-005bc9b0-c849-4391-b9e7-d8801f123429 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:58.574300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-71c42579-2522-44ff-b2f4-c1ac56d20623 req-005bc9b0-c849-4391-b9e7-d8801f123429 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:58.587150 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-71c42579-2522-44ff-b2f4-c1ac56d20623 req-005bc9b0-c849-4391-b9e7-d8801f123429 service nova] Creating event network-changed:5d6c6bf5-89d6-4cd1-855e-cd46f733a402 for instance 6511ae74-192f-4180-9957-b40b94156779 on n-h1-858384-1 Sep 19 15:40:58.592162 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-71c42579-2522-44ff-b2f4-c1ac56d20623 req-005bc9b0-c849-4391-b9e7-d8801f123429 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040506 Sep 19 15:40:58.592764 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3038/6118] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:40:59.441476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:59.442086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:59.448160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:59.448648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:59.449082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:59.449768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:59.450222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:59.450646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:59.575470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb17a131-e8ec-4842-baf1-ee224ebc053b tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.138543 Sep 19 15:40:59.576047 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3081/6119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:59 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:00.598222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:00.599004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:00.605999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:00.606500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:00.606991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:00.607697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:00.608172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:00.608615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:00.738030 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-40f2d82b-49b7-4014-90f3-ebff1f7554e3 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.144153 Sep 19 15:41:00.738612 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3039/6120] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:00 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:01.761386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:01.762010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:01.769666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:01.770156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:01.770603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:01.771331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:01.771798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:01.772229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:01.897890 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c2e085dc-3fb4-4deb-9264-564d00c01448 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.140198 Sep 19 15:41:01.898471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3082/6121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:01 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:02.921398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:02.922066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:02.929986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:02.930486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:02.930978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:02.931687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:02.932156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:02.932598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:03.064994 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fd65b75-857c-4ff2-b38f-9869a6368e93 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.147306 Sep 19 15:41:03.065577 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3040/6122] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:02 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:04.087371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:04.087988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:04.094994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:04.095492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:04.095931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:04.096634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:04.097092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:04.097518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:04.193020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cc89a122-0169-48e6-8310-241f24bef4ad req-300eb36e-20a8-49f3-80e0-adebc6bdd484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6511ae74-192f-4180-9957-b40b94156779", "name": "network-vif-plugged", "status": "completed", "tag": "5d6c6bf5-89d6-4cd1-855e-cd46f733a402"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:04.209064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc89a122-0169-48e6-8310-241f24bef4ad req-300eb36e-20a8-49f3-80e0-adebc6bdd484 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:04.210559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc89a122-0169-48e6-8310-241f24bef4ad req-300eb36e-20a8-49f3-80e0-adebc6bdd484 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:04.210559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc89a122-0169-48e6-8310-241f24bef4ad req-300eb36e-20a8-49f3-80e0-adebc6bdd484 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:04.223268 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cc89a122-0169-48e6-8310-241f24bef4ad req-300eb36e-20a8-49f3-80e0-adebc6bdd484 service nova] Creating event network-vif-plugged:5d6c6bf5-89d6-4cd1-855e-cd46f733a402 for instance 6511ae74-192f-4180-9957-b40b94156779 on n-h1-858384-1 Sep 19 15:41:04.229296 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cc89a122-0169-48e6-8310-241f24bef4ad req-300eb36e-20a8-49f3-80e0-adebc6bdd484 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041098 Sep 19 15:41:04.230330 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3041/6123] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:04.246474 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d0b7c8e4-33e7-424a-a1f8-d62f11db08ec tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.162789 Sep 19 15:41:04.247283 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3083/6124] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:04 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:05.270127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:05.270878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:05.277678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:05.278188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:05.278648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:05.279385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:05.279904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:05.280350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:05.416664 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2e4bdab-8955-4fa4-9309-0148848333c4 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1463 microversion: 2.1 time: 0.150598 Sep 19 15:41:05.417261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3042/6125] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:05 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:06.441927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:06.442458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:06.445283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:06.451171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.451663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.452102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.452796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.453343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.453834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.579832 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-70ef4eba-52a7-47a4-9260-f017a84de63a tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1648 microversion: 2.1 time: 0.142299 Sep 19 15:41:06.580416 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3084/6126] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:06 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1648 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:06.602275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:06.602980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:06.604937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:06.605714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:06.613796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.614307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.614785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.615510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.615992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.616438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.748446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1100a9dd-6c6a-4b19-a6ba-2b0595e6dab1 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1648 microversion: 2.1 time: 0.149622 Sep 19 15:41:06.749229 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3043/6127] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:06 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1648 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:06.770464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:06.771122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:06.777306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.777794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.778232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.778959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.779415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.779842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.907700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13be55c2-7b01-48bf-aee9-7bb458175e44 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1648 microversion: 2.1 time: 0.140842 Sep 19 15:41:06.908301 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3085/6128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:06 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1648 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:06.930378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:06.930940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:06.936953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.937462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.938059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.938805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.939291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.939742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.967270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:41:07.041679 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-af566fdc-d118-4edd-aec7-82703f0336ad tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "DELETE /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 204 len: 0 microversion: 2.1 time: 0.114618 Sep 19 15:41:07.042371 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3044/6129] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:41:06 2022] DELETE /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:41:07.052095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:07.052760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:07.058819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:07.059312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:07.059754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:07.060455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:07.060916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:07.061344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:07.188903 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17e1947c-8bb6-4bf0-9998-8e5693b6eecb tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1654 microversion: 2.1 time: 0.141282 Sep 19 15:41:07.189527 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3086/6130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:07 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:08.213418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:08.214139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:08.221670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:08.222183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:08.222642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:08.223388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:08.223866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:08.224309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:08.385340 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-637e33c4-9530-49b6-95d4-8a5ac7c8790e tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 200 len: 1654 microversion: 2.1 time: 0.175958 Sep 19 15:41:08.385872 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3045/6131] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:08 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 1654 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:08.883801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a92f7875-d21a-4ba8-a0d3-eeacfef9d249 req-38f9c224-498e-4a30-a39d-5922e732494c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6511ae74-192f-4180-9957-b40b94156779", "name": "network-vif-deleted", "tag": "5d6c6bf5-89d6-4cd1-855e-cd46f733a402"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:08.910002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a92f7875-d21a-4ba8-a0d3-eeacfef9d249 req-38f9c224-498e-4a30-a39d-5922e732494c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:08.911244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a92f7875-d21a-4ba8-a0d3-eeacfef9d249 req-38f9c224-498e-4a30-a39d-5922e732494c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:08.911733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a92f7875-d21a-4ba8-a0d3-eeacfef9d249 req-38f9c224-498e-4a30-a39d-5922e732494c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:08.932594 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a92f7875-d21a-4ba8-a0d3-eeacfef9d249 req-38f9c224-498e-4a30-a39d-5922e732494c service nova] Creating event network-vif-deleted:5d6c6bf5-89d6-4cd1-855e-cd46f733a402 for instance 6511ae74-192f-4180-9957-b40b94156779 on n-h1-858384-1 Sep 19 15:41:08.939683 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a92f7875-d21a-4ba8-a0d3-eeacfef9d249 req-38f9c224-498e-4a30-a39d-5922e732494c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146988 Sep 19 15:41:08.940805 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3087/6132] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:09.408508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:09.409171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: 6511ae74-192f-4180-9957-b40b94156779] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:09.417311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.417827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.418283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.419209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.419688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.420137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] HTTP exception thrown: Instance 6511ae74-192f-4180-9957-b40b94156779 could not be found. Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Request method failure captured: Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 HTTP/1.1 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI18ZQGQQDG1xNd3g7KfTZ0rH8hyNJXNsJWwo9RUclUDqii6b1-7HmCKGdY8Y4JOAIBoME_aswu2Nccon7RMR4NTMcTrkfo3TnYBDQu73GoxlRGNpg_YeKFVOk3Q0Fn0pJGkyUvg_0Jf81aWBu9ycFbM9Mm31cNwzItifrjDC3Z-bhI Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 9872c9e09c894bcfa0533ab7b001ed74 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestServerMultinode-649026310 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9872c9e09c894bcfa0533ab7b001ed74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9872c9e09c894bcfa0533ab7b001ed74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9872c9e09c894bcfa0533ab7b001ed74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9872c9e09c894bcfa0533ab7b001ed74"}]}] Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestServerMultinode-649026310 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 9872c9e09c894bcfa0533ab7b001ed74 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestServerMultinode-649026310 Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestServerMultinode-649026310-project-admin Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 565853307dd04c39ba9e5dbfb486599d Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestServerMultinode-649026310-project-admin Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 6511ae74-192f-4180-9957-b40b94156779 could not be found. Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '6511ae74-192f-4180-9957-b40b94156779'} Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6511ae74-192f-4180-9957-b40b94156779 could not be found. Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:41:09.439095 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6511ae74-192f-4180-9957-b40b94156779 could not be found. Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6511ae74-192f-4180-9957-b40b94156779 could not be found. Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Returning 404 to user: Instance 6511ae74-192f-4180-9957-b40b94156779 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82a1a1f7-18be-4e78-9fea-9ccd9e085879 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779" status: 404 len: 111 microversion: 2.1 time: 0.033945 Sep 19 15:41:09.443675 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3046/6133] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:09 2022] GET /compute/v2.1/servers/6511ae74-192f-4180-9957-b40b94156779 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:41:09.449395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:09.450953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:09.460102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.460532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.461003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.461788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.462243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.462675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.488989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:41:09.565773 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3d7e459f-42fd-439a-bef4-2c0a72e4c74f tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "DELETE /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 204 len: 0 microversion: 2.1 time: 0.121113 Sep 19 15:41:09.566373 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3088/6134] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:41:09 2022] DELETE /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:41:09.575203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:09.575833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:09.583404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.583915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.584370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.585085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.585564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.586013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.710783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:09.716121 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c4889317-a860-4a52-a77f-9bccb8bd0c60 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1653 microversion: 2.1 time: 0.144660 Sep 19 15:41:09.716705 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3047/6135] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:09 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1653 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:10.740396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:10.741114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:10.748913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:10.749406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:10.749853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:10.750823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:10.751289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:10.751726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:10.876946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:10.882031 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-657c8de4-3e88-4c56-aa2b-140e692f3784 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 200 len: 1653 microversion: 2.1 time: 0.145809 Sep 19 15:41:10.882609 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3089/6136] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:10 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 1653 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:41:11.355690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-323199f8-85f9-434c-966f-760f18b84e21 req-3f12ec74-99d9-44ef-a823-e4f89d510c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77b9295-d50b-4ded-990b-64ccec4a5e8b", "name": "network-vif-deleted", "tag": "25cc1d54-6db6-4965-8b11-4238ae076f6a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:11.371481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-323199f8-85f9-434c-966f-760f18b84e21 req-3f12ec74-99d9-44ef-a823-e4f89d510c91 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:11.372361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-323199f8-85f9-434c-966f-760f18b84e21 req-3f12ec74-99d9-44ef-a823-e4f89d510c91 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:11.372710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-323199f8-85f9-434c-966f-760f18b84e21 req-3f12ec74-99d9-44ef-a823-e4f89d510c91 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:11.388510 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-323199f8-85f9-434c-966f-760f18b84e21 req-3f12ec74-99d9-44ef-a823-e4f89d510c91 service nova] Creating event network-vif-deleted:25cc1d54-6db6-4965-8b11-4238ae076f6a for instance a77b9295-d50b-4ded-990b-64ccec4a5e8b on n-h2-858384-1 Sep 19 15:41:11.395898 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-323199f8-85f9-434c-966f-760f18b84e21 req-3f12ec74-99d9-44ef-a823-e4f89d510c91 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044630 Sep 19 15:41:11.396834 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3048/6137] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:41:11.905491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:11.906123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] [instance: a77b9295-d50b-4ded-990b-64ccec4a5e8b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:11.914255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:11.914766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:11.915207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:11.915904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:11.916359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:11.916786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:11.931230 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] HTTP exception thrown: Instance a77b9295-d50b-4ded-990b-64ccec4a5e8b could not be found. Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Request method failure captured: Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b HTTP/1.1 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI18ZQGQQDG1xNd3g7KfTZ0rH8hyNJXNsJWwo9RUclUDqii6b1-7HmCKGdY8Y4JOAIBoME_aswu2Nccon7RMR4NTMcTrkfo3TnYBDQu73GoxlRGNpg_YeKFVOk3Q0Fn0pJGkyUvg_0Jf81aWBu9ycFbM9Mm31cNwzItifrjDC3Z-bhI Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 9872c9e09c894bcfa0533ab7b001ed74 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestServerMultinode-649026310 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9872c9e09c894bcfa0533ab7b001ed74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9872c9e09c894bcfa0533ab7b001ed74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9872c9e09c894bcfa0533ab7b001ed74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9872c9e09c894bcfa0533ab7b001ed74"}]}] Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestServerMultinode-649026310 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 9872c9e09c894bcfa0533ab7b001ed74 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestServerMultinode-649026310 Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestServerMultinode-649026310-project-admin Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 565853307dd04c39ba9e5dbfb486599d Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestServerMultinode-649026310-project-admin Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a77b9295-d50b-4ded-990b-64ccec4a5e8b could not be found. Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a77b9295-d50b-4ded-990b-64ccec4a5e8b'} Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77b9295-d50b-4ded-990b-64ccec4a5e8b could not be found. Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77b9295-d50b-4ded-990b-64ccec4a5e8b could not be found. Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:11.932894 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77b9295-d50b-4ded-990b-64ccec4a5e8b could not be found. Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] Returning 404 to user: Instance a77b9295-d50b-4ded-990b-64ccec4a5e8b could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21b1711c-52e6-4578-89f8-d9935c7f7991 tempest-TestServerMultinode-649026310 tempest-TestServerMultinode-649026310-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b" status: 404 len: 111 microversion: 2.1 time: 0.032615 Sep 19 15:41:11.936376 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3090/6138] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:11 2022] GET /compute/v2.1/servers/a77b9295-d50b-4ded-990b-64ccec4a5e8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:41:39.724507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:39.725297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:39.835667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-792547665", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:39.887067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] validate_networks() for None {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:41:40.182223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:41:40.182976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:41:40.183800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:41:40.184467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:41:40.185142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:41:40.195590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:40.196087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:40.196531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:40.197294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:40.197760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:40.198195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:40.219790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Getting quotas for project 64a307c7111c4faa84b492f71b921b4c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:41:40.225268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Getting quotas for user 4d18df48ffc24ac99acfca4abbea7b05 and project 64a307c7111c4faa84b492f71b921b4c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:41:40.237513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:41:40.240089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:41:40.287738 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-925c25d3-2015-419d-9ec5-2c2f35ca6460 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568558 Sep 19 15:41:40.288407 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3049/6139] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:41:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:41:40.301405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e71f860e-6b95-41fb-8c52-c40cecb98c9a tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:40.302029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e71f860e-6b95-41fb-8c52-c40cecb98c9a tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:40.304202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:40.305045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:40.361291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e71f860e-6b95-41fb-8c52-c40cecb98c9a tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:40.369441 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e71f860e-6b95-41fb-8c52-c40cecb98c9a tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1221 microversion: 2.1 time: 0.072393 Sep 19 15:41:40.370126 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3091/6140] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:40 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1221 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:41.393264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:41.394174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:41.401719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:41.402223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:41.402715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:41.403393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:41.403896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:41.404334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:41.508921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:41.517265 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4502521c-ba50-4dc0-a277-3e79708d3616 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1279 microversion: 2.1 time: 0.128116 Sep 19 15:41:41.517841 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3050/6141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:41 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:42.541513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:42.542141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:42.550338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:42.551124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:42.551562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:42.552267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:42.552727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:42.553152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:42.752001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:42.759850 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cdecf9a9-127c-4a65-a605-95a7c0f11dc3 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1321 microversion: 2.1 time: 0.222229 Sep 19 15:41:42.760422 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3092/6142] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:42 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:42.873187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-59793644-d79f-41f5-8edd-843a87741913 req-2bb0d5a9-d04d-45b3-ac9b-fcf7103ef5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9b6db-f013-4709-b7d1-7a2ab199d7fe", "tag": "3842cac8-1c1f-41a1-ba3a-3f77779b478a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:42.888437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-59793644-d79f-41f5-8edd-843a87741913 req-2bb0d5a9-d04d-45b3-ac9b-fcf7103ef5df service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:42.889025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-59793644-d79f-41f5-8edd-843a87741913 req-2bb0d5a9-d04d-45b3-ac9b-fcf7103ef5df service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:42.889558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-59793644-d79f-41f5-8edd-843a87741913 req-2bb0d5a9-d04d-45b3-ac9b-fcf7103ef5df service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:42.902888 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-59793644-d79f-41f5-8edd-843a87741913 req-2bb0d5a9-d04d-45b3-ac9b-fcf7103ef5df service nova] Creating event network-changed:3842cac8-1c1f-41a1-ba3a-3f77779b478a for instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe on n-h1-858384-1 Sep 19 15:41:42.908505 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-59793644-d79f-41f5-8edd-843a87741913 req-2bb0d5a9-d04d-45b3-ac9b-fcf7103ef5df service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039241 Sep 19 15:41:42.909272 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3051/6143] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:43.784139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:43.784755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:43.791626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:43.792112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:43.792550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:43.793245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:43.793701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:43.794160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:43.928120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:43.935761 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e09e9ff0-e6ae-4eea-ba1c-125c01bdc048 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1321 microversion: 2.1 time: 0.156193 Sep 19 15:41:43.936333 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3093/6144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:43 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:44.959018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:44.959744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:44.966841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:44.967348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:44.968383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:44.969021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:44.969494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:44.969938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:45.106825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:45.115915 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9482379e-679c-4e1b-b867-1014139cde53 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1321 microversion: 2.1 time: 0.161205 Sep 19 15:41:45.116508 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3052/6145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:44 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:46.139203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:46.139983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:46.147137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:46.147627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:46.148066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:46.148757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:46.149218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:46.149645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:46.278520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:46.287010 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-31745274-5ad7-40ca-a014-719eb974bbc8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1321 microversion: 2.1 time: 0.151586 Sep 19 15:41:46.287583 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3094/6146] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:46 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:47.310642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:47.311316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:47.318317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:47.318865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:47.319330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:47.320047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:47.320525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:47.320974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:47.456040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:47.463656 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9173210f-d32e-46e3-8d8a-03e780104f2b tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1321 microversion: 2.1 time: 0.156982 Sep 19 15:41:47.464227 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3053/6147] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:47 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:48.479243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b5160819-fffb-4c97-95ac-11157110b273 req-38d0a8f6-57a3-4f0a-b0f3-681a592c0eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9b6db-f013-4709-b7d1-7a2ab199d7fe", "name": "network-vif-plugged", "status": "completed", "tag": "3842cac8-1c1f-41a1-ba3a-3f77779b478a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:48.486886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:48.487520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:48.489447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b5160819-fffb-4c97-95ac-11157110b273 req-38d0a8f6-57a3-4f0a-b0f3-681a592c0eb8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:48.489945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b5160819-fffb-4c97-95ac-11157110b273 req-38d0a8f6-57a3-4f0a-b0f3-681a592c0eb8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:48.490379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b5160819-fffb-4c97-95ac-11157110b273 req-38d0a8f6-57a3-4f0a-b0f3-681a592c0eb8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:48.494032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:48.494537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:48.495023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:48.495733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:48.496208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:48.496651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:48.501591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b5160819-fffb-4c97-95ac-11157110b273 req-38d0a8f6-57a3-4f0a-b0f3-681a592c0eb8 service nova] Creating event network-vif-plugged:3842cac8-1c1f-41a1-ba3a-3f77779b478a for instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe on n-h1-858384-1 Sep 19 15:41:48.506738 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b5160819-fffb-4c97-95ac-11157110b273 req-38d0a8f6-57a3-4f0a-b0f3-681a592c0eb8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095218 Sep 19 15:41:48.507369 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3095/6148] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:48.674613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:48.683186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cb7fc0db-9c44-40bc-a941-26192e9d4566 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1321 microversion: 2.1 time: 0.200223 Sep 19 15:41:48.683775 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3054/6149] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:48 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:41:49.707919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:49.708568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:49.714825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:49.715328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:49.715765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:49.716449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:49.716899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:49.717438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:49.850389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:49.858536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab4364d2-b17c-428f-a78b-33724d50225c tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1471 microversion: 2.1 time: 0.156526 Sep 19 15:41:49.859151 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3096/6150] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:49 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:49.930194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a65f408-0851-42a1-9bec-6623871ff9bd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Calling method '.version_select at 0x7fde29bbf280>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:49.994076 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4a65f408-0851-42a1-9bec-6623871ff9bd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/444f8ec322b9468fa370e992d81b8857" status: 200 len: 371 microversion: 2.1 time: 0.114703 Sep 19 15:41:49.994652 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3055/6151] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 15:41:49 2022] GET /compute/v2.1/os-quota-sets/444f8ec322b9468fa370e992d81b8857 => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:50.007240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f5c7cab3-5868-4aff-bb1b-6530fc9fd5d9 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2080061936", "id": 764299382, "os-flavor-access:is_public": "True"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:50.025973 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f5c7cab3-5868-4aff-bb1b-6530fc9fd5d9 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022542 Sep 19 15:41:50.026551 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3097/6152] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:41:50 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:50.039319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "764299382"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:50.041641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:50.047761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.048268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.048720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.049427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.049902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.050429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.208677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:50.231814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a81063dbbe8648bf8b0c91ad318f6946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444f8ec322b9468fa370e992d81b8857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:50.238022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2080061936 {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:41:50.244719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.245214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.245660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.246397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.246902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.247338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.270610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Getting quotas for project 64a307c7111c4faa84b492f71b921b4c. Resources: {'cores', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:41:50.275627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Getting quotas for user 4d18df48ffc24ac99acfca4abbea7b05 and project 64a307c7111c4faa84b492f71b921b4c. Resources: {'cores', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:41:50.289964 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] ram quota exceeded for 444f8ec322b9468fa370e992d81b8857, tried to resize instance. Sep 19 15:41:50.290508 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Request method failure captured: Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe/action HTTP/1.1 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 38 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI2z7mpMv9ggNUQdxHMh01M7LJ8U3P3S1S6yekN9dSCOQkMcUO_wrm1cWjgSLh5jTZwXIEWDi6YWrf0z6DMkyYsLihuVH2iLUkiyDHRQJsFH6yAE1Mjl16P-kXVwRCffsvpnJPqSXuHsguknsNBtxM_lSsAVxHdtnVy7L3tyXSafz8Y Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 444f8ec322b9468fa370e992d81b8857 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-883658855 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Role: reader,member,admin Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: reader,member,admin Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_444f8ec322b9468fa370e992d81b8857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/444f8ec322b9468fa370e992d81b8857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/444f8ec322b9468fa370e992d81b8857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/444f8ec322b9468fa370e992d81b8857"}]}] Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersAdminNegativeTestJSON-883658855 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 444f8ec322b9468fa370e992d81b8857 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-883658855 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersAdminNegativeTestJSON-883658855-project-admin Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a81063dbbe8648bf8b0c91ad318f6946 Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersAdminNegativeTestJSON-883658855-project-admin Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: {"resize": {"flavorRef": "764299382"}} Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'd7c9b6db-f013-4709-b7d1-7a2ab199d7fe', 'body': {'resize': {'flavorRef': '764299382'}}} Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:41:50.292611 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1a9c9016-ab71-478c-a2fd-b04fd6acf7fd tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe/action" status: 403 len: 118 microversion: 2.1 time: 0.258599 Sep 19 15:41:50.296603 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3056/6153] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:41:50 2022] POST /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe/action => generated 118 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:41:50.303343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e8952ed-fe40-40fb-884c-a7505b9bdbf8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.321389 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e8952ed-fe40-40fb-884c-a7505b9bdbf8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/764299382" status: 202 len: 0 microversion: 2.1 time: 0.021929 Sep 19 15:41:50.322053 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3098/6154] 10.222.0.81 () {58 vars in 1158 bytes} [Mon Sep 19 15:41:50 2022] DELETE /compute/v2.1/flavors/764299382 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:41:50.330727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5bfe5d7-3c62-4b43-a669-e4e8fbc2670e tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.353872 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5bfe5d7-3c62-4b43-a669-e4e8fbc2670e tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027555 Sep 19 15:41:50.354434 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3057/6155] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 15:41:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:50.375381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-628d55c2-4110-412b-81fe-6c773de36c5b tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Calling method '.version_select at 0x7fde298a5e50>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.383473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:50.445226 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-628d55c2-4110-412b-81fe-6c773de36c5b tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/444f8ec322b9468fa370e992d81b8857" status: 200 len: 371 microversion: 2.1 time: 0.074443 Sep 19 15:41:50.445806 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3099/6156] 10.222.0.81 () {58 vars in 1242 bytes} [Mon Sep 19 15:41:50 2022] GET /compute/v2.1/os-quota-sets/444f8ec322b9468fa370e992d81b8857 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:50.457740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b9db63e-5da0-4a82-9138-c3d67113b33d tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1248658791", "id": 1501589881, "os-flavor-access:is_public": "True"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:50.475410 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b9db63e-5da0-4a82-9138-c3d67113b33d tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021407 Sep 19 15:41:50.475911 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3058/6157] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:41:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:50.488353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1501589881"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:50.490659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:50.496647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.497134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.497569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.498259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.498715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.500040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.584662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a81063dbbe8648bf8b0c91ad318f6946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444f8ec322b9468fa370e992d81b8857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:50.590826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1248658791 {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:41:50.597817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.598294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.598721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.599462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.600295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.600295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.622192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Getting quotas for project 64a307c7111c4faa84b492f71b921b4c. Resources: {'cores', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:41:50.628085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Getting quotas for user 4d18df48ffc24ac99acfca4abbea7b05 and project 64a307c7111c4faa84b492f71b921b4c. Resources: {'cores', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:41:50.640272 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.compute.api [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] cores quota exceeded for 444f8ec322b9468fa370e992d81b8857, tried to resize instance. Sep 19 15:41:50.640804 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Request method failure captured: Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe/action HTTP/1.1 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 39 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI2z7mpMv9ggNUQdxHMh01M7LJ8U3P3S1S6yekN9dSCOQkMcUO_wrm1cWjgSLh5jTZwXIEWDi6YWrf0z6DMkyYsLihuVH2iLUkiyDHRQJsFH6yAE1Mjl16P-kXVwRCffsvpnJPqSXuHsguknsNBtxM_lSsAVxHdtnVy7L3tyXSafz8Y Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 444f8ec322b9468fa370e992d81b8857 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-883658855 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Role: reader,member,admin Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: reader,member,admin Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_444f8ec322b9468fa370e992d81b8857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/444f8ec322b9468fa370e992d81b8857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/444f8ec322b9468fa370e992d81b8857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/444f8ec322b9468fa370e992d81b8857"}]}] Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminNegativeTestJSON-883658855 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 444f8ec322b9468fa370e992d81b8857 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-883658855 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminNegativeTestJSON-883658855-project-admin Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a81063dbbe8648bf8b0c91ad318f6946 Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminNegativeTestJSON-883658855-project-admin Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: {"resize": {"flavorRef": "1501589881"}} Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd7c9b6db-f013-4709-b7d1-7a2ab199d7fe', 'body': {'resize': {'flavorRef': '1501589881'}}} Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:41:50.642866 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-931815a7-31a7-49a3-a4fa-d0ca15ff1fb8 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe/action" status: 403 len: 113 microversion: 2.1 time: 0.159821 Sep 19 15:41:50.646680 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3100/6158] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:41:50 2022] POST /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe/action => generated 113 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:41:50.653020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a826a10b-2aa9-4375-b662-572bdf1d303b tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.669711 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a826a10b-2aa9-4375-b662-572bdf1d303b tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1501589881" status: 202 len: 0 microversion: 2.1 time: 0.020527 Sep 19 15:41:50.670263 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3059/6159] 10.222.0.81 () {58 vars in 1161 bytes} [Mon Sep 19 15:41:50 2022] DELETE /compute/v2.1/flavors/1501589881 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:41:50.679049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-494cc8be-7d37-47f1-8332-d91c8a214482 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.702575 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-494cc8be-7d37-47f1-8332-d91c8a214482 tempest-ServersAdminNegativeTestJSON-883658855 tempest-ServersAdminNegativeTestJSON-883658855-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027399 Sep 19 15:41:50.703174 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3101/6160] 10.222.0.81 () {58 vars in 1146 bytes} [Mon Sep 19 15:41:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:50.723167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.723685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:50.729665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.730109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.730563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.731290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.731762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.732209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.758402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:41:50.834224 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21593fa7-8965-474f-91af-d04a9e21fcf0 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 204 len: 0 microversion: 2.1 time: 0.114674 Sep 19 15:41:50.834893 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3060/6161] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:41:50 2022] DELETE /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:41:50.845387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.846005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:50.852803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.853296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.853743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.854442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.854941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.855378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.988285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:50.996105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20d420de-310e-49f0-ba41-0dc2fd394b51 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1477 microversion: 2.1 time: 0.156590 Sep 19 15:41:50.996676 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3102/6162] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:50 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:52.019513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:52.020161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:52.026951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:52.027457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:52.027911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:52.028614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:52.029089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:52.029531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:52.158601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:52.166495 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7e640933-c4a3-4398-bd72-d6713fe593ba tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1477 microversion: 2.1 time: 0.151427 Sep 19 15:41:52.167101 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3061/6163] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:52 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:52.651487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-b480ea40-1827-40b8-a00c-a8e939cf7992 req-586e7714-ec46-470d-8e7b-a686e3e99e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9b6db-f013-4709-b7d1-7a2ab199d7fe", "name": "network-vif-deleted", "tag": "3842cac8-1c1f-41a1-ba3a-3f77779b478a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:52.662596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b480ea40-1827-40b8-a00c-a8e939cf7992 req-586e7714-ec46-470d-8e7b-a686e3e99e08 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:52.663115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b480ea40-1827-40b8-a00c-a8e939cf7992 req-586e7714-ec46-470d-8e7b-a686e3e99e08 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:52.663742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-b480ea40-1827-40b8-a00c-a8e939cf7992 req-586e7714-ec46-470d-8e7b-a686e3e99e08 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:52.678386 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-b480ea40-1827-40b8-a00c-a8e939cf7992 req-586e7714-ec46-470d-8e7b-a686e3e99e08 service nova] Creating event network-vif-deleted:3842cac8-1c1f-41a1-ba3a-3f77779b478a for instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe on n-h1-858384-1 Sep 19 15:41:52.683454 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-b480ea40-1827-40b8-a00c-a8e939cf7992 req-586e7714-ec46-470d-8e7b-a686e3e99e08 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035839 Sep 19 15:41:52.684069 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3103/6164] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:53.191031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:53.191710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:53.198689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:53.199225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:53.199684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:53.200412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:53.200893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:53.201343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:53.235649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:53.236245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:53.236697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:53.237215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lazy-loading 'fault' on Instance uuid d7c9b6db-f013-4709-b7d1-7a2ab199d7fe {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:41:53.280777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d18df48ffc24ac99acfca4abbea7b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a307c7111c4faa84b492f71b921b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:53.288111 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b226c39-7b03-417d-8d0d-65ddf9fbaba8 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 200 len: 1311 microversion: 2.1 time: 0.101207 Sep 19 15:41:53.297337 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3062/6165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:53 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:54.315337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:54.315952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] [instance: d7c9b6db-f013-4709-b7d1-7a2ab199d7fe] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:54.322129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:54.322632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:54.323083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:54.323770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:54.324227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:54.324653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:54.337730 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] HTTP exception thrown: Instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe could not be found. Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Request method failure captured: Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe HTTP/1.1 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI2zVAuzWMiJ7OA-62bYyz78Cbh5ohKsgIgnRZHiLU78keOA8YHAKlySw-koArCuGmh7AsI_qfCiKuD5R5uRZmV8uSHVbf9JMVPeounuFJ2IFKNjELfo73ncE3-1gBgDgsu8ecOlX8AIiHUcw_Ricueuv5_49J0v0yZ444ONbD6ylBI Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 64a307c7111c4faa84b492f71b921b4c Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1962799737 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_64a307c7111c4faa84b492f71b921b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/64a307c7111c4faa84b492f71b921b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/64a307c7111c4faa84b492f71b921b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/64a307c7111c4faa84b492f71b921b4c"}]}] Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1962799737 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 64a307c7111c4faa84b492f71b921b4c Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1962799737 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersAdminNegativeTestJSON-1962799737-project Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 4d18df48ffc24ac99acfca4abbea7b05 Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1962799737-project Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe could not be found. Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd7c9b6db-f013-4709-b7d1-7a2ab199d7fe'} Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe could not be found. Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe could not be found. Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:54.339360 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe could not be found. Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] Returning 404 to user: Instance d7c9b6db-f013-4709-b7d1-7a2ab199d7fe could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7e16e49e-61e1-46e8-8a4d-80c0c79483a5 tempest-ServersAdminNegativeTestJSON-1962799737 tempest-ServersAdminNegativeTestJSON-1962799737-project] 10.222.0.81 "GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe" status: 404 len: 111 microversion: 2.1 time: 0.031426 Sep 19 15:41:54.344027 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3104/6166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:54 2022] GET /compute/v2.1/servers/d7c9b6db-f013-4709-b7d1-7a2ab199d7fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:42:00.545688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=8 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:00.546812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:00.675478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-572211718", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "1418dedc-9a3c-4ed5-8881-dcbbfe6e502d"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:00.739632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] validate_networks() for [('1418dedc-9a3c-4ed5-8881-dcbbfe6e502d', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:42:01.174246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:42:01.174691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:42:01.175232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:42:01.175951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:42:01.176375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:42:01.185612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:01.186121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:01.186567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:01.187348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:01.187819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:01.188260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:01.208262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Getting quotas for project 5e5aac3c63724611b4cfa5dbec0b178e. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:42:01.214220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Getting quotas for user b342cc4a48e24c2497af51f865b5ec19 and project 5e5aac3c63724611b4cfa5dbec0b178e. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:42:01.228080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:42:01.230473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:42:01.283646 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a85bb65f-e066-41e9-8cad-4858fa8de73d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743304 Sep 19 15:42:01.284314 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3063/6167] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:42:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:42:01.295481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d65538b2-7a70-4252-b047-fb7907ef3b9a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:01.296415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d65538b2-7a70-4252-b047-fb7907ef3b9a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:01.301043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:01.302215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:01.366663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d65538b2-7a70-4252-b047-fb7907ef3b9a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:01.374394 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d65538b2-7a70-4252-b047-fb7907ef3b9a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1214 microversion: 2.1 time: 0.082204 Sep 19 15:42:01.375248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3105/6168] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:01 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:02.399616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:02.400363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:02.412616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:02.413886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:02.414840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:02.415859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:02.416551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:02.417341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:02.512382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:02.520738 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-561e06b9-cda7-4f36-abab-79cd9eea7496 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1272 microversion: 2.1 time: 0.126885 Sep 19 15:42:02.521637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3064/6169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:02 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:03.544994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:03.545752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:03.557715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:03.558213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:03.559900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:03.562072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:03.562700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:03.563312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:03.820015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:03.828378 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8fbf6cab-60b2-4fcf-92a0-bd56668164b0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1314 microversion: 2.1 time: 0.287119 Sep 19 15:42:03.829435 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3106/6170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:03 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:04.234730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b2bf1d96-e58c-4b00-86bb-f91e531fe65d req-639f23fe-1bf0-4258-abc1-f7d648a83ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a685870f-b753-4c7b-8416-aa9052874d82", "tag": "e0a152bb-809b-4786-8f5b-c870e551033a"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:04.249061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b2bf1d96-e58c-4b00-86bb-f91e531fe65d req-639f23fe-1bf0-4258-abc1-f7d648a83ade service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:04.249608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b2bf1d96-e58c-4b00-86bb-f91e531fe65d req-639f23fe-1bf0-4258-abc1-f7d648a83ade service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:04.250695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b2bf1d96-e58c-4b00-86bb-f91e531fe65d req-639f23fe-1bf0-4258-abc1-f7d648a83ade service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:04.265216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b2bf1d96-e58c-4b00-86bb-f91e531fe65d req-639f23fe-1bf0-4258-abc1-f7d648a83ade service nova] Creating event network-changed:e0a152bb-809b-4786-8f5b-c870e551033a for instance a685870f-b753-4c7b-8416-aa9052874d82 on n-h1-858384-1 Sep 19 15:42:04.271275 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b2bf1d96-e58c-4b00-86bb-f91e531fe65d req-639f23fe-1bf0-4258-abc1-f7d648a83ade service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040386 Sep 19 15:42:04.272121 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3065/6171] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:42:04.853428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:04.853984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:04.861442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:04.861929 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:04.862370 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:04.863088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:04.863548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:04.863975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:04.997306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:05.005785 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6674d406-1fa0-482b-bbd8-72756b3802ca tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1314 microversion: 2.1 time: 0.156377 Sep 19 15:42:05.006357 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3107/6172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:04 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:06.030177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:06.030853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:06.037149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:06.037650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:06.038105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:06.038837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:06.039315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:06.039762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:06.174817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:06.182881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a998b87-0bac-4dbe-b001-e8c767f9b0d1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1314 microversion: 2.1 time: 0.158164 Sep 19 15:42:06.183451 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3066/6173] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:06 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:07.207695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:07.208227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:07.215148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:07.215634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:07.216074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:07.216762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:07.217838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:07.218350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:07.344801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:07.352410 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf7b1a9a-3a0c-49be-9a0b-6001f50c24bb tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1314 microversion: 2.1 time: 0.148697 Sep 19 15:42:07.352984 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3108/6174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:07 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:08.374885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:08.375832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:08.383263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:08.383813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:08.384388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:08.385015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:08.385592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:08.386128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:08.526447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a860ce5d-531c-40c9-8c6f-53eed0e0ad86 req-9e812cdb-1340-40c0-8ac5-7c27ede6eaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a685870f-b753-4c7b-8416-aa9052874d82", "name": "network-vif-plugged", "status": "completed", "tag": "e0a152bb-809b-4786-8f5b-c870e551033a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:08.542785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:08.551434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a860ce5d-531c-40c9-8c6f-53eed0e0ad86 req-9e812cdb-1340-40c0-8ac5-7c27ede6eaee service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:08.554016 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa621106-5df1-4bff-a121-3b3b92230231 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1314 microversion: 2.1 time: 0.183513 Sep 19 15:42:08.554729 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3067/6175] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:08 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:08.555424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a860ce5d-531c-40c9-8c6f-53eed0e0ad86 req-9e812cdb-1340-40c0-8ac5-7c27ede6eaee service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:08.556122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a860ce5d-531c-40c9-8c6f-53eed0e0ad86 req-9e812cdb-1340-40c0-8ac5-7c27ede6eaee service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:08.568764 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a860ce5d-531c-40c9-8c6f-53eed0e0ad86 req-9e812cdb-1340-40c0-8ac5-7c27ede6eaee service nova] Creating event network-vif-plugged:e0a152bb-809b-4786-8f5b-c870e551033a for instance a685870f-b753-4c7b-8416-aa9052874d82 on n-h1-858384-1 Sep 19 15:42:08.574161 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a860ce5d-531c-40c9-8c6f-53eed0e0ad86 req-9e812cdb-1340-40c0-8ac5-7c27ede6eaee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054050 Sep 19 15:42:08.574918 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3109/6176] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:42:09.577695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:09.578251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:09.585046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:09.585548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:09.585994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:09.586685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:09.587180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:09.587615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:09.734498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:09.736856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:09.745014 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f0965a4-6c3c-4117-888b-3ffc80312396 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1314 microversion: 2.1 time: 0.171625 Sep 19 15:42:09.745620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3068/6177] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:09 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:10.769977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:10.770638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:10.772577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:10.777958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:10.778446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:10.778918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:10.779608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:10.780063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:10.780489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:10.788180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=70 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:10.916474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:10.924971 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aaf75182-30df-4501-9f5b-2275ef56e5c3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1501 microversion: 2.1 time: 0.160170 Sep 19 15:42:10.925579 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3110/6178] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:10 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:10.948433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:10.950834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:10.954140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:10.960405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:10.960938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:10.961419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:10.962129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:10.962625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:10.963094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:10.993102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:10.999281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Old instance type m1.heat2, new instance type m1.heat {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:42:11.005815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:42:11.006251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:42:11.006829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:42:11.007228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:42:11.007660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:42:11.071621 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2bc0e19a-f5fd-4697-93f8-0bb08d689810 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "POST /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82/action" status: 202 len: 0 microversion: 2.1 time: 0.127031 Sep 19 15:42:11.072167 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3069/6179] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:42:10 2022] POST /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:42:11.080795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:11.081436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:11.087630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:11.088110 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:11.088543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:11.089231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:11.089679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:11.090096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:11.231105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:11.240236 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8cbc4eb8-431f-4a18-b94e-9cdb0481afbd tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1510 microversion: 2.1 time: 0.163812 Sep 19 15:42:11.241840 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3111/6180] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:11 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:12.264583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:12.265809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:12.268005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:12.268902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:12.277002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:12.277515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:12.277974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:12.278694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:12.279203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:12.280299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:12.414253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:12.422251 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c0b88f1-b4ff-4d7b-b20b-2adbdd8927b4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1510 microversion: 2.1 time: 0.162160 Sep 19 15:42:12.422921 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3070/6181] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:12 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:13.445168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:13.445790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:13.447744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:13.454308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:13.454827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:13.455263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:13.455952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:13.456408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:13.456834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:13.586699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:13.595019 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73128474-c0b3-45ed-bc66-dcba78a25ec3 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.153749 Sep 19 15:42:13.595599 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3112/6182] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:13 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:14.618845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:14.619475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:14.628449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:14.628954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:14.629399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:14.630138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:14.630627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:14.631097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:14.770842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:14.778674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e9bb9ce-fab1-4a13-a69c-1dec11835680 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.164012 Sep 19 15:42:14.779288 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3071/6183] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:14 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:15.801882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:15.802446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:15.809345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:15.809833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:15.810277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:15.811678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:15.812078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:15.812509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:15.947456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:15.955897 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30dddac1-bd97-458b-b8b0-a2e86d90b181 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.158306 Sep 19 15:42:15.956469 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3113/6184] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:15 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:16.980335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:16.980959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:16.988725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:16.989226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:16.989676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:16.990371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:16.990888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:16.991326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:17.122947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:17.132407 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-345ff260-c026-48c6-8622-da67fe90aac0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.155778 Sep 19 15:42:17.133228 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3072/6185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:16 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:18.155674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:18.156638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:18.163323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:18.163838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:18.164280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:18.164984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:18.165448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:18.165881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:18.301173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:18.309353 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2ba7e5e-fb9e-45f8-86fa-f952bfd25bf4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.157559 Sep 19 15:42:18.309957 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3114/6186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:18 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:19.333721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:19.334262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:19.341616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:19.342117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:19.342564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:19.344133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:19.344607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:19.345049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:19.479747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:19.487888 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-994611db-1791-4a94-8f50-909098fda1cf tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.158252 Sep 19 15:42:19.488468 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3073/6187] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:19 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:20.511145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:20.511768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:20.519352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:20.519841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:20.520287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:20.520985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:20.521447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:20.521877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:20.665246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:20.674355 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-daa05b4e-4838-43b3-ba63-17ee00237cb0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.167178 Sep 19 15:42:20.674974 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3115/6188] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:20 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:21.699845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:21.700427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:21.707851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:21.708350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:21.708799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:21.709490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:21.709970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:21.710517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:21.841209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:21.849467 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e0ba280-13b0-4d53-bfd2-4c9349f74098 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.153955 Sep 19 15:42:21.849936 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3074/6189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:21 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:22.873638 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:22.874195 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:22.881694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:22.882183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:22.882633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:22.883350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:22.883809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:22.884237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:23.016368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:23.024088 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35447259-0461-45be-ad26-29cded8d5055 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.154447 Sep 19 15:42:23.024661 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3116/6190] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:22 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:24.047959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:24.048591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:24.055873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:24.056415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:24.056837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:24.057556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:24.058034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:24.058479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:24.192288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:24.200082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6f82086d-4cb8-44e5-82dd-c7e523173582 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.156231 Sep 19 15:42:24.200659 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3075/6191] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:24 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:25.223817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:25.224434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:25.231732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:25.232249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:25.232687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:25.233378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:25.233842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:25.234263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:25.370260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:25.378210 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5284c5b4-ae77-4ef6-a7cd-fa46859e1c42 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.158310 Sep 19 15:42:25.378804 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3117/6192] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:25 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:42:26.400567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:26.401223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:26.408283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:26.408788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:26.409240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:26.409951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:26.410417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:26.410884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:26.554808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:26.563173 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1d9cf15-7d3f-4113-a475-3a8732fc0700 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.166348 Sep 19 15:42:26.563750 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3076/6193] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:26 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:27.586094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:27.586710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:27.593652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:27.594135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:27.594571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:27.595283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:27.595741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:27.596192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:27.726679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:27.734496 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26535c4f-4f14-4749-8e96-367dc394e3e1 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.152389 Sep 19 15:42:27.735129 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3118/6194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:27 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:28.758371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:28.758954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:28.765594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:28.766094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:28.766542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:28.767270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:28.767790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:28.768236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:28.908415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:28.916915 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ce4f8181-9901-4e23-ad97-ee6e511f86aa tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.162568 Sep 19 15:42:28.917526 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3077/6195] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:28 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:29.942021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:29.942669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:29.948825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:29.949313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:29.949751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:29.950441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:29.950928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:29.951355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:30.081424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:30.089120 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cdb92f5b-8264-4539-b40d-214f4fc855f6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.151874 Sep 19 15:42:30.089694 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3119/6196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:29 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:31.113596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:31.114600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:31.123200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:31.123749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:31.124542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:31.125707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:31.126505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:31.127917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:31.273564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:31.282785 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ddf624c-7a03-4737-93b6-23c0119a16f8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.174501 Sep 19 15:42:31.284184 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3078/6197] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:31 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:32.307989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:32.308641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:32.316896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:32.317371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:32.317893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:32.318555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:32.319089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:32.319532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:32.468320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:32.476212 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c90298a-5757-4c87-b7ca-17d2e177e31f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.172477 Sep 19 15:42:32.476781 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3120/6198] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:32 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:33.500022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:33.500649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:33.508177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:33.508685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:33.509132 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:33.509831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:33.510302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:33.510766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:33.639243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:33.648049 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f9353ae-e746-48e1-9221-dc39f5aa380a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.152050 Sep 19 15:42:33.648628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3079/6199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:33 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:34.671023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:34.671639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:34.678907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:34.679393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:34.679830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:34.680517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:34.680981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:34.681409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:34.811455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:34.819486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0bdf351b-2a5a-42b9-8562-9f371cce7ff0 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.152434 Sep 19 15:42:34.820057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3121/6200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:34 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:35.843199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:35.843756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:35.850390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:35.850930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:35.851386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:35.852088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:35.852559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:35.853001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:35.982417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:35.991064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7ae7dbac-31ef-4983-8d47-0cc393266ced tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.152017 Sep 19 15:42:35.991690 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3080/6201] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:35 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:37.017005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:37.017617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:37.024876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:37.025339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:37.025774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:37.026460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:37.026943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:37.027366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:37.157342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:37.165616 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a9029a26-8d84-498f-9feb-32d44d36d523 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.152450 Sep 19 15:42:37.166188 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3122/6202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:37 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:38.190183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:38.190876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:38.197669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:38.198174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:38.198631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:38.199363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:38.199841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:38.200288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:38.337220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:38.345094 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08b95b1a-7d4b-4032-bb3c-378cc9a8220f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.159348 Sep 19 15:42:38.345676 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3081/6203] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:38 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:39.368670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:39.369271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:39.372119 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:42:39.372264 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 (ip 10.222.0.81) !!! Sep 19 15:42:39.378993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:39.379486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:39.379930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:39.380629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:39.381087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:39.381517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:39.512728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:39.521187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5be6852a-9e60-4e61-82cf-899080d8cdd8 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.156447 Sep 19 15:42:39.521757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3123/6204] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:39 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:40.544251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:40.544886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:40.552679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:40.553188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:40.553644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:40.554359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:40.554867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:40.555317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:40.688573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:40.696444 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d58c8cd-428c-4d91-9a64-8ae33d96063d tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.156090 Sep 19 15:42:40.696963 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3082/6205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:40 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:41.720044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:41.720596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:41.724003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=28 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:41.729603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:41.730096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:41.730540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:41.731277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:41.731741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:41.732171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:41.736107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=84 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:41.862358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:41.870113 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-85bc0421-720e-46bb-b229-ba0bfc452a1b tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.154229 Sep 19 15:42:41.870706 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3124/6206] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:41 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:42.893738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:42.894270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:42.897060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:42.902467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:42.902998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:42.903452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:42.904152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:42.904622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:42.905064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:42.909581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:43.039156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:43.047001 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-060763d4-446c-4747-b096-6afde75f688a tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.157903 Sep 19 15:42:43.047583 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3083/6207] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:42 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:44.070723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:44.071383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:44.079139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:44.079622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:44.080056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:44.081076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:44.081533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:44.081961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:44.210927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:44.218959 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43d5df5a-6745-489a-9747-d61020ab9093 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1515 microversion: 2.1 time: 0.151870 Sep 19 15:42:44.219535 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3125/6208] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:44 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:45.243953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:45.244594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:45.251646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:45.252777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:45.253281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:45.253961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:45.254471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:45.254977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:45.449126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:45.457016 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8ef2a180-8cd2-4916-937d-462f056d17c4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1514 microversion: 2.1 time: 0.216956 Sep 19 15:42:45.457604 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3084/6209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:45 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:45.506876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a685870f-b753-4c7b-8416-aa9052874d82", "name": "network-vif-unplugged", "status": "completed", "tag": "e0a152bb-809b-4786-8f5b-c870e551033a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:45.517794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:45.518393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:45.518858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:45.530663 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] Creating event network-vif-unplugged:e0a152bb-809b-4786-8f5b-c870e551033a for instance a685870f-b753-4c7b-8416-aa9052874d82 on n-h2-858384-1 Sep 19 15:42:45.536998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] Instance a685870f-b753-4c7b-8416-aa9052874d82 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:42:45.548137 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c06bc408-865c-4ffd-9c92-bcb3b2252978 req-a344f3f5-0013-44c1-b7d7-c6908d4b7db7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044795 Sep 19 15:42:45.548618 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3126/6210] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:42:46.480331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:46.480997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:46.488133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:46.488636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:46.489086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:46.489791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:46.490296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:46.490737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:46.674272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:46.682880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-19fcdffc-1e24-4319-8fae-bdc2ec307dac tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1514 microversion: 2.1 time: 0.206387 Sep 19 15:42:46.683640 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3085/6211] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:46 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:47.579888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a685870f-b753-4c7b-8416-aa9052874d82", "tag": "e0a152bb-809b-4786-8f5b-c870e551033a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:47.589797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:47.590280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:47.590712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:47.602354 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] Creating event network-changed:e0a152bb-809b-4786-8f5b-c870e551033a for instance a685870f-b753-4c7b-8416-aa9052874d82 on n-h2-858384-1 Sep 19 15:42:47.607904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] Instance a685870f-b753-4c7b-8416-aa9052874d82 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:42:47.619077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-52b0371e-cb94-4ee4-ad2c-16275caa89dc req-188cf1a6-fbf7-4207-a791-62fbd40552a8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044214 Sep 19 15:42:47.619672 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3127/6212] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:42:47.706986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:47.708163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:47.715018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:47.715529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:47.715982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:47.716700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:47.717346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:47.717791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:47.998456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:48.007011 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-29a6daf3-9bc8-458c-8ef9-2a7f21f1be0f tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1512 microversion: 2.1 time: 0.304344 Sep 19 15:42:48.007878 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3086/6213] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:47 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:49.032244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:49.032965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:49.039862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:49.040358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:49.040797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:49.041504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:49.041999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:49.042427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:49.198693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:49.207269 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a6e82114-8a59-4676-8ee1-27e98669df4c tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1509 microversion: 2.1 time: 0.180184 Sep 19 15:42:49.207854 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3128/6214] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:49 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:49.229359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:49.229902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:49.236834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:49.237332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:49.237783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:49.238523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:49.239026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:49.239473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:49.265559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:42:49.316875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Found an unconfirmed migration during delete, id: 16, status: finished Sep 19 15:42:50.678838 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b75f81cf-b95c-4d9e-9a56-73e4cde19f03 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 204 len: 0 microversion: 2.1 time: 1.453017 Sep 19 15:42:50.679936 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3087/6215] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:42:49 2022] DELETE /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 0 bytes in 1455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:42:50.688197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:50.688909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:50.695996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:50.696412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:50.696843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:50.697523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:50.698046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:50.698467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:50.828874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:50.836907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c7d7718c-96dd-4220-b075-3a3b6d544bda tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1501 microversion: 2.1 time: 0.152679 Sep 19 15:42:50.837486 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3129/6216] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:50 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:51.863135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:51.864071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:51.871041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:51.871550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:51.872004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:51.872716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:51.873187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:51.873625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:51.963852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6123d94e-ebdd-4c36-a402-01d0aa95ce16 req-3e90bf3b-eccf-4b5b-976b-dbea69900550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a685870f-b753-4c7b-8416-aa9052874d82", "name": "network-vif-plugged", "status": "completed", "tag": "e0a152bb-809b-4786-8f5b-c870e551033a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:51.975237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6123d94e-ebdd-4c36-a402-01d0aa95ce16 req-3e90bf3b-eccf-4b5b-976b-dbea69900550 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:51.975718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6123d94e-ebdd-4c36-a402-01d0aa95ce16 req-3e90bf3b-eccf-4b5b-976b-dbea69900550 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:51.976369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6123d94e-ebdd-4c36-a402-01d0aa95ce16 req-3e90bf3b-eccf-4b5b-976b-dbea69900550 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:51.988370 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6123d94e-ebdd-4c36-a402-01d0aa95ce16 req-3e90bf3b-eccf-4b5b-976b-dbea69900550 service nova] Creating event network-vif-plugged:e0a152bb-809b-4786-8f5b-c870e551033a for instance a685870f-b753-4c7b-8416-aa9052874d82 on n-h2-858384-1 Sep 19 15:42:51.993457 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6123d94e-ebdd-4c36-a402-01d0aa95ce16 req-3e90bf3b-eccf-4b5b-976b-dbea69900550 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Sep 19 15:42:51.994246 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3130/6217] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:42:52.096209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b342cc4a48e24c2497af51f865b5ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5aac3c63724611b4cfa5dbec0b178e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:52.106798 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88e00097-919f-4f2e-ab1d-1ae3bd1ba934 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 200 len: 1501 microversion: 2.1 time: 0.248688 Sep 19 15:42:52.107582 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3088/6218] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:51 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:52.472066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7524b6c2-1cc7-4724-98c3-e53fc971fbf4 req-4898ad0a-8cb4-4370-b2a8-7c938a090522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a685870f-b753-4c7b-8416-aa9052874d82", "name": "network-vif-deleted", "tag": "e0a152bb-809b-4786-8f5b-c870e551033a"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:42:52.482454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7524b6c2-1cc7-4724-98c3-e53fc971fbf4 req-4898ad0a-8cb4-4370-b2a8-7c938a090522 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:52.482964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7524b6c2-1cc7-4724-98c3-e53fc971fbf4 req-4898ad0a-8cb4-4370-b2a8-7c938a090522 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:52.483401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7524b6c2-1cc7-4724-98c3-e53fc971fbf4 req-4898ad0a-8cb4-4370-b2a8-7c938a090522 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:52.496648 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7524b6c2-1cc7-4724-98c3-e53fc971fbf4 req-4898ad0a-8cb4-4370-b2a8-7c938a090522 service nova] Creating event network-vif-deleted:e0a152bb-809b-4786-8f5b-c870e551033a for instance a685870f-b753-4c7b-8416-aa9052874d82 on n-h2-858384-1 Sep 19 15:42:52.501853 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7524b6c2-1cc7-4724-98c3-e53fc971fbf4 req-4898ad0a-8cb4-4370-b2a8-7c938a090522 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034440 Sep 19 15:42:52.502472 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3131/6219] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:42:53.133451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:53.134073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:53.140815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.141309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.141752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.142448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.142946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.143382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.156607 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] HTTP exception thrown: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Request method failure captured: Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 HTTP/1.1 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI3IdXpFLtd9Mi3VB4kyVK4CDKbWwr7Cjb0n1xryQrYrDtna9l15oeIjpIbn93TdrGtXLCk3eNyD6Wn-fBsbs3jzlLGJeBXKERslXz1SB56RQ74lqB23Vk8h9AO9-2pVWj7qcw53ekMcT_GRlMteh32NRsEDT9vmQF1PvJI74Nh69L8 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5e5aac3c63724611b4cfa5dbec0b178e Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5e5aac3c63724611b4cfa5dbec0b178e"}]}] Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5e5aac3c63724611b4cfa5dbec0b178e Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-1642991450-project Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b342cc4a48e24c2497af51f865b5ec19 Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-1642991450-project Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'a685870f-b753-4c7b-8416-aa9052874d82'} Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:42:53.158739 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Returning 404 to user: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d0a632e7-158b-4aed-b0a7-9a77badb24f4 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 404 len: 111 microversion: 2.1 time: 0.030809 Sep 19 15:42:53.163460 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3089/6220] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:53 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:42:53.178427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:53.179049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:53.185305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.185786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.186222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.186939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.187399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.187825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.201191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] HTTP exception thrown: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Request method failure captured: Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 HTTP/1.1 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI3IdXpFLtd9Mi3VB4kyVK4CDKbWwr7Cjb0n1xryQrYrDtna9l15oeIjpIbn93TdrGtXLCk3eNyD6Wn-fBsbs3jzlLGJeBXKERslXz1SB56RQ74lqB23Vk8h9AO9-2pVWj7qcw53ekMcT_GRlMteh32NRsEDT9vmQF1PvJI74Nh69L8 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 5e5aac3c63724611b4cfa5dbec0b178e Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5e5aac3c63724611b4cfa5dbec0b178e"}]}] Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 5e5aac3c63724611b4cfa5dbec0b178e Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-DeleteServersTestJSON-1642991450-project Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: b342cc4a48e24c2497af51f865b5ec19 Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-DeleteServersTestJSON-1642991450-project Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'a685870f-b753-4c7b-8416-aa9052874d82'} Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:42:53.202926 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Returning 404 to user: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3aac6d35-d7a0-4cad-99b9-3de734cde1d6 tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 404 len: 111 microversion: 2.1 time: 0.031865 Sep 19 15:42:53.207359 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3132/6221] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:42:53 2022] DELETE /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:42:53.212913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:53.213542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] [instance: a685870f-b753-4c7b-8416-aa9052874d82] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:53.219431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.219935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.221103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.221698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.222171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.222613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.235861 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] HTTP exception thrown: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Request method failure captured: Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 HTTP/1.1 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI3IdXpFLtd9Mi3VB4kyVK4CDKbWwr7Cjb0n1xryQrYrDtna9l15oeIjpIbn93TdrGtXLCk3eNyD6Wn-fBsbs3jzlLGJeBXKERslXz1SB56RQ74lqB23Vk8h9AO9-2pVWj7qcw53ekMcT_GRlMteh32NRsEDT9vmQF1PvJI74Nh69L8 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 5e5aac3c63724611b4cfa5dbec0b178e Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5e5aac3c63724611b4cfa5dbec0b178e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5e5aac3c63724611b4cfa5dbec0b178e"}]}] Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 5e5aac3c63724611b4cfa5dbec0b178e Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642991450 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-DeleteServersTestJSON-1642991450-project Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: b342cc4a48e24c2497af51f865b5ec19 Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-DeleteServersTestJSON-1642991450-project Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'a685870f-b753-4c7b-8416-aa9052874d82'} Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:42:53.238229 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] Returning 404 to user: Instance a685870f-b753-4c7b-8416-aa9052874d82 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-60a7037d-286f-427d-92d2-3f1b1e06debc tempest-DeleteServersTestJSON-1642991450 tempest-DeleteServersTestJSON-1642991450-project] 10.222.0.81 "GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82" status: 404 len: 111 microversion: 2.1 time: 0.030625 Sep 19 15:42:53.242454 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3090/6222] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:53 2022] GET /compute/v2.1/servers/a685870f-b753-4c7b-8416-aa9052874d82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:43:02.073749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1566243052", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "eafd3c3e-257c-4dd6-a87c-0cae7f4225d7"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:02.131576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] validate_networks() for [('eafd3c3e-257c-4dd6-a87c-0cae7f4225d7', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:43:02.583966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:43:02.584508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:43:02.585059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:43:02.585605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:43:02.586094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:43:02.596812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:02.597476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:02.597993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:02.598836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:02.599298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:02.599731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:02.617601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Getting quotas for project d4f35d8b121848ea9b9404a8110e9967. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:43:02.623527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Getting quotas for user 15892a85d64c4b0184e54d4d1f07444c and project d4f35d8b121848ea9b9404a8110e9967. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:43:02.636599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:43:02.639070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:43:02.699633 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-172e03ed-e908-4d41-9f72-a2bbd34cb527 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754524 Sep 19 15:43:02.700286 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3133/6223] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:43:02.714294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0bffce37-5cde-42d0-8b99-112089dc4740 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:02.714968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0bffce37-5cde-42d0-8b99-112089dc4740 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:02.791833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0bffce37-5cde-42d0-8b99-112089dc4740 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:02.803140 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0bffce37-5cde-42d0-8b99-112089dc4740 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1218 microversion: 2.1 time: 0.093365 Sep 19 15:43:02.803993 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3091/6224] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:02 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:03.829220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:03.830048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:03.838054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:03.839113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:03.839113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:03.839820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:03.840286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:03.840718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:03.947899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:03.956230 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b75147c-b064-4795-96a9-aae07254cb3b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1270 microversion: 2.1 time: 0.132852 Sep 19 15:43:03.957006 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3134/6225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:03 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:04.980106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:04.980743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:04.984198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:04.996863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:04.997647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:04.998262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:04.999194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:04.999815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:05.000425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:05.218862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:05.229865 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cd8a89e-a754-439e-b3c4-74de1c067081 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1318 microversion: 2.1 time: 0.254934 Sep 19 15:43:05.230694 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3092/6226] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:04 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:05.595657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-25b3eb39-0952-44a9-9753-4b24a1f4b22c req-89d3509e-352f-4a64-8c4d-1aa01af30ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0972ce73-c756-41ee-93c8-d9701593fdd9", "tag": "56680df4-25d6-4823-b75a-729a7c46f031"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:05.607586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25b3eb39-0952-44a9-9753-4b24a1f4b22c req-89d3509e-352f-4a64-8c4d-1aa01af30ec0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:05.608355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25b3eb39-0952-44a9-9753-4b24a1f4b22c req-89d3509e-352f-4a64-8c4d-1aa01af30ec0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:05.608951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25b3eb39-0952-44a9-9753-4b24a1f4b22c req-89d3509e-352f-4a64-8c4d-1aa01af30ec0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:05.623464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-25b3eb39-0952-44a9-9753-4b24a1f4b22c req-89d3509e-352f-4a64-8c4d-1aa01af30ec0 service nova] Creating event network-changed:56680df4-25d6-4823-b75a-729a7c46f031 for instance 0972ce73-c756-41ee-93c8-d9701593fdd9 on n-h1-858384-1 Sep 19 15:43:05.631771 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-25b3eb39-0952-44a9-9753-4b24a1f4b22c req-89d3509e-352f-4a64-8c4d-1aa01af30ec0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044380 Sep 19 15:43:05.632943 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3135/6227] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:06.254457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:06.255257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:06.262592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:06.263216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:06.263740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:06.264526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:06.265069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:06.265588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:06.405877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:06.414498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a36625f5-7c5b-4e2d-b508-bf7ca4d2732a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1318 microversion: 2.1 time: 0.164047 Sep 19 15:43:06.415112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3093/6228] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:06 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:07.439111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:07.439873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:07.446113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:07.446595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:07.447063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:07.447758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:07.448211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:07.448636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:07.580295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:07.588206 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d2bccf60-b90f-4622-8d1b-c5d4e65270f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1318 microversion: 2.1 time: 0.154376 Sep 19 15:43:07.588782 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3136/6229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:07 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:08.611924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:08.612565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:08.619460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:08.619953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:08.620400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:08.621094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:08.621634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:08.622071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:08.768503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:08.777609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-064dce43-9c3b-4bc9-aa42-f2d91d7d417d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1318 microversion: 2.1 time: 0.170482 Sep 19 15:43:08.790813 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3094/6230] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:08 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:09.808886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:09.809501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:09.816851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:09.817336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:09.817797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:09.818513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:09.819002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:09.819425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:09.952588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:09.962111 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-710e9976-c311-4c6c-adfd-1497674c62a9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1318 microversion: 2.1 time: 0.157083 Sep 19 15:43:09.962697 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3137/6231] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:09 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:10.781906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-999c77b2-576a-4eef-be33-67ed168de7fd req-32d50ff3-e8c1-4e85-b3ce-57acd2fd00d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0972ce73-c756-41ee-93c8-d9701593fdd9", "name": "network-vif-plugged", "status": "completed", "tag": "56680df4-25d6-4823-b75a-729a7c46f031"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:10.792687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-999c77b2-576a-4eef-be33-67ed168de7fd req-32d50ff3-e8c1-4e85-b3ce-57acd2fd00d5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:10.793198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-999c77b2-576a-4eef-be33-67ed168de7fd req-32d50ff3-e8c1-4e85-b3ce-57acd2fd00d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:10.793652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-999c77b2-576a-4eef-be33-67ed168de7fd req-32d50ff3-e8c1-4e85-b3ce-57acd2fd00d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:10.806491 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-999c77b2-576a-4eef-be33-67ed168de7fd req-32d50ff3-e8c1-4e85-b3ce-57acd2fd00d5 service nova] Creating event network-vif-plugged:56680df4-25d6-4823-b75a-729a7c46f031 for instance 0972ce73-c756-41ee-93c8-d9701593fdd9 on n-h1-858384-1 Sep 19 15:43:10.811610 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-999c77b2-576a-4eef-be33-67ed168de7fd req-32d50ff3-e8c1-4e85-b3ce-57acd2fd00d5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033516 Sep 19 15:43:10.812219 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3095/6232] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:10.985339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:10.986862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:10.993393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:10.993912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:10.994350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:10.995067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:10.995518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:10.995943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.129522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:11.137239 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86161bf5-43fc-4cf6-ac7b-333c7fea54f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1318 microversion: 2.1 time: 0.155957 Sep 19 15:43:11.137823 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3138/6233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:10 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.163181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:12.164173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.172268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.172950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.173544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.175052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.175690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.176646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.313154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:12.321864 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1c6708b2-19e3-455b-ba37-f19df3d6448e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1507 microversion: 2.1 time: 0.164625 Sep 19 15:43:12.322376 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3096/6234] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:12 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.343896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:12.344520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.347339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:12.352691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.353183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.353630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.354326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.354881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.355317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.358877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=66 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:12.489799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:12.497615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1cc994a-ddd8-4456-9af0-71735e4929d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1507 microversion: 2.1 time: 0.157629 Sep 19 15:43:12.498183 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3139/6235] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:12 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.519698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:12.522121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.528054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.528550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.529006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.529715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.530185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.530634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.598418 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1d0792ed-1585-40c9-9fa6-c7e6f5bcc2d2 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "PUT /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1079 microversion: 2.1 time: 0.082508 Sep 19 15:43:12.599179 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3097/6236] 10.222.0.81 () {60 vars in 1256 bytes} [Mon Sep 19 15:43:12 2022] PUT /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1079 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.618060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:12.618679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.620633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:12.625958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.626447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.626922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.627867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.628330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.628757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.632709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:12.757504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:12.765406 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a2dbdef9-0975-4374-9aff-506d6899738c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1505 microversion: 2.1 time: 0.151309 Sep 19 15:43:12.765979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3140/6237] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:12 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.788085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:12.788729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.794682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.795224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.795680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.796381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.796872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.797304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.797866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:12.933708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:12.941668 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11b4cc9f-3b95-45cb-bbc4-6de47c6f3e52 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1505 microversion: 2.1 time: 0.158062 Sep 19 15:43:12.942246 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3098/6238] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:12 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.965327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:12.967786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.974529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.975065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.975513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.976209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.976670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.977102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.005081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:13.010453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Old instance type m1.heat2, new instance type m1.heat {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:43:13.016987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:43:13.017416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:43:13.018453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:43:13.018959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:43:13.019379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:43:13.083280 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-423bf59f-4e1b-4a49-af67-c60906c2ea8a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9/action" status: 202 len: 0 microversion: 2.1 time: 0.122783 Sep 19 15:43:13.083842 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3141/6239] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:43:12 2022] POST /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:43:13.092042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:13.092885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:13.094784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:13.100810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:13.101324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:13.101786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.102511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:13.103029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:13.103477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.240498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:13.248855 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08d38150-8d5d-4b5f-912c-dfa4e813cf12 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1516 microversion: 2.1 time: 0.160745 Sep 19 15:43:13.249617 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3099/6240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:13 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:14.274994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:14.275612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:14.283066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.283592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.284047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.285689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.286249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.286703 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.528742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:14.536842 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ced6aa58-481a-4fce-a97e-62d7da7a482c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1516 microversion: 2.1 time: 0.266742 Sep 19 15:43:14.537421 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3142/6241] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:14 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:15.560270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:15.560894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:15.568719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.569217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.569666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.570369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.570865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.571303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.708501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:15.716245 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8832e083-5e9c-41aa-99c8-0d5c91ba6513 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.160226 Sep 19 15:43:15.716819 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3100/6242] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:15 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:16.740374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:16.741065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:16.748400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:16.748963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:16.749413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:16.750230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:16.750715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:16.751246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:16.888246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:16.900967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-545e28be-377b-4d73-b63b-c431cea87edf tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.165454 Sep 19 15:43:16.901728 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3143/6243] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:16 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:17.926476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:17.927152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:17.934416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:17.934960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:17.935421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:17.936130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:17.936606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:17.937052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:18.070790 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:18.080250 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-33b7036e-14c3-440c-a85d-da7fe1285a7e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.158581 Sep 19 15:43:18.080846 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3101/6244] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:17 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:19.104158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:19.104821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:19.111725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:19.112218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:19.112662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:19.113358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:19.113825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:19.114254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:19.252937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:19.262014 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7a85e16c-2422-4842-af1a-3a58da058a2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.162392 Sep 19 15:43:19.262650 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3144/6245] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:19 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:20.286226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:20.286950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:20.295378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:20.295927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:20.296404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:20.297105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:20.297636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:20.298075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:20.438393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:20.447312 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-409706d8-6296-4530-8c0e-3917afba58a3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.165014 Sep 19 15:43:20.447960 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3102/6246] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:20 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:21.471208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:21.471820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:21.478708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:21.479222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:21.479655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:21.480334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:21.480811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:21.481232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:21.612019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:21.620660 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7b6c5e9b-c229-4632-8ee2-b762bffc7ffb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.153379 Sep 19 15:43:21.621244 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3145/6247] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:21 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:22.644729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:22.645300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:22.653208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:22.653714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:22.654167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:22.654906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:22.655379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:22.655818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:22.789037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:22.796950 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-facc52ee-5520-4dce-9cd7-b2d41003d5fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.156493 Sep 19 15:43:22.797538 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3103/6248] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:22 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:23.821073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:23.822557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:23.829747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:23.830229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:23.830664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:23.831368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:23.831820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:23.832240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:24.272202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:24.280821 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-199656c7-af00-4540-a157-5ce46d083834 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.464037 Sep 19 15:43:24.281394 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3146/6249] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:23 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:25.303957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:25.304615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:25.312117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:25.312615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:25.313065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:25.313764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:25.314237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:25.314677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:25.443771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:25.451665 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2caa1487-8f11-45ed-914d-416ce1462c42 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.151887 Sep 19 15:43:25.452247 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3104/6250] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:25 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:26.474840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:26.475511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:26.482928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:26.483428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:26.483871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:26.484567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:26.485036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:26.485466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:26.618582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:26.626398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0a66fd01-822a-4d46-a289-986c14e513f9 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.155505 Sep 19 15:43:26.627013 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3147/6251] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:26 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:27.651070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:27.651703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:27.658322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:27.658861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:27.659318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:27.660026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:27.660497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:27.660938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:27.789448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:27.797939 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-92f61530-79e3-423a-b877-a277eef9dd4c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.151072 Sep 19 15:43:27.798521 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3105/6252] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:27 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:28.823355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:28.824049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:28.830095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:28.830571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:28.831040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:28.831717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:28.832168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:28.832598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:28.965488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:28.973131 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-500d509e-cbc8-4711-ba73-cedf1959aaf6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.154989 Sep 19 15:43:28.973702 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3148/6253] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:28 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:29.997467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:29.998096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:30.001078 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:43:30.001231 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:43:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 (ip 10.222.0.81) !!! Sep 19 15:43:30.009030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:30.009635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:30.010366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:30.011105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:30.011601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:30.012038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:30.141830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:30.149528 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56dff0e6-8076-43d8-826f-b25ded53cd6f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.156819 Sep 19 15:43:30.150124 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3106/6254] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:29 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:31.172933 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:31.173455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:31.180606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:31.181087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:31.182077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:31.182776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:31.183232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:31.183654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:31.314383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:31.323209 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-07c73f20-5dd4-41cf-aeae-96b605ec0915 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.154498 Sep 19 15:43:31.323811 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3149/6255] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:31 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:32.346993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:32.347654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:32.356572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:32.357075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:32.357527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:32.358264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:32.358736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:32.359196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:32.496089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:32.504603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-55ceb717-b0ed-4680-a2ac-1fc65cf2b2fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.161666 Sep 19 15:43:32.505199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3107/6256] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:32 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:33.527838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:33.528465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:33.535379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:33.535863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:33.536298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:33.536986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:33.537447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:33.537872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:33.669542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:33.677587 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3abc274d-5293-4421-99ac-e9a1dc6037f5 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.154210 Sep 19 15:43:33.678158 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3150/6257] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:33 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:34.701004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:34.701681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:34.708262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:34.708772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:34.709225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:34.709932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:34.710398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:34.710872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:34.729476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:34.847537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:34.855155 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26d63887-5f4c-41aa-a383-b218a48ede87 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.158860 Sep 19 15:43:34.855735 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3108/6258] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:34 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:35.877768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:35.878336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:35.885357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:35.885840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:35.886271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:35.886980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:35.887432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:35.887851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:36.015701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:36.023402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-043ac7db-cdf3-4f91-a0e5-175555668d5d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.149680 Sep 19 15:43:36.023981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3151/6259] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:35 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:37.047138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:37.047782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:37.055099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:37.055603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:37.056640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:37.057532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:37.058015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:37.058463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:37.190369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:37.198146 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-235c3ff5-3e3b-490f-ae75-b20fba4e4dfa tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.154948 Sep 19 15:43:37.198730 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3109/6260] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:37 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:38.222044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:38.222658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:38.230156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:38.230635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:38.231101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:38.231793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:38.232246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:38.232684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:38.366669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:38.375315 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b8f552a-2587-447a-86f4-9c8968a35df4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.157206 Sep 19 15:43:38.375894 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3152/6261] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:38 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:39.398405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:39.399047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:39.406128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:39.406625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:39.407110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:39.407813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:39.408277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:39.408711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:39.538324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:39.546262 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3af2c5af-8457-49d4-9cc8-831c96707403 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.151766 Sep 19 15:43:39.546900 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3110/6262] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:39 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:40.569496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:40.570104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:40.577786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:40.578304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:40.578761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:40.579454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:40.579905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:40.580330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:40.717117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:40.725037 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8de27146-21a6-4a51-8908-0b6baa82f074 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.159453 Sep 19 15:43:40.725597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3153/6263] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:40 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:41.747992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:41.748631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:41.755771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:41.756286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:41.756741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:41.757620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:41.758140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:41.758696 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:41.935115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:41.943756 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ce88ba1-3767-41d4-8f08-23d1579db4b1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1521 microversion: 2.1 time: 0.200311 Sep 19 15:43:41.944347 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3111/6264] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:41 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:42.474825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0972ce73-c756-41ee-93c8-d9701593fdd9", "name": "network-vif-unplugged", "status": "completed", "tag": "56680df4-25d6-4823-b75a-729a7c46f031"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:42.481175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=34 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:42.487737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:42.488229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:42.488833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:42.492950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:42.502785 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] Creating event network-vif-unplugged:56680df4-25d6-4823-b75a-729a7c46f031 for instance 0972ce73-c756-41ee-93c8-d9701593fdd9 on n-h2-858384-1 Sep 19 15:43:42.509120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:43:42.522194 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fc97b6fd-cddf-453d-8468-a0be8d96fe24 req-14eed8af-f5c8-45f3-a50c-a0f6f9b5c340 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051011 Sep 19 15:43:42.522833 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3154/6265] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:42.967877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:42.968745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:42.975847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:42.976355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:42.976811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:42.977523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:42.977993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:42.978512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:43.211465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:43.219399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-60c8ad30-71cf-40b3-880d-00581708d681 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1520 microversion: 2.1 time: 0.256296 Sep 19 15:43:43.219981 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3112/6266] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:42 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:44.243804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:44.244894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:44.253987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:44.254479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:44.254944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:44.255652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:44.256096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:44.256506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:44.395421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:44.403918 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-92ebdf9a-4b97-4bba-a161-a47a1831ab68 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1518 microversion: 2.1 time: 0.164395 Sep 19 15:43:44.404481 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3155/6267] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:44 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:44.549698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0972ce73-c756-41ee-93c8-d9701593fdd9", "tag": "56680df4-25d6-4823-b75a-729a7c46f031"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:44.555861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=28 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:44.562202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:44.562689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:44.563163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:44.575440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] Creating event network-changed:56680df4-25d6-4823-b75a-729a7c46f031 for instance 0972ce73-c756-41ee-93c8-d9701593fdd9 on n-h2-858384-1 Sep 19 15:43:44.580656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:43:44.591741 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6990692f-bee9-46a0-bf8d-8f6b439151c7 req-fdafc66f-f77d-49c9-94e8-30ff8ad0486d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045986 Sep 19 15:43:44.592333 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3113/6268] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:45.427785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:45.428714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:45.436631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.437128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.437575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.438322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.438800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.439426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.578532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:45.586421 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b04280ca-181b-41d1-a290-2343f454a74e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1515 microversion: 2.1 time: 0.162716 Sep 19 15:43:45.587046 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3156/6269] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:45 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:45.611490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:45.612149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:45.618164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.618658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.619139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.619834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.621066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.621508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.678938 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-96c6e316-2d71-4ce2-bc70-2640c12300e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9/action" status: 204 len: 0 microversion: 2.1 time: 0.073813 Sep 19 15:43:45.679582 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3114/6270] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:43:45 2022] POST /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:43:45.688684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:45.689389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:45.695554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.696170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.696518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.697174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.697627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.698050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.907145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:45.915165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f2b427a-602d-4034-9b38-9f3712fcfe57 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1515 microversion: 2.1 time: 0.230359 Sep 19 15:43:45.915763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3157/6271] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:45 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:46.941919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:46.942655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:46.949569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:46.950075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:46.950523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:46.951254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:46.951726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:46.952166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:47.087714 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:47.095455 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14b28429-d29c-47c0-9c48-eb67ff0505b4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1507 microversion: 2.1 time: 0.160413 Sep 19 15:43:47.096034 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3115/6272] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:46 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:47.118924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:47.119542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:47.127133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:47.127624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:47.128060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:47.128749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:47.129206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:47.129632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:47.257291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:47.265374 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc916048-4dae-401b-b6e4-0d52c6188ab1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1507 microversion: 2.1 time: 0.151002 Sep 19 15:43:47.265956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3158/6273] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:47 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:47.290497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a32c202a-effe-42cc-b293-d929850f1bea tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'create', calling method: .version_select at 0x7fde28a4b3a0>, body: {"keypair": {"name": "tempest-keypair-366249757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIetwcmCFEspOLO5yTxjtdenDE4/r4ocx2G0MeG+asHn+w8aqB67Ou0rCeidIEtEVMaM5nAEyg7YWwgVx4+emKz9vfq5yX+Vh3NWvLM8EMpRf9LIhdGwbOqcwUn1l4h6XQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:47.306446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a32c202a-effe-42cc-b293-d929850f1bea tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Getting quotas for project d4f35d8b121848ea9b9404a8110e9967. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:43:47.312136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-a32c202a-effe-42cc-b293-d929850f1bea tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Getting quotas for user 15892a85d64c4b0184e54d4d1f07444c and project d4f35d8b121848ea9b9404a8110e9967. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:43:47.340295 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a32c202a-effe-42cc-b293-d929850f1bea tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053223 Sep 19 15:43:47.340950 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3116/6274] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:43:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:43:48.279412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1db7775e-c045-4fe1-868d-8d82e9ec2c83 req-97c64920-301f-4077-b93e-8720ad486554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0972ce73-c756-41ee-93c8-d9701593fdd9", "name": "network-vif-plugged", "status": "completed", "tag": "56680df4-25d6-4823-b75a-729a7c46f031"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:48.292298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1db7775e-c045-4fe1-868d-8d82e9ec2c83 req-97c64920-301f-4077-b93e-8720ad486554 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.292836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1db7775e-c045-4fe1-868d-8d82e9ec2c83 req-97c64920-301f-4077-b93e-8720ad486554 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.294761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1db7775e-c045-4fe1-868d-8d82e9ec2c83 req-97c64920-301f-4077-b93e-8720ad486554 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.308990 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1db7775e-c045-4fe1-868d-8d82e9ec2c83 req-97c64920-301f-4077-b93e-8720ad486554 service nova] Creating event network-vif-plugged:56680df4-25d6-4823-b75a-729a7c46f031 for instance 0972ce73-c756-41ee-93c8-d9701593fdd9 on n-h2-858384-1 Sep 19 15:43:48.315249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1db7775e-c045-4fe1-868d-8d82e9ec2c83 req-97c64920-301f-4077-b93e-8720ad486554 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039319 Sep 19 15:43:48.316078 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3159/6275] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:48.541887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:48.543016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:48.553018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.553526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.553983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.554693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.555215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.555661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.687280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:48.695030 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ea15ed1-2402-4efb-b328-f37832204e47 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 200 len: 1507 microversion: 2.1 time: 0.158410 Sep 19 15:43:48.695621 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3117/6276] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:48 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:48.718803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:48.719444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:48.725551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.726029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.726552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.727270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.727717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.728166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.753038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:43:48.830032 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-079748a1-6a05-4fc0-9878-1efb1d59ee07 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 204 len: 0 microversion: 2.1 time: 0.115967 Sep 19 15:43:48.830684 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3160/6277] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:43:48 2022] DELETE /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:43:48.883578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1270214969", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "eafd3c3e-257c-4dd6-a87c-0cae7f4225d7"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:48.937766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] validate_networks() for [('eafd3c3e-257c-4dd6-a87c-0cae7f4225d7', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:43:49.305519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:43:49.305972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:43:49.306470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:43:49.306937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:43:49.307373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:43:49.316734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:49.317239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:49.317695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:49.318442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:49.318956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:49.319407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:49.336677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Getting quotas for project d4f35d8b121848ea9b9404a8110e9967. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:43:49.342233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Getting quotas for user 15892a85d64c4b0184e54d4d1f07444c and project d4f35d8b121848ea9b9404a8110e9967. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:43:49.355146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:43:49.357548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:43:49.404816 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3971072e-b64b-4b34-9b1e-91a4c14a49f1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524999 Sep 19 15:43:49.405404 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3118/6278] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:43:49.417957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b776b149-d968-4b95-a2a2-219e54d93d83 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:49.418657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b776b149-d968-4b95-a2a2-219e54d93d83 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:49.478909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b776b149-d968-4b95-a2a2-219e54d93d83 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:49.487228 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b776b149-d968-4b95-a2a2-219e54d93d83 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1218 microversion: 2.1 time: 0.074133 Sep 19 15:43:49.487984 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3161/6279] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:49 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:50.513113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:50.515154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:50.525479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:50.526241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:50.527912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:50.529180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:50.529657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:50.530101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:50.642315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:50.652890 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a253e180-40f3-4071-ad88-13af25ec3d10 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1278 microversion: 2.1 time: 0.147034 Sep 19 15:43:50.653952 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3119/6280] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:50 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:51.109492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-771d15c8-3291-43fe-b298-e2e0b5f0ddda req-eda6bcb2-fb76-418a-a42e-1a8a47508a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0972ce73-c756-41ee-93c8-d9701593fdd9", "name": "network-vif-deleted", "tag": "56680df4-25d6-4823-b75a-729a7c46f031"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:51.123076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-771d15c8-3291-43fe-b298-e2e0b5f0ddda req-eda6bcb2-fb76-418a-a42e-1a8a47508a98 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:51.123718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-771d15c8-3291-43fe-b298-e2e0b5f0ddda req-eda6bcb2-fb76-418a-a42e-1a8a47508a98 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:51.124159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-771d15c8-3291-43fe-b298-e2e0b5f0ddda req-eda6bcb2-fb76-418a-a42e-1a8a47508a98 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:51.142352 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-771d15c8-3291-43fe-b298-e2e0b5f0ddda req-eda6bcb2-fb76-418a-a42e-1a8a47508a98 service nova] Creating event network-vif-deleted:56680df4-25d6-4823-b75a-729a7c46f031 for instance 0972ce73-c756-41ee-93c8-d9701593fdd9 on n-h2-858384-1 Sep 19 15:43:51.148151 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-771d15c8-3291-43fe-b298-e2e0b5f0ddda req-eda6bcb2-fb76-418a-a42e-1a8a47508a98 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043539 Sep 19 15:43:51.148764 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3162/6281] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:51.676240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:51.677163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:51.686418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:51.687581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:51.688038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:51.689192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:51.689680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:51.690123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:51.952640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:51.961258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82fb1841-0f0c-4ba4-8a77-ce3e50860831 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.289295 Sep 19 15:43:51.961864 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3120/6282] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:51 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:52.985957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:52.986665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:52.993679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:52.994191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:52.994623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:52.996161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:52.996621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:52.997046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:53.130223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:53.138052 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-26695152-8a99-4dbe-b5fc-dd33af2735f4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.156348 Sep 19 15:43:53.138609 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3163/6283] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:52 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:53.163841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ded30008-031a-41b9-8994-372609c61122 req-98d21a6f-96d8-468e-b052-393cbe7abfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344b02f6-deaa-4345-8fd1-398ebc00a7dd", "tag": "c8d9a8cc-65ba-4327-8844-2c95a39945a9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:53.175071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ded30008-031a-41b9-8994-372609c61122 req-98d21a6f-96d8-468e-b052-393cbe7abfc6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:53.175566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ded30008-031a-41b9-8994-372609c61122 req-98d21a6f-96d8-468e-b052-393cbe7abfc6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:53.176007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ded30008-031a-41b9-8994-372609c61122 req-98d21a6f-96d8-468e-b052-393cbe7abfc6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:53.188126 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ded30008-031a-41b9-8994-372609c61122 req-98d21a6f-96d8-468e-b052-393cbe7abfc6 service nova] Creating event network-changed:c8d9a8cc-65ba-4327-8844-2c95a39945a9 for instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd on n-h2-858384-1 Sep 19 15:43:53.193032 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ded30008-031a-41b9-8994-372609c61122 req-98d21a6f-96d8-468e-b052-393cbe7abfc6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032878 Sep 19 15:43:53.193612 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3121/6284] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:54.167447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:54.168148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:54.175066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:54.175553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:54.175992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:54.176964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:54.177423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:54.177848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:54.309311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:54.317051 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7465d8f-7884-4bbc-8580-2fc3004c43b3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.153643 Sep 19 15:43:54.317666 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3164/6285] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:54 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:55.342452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:55.343199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:55.349380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:55.349932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:55.350380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:55.351110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:55.351573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:55.352116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:55.480777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:55.488376 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e00bb946-0d9f-4a3e-9d36-f4f3f7e4f937 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.151755 Sep 19 15:43:55.488947 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3122/6286] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:55 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:56.511523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:56.512078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:56.519604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:56.520221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:56.520898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:56.521816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:56.522306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:56.522943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:56.664895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:56.673797 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-637ff050-1015-471d-a975-68e045ad72b7 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.166279 Sep 19 15:43:56.681855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3165/6287] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:56 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:57.697278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:57.697825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:57.704745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:57.705240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:57.705685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:57.706377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:57.706876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:57.707310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:57.835907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:57.843713 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9ce1d473-28a3-4bf1-aa0a-e48a64968ac3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.150420 Sep 19 15:43:57.844294 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3123/6288] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:57 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:58.306909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a4153012-ac1d-489c-9fbe-f067b05f91e1 req-06f2c7eb-a57d-43f7-a050-bc58d8c31940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344b02f6-deaa-4345-8fd1-398ebc00a7dd", "name": "network-vif-plugged", "status": "completed", "tag": "c8d9a8cc-65ba-4327-8844-2c95a39945a9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:58.319645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a4153012-ac1d-489c-9fbe-f067b05f91e1 req-06f2c7eb-a57d-43f7-a050-bc58d8c31940 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:58.320318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a4153012-ac1d-489c-9fbe-f067b05f91e1 req-06f2c7eb-a57d-43f7-a050-bc58d8c31940 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:58.320765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a4153012-ac1d-489c-9fbe-f067b05f91e1 req-06f2c7eb-a57d-43f7-a050-bc58d8c31940 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:58.333077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a4153012-ac1d-489c-9fbe-f067b05f91e1 req-06f2c7eb-a57d-43f7-a050-bc58d8c31940 service nova] Creating event network-vif-plugged:c8d9a8cc-65ba-4327-8844-2c95a39945a9 for instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd on n-h2-858384-1 Sep 19 15:43:58.338476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a4153012-ac1d-489c-9fbe-f067b05f91e1 req-06f2c7eb-a57d-43f7-a050-bc58d8c31940 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035115 Sep 19 15:43:58.339971 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3166/6289] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:58.866895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:58.867529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:58.874861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:58.875365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:58.875817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:58.876517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:58.876986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:58.877425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:59.008590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:59.016963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-085a5828-35f5-4063-8080-78bdc76dec85 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1318 microversion: 2.1 time: 0.154068 Sep 19 15:43:59.017534 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3124/6290] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:58 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:00.040018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:00.040647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:00.043156 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:00.049187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.049677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.050117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.050843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.051296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.051987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.184736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:00.192647 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d05c2cb2-53cb-4616-8cae-098371e982d6 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1508 microversion: 2.1 time: 0.156986 Sep 19 15:44:00.193230 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3167/6291] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:00 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:00.216066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:00.216686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:00.218624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:00.219340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:00.226072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.226568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.227052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.227755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.228221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.228658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.359407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:00.367148 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eb8e4368-32ec-4e59-bf71-cb0a550a0097 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1508 microversion: 2.1 time: 0.155389 Sep 19 15:44:00.367918 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3125/6292] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:00 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:00.390625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:00.392934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:00.400079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.400618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.401399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.402226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.402960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.403442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.434859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:00.441997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Old instance type m1.heat2, new instance type m1.heat {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:44:00.450911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:44:00.451440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:44:00.452036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:44:00.452515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:44:00.453043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:44:00.524709 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1d8ea597-9867-46c6-bded-247923bab158 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd/action" status: 202 len: 0 microversion: 2.1 time: 0.137948 Sep 19 15:44:00.525320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3168/6293] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:44:00 2022] POST /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:44:00.534382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:00.535142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:00.541187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.541977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.542576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.543358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.543860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.544339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.687193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:00.689504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:00.697603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-87d7b420-4e7e-4436-91dd-514f2c20040b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1515 microversion: 2.1 time: 0.167316 Sep 19 15:44:00.698297 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3126/6294] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:00 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:01.721693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:01.723040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:01.731722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:01.732221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:01.732657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:01.733353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:01.733803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:01.734222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:01.946596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:01.955398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09f1cae0-eece-4030-bc04-399236159e3c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1515 microversion: 2.1 time: 0.238136 Sep 19 15:44:01.955978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3169/6295] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:01 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:02.977749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:02.978384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:02.987113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:02.987621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:02.988080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:02.988789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:02.989267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:02.989712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:03.119537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:03.127502 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94674207-a499-4fbc-bbe8-24a05a741ac1 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.153702 Sep 19 15:44:03.128083 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3127/6296] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:02 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:04.150843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:04.151566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:04.159023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:04.159563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:04.159955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:04.160645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:04.161102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:04.161554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:04.295453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:04.303464 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c3058f20-edbf-4346-a37a-ffb43a1f4c35 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.156581 Sep 19 15:44:04.304037 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3170/6297] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:04 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:05.326891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:05.327549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:05.334148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:05.334650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:05.335141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:05.335847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:05.336324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:05.336770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:05.470647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:05.478366 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e0f78899-62f6-46f3-aa95-5fc5e023139c tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.155561 Sep 19 15:44:05.479175 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3128/6298] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:05 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:06.502045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:06.502664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:06.509536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:06.510020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:06.510459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:06.511179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:06.511858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:06.512288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:06.516178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:06.642957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:06.650654 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8144daf-e4d0-41d3-a8bf-dd8ce66a4b61 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.152554 Sep 19 15:44:06.651255 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3171/6299] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:06 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:07.674341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:07.674999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:07.682122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:07.682628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:07.683224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:07.683934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:07.684406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:07.684849 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:07.818071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:07.825946 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-421e2c5f-e504-40fb-a2ad-fdb8ab4da2bb tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.155574 Sep 19 15:44:07.826561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3129/6300] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:07 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:08.849585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:08.850210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:08.857910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:08.858417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:08.858890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:08.859580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:08.860030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:08.860449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:08.992322 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:09.000477 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-20b8e357-2afd-4ab6-8c0a-19c061253b9f tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.154866 Sep 19 15:44:09.001057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3172/6301] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:08 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:10.024096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:10.024728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:10.032535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:10.033040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:10.033489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:10.034192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:10.034666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:10.035135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:10.171043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:10.179081 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf88d8ca-096f-4142-8ec3-5604fcdfd864 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.158937 Sep 19 15:44:10.179663 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3130/6302] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:10 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:11.202566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:11.203208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:11.210136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:11.211000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:11.213547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:11.214359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:11.214932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:11.215369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:11.346203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:11.353967 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-53348721-84a7-450c-85d0-b925898dbcc4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.155575 Sep 19 15:44:11.354551 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3173/6303] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:11 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:12.378298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:12.379254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:12.387513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:12.388105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:12.388673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:12.389497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:12.389989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:12.390437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:12.523951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:12.532749 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17c86ed2-5ce3-4e45-aae3-bed8471b4251 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.159465 Sep 19 15:44:12.533324 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3131/6304] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:12 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:13.556733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:13.557348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:13.560846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:13.566146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:13.566630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:13.567088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:13.567780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:13.568234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:13.568658 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:13.698515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:13.706380 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-795de3d5-df1c-4e43-ae30-c8823fe957b0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.153652 Sep 19 15:44:13.707020 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3174/6305] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:13 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:14.730699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:14.731343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:14.733947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:14.739470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:14.740027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:14.740581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:14.741378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:14.741958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:14.742472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:14.876657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:14.884365 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76465a6a-a99f-418f-a037-7487b73ebf1b tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.158283 Sep 19 15:44:14.884936 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3132/6306] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:14 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:44:15.910191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:15.910848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:15.918352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:15.918971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:15.919410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:15.920104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:15.920558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:15.920982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:16.061934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:16.069700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2217e3eb-3b50-49b7-b881-454b39587051 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.163434 Sep 19 15:44:16.070270 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3175/6307] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:15 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:17.093083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:17.093789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:17.100644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:17.101153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:17.101609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:17.102315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:17.102818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:17.103268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:17.233420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:17.241187 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fdd76c66-5143-40b1-a96d-9bed37587198 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.152355 Sep 19 15:44:17.241758 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3133/6308] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:17 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:18.265167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:18.265764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:18.272675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:18.273160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:18.273598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:18.274290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:18.274761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:18.275200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:18.408980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:18.416795 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-41e13d20-886f-4f4d-9f63-c3ec89699e8e tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.156149 Sep 19 15:44:18.417425 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3176/6309] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:18 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:19.439992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:19.440670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:19.447567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:19.448075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:19.449081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:19.449913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:19.450391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:19.450863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:19.582210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:19.591893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d53ec1b5-51e0-4395-a9ab-0d1fe8acc3c4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.155849 Sep 19 15:44:19.592469 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3134/6310] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:19 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:20.615493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:20.616107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:20.619104 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:44:20.619262 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd (ip 10.222.0.81) !!! Sep 19 15:44:20.625718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:20.626201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:20.626637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:20.627361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:20.627820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:20.628250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:20.757965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:20.766614 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f0a09d1-271e-46a1-b5bf-374e798e814d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.155093 Sep 19 15:44:20.767219 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3177/6311] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:20 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:21.790655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:21.791324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:21.798116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:21.798624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:21.799125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:21.799831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:21.800311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:21.800755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:21.931660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:21.940197 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-92b2e303-7996-4c40-9ac2-64b1b5973bd4 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.153524 Sep 19 15:44:21.940780 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3135/6312] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:21 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:22.963821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:22.964462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:22.972190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:22.972675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:22.973105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:22.973795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:22.974333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:22.974816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:23.105081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:23.113396 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cec2f6f5-5213-45ce-b2e7-91ab819e91db tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.153488 Sep 19 15:44:23.113980 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3178/6313] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:22 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:24.139427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:24.140097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:24.147069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:24.147574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:24.148030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:24.148735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:24.149210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:24.149653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:24.283810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:24.292487 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b8b2bc0-91c8-488f-b6c9-92f51caf12fc tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.156820 Sep 19 15:44:24.293461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3136/6314] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:24 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:25.317014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:25.317641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:25.324575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:25.325193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:25.325640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:25.326342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:25.326832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:25.327266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:25.457993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:25.466165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4d51b4a0-ef17-4d64-b2e0-536bdba61615 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.153095 Sep 19 15:44:25.466737 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3179/6315] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:25 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:26.492834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:26.493609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:26.502209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:26.502865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:26.503441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:26.504231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:26.504823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:26.505364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:26.640740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:26.648403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e23c6a03-0798-4692-ada9-ec19446a48e8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.160327 Sep 19 15:44:26.648974 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3137/6316] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:26 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:27.671574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:27.672251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:27.679341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:27.679825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:27.680260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:27.680945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:27.681391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:27.681813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:27.811035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:27.818832 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b211e69-173f-4766-99b0-d7f959c16269 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.151510 Sep 19 15:44:27.819404 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3180/6317] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:27 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:28.843373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:28.843930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:28.850412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:28.850966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:28.851426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:28.852143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:28.852620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:28.853074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:28.987870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:28.995774 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a398997-058d-4319-b5bd-354a10ddf703 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1520 microversion: 2.1 time: 0.157265 Sep 19 15:44:28.996357 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3138/6318] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:28 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:29.645863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344b02f6-deaa-4345-8fd1-398ebc00a7dd", "name": "network-vif-unplugged", "status": "completed", "tag": "c8d9a8cc-65ba-4327-8844-2c95a39945a9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:29.655806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:29.656290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:29.656722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:29.668406 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] Creating event network-vif-unplugged:c8d9a8cc-65ba-4327-8844-2c95a39945a9 for instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd on n-h1-858384-1 Sep 19 15:44:29.674391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:44:29.686707 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-69cab474-a3dc-4832-8845-f897e9e59610 req-7315d423-e74c-4b30-93ab-bc9aed0dc50e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044815 Sep 19 15:44:29.687548 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3181/6319] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:44:30.019300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:30.019961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:30.026731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:30.027282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:30.028774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:30.029503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:30.029982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:30.030429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:30.551419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:30.560215 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-42314cbf-bfc5-40ba-b91d-ef90ee3d9fc8 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1519 microversion: 2.1 time: 0.544725 Sep 19 15:44:30.560811 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3139/6320] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:30 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1519 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:31.585443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:31.586148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:31.593437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:31.593924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:31.594363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:31.595080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:31.595539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:31.595972 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:31.710829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344b02f6-deaa-4345-8fd1-398ebc00a7dd", "tag": "c8d9a8cc-65ba-4327-8844-2c95a39945a9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:31.721638 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:31.722128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:31.722570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:31.735418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:31.735660 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] Creating event network-changed:c8d9a8cc-65ba-4327-8844-2c95a39945a9 for instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd on n-h1-858384-1 Sep 19 15:44:31.741218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:44:31.744024 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d22e9c73-fe10-4b49-b1b9-535fc4f69d01 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1517 microversion: 2.1 time: 0.163624 Sep 19 15:44:31.744673 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3182/6321] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:31 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:31.752141 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2c73b4bf-0be5-4705-bacd-244bc5d52e38 req-a8716dd0-4ae4-489e-98b0-5225add2ad12 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045031 Sep 19 15:44:31.752736 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3140/6322] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:44:32.770772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:32.771646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:32.779366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:32.780483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:32.780965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:32.781669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:32.782128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:32.782550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:32.921568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:32.930809 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-955ebce0-3244-4651-aaea-3a8b4ddff338 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1514 microversion: 2.1 time: 0.166376 Sep 19 15:44:32.931844 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3183/6323] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:32 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:32.958677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:32.959378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:32.967797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:32.968303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:32.968760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:32.969472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:32.969943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:32.970384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:32.986396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=86 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:33.033625 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-25a38466-c582-46b6-baa1-c410a9adec2a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "POST /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd/action" status: 204 len: 0 microversion: 2.1 time: 0.079845 Sep 19 15:44:33.034259 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3141/6324] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:44:32 2022] POST /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:44:33.045116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:33.045852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:33.053299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:33.054129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:33.054724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:33.056012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:33.056469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:33.056946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:33.319928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:33.329926 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1946b39-72b8-430a-be53-51dc7b98994d tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1514 microversion: 2.1 time: 0.290749 Sep 19 15:44:33.330897 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3184/6325] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:33 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:34.358528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:34.359403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:34.365667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.366174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.366662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.367397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.367861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.368297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.513379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:34.521282 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-73632f37-4075-4f75-8377-ccf9d493ed64 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1506 microversion: 2.1 time: 0.169291 Sep 19 15:44:34.521848 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3142/6326] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:34 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:34.543770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:34.545019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:34.551879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.552614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.553074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.553744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.554196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.554617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.689818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:34.697629 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b119cec-9ea7-4717-a389-046bbc55aeb3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1506 microversion: 2.1 time: 0.157774 Sep 19 15:44:34.698208 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3185/6327] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:34 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:34.719931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:34.720566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:34.726652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.727199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.727665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.728377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.728853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.729300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.859788 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:34.867543 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ababe376-ce44-4482-965a-334aefe6e97a tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1506 microversion: 2.1 time: 0.152106 Sep 19 15:44:34.868118 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3143/6328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:34 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:34.889341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:34.889781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:34.895823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.896313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.896758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.897468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.897966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.898398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.924199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:44:34.968956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:35.001096 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fe70aece-df6d-48d7-9d86-72c528b892e0 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "DELETE /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 204 len: 0 microversion: 2.1 time: 0.115355 Sep 19 15:44:35.005941 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3186/6329] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:44:34 2022] DELETE /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:44:35.019237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:35.019756 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:35.025768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.026273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.026733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.027463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.027941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.028388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.054461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:44:35.101557 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.compute.api [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Instance is already in deleting state, ignoring this request Sep 19 15:44:35.102417 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a91e3ff7-d539-4f93-9dc2-e01c29fd3538 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "DELETE /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 204 len: 0 microversion: 2.1 time: 0.087281 Sep 19 15:44:35.103321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3144/6330] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:44:35 2022] DELETE /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:44:35.114824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:35.115534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:35.121763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.122246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.122943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.123807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.124263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.124686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.211457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-00805516-e076-4f56-aa3c-bb0e95565f0c req-f9583498-6219-4e77-9c32-233b40837a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344b02f6-deaa-4345-8fd1-398ebc00a7dd", "name": "network-vif-plugged", "status": "completed", "tag": "c8d9a8cc-65ba-4327-8844-2c95a39945a9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:35.222512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-00805516-e076-4f56-aa3c-bb0e95565f0c req-f9583498-6219-4e77-9c32-233b40837a99 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.223042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-00805516-e076-4f56-aa3c-bb0e95565f0c req-f9583498-6219-4e77-9c32-233b40837a99 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.223485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-00805516-e076-4f56-aa3c-bb0e95565f0c req-f9583498-6219-4e77-9c32-233b40837a99 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.238597 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-00805516-e076-4f56-aa3c-bb0e95565f0c req-f9583498-6219-4e77-9c32-233b40837a99 service nova] Creating event network-vif-plugged:c8d9a8cc-65ba-4327-8844-2c95a39945a9 for instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd on n-h1-858384-1 Sep 19 15:44:35.243902 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-00805516-e076-4f56-aa3c-bb0e95565f0c req-f9583498-6219-4e77-9c32-233b40837a99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036263 Sep 19 15:44:35.245599 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3145/6331] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:44:35.272669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:35.282672 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2db94d5-41b4-47f3-842c-fa746317c709 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1512 microversion: 2.1 time: 0.172814 Sep 19 15:44:35.283409 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3187/6332] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:35 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:36.307197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:36.307913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:36.314131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:36.314631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:36.315116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:36.315820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:36.316293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:36.316762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:36.532481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15892a85d64c4b0184e54d4d1f07444c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f35d8b121848ea9b9404a8110e9967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:36.540268 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d835aca4-5f9a-468f-8aa3-4d927bd79387 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 200 len: 1512 microversion: 2.1 time: 0.238497 Sep 19 15:44:36.540837 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3146/6333] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:36 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:36.849080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ebf56869-7966-4567-90f6-6f60ea6fe41a req-8b539ace-cc22-4a38-b4d7-2e063c9cb2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344b02f6-deaa-4345-8fd1-398ebc00a7dd", "name": "network-vif-deleted", "tag": "c8d9a8cc-65ba-4327-8844-2c95a39945a9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:36.861835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ebf56869-7966-4567-90f6-6f60ea6fe41a req-8b539ace-cc22-4a38-b4d7-2e063c9cb2c0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:36.862318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ebf56869-7966-4567-90f6-6f60ea6fe41a req-8b539ace-cc22-4a38-b4d7-2e063c9cb2c0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:36.862769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ebf56869-7966-4567-90f6-6f60ea6fe41a req-8b539ace-cc22-4a38-b4d7-2e063c9cb2c0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:36.874483 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ebf56869-7966-4567-90f6-6f60ea6fe41a req-8b539ace-cc22-4a38-b4d7-2e063c9cb2c0 service nova] Creating event network-vif-deleted:c8d9a8cc-65ba-4327-8844-2c95a39945a9 for instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd on n-h1-858384-1 Sep 19 15:44:36.879271 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ebf56869-7966-4567-90f6-6f60ea6fe41a req-8b539ace-cc22-4a38-b4d7-2e063c9cb2c0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Sep 19 15:44:36.879874 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3188/6334] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:44:37.563877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:37.564498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 344b02f6-deaa-4345-8fd1-398ebc00a7dd] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:37.571252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:37.571743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:37.572188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:37.572879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:37.573347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:37.573785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:37.587665 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] HTTP exception thrown: Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd could not be found. Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Request method failure captured: Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd HTTP/1.1 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI4FI56iSe68CfnsqnXw87jmoF2UBPdixIg6gjFX8imQmqrJ47EXQA2JykpiMC9OYw5YGNEJQ5YMhLu6IeWCV3iQmuQDAVkSHH3guNDBjxuXa_k7eiBXVMjVSW6AH4Zt4n7HKYjU2tqL5_40mphvPThbt1wFCK9Kz3zDPjt6_GlVx6I Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d4f35d8b121848ea9b9404a8110e9967 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d4f35d8b121848ea9b9404a8110e9967"}]}] Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d4f35d8b121848ea9b9404a8110e9967 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiskConfigTestJSON-1212082366-project Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 15892a85d64c4b0184e54d4d1f07444c Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212082366-project Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd could not be found. Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '344b02f6-deaa-4345-8fd1-398ebc00a7dd'} Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd could not be found. Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd could not be found. Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:44:37.589286 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd could not be found. Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Returning 404 to user: Instance 344b02f6-deaa-4345-8fd1-398ebc00a7dd could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d8aa91d-43d3-4395-abf1-3e1fd84c6511 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd" status: 404 len: 111 microversion: 2.1 time: 0.031103 Sep 19 15:44:37.594830 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3147/6335] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:37 2022] GET /compute/v2.1/servers/344b02f6-deaa-4345-8fd1-398ebc00a7dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:44:37.600586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d94a1e70-d47e-46a8-8d3f-5df33b0986f3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '.version_select at 0x7fde28cb9dc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:37.624266 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d94a1e70-d47e-46a8-8d3f-5df33b0986f3 tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366249757" status: 202 len: 0 microversion: 2.1 time: 0.027846 Sep 19 15:44:37.624831 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3189/6336] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 15:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366249757 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:44:38.229596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:38.230043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:38.236527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:38.237017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:38.237463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:38.238156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:38.238618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:38.239078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:38.252711 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] HTTP exception thrown: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Request method failure captured: Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 HTTP/1.1 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI4FI56iSe68CfnsqnXw87jmoF2UBPdixIg6gjFX8imQmqrJ47EXQA2JykpiMC9OYw5YGNEJQ5YMhLu6IeWCV3iQmuQDAVkSHH3guNDBjxuXa_k7eiBXVMjVSW6AH4Zt4n7HKYjU2tqL5_40mphvPThbt1wFCK9Kz3zDPjt6_GlVx6I Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d4f35d8b121848ea9b9404a8110e9967 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d4f35d8b121848ea9b9404a8110e9967"}]}] Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d4f35d8b121848ea9b9404a8110e9967 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerDiskConfigTestJSON-1212082366-project Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 15892a85d64c4b0184e54d4d1f07444c Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212082366-project Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '0972ce73-c756-41ee-93c8-d9701593fdd9'} Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:44:38.254233 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Returning 404 to user: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a407a58e-26bf-42d5-b708-62fce8a812dd tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 404 len: 111 microversion: 2.1 time: 0.030045 Sep 19 15:44:38.258314 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3148/6337] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:44:38 2022] DELETE /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:44:38.265063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:38.265820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] [instance: 0972ce73-c756-41ee-93c8-d9701593fdd9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:38.272442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:38.272923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:38.273357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:38.274040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:38.274490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:38.274952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:38.291588 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] HTTP exception thrown: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Request method failure captured: Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 HTTP/1.1 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI4FI56iSe68CfnsqnXw87jmoF2UBPdixIg6gjFX8imQmqrJ47EXQA2JykpiMC9OYw5YGNEJQ5YMhLu6IeWCV3iQmuQDAVkSHH3guNDBjxuXa_k7eiBXVMjVSW6AH4Zt4n7HKYjU2tqL5_40mphvPThbt1wFCK9Kz3zDPjt6_GlVx6I Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d4f35d8b121848ea9b9404a8110e9967 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d4f35d8b121848ea9b9404a8110e9967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d4f35d8b121848ea9b9404a8110e9967"}]}] Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d4f35d8b121848ea9b9404a8110e9967 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212082366 Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerDiskConfigTestJSON-1212082366-project Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 15892a85d64c4b0184e54d4d1f07444c Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212082366-project Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '0972ce73-c756-41ee-93c8-d9701593fdd9'} Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:44:38.293303 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] Returning 404 to user: Instance 0972ce73-c756-41ee-93c8-d9701593fdd9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0400f6f0-1e13-4e19-9e07-0c95271370ae tempest-ServerDiskConfigTestJSON-1212082366 tempest-ServerDiskConfigTestJSON-1212082366-project] 10.222.0.81 "GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9" status: 404 len: 111 microversion: 2.1 time: 0.035018 Sep 19 15:44:38.298281 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3190/6338] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:38 2022] GET /compute/v2.1/servers/0972ce73-c756-41ee-93c8-d9701593fdd9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:44:46.664148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89a42f79-dfb8-4b7d-9771-0cd4e07f667f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'create', calling method: .version_select at 0x7fde28a57f70>, body: {"keypair": {"name": "tempest-keypair-1260302455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJceZas23fZQNDyK8aGNj+dOz4IXORptFXLy0Du6adudpOvSea+xRdo71g/pCXlNPYJ4jfcLWwQyP7lnV0oNPW9l5K2twfIEaSYPPHFP+5YbEprBAhUinskw8qF7AH8tHg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:46.670200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=34 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:46.682811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-89a42f79-dfb8-4b7d-9771-0cd4e07f667f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:44:46.689264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-89a42f79-dfb8-4b7d-9771-0cd4e07f667f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:44:46.719781 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89a42f79-dfb8-4b7d-9771-0cd4e07f667f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176499 Sep 19 15:44:46.720400 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3149/6339] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:44:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:44:48.041383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1706145710", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d764445a-f4f8-40d5-9f18-651713c6db6e"}], "security_groups": [{"name": "tempest-securitygroup--2053664145"}], "key_name": "tempest-keypair-1260302455", "user_data": "}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:48.052374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:48.153569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] validate_networks() for [('d764445a-f4f8-40d5-9f18-651713c6db6e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:44:48.279428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:48.914395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:44:48.914851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:44:48.915565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:44:48.915978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:44:48.916388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:44:48.926583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:48.927377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:48.927992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:48.928731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:48.929190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:48.929756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:48.950198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:44:48.956598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:44:48.970027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:44:48.972397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:44:49.022387 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-176eba7b-94b1-4282-b0b0-7567d18edf89 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.985176 Sep 19 15:44:49.029307 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3191/6340] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:44:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:44:49.032374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:49.036581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b0115c9b-1c8a-48be-8ffd-1e439f4bdf9d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:49.037251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b0115c9b-1c8a-48be-8ffd-1e439f4bdf9d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:49.104785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b0115c9b-1c8a-48be-8ffd-1e439f4bdf9d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:49.114180 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b0115c9b-1c8a-48be-8ffd-1e439f4bdf9d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1239 microversion: 2.1 time: 0.083317 Sep 19 15:44:49.115206 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3150/6341] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:49 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:50.138497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:50.139398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:50.147242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:50.148219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:50.148896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:50.150084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:50.150770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:50.151410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:50.230871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:50.241281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac15e270-d034-4e97-8bdf-e1fcaaf45da3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1299 microversion: 2.1 time: 0.107547 Sep 19 15:44:50.242194 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3192/6342] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:50 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:51.268592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:51.269221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:51.276888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:51.277406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:51.277869 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:51.278740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:51.279245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:51.279693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:51.526683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:51.534891 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e39d11c9-e110-480f-85c1-44f54ec33700 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1365 microversion: 2.1 time: 0.270240 Sep 19 15:44:51.535482 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3151/6343] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:51 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:44:51.681048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c448173d-9b4c-4320-9984-432f552f2f61 req-3a451a3b-38dc-4a6a-bc90-a0f3012eac43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:51.694667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c448173d-9b4c-4320-9984-432f552f2f61 req-3a451a3b-38dc-4a6a-bc90-a0f3012eac43 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:51.695169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c448173d-9b4c-4320-9984-432f552f2f61 req-3a451a3b-38dc-4a6a-bc90-a0f3012eac43 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:51.695603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c448173d-9b4c-4320-9984-432f552f2f61 req-3a451a3b-38dc-4a6a-bc90-a0f3012eac43 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:51.707836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c448173d-9b4c-4320-9984-432f552f2f61 req-3a451a3b-38dc-4a6a-bc90-a0f3012eac43 service nova] Creating event network-changed:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h2-858384-1 Sep 19 15:44:51.713187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c448173d-9b4c-4320-9984-432f552f2f61 req-3a451a3b-38dc-4a6a-bc90-a0f3012eac43 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036487 Sep 19 15:44:51.713828 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3193/6344] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:44:52.558889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:52.560181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:52.566969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:52.567469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:52.567917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:52.568614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:52.569081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:52.569516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:52.705532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:52.713343 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76a5c5a7-fdbf-47e1-b90c-512502092a8a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1365 microversion: 2.1 time: 0.158322 Sep 19 15:44:52.713909 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3152/6345] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:52 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:53.737533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:53.738243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:53.744490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:53.744977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:53.745418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:53.746115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:53.746574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:53.747057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:53.885496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:53.894794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-220458de-4556-4ba0-bfad-49f7adc76e16 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1365 microversion: 2.1 time: 0.162429 Sep 19 15:44:53.895370 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3194/6346] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:53 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:54.917582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:54.918196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:54.925979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:54.926485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:54.926973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:54.927947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:54.928422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:54.928871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:55.059331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:55.067745 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a9a38cd2-c78e-4c11-87a3-bf8d37f456f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1365 microversion: 2.1 time: 0.154012 Sep 19 15:44:55.068328 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3153/6347] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:54 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:56.089522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:56.090138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:56.099256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:56.099774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:56.100213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:56.101006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:56.101460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:56.101882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:56.234696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:56.242387 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43f57bb1-3ba7-40b6-bbe0-22cc4568a458 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1365 microversion: 2.1 time: 0.156789 Sep 19 15:44:56.242973 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3195/6348] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:56 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:56.594644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-be2c2d03-4b1d-48be-898a-0c6541d2ef13 req-0a3482a9-de05-411c-a678-4eb772d14ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "name": "network-vif-plugged", "status": "completed", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:56.606524 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-be2c2d03-4b1d-48be-898a-0c6541d2ef13 req-0a3482a9-de05-411c-a678-4eb772d14ab2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:56.607216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-be2c2d03-4b1d-48be-898a-0c6541d2ef13 req-0a3482a9-de05-411c-a678-4eb772d14ab2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:56.607995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-be2c2d03-4b1d-48be-898a-0c6541d2ef13 req-0a3482a9-de05-411c-a678-4eb772d14ab2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:56.619689 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-be2c2d03-4b1d-48be-898a-0c6541d2ef13 req-0a3482a9-de05-411c-a678-4eb772d14ab2 service nova] Creating event network-vif-plugged:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h2-858384-1 Sep 19 15:44:56.625683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-be2c2d03-4b1d-48be-898a-0c6541d2ef13 req-0a3482a9-de05-411c-a678-4eb772d14ab2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Sep 19 15:44:56.626356 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3154/6349] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:44:57.265296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:57.266069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:57.272850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:57.273330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:57.273761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:57.274473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:57.274955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:57.275380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:57.407452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:57.415422 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b4874f8-8bda-4255-abe9-d0a437caf04b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1365 microversion: 2.1 time: 0.154876 Sep 19 15:44:57.415996 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3196/6350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:57 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:44:58.440305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:58.441538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:58.447915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:58.448413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:58.448866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:58.449596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:58.450064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:58.450496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:58.582661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:58.590391 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f9d5c6f-e9e6-46c8-b65b-1f63219bac19 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1552 microversion: 2.1 time: 0.155604 Sep 19 15:44:58.590987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3155/6351] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:58 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:58.615417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:58.615938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:58.622768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:58.623287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:58.623731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:58.624428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:58.624893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:58.625328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:58.704795 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a8d03471-7e65-4ee1-aac3-1072261c9b50 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093190 Sep 19 15:44:58.705420 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3197/6352] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:44:58 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:44:59.632771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-aa76e099-5785-4130-8c83-eb23895cde63 req-df2a5007-be4e-4818-a77d-2cf8aa9d0134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:44:59.637713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:59.645106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aa76e099-5785-4130-8c83-eb23895cde63 req-df2a5007-be4e-4818-a77d-2cf8aa9d0134 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:59.645605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aa76e099-5785-4130-8c83-eb23895cde63 req-df2a5007-be4e-4818-a77d-2cf8aa9d0134 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:59.646058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-aa76e099-5785-4130-8c83-eb23895cde63 req-df2a5007-be4e-4818-a77d-2cf8aa9d0134 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:59.657299 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-aa76e099-5785-4130-8c83-eb23895cde63 req-df2a5007-be4e-4818-a77d-2cf8aa9d0134 service nova] Creating event network-changed:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h2-858384-1 Sep 19 15:44:59.662367 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-aa76e099-5785-4130-8c83-eb23895cde63 req-df2a5007-be4e-4818-a77d-2cf8aa9d0134 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033392 Sep 19 15:44:59.663011 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3156/6353] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:45:34.420805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:34.421582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:34.423315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:34.424524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=32 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:34.429147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:34.429763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:34.437653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:34.438229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:34.438779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:34.440249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:34.440955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:34.441387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:34.652308 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:34.660682 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4929322b-d3fa-4103-b691-32ec66900b36 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1669 microversion: 2.1 time: 0.240718 Sep 19 15:45:34.661249 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3198/6354] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:34 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1669 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:34.682611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:34.683337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=28 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:34.688183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:34.688902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:34.696440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:34.696944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:34.697406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:34.698096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:34.698572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:34.699041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.195968 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:35.204040 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b95a2c3b-dea8-48bc-b2bb-b6d6e51ad7c6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1669 microversion: 2.1 time: 0.523517 Sep 19 15:45:35.204628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3157/6355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:34 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1669 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:35.226833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:35.227472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:35.233612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.234090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.234520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.235303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.235752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.236860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.363745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:35.371630 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39a3e620-125b-42de-a911-814bca0dbc9e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1669 microversion: 2.1 time: 0.148956 Sep 19 15:45:35.372229 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3199/6356] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:35 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:35.393810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:35.396099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:35.402004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.402514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.403016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.403726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.404205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.404650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.434606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:35.440406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Old instance type m1.heat2, new instance type m1.heat {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:45:35.447915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:45:35.448295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:45:35.448786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:45:35.449208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:45:35.449634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:45:35.517611 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28f6b38e-2058-481e-9af0-a3485e368891 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23/action" status: 202 len: 0 microversion: 2.1 time: 0.127682 Sep 19 15:45:35.518256 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3158/6357] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:45:35 2022] POST /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:45:35.526354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:35.527199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:35.534427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.534983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.535439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.536144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.536606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.537038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.674564 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:35.683095 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dd6b1890-cbc9-4e04-9aff-51af510a71f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1678 microversion: 2.1 time: 0.160578 Sep 19 15:45:35.683679 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3200/6358] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:35 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:45:36.708554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:36.709174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:36.721037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:36.721815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:36.722350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:36.723189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:36.723750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:36.724241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:36.857088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:36.865618 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76da9ae9-41bf-4b3d-a3a4-4022bdb28314 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1678 microversion: 2.1 time: 0.162459 Sep 19 15:45:36.866193 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3159/6359] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:36 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:37.889832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:37.890455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:37.898208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:37.898696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:37.899161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:37.899853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:37.900310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:37.900739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:38.035240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:38.043014 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-622865c7-9c1f-4e5b-901d-bb4bc8a3f5d2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.157051 Sep 19 15:45:38.043582 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3201/6360] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:37 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:39.067697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:39.068320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:39.075139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:39.075645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:39.076100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:39.076809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:39.077290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:39.077734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:39.208377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:39.216076 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-985c0622-ecd5-443a-833d-73f880b6da62 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.153103 Sep 19 15:45:39.216649 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3160/6361] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:39 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:40.240577 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:40.241198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:40.248085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:40.248594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:40.249033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:40.249727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:40.250187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:40.250615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:40.381797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:40.389591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc744e61-f542-4765-a1e9-a7ccc784c21c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.153554 Sep 19 15:45:40.390168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3202/6362] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:40 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:41.415444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:41.416076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:41.422990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:41.424085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:41.424540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:41.425241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:41.425717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:41.426157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:41.560032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:41.568556 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a06792fe-664f-4c24-b189-4f358b6121c9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.157049 Sep 19 15:45:41.569062 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3161/6363] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:41 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:42.592210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:42.592822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:42.600903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:42.601388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:42.601819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:42.602504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:42.602986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:42.603410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:42.732710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:42.741622 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9c1bc0ce-2747-445a-b1eb-46fe2047dc79 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.153322 Sep 19 15:45:42.742192 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3203/6364] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:42 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:43.764961 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:43.765492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:43.772502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:43.773001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:43.773450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:43.774147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:43.774618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:43.775097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:43.908233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:43.916240 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d096a69-4e01-4c96-9a1d-fe8eb159029c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.155244 Sep 19 15:45:43.916826 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3162/6365] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:43 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:44.940253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:44.940878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:44.947820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:44.948310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:44.948756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:44.949452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:44.949931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:44.950346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:45.081639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:45.089484 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e07c9916-f049-43ed-81df-f205ba187c5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.153673 Sep 19 15:45:45.090075 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3204/6366] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:44 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:46.112936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:46.113594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:46.120551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:46.121053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:46.121504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:46.122205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:46.122674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:46.123136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:46.256743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:46.264472 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ad9cddf-970e-4bc3-b2d3-485a5aa13994 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.156082 Sep 19 15:45:46.265050 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3163/6367] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:46 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:47.288240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:47.288850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:47.295662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:47.296149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:47.296585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:47.297266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:47.297718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:47.298146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:47.428926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:47.436623 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8148c6c-13eb-4eb4-9cf9-e22826d125c0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.152553 Sep 19 15:45:47.437199 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3205/6368] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:47 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:48.462089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:48.462724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:48.469559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:48.470663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:48.471494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:48.472210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:48.472691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:48.473139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:48.601673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:48.609398 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a4c684d5-dc45-44e5-9680-f68d590358fd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1683 microversion: 2.1 time: 0.151267 Sep 19 15:45:48.609974 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3164/6369] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:48 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:49.632836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:49.633398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:49.639764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.640247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.640680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.641380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.641828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.643064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.756360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "name": "network-vif-unplugged", "status": "completed", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:49.766860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.767528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.768019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.783645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] Creating event network-vif-unplugged:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h1-858384-1 Sep 19 15:45:49.789373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:45:49.801701 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b84927a4-9af9-4fab-aad6-cd3cf9df3a8d req-71a55890-6be1-4a68-9fbc-0b15f0ca10d6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049158 Sep 19 15:45:49.802345 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3165/6370] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:45:49.896975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:49.904894 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2c564266-b421-4dea-a460-0245000c0e0c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1682 microversion: 2.1 time: 0.276068 Sep 19 15:45:49.905534 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3206/6371] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:49 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1682 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:45:50.931722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:50.932353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:50.938453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.939737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.940381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.941079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.941556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.941991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:51.074717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:51.082642 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7a3e0ce1-0bf9-42ff-93db-59349ba04ff5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1680 microversion: 2.1 time: 0.156408 Sep 19 15:45:51.083246 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3166/6372] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:50 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:51.832548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:51.843563 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:51.844042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:51.844478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:51.856342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] Creating event network-changed:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h1-858384-1 Sep 19 15:45:51.861627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:45:51.873211 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ed352219-f806-4c92-93f1-c374f8ee6d9e req-31166902-671b-4c0e-a0ed-a7d8e466469c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044989 Sep 19 15:45:51.873795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3207/6373] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:45:52.107272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:52.108021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:52.116225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.116922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.117444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.123928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.124630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.125015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.400950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:52.409540 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-944c11a2-ec0d-4726-9ba8-8173bcd18b46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1680 microversion: 2.1 time: 0.306368 Sep 19 15:45:52.410382 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3167/6374] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:52 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1680 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:53.436218 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:53.436950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:53.444616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.445111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.445549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.446249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.446706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.447163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.585158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:53.593396 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f70bbed0-5325-4542-ae71-bdf66cdf6f82 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1677 microversion: 2.1 time: 0.163356 Sep 19 15:45:53.594065 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3208/6375] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:53 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:53.616878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:53.617425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:53.624710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.625220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.625673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.627369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.627916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.628363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.690354 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8c9651d6-83a2-44d2-bede-aca55436e904 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23/action" status: 204 len: 0 microversion: 2.1 time: 0.076084 Sep 19 15:45:53.691039 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3168/6376] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:45:53 2022] POST /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:45:53.699412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:53.700032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:53.706183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.706601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.707104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.707830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.708299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.708684 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.918065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:53.926495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c03f30db-7c98-403e-b2fe-ff5e8f990525 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1677 microversion: 2.1 time: 0.230837 Sep 19 15:45:53.927150 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3209/6377] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:53 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:54.951684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:54.952398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:54.959766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:54.960275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:54.960733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:54.961449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:54.961924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:54.962374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:55.096342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:55.104129 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c94e4d99-c820-42c4-893f-c085d88697bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1677 microversion: 2.1 time: 0.157650 Sep 19 15:45:55.104705 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3169/6378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:54 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:55.748655 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-519d4863-0d23-4e37-a30d-590ee1704ab0 req-8dfca3d2-f2c2-4f02-893c-c9bca6eb0bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "name": "network-vif-plugged", "status": "completed", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:55.759523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-519d4863-0d23-4e37-a30d-590ee1704ab0 req-8dfca3d2-f2c2-4f02-893c-c9bca6eb0bbb service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:55.760015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-519d4863-0d23-4e37-a30d-590ee1704ab0 req-8dfca3d2-f2c2-4f02-893c-c9bca6eb0bbb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:55.760446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-519d4863-0d23-4e37-a30d-590ee1704ab0 req-8dfca3d2-f2c2-4f02-893c-c9bca6eb0bbb service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:55.772586 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-519d4863-0d23-4e37-a30d-590ee1704ab0 req-8dfca3d2-f2c2-4f02-893c-c9bca6eb0bbb service nova] Creating event network-vif-plugged:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h1-858384-1 Sep 19 15:45:55.777609 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-519d4863-0d23-4e37-a30d-590ee1704ab0 req-8dfca3d2-f2c2-4f02-893c-c9bca6eb0bbb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Sep 19 15:45:55.778280 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3210/6379] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:45:56.127808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:56.128363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:56.135568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.136079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.136533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.137245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.137724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.138168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.266612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:56.275203 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c93bb50a-f543-4e12-8bc1-5a376b8e93bf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1669 microversion: 2.1 time: 0.151369 Sep 19 15:45:56.275777 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3170/6380] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:56 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:56.300360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:56.301062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:56.307498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.307975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.308406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.309087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.309535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.309953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.445683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:56.453500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6f9883c1-6241-431c-84d3-fbe44fb667f9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1669 microversion: 2.1 time: 0.158156 Sep 19 15:45:56.454071 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3211/6381] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:56 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:56.476613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:56.477286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:56.484445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.484936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.485383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.486911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.487380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.487832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.502964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:56.621275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:56.629572 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-748a5606-7a59-400c-b08c-eacfa8681aa4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1669 microversion: 2.1 time: 0.156807 Sep 19 15:45:56.630143 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3171/6382] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:56 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:56.651508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:56.651946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:56.657917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.658403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.658871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.659559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.660013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.660436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.685480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:45:56.765122 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa1d1dd5-88d1-4a14-b70b-630ae3dc5f93 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 204 len: 0 microversion: 2.1 time: 0.117306 Sep 19 15:45:56.765844 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3212/6383] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:45:56 2022] DELETE /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:45:56.774540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:56.775334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:56.781509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.782016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.782598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.783340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.783811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.784251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.916265 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:56.924317 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b619d20c-55fe-4fe0-a1c3-e67d8296a95e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1675 microversion: 2.1 time: 0.153929 Sep 19 15:45:56.925080 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3172/6384] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:56 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:57.949361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:57.950080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:57.958464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:57.958984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:57.959432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:57.960141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:57.960605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:57.961035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:58.097652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:58.101298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:58.107389 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bbd1c875-2241-45cc-a9d3-5fd890b43a5b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1675 microversion: 2.1 time: 0.162374 Sep 19 15:45:58.108501 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3213/6385] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:57 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:59.130974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:59.131607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:59.139024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:59.139533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:59.140190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:59.140919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:59.141446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:59.142547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:59.239216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:59.247567 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c725ee1-4416-4048-a9de-0d3a5396ec91 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 200 len: 1607 microversion: 2.1 time: 0.120763 Sep 19 15:45:59.248152 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3173/6386] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:59 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 1607 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:59.352294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-fa7983bf-f2fc-49cb-87ce-3e482fda9ba2 req-a61a5780-4fc3-49ff-af3d-f159b9c3fc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e86dd66-8890-494c-a2dc-c9620b355b23", "name": "network-vif-deleted", "tag": "aa543c41-4970-43cb-b452-1aebc391c70b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:59.363804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fa7983bf-f2fc-49cb-87ce-3e482fda9ba2 req-a61a5780-4fc3-49ff-af3d-f159b9c3fc05 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:59.364649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fa7983bf-f2fc-49cb-87ce-3e482fda9ba2 req-a61a5780-4fc3-49ff-af3d-f159b9c3fc05 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:59.364791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-fa7983bf-f2fc-49cb-87ce-3e482fda9ba2 req-a61a5780-4fc3-49ff-af3d-f159b9c3fc05 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:59.378335 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-fa7983bf-f2fc-49cb-87ce-3e482fda9ba2 req-a61a5780-4fc3-49ff-af3d-f159b9c3fc05 service nova] Creating event network-vif-deleted:aa543c41-4970-43cb-b452-1aebc391c70b for instance 4e86dd66-8890-494c-a2dc-c9620b355b23 on n-h1-858384-1 Sep 19 15:45:59.383220 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-fa7983bf-f2fc-49cb-87ce-3e482fda9ba2 req-a61a5780-4fc3-49ff-af3d-f159b9c3fc05 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034616 Sep 19 15:45:59.383837 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3214/6387] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:00.270953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:00.271597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:00.278375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.278958 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.279361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.280072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.280547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.280990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.295136 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 HTTP/1.1 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4e86dd66-8890-494c-a2dc-c9620b355b23'} Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:00.296850 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eeac6643-2712-4a80-9e8c-58b953a83e7d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 404 len: 111 microversion: 2.1 time: 0.032049 Sep 19 15:46:00.301446 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3174/6388] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:00 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:46:00.313441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:00.314726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:00.321373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.321863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.322300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.323025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.323486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.323914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.338133 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 HTTP/1.1 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4e86dd66-8890-494c-a2dc-c9620b355b23'} Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:00.339832 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3f465906-0742-45e1-b6e5-74d89df2c1f7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 404 len: 111 microversion: 2.1 time: 0.032292 Sep 19 15:46:00.343431 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3215/6389] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:00 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:46:00.391509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1252922807", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "d764445a-f4f8-40d5-9f18-651713c6db6e"}], "security_groups": [{"name": "tempest-securitygroup--2053664145"}], "key_name": "tempest-keypair-1260302455", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:00.498278 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] validate_networks() for [('d764445a-f4f8-40d5-9f18-651713c6db6e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:46:00.869469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:46:00.869914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:46:00.870408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:46:00.870935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:46:00.871367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:46:00.881134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.881659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.882114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.882889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.883394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.883834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.901425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:46:00.906776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:46:00.921719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:46:00.924201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:46:00.971165 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c5d454ef-f515-4920-96a4-51ca240cd56c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.583514 Sep 19 15:46:00.971820 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3175/6390] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:46:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:46:00.982975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-65736ae4-e0bb-467f-90fd-621ee73808eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:00.983594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-65736ae4-e0bb-467f-90fd-621ee73808eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:01.044710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-65736ae4-e0bb-467f-90fd-621ee73808eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:01.053251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-65736ae4-e0bb-467f-90fd-621ee73808eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1239 microversion: 2.1 time: 0.073776 Sep 19 15:46:01.053823 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3216/6391] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:00 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:02.079964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:02.080599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:02.087697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:02.088207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:02.088663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:02.089372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:02.089846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:02.090289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:02.192258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:02.200273 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8014caf-41b1-4027-a7d6-66e111905cbb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1297 microversion: 2.1 time: 0.126496 Sep 19 15:46:02.200860 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3176/6392] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:02 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:03.225221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:03.225850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:03.232751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:03.233248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:03.233693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:03.234431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:03.234931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:03.235970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:03.437876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:03.447042 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13b5f85e-aeeb-402e-af8e-150455c166a2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1365 microversion: 2.1 time: 0.225762 Sep 19 15:46:03.447829 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3217/6393] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:03 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:03.507291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-6cc29d0c-97e8-4fce-bfcc-ad958da9d934 req-5b350d84-3b28-478c-ba8f-1af8f96cfe37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:03.522443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6cc29d0c-97e8-4fce-bfcc-ad958da9d934 req-5b350d84-3b28-478c-ba8f-1af8f96cfe37 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:03.523058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6cc29d0c-97e8-4fce-bfcc-ad958da9d934 req-5b350d84-3b28-478c-ba8f-1af8f96cfe37 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:03.523512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-6cc29d0c-97e8-4fce-bfcc-ad958da9d934 req-5b350d84-3b28-478c-ba8f-1af8f96cfe37 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:03.535691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-6cc29d0c-97e8-4fce-bfcc-ad958da9d934 req-5b350d84-3b28-478c-ba8f-1af8f96cfe37 service nova] Creating event network-changed:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h1-858384-1 Sep 19 15:46:03.540895 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-6cc29d0c-97e8-4fce-bfcc-ad958da9d934 req-5b350d84-3b28-478c-ba8f-1af8f96cfe37 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037319 Sep 19 15:46:03.541500 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3177/6394] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:04.470427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:04.471077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:04.473874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:04.479183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:04.479673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:04.480114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:04.480813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:04.481304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:04.481737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:04.609919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:04.617782 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-99e539e0-7737-4405-aac6-8d0b7c881bf1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1365 microversion: 2.1 time: 0.151461 Sep 19 15:46:04.618351 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3218/6395] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:04 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:05.643636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:05.644358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:05.646373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:05.651930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:05.652439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:05.652894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:05.653607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:05.654086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:05.655453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:05.789770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:05.799428 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-62b797a4-d858-4fb3-9a11-a9d21d98ca98 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1365 microversion: 2.1 time: 0.161208 Sep 19 15:46:05.800015 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3178/6396] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:05 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:06.823421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:06.824044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:06.831042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:06.831535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:06.831979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:06.832675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:06.833137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:06.833571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:06.968977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:06.976902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-21c2d656-35d0-4926-a514-286dc7a529da tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1365 microversion: 2.1 time: 0.157411 Sep 19 15:46:06.977476 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3219/6397] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:06 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:07.709935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1db57774-3fc3-4bb3-ade5-b038730104b2 req-df0041c4-30dc-4cf2-9b30-9ee06856b4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "name": "network-vif-plugged", "status": "completed", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:07.721518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1db57774-3fc3-4bb3-ade5-b038730104b2 req-df0041c4-30dc-4cf2-9b30-9ee06856b4dd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:07.722000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1db57774-3fc3-4bb3-ade5-b038730104b2 req-df0041c4-30dc-4cf2-9b30-9ee06856b4dd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:07.722449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1db57774-3fc3-4bb3-ade5-b038730104b2 req-df0041c4-30dc-4cf2-9b30-9ee06856b4dd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:07.733830 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1db57774-3fc3-4bb3-ade5-b038730104b2 req-df0041c4-30dc-4cf2-9b30-9ee06856b4dd service nova] Creating event network-vif-plugged:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h1-858384-1 Sep 19 15:46:07.739626 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1db57774-3fc3-4bb3-ade5-b038730104b2 req-df0041c4-30dc-4cf2-9b30-9ee06856b4dd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033358 Sep 19 15:46:07.740220 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3179/6398] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:08.000044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:08.000598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:08.007472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:08.007962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:08.008404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:08.009093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:08.009547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:08.009973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:08.143737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:08.152994 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e69fe041-188e-4590-a0ab-bae8f5da721d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1365 microversion: 2.1 time: 0.156785 Sep 19 15:46:08.153598 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3220/6399] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:07 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:09.179990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:09.180737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:09.187081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:09.187584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:09.188035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:09.188771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:09.189234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:09.189689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:09.322165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:09.330507 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12faf46a-17bd-4a39-a241-4ca685ce6d9f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1551 microversion: 2.1 time: 0.156028 Sep 19 15:46:09.331126 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3180/6400] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:09 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:09.353864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:09.354426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:09.363065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:09.363575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:09.364057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:09.364785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:09.365286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:09.365716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:09.447134 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1e82f42f-6720-407e-a8a1-8a8ba24b67b6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097360 Sep 19 15:46:09.447731 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3221/6401] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:46:09 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:10.764042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-3c83b34b-9c43-42d9-9c49-0fa255bd389f req-14432716-a446-40fb-9f70-ddb7040fefdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:10.774542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3c83b34b-9c43-42d9-9c49-0fa255bd389f req-14432716-a446-40fb-9f70-ddb7040fefdf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:10.775069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3c83b34b-9c43-42d9-9c49-0fa255bd389f req-14432716-a446-40fb-9f70-ddb7040fefdf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:10.775522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-3c83b34b-9c43-42d9-9c49-0fa255bd389f req-14432716-a446-40fb-9f70-ddb7040fefdf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:10.786653 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-3c83b34b-9c43-42d9-9c49-0fa255bd389f req-14432716-a446-40fb-9f70-ddb7040fefdf service nova] Creating event network-changed:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h1-858384-1 Sep 19 15:46:10.791649 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-3c83b34b-9c43-42d9-9c49-0fa255bd389f req-14432716-a446-40fb-9f70-ddb7040fefdf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108827 Sep 19 15:46:10.792256 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3181/6402] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:43.651645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.652531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=7 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.653272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=32 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.657890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c225607-fee1-40ce-b4f8-8ec33fc97b40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:43.665287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c225607-fee1-40ce-b4f8-8ec33fc97b40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:43.665779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c225607-fee1-40ce-b4f8-8ec33fc97b40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:43.666225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c225607-fee1-40ce-b4f8-8ec33fc97b40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:43.689206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c225607-fee1-40ce-b4f8-8ec33fc97b40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Going to try to stop instance {{(pid=128730) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 15:46:43.731573 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c225607-fee1-40ce-b4f8-8ec33fc97b40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action" status: 202 len: 0 microversion: 2.1 time: 0.081110 Sep 19 15:46:43.732190 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3222/6403] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:46:43 2022] POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:46:43.738341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.739185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.741054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=7 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.741831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=43 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:43.747269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:43.748136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:43.756550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:43.757048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:43.757494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:43.758200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:43.758670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:43.759141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:43.902420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:43.910893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c2e2bf66-e93b-4f8c-9da2-b83d3318442a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.173481 Sep 19 15:46:43.911470 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3182/6404] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:43 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:44.934807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:44.935538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:44.943415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:44.943898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:44.944329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:44.945010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:44.945466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:44.945886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:45.075028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:45.083006 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0ab049b9-00dd-4221-b8d5-77891e3a3de6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.152372 Sep 19 15:46:45.083588 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3223/6405] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:44 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:46.106799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:46.107439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:46.115062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:46.115575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:46.116031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:46.116738 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:46.117213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:46.117657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:46.248364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:46.256781 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bec0e0bb-3ee0-4640-b696-d6b155b0f498 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.153912 Sep 19 15:46:46.257356 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3183/6406] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:46 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:47.279805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:47.280422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:47.288002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:47.288514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:47.288943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:47.289623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:47.290074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:47.290495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:47.418369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:47.426977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-42fc4cda-356e-46b8-afac-f894eb08320c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.151010 Sep 19 15:46:47.427546 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3224/6407] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:47 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:48.451100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:48.451732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:48.459143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:48.459651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:48.460104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:48.460816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:48.461287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:48.461728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:48.589582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:48.598191 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c6f058ff-d9bf-42ee-b655-b20bbaa1922e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.151448 Sep 19 15:46:48.598791 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3184/6408] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:48 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:49.622240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:49.622877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:49.630601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:49.631113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:49.631544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:49.632230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:49.632680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:49.633100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:49.769354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:49.777237 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-19e54eac-d8a8-4f64-a223-c069eedfb8b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.158864 Sep 19 15:46:49.777834 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3225/6409] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:49 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:50.800722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:50.801354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:50.808454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:50.808957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:50.809410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:50.810113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:50.810584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:50.811065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:50.940443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:50.948275 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eb014020-b49f-4fcc-bb54-49188ea7fd01 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.151591 Sep 19 15:46:50.948858 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3185/6410] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:50 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:51.971876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:51.972495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:51.979340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:51.979831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:51.980273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:51.980966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:51.981425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:51.981854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:52.115639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:52.123358 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9fb7e2a3-9f2f-4d36-b165-b888c27b65d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.155991 Sep 19 15:46:52.123926 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3226/6411] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:51 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:53.146827 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:53.147372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:53.154136 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:53.154632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:53.155186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:53.155998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:53.156487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:53.156926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:53.288115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:53.295965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d6a3a489-f204-48cc-b3e4-a5e198d24cdf tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.153146 Sep 19 15:46:53.297128 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3186/6412] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:53 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:54.320791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:54.321434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:54.329664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:54.330139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:54.330573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:54.331295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:54.331748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:54.332169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:54.467601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:54.475989 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ed35517-4059-41a1-b688-af95e58885d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.159161 Sep 19 15:46:54.476553 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3227/6413] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:54 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:55.498826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:55.499510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:55.506491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:55.507027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:55.507479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:55.508177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:55.508645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:55.509080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:55.642586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:55.650321 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e3816a1-bafc-45b5-9224-22f2d226a62e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.155398 Sep 19 15:46:55.650923 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3187/6414] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:55 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:56.674150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:56.674782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:56.681753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:56.682235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:56.682666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:56.683377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:56.683827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:56.684245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:56.815952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:56.823673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8cd451a-206a-4ec9-8609-b6dc116a02a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.154245 Sep 19 15:46:56.824246 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3228/6415] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:56 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:57.848268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:57.848809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:57.855286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:57.855816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:57.856276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:57.856981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:57.857456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:57.857898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:57.991770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:57.999665 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed0ee0df-d062-45ec-9051-d2f480784bf0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.156333 Sep 19 15:46:58.000503 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3188/6416] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:57 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:59.022888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:59.023436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:59.029995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:59.030478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:59.031022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:59.031964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:59.032426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:59.032853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:59.174919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:59.183854 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-00bdf0ea-f7b8-492e-8aa6-439733183f38 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.164960 Sep 19 15:46:59.184444 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3229/6417] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:59 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:00.207725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:00.208360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:00.215351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:00.215858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:00.216312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:00.217018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:00.217498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:00.217939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:00.351374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:00.359372 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-614fa574-7260-4853-a456-42a9e75223a1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1655 microversion: 2.1 time: 0.155296 Sep 19 15:47:00.359977 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3189/6418] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:00 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:00.381621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:00.383883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:00.391255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:00.391738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:00.392170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:00.392853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:00.393302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:00.393720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:00.422707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:00.428137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Old instance type m1.heat2, new instance type m1.heat {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:47:00.436066 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:47:00.436538 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:47:00.437310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:47:00.438074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:47:00.438520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:47:00.506150 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fc6711f5-59df-4766-a07d-4b11331c2954 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action" status: 202 len: 0 microversion: 2.1 time: 0.128227 Sep 19 15:47:00.506687 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3230/6419] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:47:00 2022] POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:47:00.515072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:00.515792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:00.521854 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:00.522352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:00.522819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:00.523523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:00.523984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:00.524610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:00.661929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:00.670350 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2328c054-a142-4644-993b-162588cb8227 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.159174 Sep 19 15:47:00.670982 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3190/6420] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:00 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:01.696702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:01.697319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:01.704405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:01.704900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:01.705341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:01.706038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:01.706494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:01.706960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:01.845793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:01.854574 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba8a71b3-1349-4b5d-80c5-1b72b0b1fb07 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1678 microversion: 2.1 time: 0.162643 Sep 19 15:47:01.855174 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3231/6421] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:01 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:02.878135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:02.878784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:02.885692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:02.886188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:02.886649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:02.887384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:02.887857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:02.888297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:03.027011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:03.034697 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3b8fb844-97bf-4c34-baaf-a59e0b86987e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1683 microversion: 2.1 time: 0.160570 Sep 19 15:47:03.035307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3191/6422] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:02 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:04.058440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:04.059086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:04.066530 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:04.067052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:04.067496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:04.068190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:04.068648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:04.069071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:04.508255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:04.516752 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d29bc1ba-f867-4ac9-b7a9-4c3859401be7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1683 microversion: 2.1 time: 0.462267 Sep 19 15:47:04.517414 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3232/6423] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:04 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1683 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:05.125757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "name": "network-vif-unplugged", "status": "completed", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:05.136382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:05.136880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:05.137330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:05.149855 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] Creating event network-vif-unplugged:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h2-858384-1 Sep 19 15:47:05.155328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:47:05.167043 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d6c42b5f-c08b-42c8-b7be-8b46b8aa6ec8 req-695e9bda-cf98-4f58-bf7a-720beb10250c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045493 Sep 19 15:47:05.167664 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3192/6424] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:05.540161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:05.540807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:05.548808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:05.549427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:05.549939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:05.550861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:05.551470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:05.551844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:05.798101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:05.806175 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2bed58d0-4041-4feb-a6a3-691b36ee387a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1682 microversion: 2.1 time: 0.269956 Sep 19 15:47:05.806992 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3233/6425] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:05 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1682 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:06.832779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:06.833520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:06.839659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:06.840156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:06.840603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:06.841296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:06.841760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:06.842195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:06.976565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:06.984345 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-610dcbdd-64ca-460e-b45a-6605c1470071 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1680 microversion: 2.1 time: 0.157567 Sep 19 15:47:06.984920 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3193/6426] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:06 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:07.200742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:07.211229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:07.211712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:07.212148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:07.223934 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] Creating event network-changed:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h2-858384-1 Sep 19 15:47:07.229259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:47:07.240748 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-e98e7218-4660-4970-8ef4-c6c13675ad1c req-bc4245cb-559b-4ec4-b1c8-5da82e2372d9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043715 Sep 19 15:47:07.241332 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3234/6427] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:08.009586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:08.010245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:08.017244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:08.017754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:08.018210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:08.018969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:08.019446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:08.019888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:08.326399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:08.334974 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2c267db1-e8bb-4001-b5f3-a62c7e4f4f34 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1676 microversion: 2.1 time: 0.329385 Sep 19 15:47:08.335811 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3194/6428] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:08 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1676 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:08.360242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:08.360955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:08.367355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:08.367919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:08.368423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:08.369183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:08.369702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:08.370188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:08.416163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:08.442364 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75851667-35b2-427f-8f90-60edabe44afd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action" status: 204 len: 0 microversion: 2.1 time: 0.087168 Sep 19 15:47:08.445545 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3235/6429] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:47:08 2022] POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:47:08.455196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:08.456387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:08.463943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:08.464677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:08.466252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:08.467027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:08.467733 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:08.469325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:08.736781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:08.744977 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6683e4a6-93e7-43aa-b02a-c359bf82b0bc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1676 microversion: 2.1 time: 0.294843 Sep 19 15:47:08.745576 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3195/6430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:08 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1676 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:47:09.773359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:09.774089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:09.782094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:09.782582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:09.783053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:09.783754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:09.784214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:09.784662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:09.926159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:09.934594 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c41ddc9d-a4b0-4aab-bccb-732b33836742 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1655 microversion: 2.1 time: 0.167093 Sep 19 15:47:09.935209 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3236/6431] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:09 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:09.959013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:09.959648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:09.966635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:09.967192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:09.967677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:09.968438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:09.968912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:09.969356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:10.100000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:10.107752 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6066cdd8-3121-41ea-9d35-3ff8dfd6681b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1655 microversion: 2.1 time: 0.152747 Sep 19 15:47:10.108333 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3196/6432] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:09 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:10.130366 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8f300c4-8e05-47c8-aa02-32adca9fdb77 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:10.136693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8f300c4-8e05-47c8-aa02-32adca9fdb77 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:10.137184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8f300c4-8e05-47c8-aa02-32adca9fdb77 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:10.137629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8f300c4-8e05-47c8-aa02-32adca9fdb77 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:10.160442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8f300c4-8e05-47c8-aa02-32adca9fdb77 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Going to try to start instance {{(pid=128730) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 15:47:10.201503 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8f300c4-8e05-47c8-aa02-32adca9fdb77 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action" status: 202 len: 0 microversion: 2.1 time: 0.074948 Sep 19 15:47:10.202112 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3237/6433] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:47:10 2022] POST /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:47:10.211434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:10.212068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:10.219075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:10.219579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:10.220042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:10.220759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:10.221238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:10.221684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:10.445180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:10.453388 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a45bc5fa-05cc-4374-baf2-0737a10bd98b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1664 microversion: 2.1 time: 0.245850 Sep 19 15:47:10.453972 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3197/6434] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:10 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1664 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:11.319775 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7509ae13-78c2-4a60-bbea-6b24760df724 req-346ab273-291b-430a-a7dd-9475f88b75e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "name": "network-vif-plugged", "status": "completed", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:11.344750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7509ae13-78c2-4a60-bbea-6b24760df724 req-346ab273-291b-430a-a7dd-9475f88b75e8 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.345154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7509ae13-78c2-4a60-bbea-6b24760df724 req-346ab273-291b-430a-a7dd-9475f88b75e8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.345632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7509ae13-78c2-4a60-bbea-6b24760df724 req-346ab273-291b-430a-a7dd-9475f88b75e8 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.360383 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7509ae13-78c2-4a60-bbea-6b24760df724 req-346ab273-291b-430a-a7dd-9475f88b75e8 service nova] Creating event network-vif-plugged:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h2-858384-1 Sep 19 15:47:11.365848 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7509ae13-78c2-4a60-bbea-6b24760df724 req-346ab273-291b-430a-a7dd-9475f88b75e8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123925 Sep 19 15:47:11.366470 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3238/6435] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:11.477100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:11.477730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:11.484784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.485281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.485734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.486439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.486941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.487386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.616669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:11.620218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=100 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:11.625990 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d75a05cc-4095-4f05-9d03-0983e2a04706 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1668 microversion: 2.1 time: 0.152813 Sep 19 15:47:11.626561 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3198/6436] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:11 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:11.649328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:11.649953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:11.656255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.656764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.657215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.657912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.658374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.658830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.683934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:47:11.759993 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f1f87ab2-d53d-44dc-b38a-132f0bc45c97 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 204 len: 0 microversion: 2.1 time: 0.114538 Sep 19 15:47:11.760984 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3239/6437] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:47:11 2022] DELETE /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:47:11.770181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:11.770871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:11.777918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.778453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.778979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.779725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:11.780250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:11.780897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:11.913463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:11.921470 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0a63d967-7d99-42df-ac77-0e62c1e4750a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1674 microversion: 2.1 time: 0.156364 Sep 19 15:47:11.922051 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3199/6438] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:11 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:12.946255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:12.947132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:12.954574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:12.955100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:12.955605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:12.956710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:12.957561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:12.958212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:13.174091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:13.182467 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-29c4fc0b-b2a8-4b20-ba30-72846af8b396 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 200 len: 1674 microversion: 2.1 time: 0.240528 Sep 19 15:47:13.183085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3240/6439] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:12 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:13.947416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-22a872a1-38b2-4d7a-abe2-f2628d41caaa req-7824c006-1f72-4404-a59c-8b5eec64b95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d884fc5-1d0f-4a25-bf97-405594eb7e49", "name": "network-vif-deleted", "tag": "9c5e39d2-9d50-4f9d-9e7c-4baf102876f2"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:13.955321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=37 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:13.961891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-22a872a1-38b2-4d7a-abe2-f2628d41caaa req-7824c006-1f72-4404-a59c-8b5eec64b95a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:13.962477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-22a872a1-38b2-4d7a-abe2-f2628d41caaa req-7824c006-1f72-4404-a59c-8b5eec64b95a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:13.963038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-22a872a1-38b2-4d7a-abe2-f2628d41caaa req-7824c006-1f72-4404-a59c-8b5eec64b95a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:13.976029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-22a872a1-38b2-4d7a-abe2-f2628d41caaa req-7824c006-1f72-4404-a59c-8b5eec64b95a service nova] Creating event network-vif-deleted:9c5e39d2-9d50-4f9d-9e7c-4baf102876f2 for instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 on n-h2-858384-1 Sep 19 15:47:13.981055 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-22a872a1-38b2-4d7a-abe2-f2628d41caaa req-7824c006-1f72-4404-a59c-8b5eec64b95a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037455 Sep 19 15:47:13.981659 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3200/6440] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:47:14.206146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:14.206926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:14.209627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:14.215911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:14.216452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:14.216952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:14.217689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:14.218300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:14.218950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:14.233911 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 HTTP/1.1 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9d884fc5-1d0f-4a25-bf97-405594eb7e49'} Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:47:14.235875 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f705a8f-9909-4e16-bb97-7e322ee32eb1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 404 len: 111 microversion: 2.1 time: 0.035731 Sep 19 15:47:14.240168 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3241/6441] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:14 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:47:14.254197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:14.254970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:14.261150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:14.261666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:14.262263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:14.263054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:14.263520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:14.263971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:14.277843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 HTTP/1.1 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9d884fc5-1d0f-4a25-bf97-405594eb7e49'} Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:47:14.279969 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4a6e9908-9fd5-42d2-b6ba-5bf3db129062 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 404 len: 111 microversion: 2.1 time: 0.032978 Sep 19 15:47:14.284749 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3201/6442] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:14 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:47:14.331862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-764310203", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "d764445a-f4f8-40d5-9f18-651713c6db6e"}], "security_groups": [{"name": "tempest-securitygroup--2053664145"}], "key_name": "tempest-keypair-1260302455", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:14.440407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] validate_networks() for [('d764445a-f4f8-40d5-9f18-651713c6db6e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:47:14.851363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:47:14.851822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:47:14.852297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:47:14.852711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:47:14.853128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:47:14.862180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:14.862664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:14.863151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:14.863875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:14.864336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:14.864761 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:14.881829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:47:14.887078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:47:14.900265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:47:14.902609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:47:14.951500 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-01d0617d-dce0-4e2b-8e64-ca2e37fde89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.623562 Sep 19 15:47:14.952096 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3242/6443] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:47:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:47:14.964229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d354cc02-b5f9-4276-a497-15cd45349c0f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:14.964956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d354cc02-b5f9-4276-a497-15cd45349c0f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:15.024724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d354cc02-b5f9-4276-a497-15cd45349c0f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:15.032262 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d354cc02-b5f9-4276-a497-15cd45349c0f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1238 microversion: 2.1 time: 0.071965 Sep 19 15:47:15.032835 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3202/6444] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:14 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:16.056494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:16.057769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:16.066388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:16.067282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:16.067822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:16.068601 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:16.069134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:16.069742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:16.145053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:16.152744 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f09c0da2-0cdf-437e-a207-c56e3a780592 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1296 microversion: 2.1 time: 0.100727 Sep 19 15:47:16.153345 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3243/6445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:16 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:17.176541 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:17.177166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:17.184254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:17.184748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:17.185194 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:17.185896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:17.186880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:17.187654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:17.382575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:17.391177 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e2a5f3a7-5221-452f-a77b-5ca37be4f56b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1364 microversion: 2.1 time: 0.218505 Sep 19 15:47:17.391775 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3203/6446] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:17 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:17.414325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-49fe9d5c-fef9-427f-a8f2-1099da1496ae req-0251cfa7-72ff-49a6-923b-6c3426a1f2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:17.425801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-49fe9d5c-fef9-427f-a8f2-1099da1496ae req-0251cfa7-72ff-49a6-923b-6c3426a1f2f9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:17.426387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-49fe9d5c-fef9-427f-a8f2-1099da1496ae req-0251cfa7-72ff-49a6-923b-6c3426a1f2f9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:17.426974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-49fe9d5c-fef9-427f-a8f2-1099da1496ae req-0251cfa7-72ff-49a6-923b-6c3426a1f2f9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:17.439105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-49fe9d5c-fef9-427f-a8f2-1099da1496ae req-0251cfa7-72ff-49a6-923b-6c3426a1f2f9 service nova] Creating event network-changed:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:47:17.444512 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-49fe9d5c-fef9-427f-a8f2-1099da1496ae req-0251cfa7-72ff-49a6-923b-6c3426a1f2f9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033914 Sep 19 15:47:17.445594 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3244/6447] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:18.415094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:18.415701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:18.423799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:18.424300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:18.424748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:18.425450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:18.425917 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:18.426357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:18.957618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:18.965186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d3018d2b-60e3-4cd5-92cd-fcbe12d80676 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1364 microversion: 2.1 time: 0.554023 Sep 19 15:47:18.965755 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3204/6448] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:18 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:19.991458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:19.992918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:20.000221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:20.000777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:20.001918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:20.002682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:20.003283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:20.004678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:20.143462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:20.151224 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-264f1a63-76cd-4121-a42c-250993fb5ac5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1364 microversion: 2.1 time: 0.165822 Sep 19 15:47:20.151893 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3245/6449] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:19 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:21.174966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:21.175707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:21.183266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:21.183766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:21.184213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:21.184916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:21.185386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:21.185822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:21.319326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:21.326875 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64db6723-2503-45c5-8eb2-223ae473e89a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1364 microversion: 2.1 time: 0.157040 Sep 19 15:47:21.327452 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3205/6450] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:21 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:22.062131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2c4f7ebf-3f80-4d29-bfc5-2f1b29728d10 req-100fa9f4-f9e5-4dba-897a-48d1cf05a96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "name": "network-vif-plugged", "status": "completed", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:22.073707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2c4f7ebf-3f80-4d29-bfc5-2f1b29728d10 req-100fa9f4-f9e5-4dba-897a-48d1cf05a96b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:22.074188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2c4f7ebf-3f80-4d29-bfc5-2f1b29728d10 req-100fa9f4-f9e5-4dba-897a-48d1cf05a96b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:22.074614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2c4f7ebf-3f80-4d29-bfc5-2f1b29728d10 req-100fa9f4-f9e5-4dba-897a-48d1cf05a96b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:22.086579 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2c4f7ebf-3f80-4d29-bfc5-2f1b29728d10 req-100fa9f4-f9e5-4dba-897a-48d1cf05a96b service nova] Creating event network-vif-plugged:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:47:22.091621 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2c4f7ebf-3f80-4d29-bfc5-2f1b29728d10 req-100fa9f4-f9e5-4dba-897a-48d1cf05a96b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034470 Sep 19 15:47:22.092219 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3246/6451] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:22.350138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:22.350789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:22.357533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:22.358031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:22.359364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:22.360167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:22.360639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:22.361073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:22.494014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:22.501951 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4715b52d-6f3d-487c-83cc-34036b11ac59 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1364 microversion: 2.1 time: 0.155706 Sep 19 15:47:22.502531 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3206/6452] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:22 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:23.527434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:23.528133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:23.535191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:23.535673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:23.536104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:23.536784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:23.537235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:23.537653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:23.665825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:23.673758 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2269a5bc-6951-4cd9-9c69-a7e41586001a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1550 microversion: 2.1 time: 0.151402 Sep 19 15:47:23.674328 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3247/6453] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:23 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:23.697387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:23.697879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:23.704729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:23.705231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:23.705683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:23.706386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:23.706897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:23.707342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:23.787347 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-aca93cba-352b-4ce3-8a4e-d3be48992bf8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093811 Sep 19 15:47:23.788230 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3207/6454] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:47:23 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:24.724025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8d89dbee-8944-44d0-8a98-48cc0fa7ebc5 req-408a6dfc-b7b3-4f2f-a7ca-445b37ebdb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:24.734721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8d89dbee-8944-44d0-8a98-48cc0fa7ebc5 req-408a6dfc-b7b3-4f2f-a7ca-445b37ebdb39 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:24.735229 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8d89dbee-8944-44d0-8a98-48cc0fa7ebc5 req-408a6dfc-b7b3-4f2f-a7ca-445b37ebdb39 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:24.735664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8d89dbee-8944-44d0-8a98-48cc0fa7ebc5 req-408a6dfc-b7b3-4f2f-a7ca-445b37ebdb39 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:24.746598 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8d89dbee-8944-44d0-8a98-48cc0fa7ebc5 req-408a6dfc-b7b3-4f2f-a7ca-445b37ebdb39 service nova] Creating event network-changed:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:47:24.752406 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8d89dbee-8944-44d0-8a98-48cc0fa7ebc5 req-408a6dfc-b7b3-4f2f-a7ca-445b37ebdb39 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031959 Sep 19 15:47:24.753234 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3248/6455] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:57.675792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.676708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=17 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.677380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=38 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.681786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:57.684051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:57.691531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:57.691977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:57.692435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:57.693138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:57.693616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:57.694064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:57.723934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:57.729741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128731) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:47:57.736761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:47:57.737199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:47:57.737703 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:47:57.738117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:47:57.738547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:47:57.801781 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ecd9a68e-ba85-4ae8-ab44-2f60526211be tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f/action" status: 202 len: 0 microversion: 2.1 time: 0.127730 Sep 19 15:47:57.802398 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3208/6456] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:47:57 2022] POST /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:47:57.812572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:57.813276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:57.815603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.816260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.817030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.818131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=67,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.819581 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:47:57.819781 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:47:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f (ip 10.222.0.81) !!! Sep 19 15:47:57.837992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:57.838573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:57.839099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:57.839942 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:57.840415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:57.840909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:57.979267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:57.987965 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebdd6f40-77c6-4c41-a220-2d45d98288b0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1676 microversion: 2.1 time: 0.180663 Sep 19 15:47:57.988857 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3249/6457] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:57 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:59.014354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:59.015117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:59.023098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:59.023594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:59.024048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:59.024762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:59.025295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:59.025685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:59.249350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:59.257172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0493a3d7-16d8-438a-bcd3-a6641c333391 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1676 microversion: 2.1 time: 0.248137 Sep 19 15:47:59.257837 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3209/6458] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:59 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:00.282262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:00.282916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:00.288875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:00.289360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:00.289793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:00.290481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:00.290966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:00.291397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:00.421169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:00.428789 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-923659f0-3763-487f-a222-cdb71e514b76 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.151303 Sep 19 15:48:00.429607 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3250/6459] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:00 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:01.453458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:01.454087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:01.461152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:01.461650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:01.462102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:01.462834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:01.463308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:01.463746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:01.596656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:01.604369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f74e5e8-4ea9-45f8-8580-16e5515d4d99 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.154922 Sep 19 15:48:01.604948 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3210/6460] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:01 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:02.629312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:02.629837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:02.636837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:02.637320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:02.637760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:02.639146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:02.639790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:02.640222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:02.769046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:02.776841 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ff5e2a0c-5b0f-438b-9033-367fd5ce83a7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.152499 Sep 19 15:48:02.777760 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3251/6461] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:02 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:03.802111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:03.802637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:03.809715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:03.810230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:03.811019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:03.811722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:03.812189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:03.812627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:03.939273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:03.946893 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ebdfdd38-2261-4cca-971c-83cf894f69d7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.148728 Sep 19 15:48:03.947463 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3211/6462] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:03 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:04.970501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:04.971154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:04.978091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:04.978587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:04.979061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:04.979770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:04.980230 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:04.980660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:05.115424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:05.123361 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e5e31d34-b34e-4196-ab21-786f9a0dfd68 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.157539 Sep 19 15:48:05.124009 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3252/6463] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:04 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:06.147159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:06.147787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:06.154894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:06.155389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:06.155838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:06.156536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:06.157005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:06.157445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:06.283872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:06.291541 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6cdfbbf7-24fb-4e63-9245-e8a2314c7222 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.148345 Sep 19 15:48:06.292117 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3212/6464] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:06 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:07.316017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:07.316680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:07.323595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:07.324082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:07.324523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:07.325210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:07.325759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:07.326357 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:07.458141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:07.466039 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04a69661-20c7-4991-8358-129d5d2bffa5 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.153950 Sep 19 15:48:07.466629 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3253/6465] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:07 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:08.489291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:08.489952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:08.497196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:08.498232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:08.498700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:08.499490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:08.499965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:08.500408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:08.636146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:08.644082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-12edb6fd-ea47-4157-8010-c580ab01464e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.158770 Sep 19 15:48:08.644662 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3213/6466] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:08 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:09.667580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:09.668120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:09.675823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:09.676306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:09.676742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:09.677427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:09.677883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:09.678303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:09.808237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:09.816119 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f40f795d-d058-42c9-a630-93e72af80200 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.152877 Sep 19 15:48:09.816691 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3254/6467] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:09 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:10.839386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:10.840027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:10.846885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:10.847393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:10.847851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:10.848566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:10.849045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:10.849492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:10.979163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:10.987389 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6af8b741-6b6c-46e9-9659-a0d733582c46 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.151964 Sep 19 15:48:10.987961 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3214/6468] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:10 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:12.011686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:12.012312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:12.019217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:12.019706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:12.020151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:12.020848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:12.021310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:12.021741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:12.152120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:12.160052 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-39c3dfa6-3e61-49f3-a459-a445ae520b00 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.152575 Sep 19 15:48:12.160631 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3255/6469] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:12 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:13.183948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:13.184584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:13.192430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:13.192944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:13.193399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:13.194106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:13.194581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:13.195057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:13.327374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:13.335194 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-53b27d18-f5c6-45ff-b6d7-d5d068e914c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.155158 Sep 19 15:48:13.335767 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3215/6470] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:13 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:14.358374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:14.359113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:14.366025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:14.366515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:14.366989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:14.367690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:14.368153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:14.368586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:14.498083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:14.505836 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-246af3b8-eb6a-49f3-85cf-138b961cd8d4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.151456 Sep 19 15:48:14.506408 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3256/6471] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:14 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:15.531809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:15.532438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:15.539475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:15.539986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:15.540436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:15.541145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:15.541656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:15.542058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:15.673662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:15.681578 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-16c02a71-5de3-4628-b547-00b138cf6f47 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1681 microversion: 2.1 time: 0.156022 Sep 19 15:48:15.682154 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3216/6472] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:15 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:16.705270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:16.705866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:16.713162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:16.713657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:16.714102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:16.714839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:16.715311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:16.715744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:16.919313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:16.927125 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-703b0156-fe0b-4eda-89a9-ba726c11214f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1680 microversion: 2.1 time: 0.226378 Sep 19 15:48:16.927703 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3257/6473] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:16 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:17.233377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "name": "network-vif-unplugged", "status": "completed", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:17.243592 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:17.244118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:17.244561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:17.257362 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] Creating event network-vif-unplugged:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h2-858384-1 Sep 19 15:48:17.262682 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] Instance 5f427592-61e1-4dd9-b002-f3c58981262f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:48:17.274761 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-d0a7864b-5840-4b6f-8cb2-f202fe2fe301 req-7092ffb4-4c1a-45c0-97b4-039be982ab12 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045187 Sep 19 15:48:17.275768 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3217/6474] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:17.951416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:17.952036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:17.958931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:17.959427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:17.959879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:17.960578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:17.961041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:17.961473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:18.168841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:18.177382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54d9ef39-6153-4921-a50a-bbbd3f695a02 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1680 microversion: 2.1 time: 0.229956 Sep 19 15:48:18.177987 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3258/6475] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:17 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:19.203851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:19.204566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:19.210732 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:19.211298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:19.211725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:19.212424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:19.212893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:19.213336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:19.310348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:19.320757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:19.321236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:19.321669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:19.333942 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] Creating event network-changed:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h2-858384-1 Sep 19 15:48:19.339412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] Instance 5f427592-61e1-4dd9-b002-f3c58981262f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:48:19.350646 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-58e1d465-f151-4b72-b530-198397056479 req-e45053c2-0835-40dc-bdd1-d442da5f2937 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044477 Sep 19 15:48:19.351295 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3259/6476] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:19.351943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:19.360736 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6a1319c1-190c-4cd7-a32a-83809170c505 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1678 microversion: 2.1 time: 0.162982 Sep 19 15:48:19.361357 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3218/6477] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:19 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:20.387021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:20.387606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:20.393994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.394494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.394975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.395685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.396151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.396578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.622653 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:20.630739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d4a27b7-4820-425b-9941-c5d870c7f777 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1675 microversion: 2.1 time: 0.249115 Sep 19 15:48:20.631296 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3260/6478] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:20 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:20.654692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:20.655279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:20.662064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.662571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.663056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.663768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.664241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.664688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.706114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.706632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.707126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.707939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.708416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.708866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.730126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:48:20.735421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:48:20.835106 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bc4af83b-9d18-4dd5-b57f-46e0285433ac tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f/action" status: 202 len: 0 microversion: 2.1 time: 0.184691 Sep 19 15:48:20.835755 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3219/6479] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:48:20 2022] POST /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:48:20.844785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:20.845406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:20.851389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.851887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.852332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:20.853118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:20.853585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:20.854017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:21.054208 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:21.062780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bf739400-1cd3-4814-aa5f-88a6744146e0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1674 microversion: 2.1 time: 0.222666 Sep 19 15:48:21.063368 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3261/6480] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:20 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:22.087305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:22.088102 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:22.095852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:22.096360 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:22.096824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:22.097535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:22.098036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:22.098484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:22.118339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:22.237545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:22.245415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-881dccab-4287-4f83-a947-39aef3f434d8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1674 microversion: 2.1 time: 0.162631 Sep 19 15:48:22.246178 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3220/6481] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:22 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:23.268856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:23.269479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:23.276499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:23.276944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:23.277387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:23.278099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:23.279103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:23.279667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:23.414290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:23.423216 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75b38e8f-4b59-49e1-8d2d-4222b5bcd641 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1674 microversion: 2.1 time: 0.158246 Sep 19 15:48:23.423798 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3262/6482] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:23 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:23.608658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "name": "network-vif-plugged", "status": "completed", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:23.620021 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:23.620516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:23.621148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:23.633997 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] Creating event network-vif-plugged:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:48:23.640878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] Instance 5f427592-61e1-4dd9-b002-f3c58981262f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:48:23.652203 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a6a8376b-a36f-419a-8a2c-425cefc53b51 req-8d98c207-cf18-4a0a-8bc1-b3c424ca373b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049185 Sep 19 15:48:23.653007 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3221/6483] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:23.903018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "name": "network-vif-unplugged", "status": "completed", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:23.913213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:23.913748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:23.914307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:23.927780 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] Creating event network-vif-unplugged:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:48:23.933667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] Instance 5f427592-61e1-4dd9-b002-f3c58981262f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:48:23.944968 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8affd76c-46e4-4bfe-8486-6e86594bd75f req-22c5b200-c34a-4fff-aaed-23e6f0a106ed service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045798 Sep 19 15:48:23.945597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3263/6484] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:24.446425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:24.447179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:24.453914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:24.454418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:24.454904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:24.455606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:24.456076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:24.456517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:24.686915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:24.694874 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9422c7ce-132a-47f8-9499-0e5e8021d7e2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1674 microversion: 2.1 time: 0.252684 Sep 19 15:48:24.695455 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3222/6485] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:24 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1674 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:25.721336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:25.721961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:25.728124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:25.728609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:25.729048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:25.729732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:25.730203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:25.730610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:25.860707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:25.868496 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-768f5fea-add5-424e-94c5-717d169187f6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1674 microversion: 2.1 time: 0.152933 Sep 19 15:48:25.869060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3264/6486] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:25 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:25.980676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:25.990801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:25.991291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:25.991731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:26.003178 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] Creating event network-changed:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:48:26.008376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] Instance 5f427592-61e1-4dd9-b002-f3c58981262f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:48:26.020454 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2bde8399-5b88-4465-8776-6d7c5b0a5842 req-1e2ec4e1-e65c-4684-97be-c2e1d8084edf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043375 Sep 19 15:48:26.021075 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3223/6487] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:26.893730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:26.894344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:26.901120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:26.901611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:26.902051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:26.902766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:26.903248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:26.904211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.055652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:27.063612 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8984d9f8-02a8-4c8a-9d1e-4fcd1ff21e96 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1667 microversion: 2.1 time: 0.173861 Sep 19 15:48:27.064188 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3265/6488] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:26 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:27.088026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:27.088747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:27.095631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.096135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.096587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.097290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.097800 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.098244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.245499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:27.253438 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-66b6dc16-db13-4aa0-9134-0192f42aaf72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1667 microversion: 2.1 time: 0.170528 Sep 19 15:48:27.254012 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3224/6489] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:27 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:27.275496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:27.276111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:27.282926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.283418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.283857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.284582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.285041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.285495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.289554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=100 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:27.416784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:27.424807 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6542513c-83d4-4ef9-83cb-4916fd0dc5e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1667 microversion: 2.1 time: 0.153186 Sep 19 15:48:27.425382 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3266/6490] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:27 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:27.447367 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:27.447981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:27.454772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.455296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.455752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.456462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.456944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.457386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.485209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:48:27.568404 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78a8f52a-7321-490c-8c83-89768f91137b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 204 len: 0 microversion: 2.1 time: 0.124582 Sep 19 15:48:27.569344 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3225/6491] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:48:27 2022] DELETE /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:48:27.577905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:27.578529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:27.584626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.585116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.585558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.586256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.586715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.587168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.723699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:27.731937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0990320c-9b45-48ac-af5f-65269f86d165 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1673 microversion: 2.1 time: 0.157902 Sep 19 15:48:27.732823 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3267/6492] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:27 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:28.314394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-949df407-5bac-4bcd-a57d-ffbe2f30ab72 req-22cc8950-602b-46a6-b517-90f63a6f4d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "name": "network-vif-plugged", "status": "completed", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:28.320454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:28.331572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-949df407-5bac-4bcd-a57d-ffbe2f30ab72 req-22cc8950-602b-46a6-b517-90f63a6f4d88 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:28.332075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-949df407-5bac-4bcd-a57d-ffbe2f30ab72 req-22cc8950-602b-46a6-b517-90f63a6f4d88 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:28.332543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-949df407-5bac-4bcd-a57d-ffbe2f30ab72 req-22cc8950-602b-46a6-b517-90f63a6f4d88 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:28.344415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-949df407-5bac-4bcd-a57d-ffbe2f30ab72 req-22cc8950-602b-46a6-b517-90f63a6f4d88 service nova] Creating event network-vif-plugged:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:48:28.349542 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-949df407-5bac-4bcd-a57d-ffbe2f30ab72 req-22cc8950-602b-46a6-b517-90f63a6f4d88 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040037 Sep 19 15:48:28.350153 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3226/6493] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:28.756533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:28.757097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:28.759820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=39 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:28.765593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:28.766112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:28.766540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:28.767291 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:28.767759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:28.768192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:28.941849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:28.949791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-786740ba-1480-4eda-8837-410cfabb1ecc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1673 microversion: 2.1 time: 0.197338 Sep 19 15:48:28.951061 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3268/6494] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:28 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:29.975475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:29.976203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:29.984238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:29.984755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:29.985208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:29.986119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:29.986598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:29.987119 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:30.022464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c08a02b3-9d56-4731-aaba-50d32d2e7b4c req-44d559a6-98c0-4227-8dd4-57c56c90e602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f427592-61e1-4dd9-b002-f3c58981262f", "name": "network-vif-deleted", "tag": "bff76b0d-ed6d-4858-8b41-7e7f107bba7c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:30.045049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c08a02b3-9d56-4731-aaba-50d32d2e7b4c req-44d559a6-98c0-4227-8dd4-57c56c90e602 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:30.045816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c08a02b3-9d56-4731-aaba-50d32d2e7b4c req-44d559a6-98c0-4227-8dd4-57c56c90e602 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:30.045990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c08a02b3-9d56-4731-aaba-50d32d2e7b4c req-44d559a6-98c0-4227-8dd4-57c56c90e602 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:30.063978 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c08a02b3-9d56-4731-aaba-50d32d2e7b4c req-44d559a6-98c0-4227-8dd4-57c56c90e602 service nova] Creating event network-vif-deleted:bff76b0d-ed6d-4858-8b41-7e7f107bba7c for instance 5f427592-61e1-4dd9-b002-f3c58981262f on n-h1-858384-1 Sep 19 15:48:30.069973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:30.070621 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c08a02b3-9d56-4731-aaba-50d32d2e7b4c req-44d559a6-98c0-4227-8dd4-57c56c90e602 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051293 Sep 19 15:48:30.071926 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3269/6495] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:30.081102 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e09c8d4e-e1c9-47b7-92c7-2518c7bcd643 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 200 len: 1605 microversion: 2.1 time: 0.109687 Sep 19 15:48:30.081695 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3227/6496] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:29 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:31.107323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:31.108168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:31.115444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.115949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.116388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.117077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.117531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.117952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.131751 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f HTTP/1.1 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '5f427592-61e1-4dd9-b002-f3c58981262f'} Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:31.133364 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8ebfc91f-96d8-4b7b-83ac-854ecbe528eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 404 len: 111 microversion: 2.1 time: 0.033117 Sep 19 15:48:31.137686 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3270/6497] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:31 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:48:31.154113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:31.155002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:31.159075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:31.165956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.166740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.167393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.168411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.170307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.171061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.189910 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f HTTP/1.1 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5f427592-61e1-4dd9-b002-f3c58981262f'} Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:31.192106 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f4e37b08-448f-471c-ac86-104f21628ac9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 404 len: 111 microversion: 2.1 time: 0.045531 Sep 19 15:48:31.195857 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3228/6498] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:31 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:48:31.244131 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-80162804", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "d764445a-f4f8-40d5-9f18-651713c6db6e"}], "security_groups": [{"name": "tempest-securitygroup--2053664145"}], "key_name": "tempest-keypair-1260302455", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:31.353055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] validate_networks() for [('d764445a-f4f8-40d5-9f18-651713c6db6e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:48:31.727862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:48:31.728294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:48:31.728802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:48:31.729271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:48:31.729687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:48:31.739345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.739837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.740274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.741010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.741462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.741890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.758592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:48:31.763823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:48:31.776109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:48:31.779318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:48:31.832325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b51743c-53b3-4a06-a766-eed551289bd2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.591903 Sep 19 15:48:31.836755 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3271/6499] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:48:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:48:31.845213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-37120711-34f1-4a95-843a-9c963d41efda tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:31.845836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-37120711-34f1-4a95-843a-9c963d41efda tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:31.905839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-37120711-34f1-4a95-843a-9c963d41efda tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:31.913261 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-37120711-34f1-4a95-843a-9c963d41efda tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1237 microversion: 2.1 time: 0.072390 Sep 19 15:48:31.913898 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3229/6500] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:31 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:32.938864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:32.939491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:32.946316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:32.947051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:32.947666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:32.948531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:32.948990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:32.949415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:33.022284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:33.030902 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b9f75a7-b7a4-4889-830b-5de5a3bf091d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1307 microversion: 2.1 time: 0.097797 Sep 19 15:48:33.031496 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3272/6501] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:32 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:34.054721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:34.055388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:34.063354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:34.063874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:34.064322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:34.065034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:34.065513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:34.065956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:34.270950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:34.279735 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2f779893-5786-4631-8353-8b8244afca4d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1363 microversion: 2.1 time: 0.228931 Sep 19 15:48:34.280314 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3230/6502] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:34 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:34.425765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8f583b97-6303-446f-8ecc-c2e63bedf432 req-11635fe1-5ff0-4839-9395-c6b2680a0da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:34.446185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8f583b97-6303-446f-8ecc-c2e63bedf432 req-11635fe1-5ff0-4839-9395-c6b2680a0da2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:34.446671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8f583b97-6303-446f-8ecc-c2e63bedf432 req-11635fe1-5ff0-4839-9395-c6b2680a0da2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:34.447143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8f583b97-6303-446f-8ecc-c2e63bedf432 req-11635fe1-5ff0-4839-9395-c6b2680a0da2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:34.460187 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8f583b97-6303-446f-8ecc-c2e63bedf432 req-11635fe1-5ff0-4839-9395-c6b2680a0da2 service nova] Creating event network-changed:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:48:34.465093 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8f583b97-6303-446f-8ecc-c2e63bedf432 req-11635fe1-5ff0-4839-9395-c6b2680a0da2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043262 Sep 19 15:48:34.466075 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3273/6503] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:35.304025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:35.304926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:35.312189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:35.312695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:35.313151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:35.313867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:35.314342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:35.314816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:35.443375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:35.452039 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c866a9f-1999-4af6-a427-76845fb338cb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1363 microversion: 2.1 time: 0.151934 Sep 19 15:48:35.452617 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3231/6504] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:35 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:36.475867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:36.476570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:36.483676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.484160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.484598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.485288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.485743 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.486165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.619266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:36.627148 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd279865-38f9-4b57-bb7a-3a474272e7fc tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1363 microversion: 2.1 time: 0.155539 Sep 19 15:48:36.627743 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3274/6505] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:36 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:37.652092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:37.653344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:37.663698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:37.664217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:37.664675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:37.665403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:37.665880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:37.666327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:37.837571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:37.846481 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf9ae38a-8ca8-4f31-b9fb-baab7dd345bd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1363 microversion: 2.1 time: 0.199074 Sep 19 15:48:37.847084 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3232/6506] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:37 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:38.872154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:38.872958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:38.879899 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:38.880393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:38.880856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:38.881536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:38.882001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:38.882432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.019145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:39.026990 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f93fc328-2ab6-4b2a-bf0e-6a3226c14673 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1363 microversion: 2.1 time: 0.159015 Sep 19 15:48:39.027560 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3275/6507] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:38 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:39.654054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-bf18a85e-8a73-434d-9f57-d5f14cf76441 req-0da95501-5302-42bd-b033-46105427ced5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "name": "network-vif-plugged", "status": "completed", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:39.666377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bf18a85e-8a73-434d-9f57-d5f14cf76441 req-0da95501-5302-42bd-b033-46105427ced5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.666910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bf18a85e-8a73-434d-9f57-d5f14cf76441 req-0da95501-5302-42bd-b033-46105427ced5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.667726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-bf18a85e-8a73-434d-9f57-d5f14cf76441 req-0da95501-5302-42bd-b033-46105427ced5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.680309 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-bf18a85e-8a73-434d-9f57-d5f14cf76441 req-0da95501-5302-42bd-b033-46105427ced5 service nova] Creating event network-vif-plugged:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:48:39.686390 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-bf18a85e-8a73-434d-9f57-d5f14cf76441 req-0da95501-5302-42bd-b033-46105427ced5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036165 Sep 19 15:48:39.687104 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3233/6508] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:40.050394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:40.050987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:40.058376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:40.058918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:40.059396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:40.060096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:40.060560 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:40.060992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:40.201334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:40.209149 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e81ab4a8-470d-4517-afd4-c0038731f588 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1363 microversion: 2.1 time: 0.162811 Sep 19 15:48:40.209733 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3276/6509] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:40 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:41.233464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:41.234770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:41.241992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.242485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.242964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.243657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.244124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.244558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.377921 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:41.386693 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e82f00d-e394-4f3c-be56-5790204be72d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1550 microversion: 2.1 time: 0.157381 Sep 19 15:48:41.387319 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3234/6510] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:41 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:41.410494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:41.411058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:41.417934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.418430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.418911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.419628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.420092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.420527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.503012 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-30b0401d-20d0-4312-b0ba-0b533cb673b4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096903 Sep 19 15:48:41.503644 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3277/6511] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:48:41 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:42.429187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-236187a8-3655-4d0f-bd43-3eb2c4e989fc req-06879cef-6d34-4a03-8561-36e777a377e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:42.434393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:42.442358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-236187a8-3655-4d0f-bd43-3eb2c4e989fc req-06879cef-6d34-4a03-8561-36e777a377e4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:42.442898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-236187a8-3655-4d0f-bd43-3eb2c4e989fc req-06879cef-6d34-4a03-8561-36e777a377e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:42.443354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-236187a8-3655-4d0f-bd43-3eb2c4e989fc req-06879cef-6d34-4a03-8561-36e777a377e4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:42.455396 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-236187a8-3655-4d0f-bd43-3eb2c4e989fc req-06879cef-6d34-4a03-8561-36e777a377e4 service nova] Creating event network-changed:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:48:42.460394 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-236187a8-3655-4d0f-bd43-3eb2c4e989fc req-06879cef-6d34-4a03-8561-36e777a377e4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 Sep 19 15:48:42.461036 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3235/6512] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:49:16.681581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:16.682367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:16.684292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:16.684927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=52 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:16.688926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:16.689589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:16.697846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:16.698342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:16.698811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:16.699519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:16.699984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:16.700422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:16.835270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:16.842976 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3ca7ecc3-6032-4611-8b03-020a7fcf08f4 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1667 microversion: 2.1 time: 0.162220 Sep 19 15:49:16.843544 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3278/6513] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:16 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:16.864544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=21 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:16.865351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:16.870870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4feeb87-ab28-45c0-af21-484e3eaa6c1d"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:16.873262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:16.881425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:16.881932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:16.882382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:16.883108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:16.883576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:16.884013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:17.118301 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7d039dbe-278d-483b-8b18-d13692a7b00a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256187 Sep 19 15:49:17.118949 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3236/6514] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:49:16 2022] POST /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:49:28.904796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:28.907876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:28.910122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:28.910795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:28.916866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:28.917350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:28.917785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:28.918465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:28.918951 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:28.919374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:28.948242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:28.953550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 15:49:28.961265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:49:28.961685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:49:28.962154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:49:28.962561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:49:28.962999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:49:29.027075 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab17378c-e735-4d12-8d9d-895124eb103a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/action" status: 202 len: 0 microversion: 2.1 time: 0.126455 Sep 19 15:49:29.027783 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3279/6515] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:49:28 2022] POST /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:49:29.035051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:29.035950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:29.040774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:29.041426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:29.049270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:29.050005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:29.050437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:29.051307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:29.051784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:29.052256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:29.189556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:29.198219 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8b23e5c7-6734-4807-8124-371c1c30de1a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1722 microversion: 2.1 time: 0.166020 Sep 19 15:49:29.198806 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3237/6516] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:29 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:30.223786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:30.224428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:30.231877 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:30.232406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:30.232847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:30.233549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:30.234009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:30.234474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:30.471701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:30.480098 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f8940ff5-7a4a-4512-86b2-94b0a4fd5d5c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1722 microversion: 2.1 time: 0.261428 Sep 19 15:49:30.480613 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3280/6517] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:30 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:31.504282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:31.504907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:31.511669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:31.512167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:31.512614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:31.513304 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:31.513768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:31.514202 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:31.644817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:31.653181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-620eb698-f938-43e1-b952-77dd68b7c8ad tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.152830 Sep 19 15:49:31.654379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3238/6518] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:31 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:32.678070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:32.678693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:32.685857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:32.686348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:32.686818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:32.687517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:32.687982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:32.689118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:32.823626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:32.832099 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-57b7c925-6946-4f97-9fe5-97f0987457b1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.157985 Sep 19 15:49:32.832671 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3281/6519] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:32 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:33.856049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:33.856627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:33.863623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:33.864117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:33.864575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:33.865273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:33.865744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:33.866185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:33.994640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:34.003414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-299f5584-a895-449c-b82f-72f645e29543 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.151360 Sep 19 15:49:34.003983 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3239/6520] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:33 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:35.026271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:35.026915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:35.036697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:35.037190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:35.037636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:35.038342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:35.038837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:35.039272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:35.171375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:35.179782 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e03dac1b-f494-46e7-9219-9dc4a8a48790 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.157435 Sep 19 15:49:35.180646 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3282/6521] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:35 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:36.203680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:36.204302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:36.211141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:36.211643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:36.212096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:36.212799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:36.213272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:36.213712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:36.345274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:36.354320 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3e20cd7c-0acc-448b-8a65-06c23db8ce14 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.154532 Sep 19 15:49:36.355220 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3240/6522] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:36 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:37.378271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:37.378940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:37.385822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:37.386314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:37.386781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:37.387476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:37.387937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:37.388368 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:37.519474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:37.527709 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c13306a9-6a52-4917-97f8-8a56b8a6bd2c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.153615 Sep 19 15:49:37.528281 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3283/6523] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:37 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:38.555872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:38.556500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:38.564088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:38.564935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:38.565390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:38.566101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:38.566577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:38.567033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:38.989823 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:38.998379 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-99061196-6a17-416c-bc81-2420e16061f3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.449142 Sep 19 15:49:38.999000 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3241/6524] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:38 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:40.023307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:40.023920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:40.031440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:40.031924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:40.032362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:40.033050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:40.033504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:40.033927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:40.162467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:40.171549 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5b4bdbac-ebc1-431d-a21b-1e008aec5359 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.152165 Sep 19 15:49:40.172124 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3284/6525] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:40 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:41.195652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:41.196291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:41.203169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:41.203676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:41.204128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:41.204831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:41.205303 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:41.205745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:41.337476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:41.346288 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d8b559f1-4910-47fe-a596-aeb5a57a8372 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.154480 Sep 19 15:49:41.351326 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3242/6526] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:41 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:42.370329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:42.370874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:42.378546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:42.379104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:42.379548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:42.380258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:42.380726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:42.381157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:42.510741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:42.519316 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-90d1c6dd-3912-43d1-bec3-e6053551760e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.152974 Sep 19 15:49:42.519907 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3285/6527] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:42 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:43.542533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:43.543190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:43.550338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:43.550883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:43.551334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:43.552028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:43.552493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:43.552927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:43.681801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:43.691052 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dd9ab623-e52b-4e05-923c-dd4fea0bb90c tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.152346 Sep 19 15:49:43.691556 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3243/6528] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:43 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:44.715163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:44.715694 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:44.723148 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:44.723641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:44.724085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:44.724777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:44.725239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:44.725669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:44.860451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:44.868864 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8493683b-6a55-4d71-8cc1-29f276601d44 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.157801 Sep 19 15:49:44.869460 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3286/6529] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:44 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:45.892866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:45.893389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:45.900174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:45.900729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:45.901180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:45.901880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:45.902344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:45.902801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:46.074051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:46.082276 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-877efe64-899b-4c4d-aa26-e0ec2959f382 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.193436 Sep 19 15:49:46.082932 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3244/6530] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:45 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:47.105885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:47.106516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:47.114559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:47.115286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:47.115730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:47.116425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:47.116887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:47.117325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:47.250430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:47.258789 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f625c28-b231-4933-983c-1ecd19fb2608 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.157134 Sep 19 15:49:47.259378 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3287/6531] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:47 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:48.281651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:48.282344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:48.289622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:48.290180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:48.290623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:48.291385 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:48.291859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:48.292328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:48.424829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:48.433434 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7aa9bc2b-a3e0-4651-8a54-ddd7d79626d6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.155891 Sep 19 15:49:48.434216 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3245/6532] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:48 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:49.459027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:49.459636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:49.467165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:49.467657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:49.468097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:49.468806 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:49.469478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:49.470244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:49.644903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:49.653240 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-73d19361-319d-4afc-881f-3a9ea5759e2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1727 microversion: 2.1 time: 0.199627 Sep 19 15:49:49.653821 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3288/6533] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:49 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:50.212482 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "name": "network-vif-unplugged", "status": "completed", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:50.224216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:50.224776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:50.225313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:50.238973 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] Creating event network-vif-unplugged:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h1-858384-1 Sep 19 15:49:50.244469 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:49:50.255603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-857c2a12-81a7-4a76-a6dc-145d10e36976 req-f5d056cd-aa4c-4b39-8830-89eca12271aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046988 Sep 19 15:49:50.256216 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3246/6534] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:49:50.677621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:50.678236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:50.684586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:50.685078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:50.685519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:50.686231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:50.686692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:50.687152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:50.906261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:50.914860 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23c9846f-9189-4e0f-a861-7e9e2e372aa1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1726 microversion: 2.1 time: 0.242304 Sep 19 15:49:50.915445 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3289/6535] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:50 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1726 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:51.940621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:51.941356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:51.947923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:51.948435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:51.948888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:51.949611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:51.950086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:51.950532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:52.088522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:52.097488 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bc30c7f9-e809-4635-8560-2aceb11008b8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.162512 Sep 19 15:49:52.098067 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3247/6536] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:51 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:52.293892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:52.304376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:52.304860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:52.305566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:52.317539 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] Creating event network-changed:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h1-858384-1 Sep 19 15:49:52.322928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:49:52.334601 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-9fcb9bd7-81e1-4ab1-951e-b12f9e4754ca req-8f703a8a-dd7d-485b-ba37-f02a6f4038de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044511 Sep 19 15:49:52.335330 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3290/6537] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:49:53.121285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:53.121839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:53.129313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:53.129830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:53.130289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:53.131038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:53.131520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:53.131975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:53.313931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:53.322335 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2bba5c7-c6ef-4aca-bf9d-3ae90291acf9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.205175 Sep 19 15:49:53.322962 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3248/6538] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:53 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:54.347176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:54.347896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:54.354360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:54.354881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:54.355326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:54.356034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:54.356492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:54.356924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:54.493589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:54.502283 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dd2efda5-aff9-497e-abcd-ac37bca7e2ee tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.160490 Sep 19 15:49:54.503241 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3291/6539] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:54 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:55.526224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:55.526895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:55.533528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:55.534031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:55.534488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:55.535224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:55.535698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:55.536141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:55.670246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:55.678894 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a288290e-da78-4827-9b9c-15c95a59cb2e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.156657 Sep 19 15:49:55.679483 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3249/6540] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:55 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:49:56.703203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:56.703992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:56.710608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:56.711120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:56.711552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:56.712236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:56.712688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:56.713114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:56.845036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:56.853511 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-54f3849a-10e2-4101-a5a7-f2cee0086a11 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.154353 Sep 19 15:49:56.854085 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3292/6541] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:56 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:57.877812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:57.878526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:57.885334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:57.885925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:57.886443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:57.887244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:57.887712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:57.888153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:58.024465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:58.033621 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-58d7c2f9-c879-4e7f-bd30-6cfdfa9099e3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.160303 Sep 19 15:49:58.034514 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3250/6542] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:57 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:59.057945 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:59.058506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:59.060846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=33 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:59.066893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:59.067389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:59.067835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:59.068541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:59.069006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:59.069442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:59.073617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:59.203885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:59.212156 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cf67fe09-8d86-410f-a4fb-ed8f35c3d84d tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.158579 Sep 19 15:49:59.212750 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3293/6543] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:59 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:00.236589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:00.237212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:00.239997 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=29 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:00.245274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:00.245774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:00.246223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:00.246964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:00.247431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:00.247868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:00.251183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=83 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:00.379716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:00.388181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3fce4162-c55c-4424-8fef-1ab3ee982dbd tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.156096 Sep 19 15:50:00.388762 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3251/6544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:00 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:01.411616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:01.412298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:01.419207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:01.419692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:01.420126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:01.420814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:01.421267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:01.421688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:01.552304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:01.560891 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b4c8e5f-6a8f-477b-88a2-bb3e6ef2f184 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.153595 Sep 19 15:50:01.561471 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3294/6545] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:01 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:02.585388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:02.585920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:02.592862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:02.593359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:02.593861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:02.595171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:02.595640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:02.596077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:02.728879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:02.737399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20c44dd1-d8ca-4ec4-92be-898c3bc6d18e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1724 microversion: 2.1 time: 0.156048 Sep 19 15:50:02.737984 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3252/6546] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:02 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:03.760093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:03.760713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:03.767818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:03.768306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:03.768742 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:03.769434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:03.769888 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:03.770313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.209992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:04.218251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-99a77bd2-d771-45ec-8d9f-a9241067f356 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1721 microversion: 2.1 time: 0.462084 Sep 19 15:50:04.218880 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3295/6547] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:03 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:04.241207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:04.241742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:04.248586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.249085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.249531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.251242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.251719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.252159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.291058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.291551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.291998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.292718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.293207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.293643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.315006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:50:04.320196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Getting quotas for user 747555ab1d5d4f2abb66857698bfbd7d and project d7b1038a25504e9593adef9bb050f6dd. Resources: {'cores', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:50:04.419867 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-992f3c9e-e694-4aa0-b50d-485ed96d4c2f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "POST /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/action" status: 202 len: 0 microversion: 2.1 time: 0.182484 Sep 19 15:50:04.420426 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3253/6548] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:50:04 2022] POST /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:50:04.430918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:04.431529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:04.437973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.438559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.439080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.439985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.440672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.441240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.639834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:04.649287 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7896f313-6daa-490a-bd12-2daa533b11ea tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.223149 Sep 19 15:50:04.649647 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3296/6549] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:04 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:05.674340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:05.675163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:05.681589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:05.682086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:05.682536 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:05.683275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:05.683749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:05.684188 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:05.817805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:05.826041 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-630a9240-1768-428c-989a-c2e55df5e368 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.157135 Sep 19 15:50:05.826616 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3254/6550] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:05 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:06.761248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "name": "network-vif-plugged", "status": "completed", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:06.774454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:06.775019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:06.775462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:06.789783 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] Creating event network-vif-plugged:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h1-858384-1 Sep 19 15:50:06.798437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:50:06.811043 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-648fbdac-e928-46a5-9c1a-07c009d359a9 req-adeacae8-db79-4d3a-ad34-df4c4d24561c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053048 Sep 19 15:50:06.811839 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3297/6551] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:06.850775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:06.851457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:06.859008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:06.859576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:06.860031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:06.860748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:06.861223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:06.861665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:06.999401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:07.007888 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcb1a780-308b-44b8-baa0-b8494d2a72eb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.161163 Sep 19 15:50:07.008492 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3255/6552] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:06 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:08.032987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:08.033579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:08.040821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:08.041304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:08.041740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:08.042430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:08.042914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:08.043338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:08.178640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:08.188198 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b8ce30a4-62ef-4458-8b45-3b19c9ab9d85 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.159780 Sep 19 15:50:08.188878 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3298/6553] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:08 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:09.211715 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:09.212345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:09.219450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:09.219956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:09.220560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:09.221281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:09.221741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:09.222182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:09.368941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:09.380193 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6cbb42a-cee5-42ac-889d-239a4f18ff72 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.172305 Sep 19 15:50:09.380843 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3256/6554] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:09 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:09.857153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "name": "network-vif-unplugged", "status": "completed", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:09.868803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:09.869316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:09.869785 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:09.884209 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] Creating event network-vif-unplugged:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:50:09.890587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:50:09.901810 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c251256a-2a1a-4473-a066-005057d98592 req-ac15b362-2241-400a-aa52-f41634308ade service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048628 Sep 19 15:50:09.902739 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3299/6555] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:10.405461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:10.406180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:10.413581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:10.414094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:10.414549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:10.415301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:10.415774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:10.416219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:10.643078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:10.652865 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f82f2365-1623-410f-ac77-988c21b57e28 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.251250 Sep 19 15:50:10.653547 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3257/6556] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:10 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:11.678645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:11.679452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:11.685959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:11.686444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:11.686917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:11.688297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:11.688758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:11.689188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:11.822901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:11.831653 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c757d97-ae1d-4c1c-921c-f0f7fbe2a10b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.158370 Sep 19 15:50:11.832226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3300/6557] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:11 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:11.950929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:11.961555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:11.962144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:11.962586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:11.974863 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] Creating event network-changed:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:50:11.980166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 15:50:11.992941 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cdff084c-6725-4279-a7c1-74b7186c0cbf req-3300e406-b151-4ae1-bd50-0a0684d212a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045745 Sep 19 15:50:11.994146 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3258/6558] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:50:12.855864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:12.857067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:12.864837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:12.865328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:12.865766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:12.866467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:12.866950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:12.867373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:13.013364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:13.023155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0338694c-11c7-4c2d-9594-25eb6c27c3d9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.171364 Sep 19 15:50:13.023762 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3301/6559] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:12 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:14.047238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:14.047972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:14.055359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:14.056143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:14.056602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:14.057311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:14.057783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:14.058225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:14.196779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:14.205818 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4e27bc42-ab26-47fe-b755-a34b65dcd3f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.163006 Sep 19 15:50:14.206406 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3259/6560] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:14 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:15.229618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:15.230205 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:15.238254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:15.238740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:15.239198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:15.239889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:15.240343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:15.240764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:15.372871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:15.381192 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d644340-90c5-4df0-ba01-6f9c3c6812b9 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.155602 Sep 19 15:50:15.381776 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3302/6561] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:15 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:16.405508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:16.406643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:16.408699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:16.415153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:16.415667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:16.416124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:16.416858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:16.417369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:16.417816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:16.547461 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:16.556000 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1c590db8-c8b8-466b-aa59-818a18e331d1 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.154207 Sep 19 15:50:16.556587 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3260/6562] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:16 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:17.580606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:17.581221 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:17.588341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:17.588827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:17.589265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:17.589958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:17.590408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:17.590854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:17.726960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:17.736017 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0cdfeb08-bc43-4a66-8c46-9c1d2d3943a8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.159740 Sep 19 15:50:17.736592 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3303/6563] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:17 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:50:18.759487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:18.760040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:18.767745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:18.768251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:18.768708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:18.769421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:18.769898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:18.770343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:18.899296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:18.908125 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5cc4a0f8-e29d-4b03-be39-b6e702bd301f tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.152719 Sep 19 15:50:18.908703 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3261/6564] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:18 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:19.931883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:19.932486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:19.939920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:19.940405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:19.940842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:19.941526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:19.941980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:19.942402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:20.075298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:20.083739 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-490842b4-874c-44ad-99a5-60a004c089b3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.156037 Sep 19 15:50:20.084305 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3304/6565] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:19 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:21.107357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:21.107972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:21.114906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:21.115416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:21.115879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:21.116590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:21.117121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:21.117564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:21.246632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:21.255509 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d0e3886-6f19-4890-95cb-25748dff0a05 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.152175 Sep 19 15:50:21.256090 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3262/6566] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:21 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:22.278422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:22.279244 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:22.287685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:22.288411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:22.289051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:22.289773 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:22.290216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:22.290650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:22.429789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:22.439898 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7436f4c8-1784-4e02-9d49-1749bca4e6df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1720 microversion: 2.1 time: 0.165332 Sep 19 15:50:22.440504 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3305/6567] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:22 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:23.464750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:23.465387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:23.472563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.473072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.473533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.474248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.474728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.475203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.608501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:23.617532 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa0afa15-07de-4a1e-ac08-5a9f9a83b717 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1713 microversion: 2.1 time: 0.156784 Sep 19 15:50:23.618115 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3263/6568] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:23 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:23.640246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:23.641118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:23.647893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.648388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.648826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.649512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.649971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.650388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.778692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:23.787180 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b2527c48-a431-46db-833e-fabcec3b7f40 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1713 microversion: 2.1 time: 0.150769 Sep 19 15:50:23.787763 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3306/6569] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:23 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:23.809998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:23.810644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:23.817538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.818039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.818493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.819217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.819692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.820133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:24.258562 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:24.267585 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7de29b1-5ce3-4a89-b984-5b63a42a1b12 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1713 microversion: 2.1 time: 0.461836 Sep 19 15:50:24.268175 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3264/6570] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:23 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1713 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:24.290960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:24.291403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:24.297805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:24.298302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:24.298767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:24.299476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:24.299943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:24.300372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:24.329154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:50:24.414107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-354127fd-f532-4b47-88d8-d6790ca8743a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 204 len: 0 microversion: 2.1 time: 0.126810 Sep 19 15:50:24.414941 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3307/6571] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:24 2022] DELETE /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:50:24.423383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:24.424011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:24.430125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:24.430925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:24.431380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:24.432085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:24.432554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:24.432986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:24.435832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:24.569554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:24.578513 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3826a20d-9b1a-438c-8381-56c190782ef6 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1719 microversion: 2.1 time: 0.158482 Sep 19 15:50:24.579149 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3265/6572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:24 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:25.603103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:25.603847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:25.611330 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:25.611816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:25.612256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:25.613167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:25.613400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:25.613864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:25.745203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:25.747520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:25.755259 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0366bdd5-e48d-4d29-b855-43fdb298051a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1719 microversion: 2.1 time: 0.156527 Sep 19 15:50:25.755842 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3308/6573] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:25 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:26.117841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2ec93ab2-4867-4e38-a7d1-7447d99ad7f9 req-c740ea04-bc04-44d0-a8ed-d3d883d95fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "name": "network-vif-plugged", "status": "completed", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:26.131041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2ec93ab2-4867-4e38-a7d1-7447d99ad7f9 req-c740ea04-bc04-44d0-a8ed-d3d883d95fa2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:26.131882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2ec93ab2-4867-4e38-a7d1-7447d99ad7f9 req-c740ea04-bc04-44d0-a8ed-d3d883d95fa2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:26.132395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2ec93ab2-4867-4e38-a7d1-7447d99ad7f9 req-c740ea04-bc04-44d0-a8ed-d3d883d95fa2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:26.145103 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2ec93ab2-4867-4e38-a7d1-7447d99ad7f9 req-c740ea04-bc04-44d0-a8ed-d3d883d95fa2 service nova] Creating event network-vif-plugged:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:50:26.150310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2ec93ab2-4867-4e38-a7d1-7447d99ad7f9 req-c740ea04-bc04-44d0-a8ed-d3d883d95fa2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Sep 19 15:50:26.150955 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3266/6574] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:26.783930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:26.784786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:26.797890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-47811742-0236-47bb-aafa-da44e0626b67 req-b0f8d8ce-be5c-4817-9895-7361f25e9e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f", "name": "network-vif-deleted", "tag": "080cbe50-5d16-4ab8-a5ca-6c8debf98bc9"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:26.817652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47811742-0236-47bb-aafa-da44e0626b67 req-b0f8d8ce-be5c-4817-9895-7361f25e9e77 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:26.818593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:26.819194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:26.819728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:26.820567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:26.821097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:26.821758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:26.826084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47811742-0236-47bb-aafa-da44e0626b67 req-b0f8d8ce-be5c-4817-9895-7361f25e9e77 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:26.826624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-47811742-0236-47bb-aafa-da44e0626b67 req-b0f8d8ce-be5c-4817-9895-7361f25e9e77 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:26.843853 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-47811742-0236-47bb-aafa-da44e0626b67 req-b0f8d8ce-be5c-4817-9895-7361f25e9e77 service nova] Creating event network-vif-deleted:080cbe50-5d16-4ab8-a5ca-6c8debf98bc9 for instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f on n-h2-858384-1 Sep 19 15:50:26.852172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-47811742-0236-47bb-aafa-da44e0626b67 req-b0f8d8ce-be5c-4817-9895-7361f25e9e77 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059344 Sep 19 15:50:26.856885 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3267/6575] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:26.902900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:26.912422 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0bd69ae4-72a4-4443-9353-77080656af5e tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1368 microversion: 2.1 time: 0.135328 Sep 19 15:50:26.913011 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3309/6576] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:26 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:50:27.938148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:27.938919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:27.945168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:27.945735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:27.946252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:27.947047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:27.947584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:27.948026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:28.012676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:28.021052 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-173d6c2f-971d-4cdb-88b5-8183e7c4f4fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1368 microversion: 2.1 time: 0.088763 Sep 19 15:50:28.021628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3268/6577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:27 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:29.044342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:29.044961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:29.051356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:29.051848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:29.052292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:29.052993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:29.053452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:29.053880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:29.118091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:29.127787 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5404ccfb-98c6-4548-a842-0f57bc9035f0 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1368 microversion: 2.1 time: 0.087551 Sep 19 15:50:29.128386 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3310/6578] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:29 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:30.152382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:30.152970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:30.160971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:30.161481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:30.161971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:30.162685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:30.163196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:30.163651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:30.228009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:30.236811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-818b9ccc-0289-4cf7-ad7d-4bc9176bd76a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1368 microversion: 2.1 time: 0.088565 Sep 19 15:50:30.237393 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3269/6579] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:30 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:31.259802 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:31.260614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:31.263680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:31.270004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.270533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.271004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.271767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.272225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.272650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.306880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.307369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.307807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.308259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lazy-loading 'fault' on Instance uuid ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:50:31.353807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747555ab1d5d4f2abb66857698bfbd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b1038a25504e9593adef9bb050f6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:31.362727 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f15171cf-b1a2-4085-9ba6-f45092c9c8bb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 200 len: 1327 microversion: 2.1 time: 0.106828 Sep 19 15:50:31.363377 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3311/6580] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:31 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:32.385505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:32.386134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:32.388995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:32.394838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:32.395346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:32.395796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:32.396504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:32.397083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:32.397531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:32.412663 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f HTTP/1.1 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f'} Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:32.414413 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9eea01ec-6c67-4721-bb5a-8db4eb28ed70 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 404 len: 111 microversion: 2.1 time: 0.034558 Sep 19 15:50:32.419359 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3270/6581] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:32 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:50:32.480552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:32.482876 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:32.490613 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:32.491128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:32.491566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:32.492249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:32.492701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:32.493126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:32.506589 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-volume_attachments HTTP/1.1 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': 'ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f'} Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:32.508227 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-55d7eed8-2680-4ad6-af12-6dc0b773dee7 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033161 Sep 19 15:50:32.512834 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3312/6582] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:50:32 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:35.836708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:35.837297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:35.845189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.845700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.846146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.846900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.847373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.847810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.863446 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f HTTP/1.1 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f'} Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:35.865063 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f9c3fa1-9c75-4f3c-a1cf-f4fcf698fdf3 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 404 len: 111 microversion: 2.1 time: 0.034002 Sep 19 15:50:35.869410 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3271/6583] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:35 2022] DELETE /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:35.875380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:35.876016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:35.883345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.883841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.884284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.885002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.885461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.885892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.900807 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f HTTP/1.1 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f'} Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.902422 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-31947323-4ad8-43f3-8ede-886edd0ca5c8 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f" status: 404 len: 111 microversion: 2.1 time: 0.032526 Sep 19 15:50:35.907982 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3313/6584] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:35 2022] GET /compute/v2.1/servers/ffa4c9c7-74a3-4f63-b4d6-3a0c78f3800f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:35.917390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:35.917897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:35.924641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.925143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.925591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.926294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.926777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.927221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.941671 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f HTTP/1.1 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5f427592-61e1-4dd9-b002-f3c58981262f'} Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:35.943294 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:35.947821 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-88039b8b-54f3-426a-bc01-57d72209bae2 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 404 len: 111 microversion: 2.1 time: 0.031423 Sep 19 15:50:35.949061 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3272/6585] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:35 2022] DELETE /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:35.953361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:35.953982 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 5f427592-61e1-4dd9-b002-f3c58981262f] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:35.960216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.960705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.961143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.961843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.962300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.962776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.976944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f HTTP/1.1 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '5f427592-61e1-4dd9-b002-f3c58981262f'} Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:35.978531 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 5f427592-61e1-4dd9-b002-f3c58981262f could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-211883ba-0d48-4805-92d7-b9403730772b tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f" status: 404 len: 111 microversion: 2.1 time: 0.030571 Sep 19 15:50:35.983192 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3314/6586] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:35 2022] GET /compute/v2.1/servers/5f427592-61e1-4dd9-b002-f3c58981262f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:50:35.988956 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:35.989474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:35.995779 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.996289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.996744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:35.997456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:35.997930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:35.998374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.012808 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 HTTP/1.1 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '9d884fc5-1d0f-4a25-bf97-405594eb7e49'} Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:36.014424 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9eab4e32-5c89-43d9-809b-572c7e0f69df tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 404 len: 111 microversion: 2.1 time: 0.031738 Sep 19 15:50:36.019181 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3273/6587] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:35 2022] DELETE /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:50:36.025141 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:36.025757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 9d884fc5-1d0f-4a25-bf97-405594eb7e49] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:36.032071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.032569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.033013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.033717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.034177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.034797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.051495 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 HTTP/1.1 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '9d884fc5-1d0f-4a25-bf97-405594eb7e49'} Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.053046 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 9d884fc5-1d0f-4a25-bf97-405594eb7e49 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9f419c10-9834-4f48-a161-ae47ecf3d21a tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49" status: 404 len: 111 microversion: 2.1 time: 0.033163 Sep 19 15:50:36.058932 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3315/6588] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:36 2022] GET /compute/v2.1/servers/9d884fc5-1d0f-4a25-bf97-405594eb7e49 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:36.064372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:36.064858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:36.071226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.071735 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.072187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.072899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.073370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.073809 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.087722 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 HTTP/1.1 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '4e86dd66-8890-494c-a2dc-c9620b355b23'} Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:36.089335 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b33678e4-6622-4de1-8259-f57670444e30 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 404 len: 111 microversion: 2.1 time: 0.031218 Sep 19 15:50:36.097139 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3274/6589] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:36 2022] DELETE /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:36.100234 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:36.100988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [instance: 4e86dd66-8890-494c-a2dc-c9620b355b23] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:36.107051 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.107536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.107970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.108654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.109810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.110345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.124254 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] HTTP exception thrown: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Request method failure captured: Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 HTTP/1.1 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI5u2BmxggUu86xC-IOp1sUpdBOI27hc4NH4_JkpIf-BFsmeXv-YsSjPTtv5XfoDjqJdOC54UBFdzu_vWFUl8bUtRBgcTJg00CQuuBX4oo29g9fQDKzDRDJpcJQpmoV0LEbrQifk9IU5YiD9szVMqpokz3hIMw3ajl9y4n7d_EvVMs4 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7b1038a25504e9593adef9bb050f6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7b1038a25504e9593adef9bb050f6dd"}]}] Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: d7b1038a25504e9593adef9bb050f6dd Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServerActionsTestJSON-1991243942 Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 747555ab1d5d4f2abb66857698bfbd7d Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServerActionsTestJSON-1991243942-project Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '4e86dd66-8890-494c-a2dc-c9620b355b23'} Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:36.125872 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Returning 404 to user: Instance 4e86dd66-8890-494c-a2dc-c9620b355b23 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3c110fd-920d-4a6f-a672-b8d222d5ac61 tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23" status: 404 len: 111 microversion: 2.1 time: 0.031121 Sep 19 15:50:36.131402 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3316/6590] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:36 2022] GET /compute/v2.1/servers/4e86dd66-8890-494c-a2dc-c9620b355b23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:36.136073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57b8f4f3-4610-4cd6-ae6d-46999e0d20fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] Calling method '.version_select at 0x7fde28bb24c0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:36.140589 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57b8f4f3-4610-4cd6-ae6d-46999e0d20fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [51a2263b-92d3-4718-ac86-2e1e88a872e0] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:50:37.148213 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [None req-57b8f4f3-4610-4cd6-ae6d-46999e0d20fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] [51a2263b-92d3-4718-ac86-2e1e88a872e0] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 43182. Sep 19 15:50:37.170943 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57b8f4f3-4610-4cd6-ae6d-46999e0d20fb tempest-ServerActionsTestJSON-1991243942 tempest-ServerActionsTestJSON-1991243942-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260302455" status: 202 len: 0 microversion: 2.1 time: 1.038764 Sep 19 15:50:37.171613 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3275/6591] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 15:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260302455 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:50:46.319522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=13 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:46.321401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=31 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:46.493505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1774454383", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e11812d6-f999-4b87-913f-97febe577812"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:46.743587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] validate_networks() for [('e11812d6-f999-4b87-913f-97febe577812', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:50:47.216111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:50:47.216610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:50:47.217169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:50:47.217657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:50:47.218720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:50:47.229127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:47.229619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:47.230055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:47.230821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:47.231353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:47.231779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:47.250138 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Getting quotas for project e82f0875bb8f4715947e36a60427714b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:50:47.255983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Getting quotas for user da1bda3fd38b43b48ee047ec5facbacc and project e82f0875bb8f4715947e36a60427714b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:50:47.269570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:50:47.271901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:50:47.322468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-56093d44-1896-40ff-82bf-055aa1033f71 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003838 Sep 19 15:50:47.334171 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3317/6592] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:50:47.337203 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=31 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:47.338916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:47.345540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a248c96a-c7b3-4d44-b0ab-4836990daec2 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:47.346392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a248c96a-c7b3-4d44-b0ab-4836990daec2 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:47.474372 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a248c96a-c7b3-4d44-b0ab-4836990daec2 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:47.482717 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a248c96a-c7b3-4d44-b0ab-4836990daec2 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1217 microversion: 2.1 time: 0.147512 Sep 19 15:50:47.491943 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3276/6593] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:47 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:50:48.511039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:48.511656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:48.519489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:48.519997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:48.520443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:48.521297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:48.521769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:48.522194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:48.600729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:48.609541 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e90982a-d05c-4a78-ad58-d1f609206815 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1275 microversion: 2.1 time: 0.103368 Sep 19 15:50:48.610382 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3318/6594] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:48 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:49.635371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:49.636015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:49.644801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.645542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.646162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.647492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.648137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.648776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.864215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-25778707-99c2-4070-a986-03804e1edfcc req-636c649e-88e0-4a58-b113-68a105446ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360435b0-4db1-45cc-9ea0-f7c6d51ae0fc", "tag": "32af5bba-2844-4c48-aacf-bb805b1e7a34"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:49.874543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:49.884323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25778707-99c2-4070-a986-03804e1edfcc req-636c649e-88e0-4a58-b113-68a105446ba0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.885284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25778707-99c2-4070-a986-03804e1edfcc req-636c649e-88e0-4a58-b113-68a105446ba0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.886133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-25778707-99c2-4070-a986-03804e1edfcc req-636c649e-88e0-4a58-b113-68a105446ba0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.890740 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61b31c6c-fe8e-47e6-a580-edc34b5482fa tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1317 microversion: 2.1 time: 0.259621 Sep 19 15:50:49.902390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-25778707-99c2-4070-a986-03804e1edfcc req-636c649e-88e0-4a58-b113-68a105446ba0 service nova] Creating event network-changed:32af5bba-2844-4c48-aacf-bb805b1e7a34 for instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc on n-h1-858384-1 Sep 19 15:50:49.903949 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3277/6595] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:49 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:49.917369 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-25778707-99c2-4070-a986-03804e1edfcc req-636c649e-88e0-4a58-b113-68a105446ba0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057726 Sep 19 15:50:49.917988 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3319/6596] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:50:50.917016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:50.917739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:50.924693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:50.925165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:50.925620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:50.926394 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:50.926826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:50.927300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:51.058245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:51.066242 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9f70b127-c369-47ae-b776-bb4fad50960a tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1317 microversion: 2.1 time: 0.155295 Sep 19 15:50:51.066838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3278/6597] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:50 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:52.090426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:52.091299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:52.097641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:52.098123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:52.098562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:52.099286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:52.099748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:52.100176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:52.228124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:52.236695 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-96552690-ed8e-4c43-9184-cf6257c35d88 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1317 microversion: 2.1 time: 0.151423 Sep 19 15:50:52.237267 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3320/6598] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:52 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:53.259878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:53.260625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:53.267657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:53.268159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:53.268618 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:53.269339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:53.269819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:53.270267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:53.403650 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:53.412223 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5cfa54d6-9604-4043-8e7f-696cae1cfb29 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1317 microversion: 2.1 time: 0.156315 Sep 19 15:50:53.412811 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3279/6599] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:53 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:54.435569 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:54.436294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:54.443356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.443837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.444268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.444957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.445407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.445829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.572688 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:54.580935 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4c53038b-3f51-4b8b-85f9-ba3ab2d26a47 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1317 microversion: 2.1 time: 0.149290 Sep 19 15:50:54.581512 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3321/6600] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:54 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:54.957581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1bf69fd1-8e5a-4397-a13d-c60a3a42fdb3 req-4a59b66f-ec7e-4f4c-b9db-ce532fb8036d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360435b0-4db1-45cc-9ea0-f7c6d51ae0fc", "name": "network-vif-plugged", "status": "completed", "tag": "32af5bba-2844-4c48-aacf-bb805b1e7a34"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:54.968814 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1bf69fd1-8e5a-4397-a13d-c60a3a42fdb3 req-4a59b66f-ec7e-4f4c-b9db-ce532fb8036d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.969458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1bf69fd1-8e5a-4397-a13d-c60a3a42fdb3 req-4a59b66f-ec7e-4f4c-b9db-ce532fb8036d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.969910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1bf69fd1-8e5a-4397-a13d-c60a3a42fdb3 req-4a59b66f-ec7e-4f4c-b9db-ce532fb8036d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.980950 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1bf69fd1-8e5a-4397-a13d-c60a3a42fdb3 req-4a59b66f-ec7e-4f4c-b9db-ce532fb8036d service nova] Creating event network-vif-plugged:32af5bba-2844-4c48-aacf-bb805b1e7a34 for instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc on n-h1-858384-1 Sep 19 15:50:54.986662 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1bf69fd1-8e5a-4397-a13d-c60a3a42fdb3 req-4a59b66f-ec7e-4f4c-b9db-ce532fb8036d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Sep 19 15:50:54.987340 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3280/6601] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:55.605524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:55.606146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:55.613927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:55.614416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:55.614908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:55.615602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:55.616056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:55.616481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:55.745381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:55.753296 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3f64f4a-6f30-4344-9fd2-0fbfa8e5b5b4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1317 microversion: 2.1 time: 0.151758 Sep 19 15:50:55.753875 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3322/6602] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:55 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:56.777910 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:56.778616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:56.785432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:56.785930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:56.786376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:56.787110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:56.787595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:56.788020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:56.876593 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:50:56.876784 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc (ip 10.222.0.81) !!! Sep 19 15:50:56.917437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:56.925572 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3991a25c-5328-4877-978f-54315dde4ee4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.152727 Sep 19 15:50:56.926157 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3281/6603] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:56 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:56.987238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-137375198", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e11812d6-f999-4b87-913f-97febe577812"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:57.044904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] validate_networks() for [('e11812d6-f999-4b87-913f-97febe577812', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:50:57.240427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:57.263158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:57.723774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:50:57.724203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:50:57.724685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:50:57.725101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:50:57.725628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:50:57.735154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:57.735583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:57.736021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:57.736749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:57.737209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:57.737644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:57.754454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Getting quotas for project e82f0875bb8f4715947e36a60427714b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:50:57.759807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Getting quotas for user da1bda3fd38b43b48ee047ec5facbacc and project e82f0875bb8f4715947e36a60427714b. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:50:57.772259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:50:57.774547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:50:57.820255 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2b70a69d-4b9a-403d-8471-aa5fd159b243 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837299 Sep 19 15:50:57.821143 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3323/6604] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:50:57.832477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9545e3b4-909d-4be8-9211-ee3a7038d0e3 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:57.833126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9545e3b4-909d-4be8-9211-ee3a7038d0e3 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:57.835199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:57.889321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9545e3b4-909d-4be8-9211-ee3a7038d0e3 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:57.896674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9545e3b4-909d-4be8-9211-ee3a7038d0e3 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1216 microversion: 2.1 time: 0.068284 Sep 19 15:50:57.897444 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3282/6605] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:57 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:50:58.924913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:58.925545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:58.933270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:58.933909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:58.934354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:58.935088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:58.935545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:58.935976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.012770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:59.020956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fbf80783-c822-4ff7-b9e6-e4c88dfd9e1f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1276 microversion: 2.1 time: 0.104994 Sep 19 15:50:59.021540 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3324/6606] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:58 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:00.043867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:00.044500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:00.052518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.053039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.053557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.054290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.054792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.055277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.280363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:00.288192 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b950c312-6bb6-40d7-81b4-d7f643129be6 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1316 microversion: 2.1 time: 0.248290 Sep 19 15:51:00.288784 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3283/6607] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:00 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:00.453848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a8884ea8-c32e-493e-acd2-237404f749f7 req-8d6dc06d-91a8-448a-bb39-576b6f3ff445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d85188-8a05-4247-9ad1-691f878852b9", "tag": "2de81dd9-d20e-4591-ba67-a495b565c27c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:00.464835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a8884ea8-c32e-493e-acd2-237404f749f7 req-8d6dc06d-91a8-448a-bb39-576b6f3ff445 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.465345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a8884ea8-c32e-493e-acd2-237404f749f7 req-8d6dc06d-91a8-448a-bb39-576b6f3ff445 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.466044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a8884ea8-c32e-493e-acd2-237404f749f7 req-8d6dc06d-91a8-448a-bb39-576b6f3ff445 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.478321 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a8884ea8-c32e-493e-acd2-237404f749f7 req-8d6dc06d-91a8-448a-bb39-576b6f3ff445 service nova] Creating event network-changed:2de81dd9-d20e-4591-ba67-a495b565c27c for instance 52d85188-8a05-4247-9ad1-691f878852b9 on n-h2-858384-1 Sep 19 15:51:00.484524 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a8884ea8-c32e-493e-acd2-237404f749f7 req-8d6dc06d-91a8-448a-bb39-576b6f3ff445 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Sep 19 15:51:00.485226 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3325/6608] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:01.312761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:01.313390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:01.320176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:01.320672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:01.321121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:01.321819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:01.322286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:01.322726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:01.463055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:01.471519 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59336d52-714e-4419-a9df-41e21392879c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1316 microversion: 2.1 time: 0.163570 Sep 19 15:51:01.472123 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3284/6609] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:01 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:02.496467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:02.497172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:02.503971 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:02.504465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:02.504905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:02.505597 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:02.506057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:02.506485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:02.637872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:02.645913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3129f21b-245d-4d5e-8476-af7a4772830f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1316 microversion: 2.1 time: 0.154744 Sep 19 15:51:02.646587 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3326/6610] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:02 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:03.668816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:03.669439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:03.676352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:03.676843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:03.677291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:03.677984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:03.678452 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:03.678923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:03.807247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:03.815625 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e0b70298-917c-4759-ab06-ddd7e95ec279 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1316 microversion: 2.1 time: 0.150740 Sep 19 15:51:03.816200 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3285/6611] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:03 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:04.267071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-accbd302-2f42-4d58-a747-247dd5ca9976 req-2efc924d-3894-4666-81b7-fc8857099624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d85188-8a05-4247-9ad1-691f878852b9", "name": "network-vif-plugged", "status": "completed", "tag": "2de81dd9-d20e-4591-ba67-a495b565c27c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:04.277993 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-accbd302-2f42-4d58-a747-247dd5ca9976 req-2efc924d-3894-4666-81b7-fc8857099624 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:04.279317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-accbd302-2f42-4d58-a747-247dd5ca9976 req-2efc924d-3894-4666-81b7-fc8857099624 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:04.279762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-accbd302-2f42-4d58-a747-247dd5ca9976 req-2efc924d-3894-4666-81b7-fc8857099624 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:04.292091 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-accbd302-2f42-4d58-a747-247dd5ca9976 req-2efc924d-3894-4666-81b7-fc8857099624 service nova] Creating event network-vif-plugged:2de81dd9-d20e-4591-ba67-a495b565c27c for instance 52d85188-8a05-4247-9ad1-691f878852b9 on n-h2-858384-1 Sep 19 15:51:04.298331 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-accbd302-2f42-4d58-a747-247dd5ca9976 req-2efc924d-3894-4666-81b7-fc8857099624 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036708 Sep 19 15:51:04.298978 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3327/6612] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:04.838894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:04.839544 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:04.846652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:04.847294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:04.847750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:04.848463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:04.848938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:04.849381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:04.977533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:04.985763 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3abf7c6-1209-46a3-acb0-bac561f293ae tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1316 microversion: 2.1 time: 0.150851 Sep 19 15:51:04.986343 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3286/6613] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:04 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:06.009471 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:06.010180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:06.017549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:06.018047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:06.018492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:06.019263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:06.019729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:06.020215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:06.154361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:06.162692 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6c497b16-d47a-494a-84c6-e259025a0b4c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1504 microversion: 2.1 time: 0.157504 Sep 19 15:51:06.163298 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3328/6614] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:06 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:06.185087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:06.185613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:06.192987 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:06.193496 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:06.193964 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:06.194676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:06.195184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:06.195634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:06.221111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:51:06.296663 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e863653-97e2-44ed-b890-b43fae354ac9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 204 len: 0 microversion: 2.1 time: 0.114530 Sep 19 15:51:06.297132 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3287/6615] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:51:06 2022] DELETE /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:51:06.306807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:06.307427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:06.314442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:06.314961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:06.315397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:06.316088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:06.316540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:06.316966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:06.444859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:06.452959 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b629a2c3-5625-4dc4-b63b-340f5b54bc8d tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1510 microversion: 2.1 time: 0.150779 Sep 19 15:51:06.453533 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3329/6616] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:06 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:07.477080 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:07.477816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:07.485540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:07.486057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:07.486534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:07.487275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:07.487752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:07.488206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:07.692207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:07.700079 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfb736e1-af2f-4586-bc69-efc47692b539 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 200 len: 1510 microversion: 2.1 time: 0.227406 Sep 19 15:51:07.700848 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3288/6617] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:07 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:08.049690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c8271a35-4e6f-4f7b-98c4-6803d6001ce1 req-578554b7-c689-4b43-bb5e-b7e7c4ae4a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d85188-8a05-4247-9ad1-691f878852b9", "name": "network-vif-deleted", "tag": "2de81dd9-d20e-4591-ba67-a495b565c27c"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:08.062990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:08.064009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:08.066704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c8271a35-4e6f-4f7b-98c4-6803d6001ce1 req-578554b7-c689-4b43-bb5e-b7e7c4ae4a14 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.067352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c8271a35-4e6f-4f7b-98c4-6803d6001ce1 req-578554b7-c689-4b43-bb5e-b7e7c4ae4a14 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.067974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c8271a35-4e6f-4f7b-98c4-6803d6001ce1 req-578554b7-c689-4b43-bb5e-b7e7c4ae4a14 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:08.088413 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c8271a35-4e6f-4f7b-98c4-6803d6001ce1 req-578554b7-c689-4b43-bb5e-b7e7c4ae4a14 service nova] Creating event network-vif-deleted:2de81dd9-d20e-4591-ba67-a495b565c27c for instance 52d85188-8a05-4247-9ad1-691f878852b9 on n-h2-858384-1 Sep 19 15:51:08.096108 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c8271a35-4e6f-4f7b-98c4-6803d6001ce1 req-578554b7-c689-4b43-bb5e-b7e7c4ae4a14 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051080 Sep 19 15:51:08.097057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3330/6618] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:08.724190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:08.725012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:08.728382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:08.733873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.734400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.734919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:08.735661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.736140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.736596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:08.752255 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] HTTP exception thrown: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 HTTP/1.1 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '52d85188-8a05-4247-9ad1-691f878852b9'} Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:08.753878 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 404 to user: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-26f12413-3dcd-499e-a163-2384ca8d224c tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 404 len: 111 microversion: 2.1 time: 0.035325 Sep 19 15:51:08.758308 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3289/6619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:08 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:08.766374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:08.767125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:08.773754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.774263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.774709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:08.775455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.775960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.776351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:08.916317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:08.924679 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8e8dd0ab-2c64-45d2-9206-9452f0aad978 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.163356 Sep 19 15:51:08.925696 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3331/6620] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:08 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:08.947888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4abb75f-bae9-45c8-a914-0706c733bd22 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:08.950268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4abb75f-bae9-45c8-a914-0706c733bd22 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 5bb8925e-d6d6-4630-bba3-656292da3450] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:08.956044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-d4abb75f-bae9-45c8-a914-0706c733bd22 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] HTTP exception thrown: Instance 5bb8925e-d6d6-4630-bba3-656292da3450 could not be found. Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4abb75f-bae9-45c8-a914-0706c733bd22 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/5bb8925e-d6d6-4630-bba3-656292da3450/action HTTP/1.1 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 32 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: {"resize": {"flavorRef": "452"}} Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5bb8925e-d6d6-4630-bba3-656292da3450 could not be found. Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5bb8925e-d6d6-4630-bba3-656292da3450', 'body': {'resize': {'flavorRef': '452'}}} Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb8925e-d6d6-4630-bba3-656292da3450 could not be found. Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:08.957630 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb8925e-d6d6-4630-bba3-656292da3450 could not be found. Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb8925e-d6d6-4630-bba3-656292da3450 could not be found. Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4abb75f-bae9-45c8-a914-0706c733bd22 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 404 to user: Instance 5bb8925e-d6d6-4630-bba3-656292da3450 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4abb75f-bae9-45c8-a914-0706c733bd22 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "POST /compute/v2.1/servers/5bb8925e-d6d6-4630-bba3-656292da3450/action" status: 404 len: 111 microversion: 2.1 time: 0.015216 Sep 19 15:51:08.963053 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3290/6621] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:51:08 2022] POST /compute/v2.1/servers/5bb8925e-d6d6-4630-bba3-656292da3450/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:08.968661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:08.969306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:08.975487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.975979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.976418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:08.977118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:08.977576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:08.978003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.111005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:09.119140 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2bd044c3-2144-41e6-8a98-59fcf724e4d9 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.154987 Sep 19 15:51:09.119827 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3332/6622] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:08 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:09.142300 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.143118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.153447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.153963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.154423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.155691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.156172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.156620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.286699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:09.294642 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e950318a-8c6f-418c-a311-fe69a13db8b1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.156329 Sep 19 15:51:09.295261 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3291/6623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:09 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:09.317245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "94494729-f04c-40eb-a2f0-a92feef9bb87"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:09.319526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.325545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.326067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.326516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.327765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.328231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.328662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.357967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:09.363384 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] HTTP exception thrown: Flavor 94494729-f04c-40eb-a2f0-a92feef9bb87 could not be found. Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: request: POST /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc/action HTTP/1.1 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 65 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: {"resize": {"flavorRef": "94494729-f04c-40eb-a2f0-a92feef9bb87"}} Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: exception: Flavor 94494729-f04c-40eb-a2f0-a92feef9bb87 could not be found. Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '360435b0-4db1-45cc-9ea0-f7c6d51ae0fc', 'body': {'resize': {'flavorRef': '94494729-f04c-40eb-a2f0-a92feef9bb87'}}} Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:09.365407 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 94494729-f04c-40eb-a2f0-a92feef9bb87 could not be found. Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 94494729-f04c-40eb-a2f0-a92feef9bb87 could not be found. Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 94494729-f04c-40eb-a2f0-a92feef9bb87 could not be found. Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 400 to user: Flavor 94494729-f04c-40eb-a2f0-a92feef9bb87 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e6de5a39-8c22-4dc7-8024-af6043b0503f tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "POST /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc/action" status: 400 len: 107 microversion: 2.1 time: 0.053711 Sep 19 15:51:09.370073 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3333/6624] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:51:09 2022] POST /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc/action => generated 107 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:51:09.376287 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.376935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.383680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.384197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.384661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.385389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.385871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.386320 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.524117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:09.533111 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-13239dcf-7806-41b2-9a3e-d8b46af14ade tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.161004 Sep 19 15:51:09.533687 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3292/6625] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:09 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:09.557212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.557924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.564025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.564516 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.564990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.565692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.566185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.566617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.694374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:09.702882 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87cb2823-e2b9-4a45-a457-9b0d58beaec5 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.149941 Sep 19 15:51:09.703460 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3334/6626] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:09 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:51:09.725100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9e903ddc-2694-4b4c-b260-90d0763d31c4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9e903ddc-2694-4b4c-b260-90d0763d31c4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: request: POST /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc/action HTTP/1.1 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 29 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: {"resize": {"flavorRef": ""}} Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '360435b0-4db1-45cc-9ea0-f7c6d51ae0fc', 'body': {'resize': {'flavorRef': ''}}} Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi '' Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.728821 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9e903ddc-2694-4b4c-b260-90d0763d31c4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9e903ddc-2694-4b4c-b260-90d0763d31c4 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "POST /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc/action" status: 400 len: 113 microversion: 2.1 time: 0.009237 Sep 19 15:51:09.734029 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3293/6627] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:51:09 2022] POST /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:51:09.738532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.739180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.745165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.745651 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.746090 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.746800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.747263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.747695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.880117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:09.887949 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-07d373b9-e14b-42e4-b30b-6dfa3b5372a1 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1505 microversion: 2.1 time: 0.153219 Sep 19 15:51:09.888516 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3335/6628] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:09 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:09.917020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.917456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.924655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.925155 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.925602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.926306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.926796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.927241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.941547 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] HTTP exception thrown: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 HTTP/1.1 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '52d85188-8a05-4247-9ad1-691f878852b9'} Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:09.943141 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 404 to user: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c89b75b-def9-40df-8cd8-066be98df826 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 404 len: 111 microversion: 2.1 time: 0.032655 Sep 19 15:51:09.948134 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3294/6629] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:51:09 2022] DELETE /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:09.954164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.954873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 52d85188-8a05-4247-9ad1-691f878852b9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.960858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.961346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.961792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.962485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.962976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.963409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.976728 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] HTTP exception thrown: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 HTTP/1.1 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '52d85188-8a05-4247-9ad1-691f878852b9'} Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:09.978260 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 404 to user: Instance 52d85188-8a05-4247-9ad1-691f878852b9 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4515c7dc-0d5d-4fdf-a829-1a91e076949e tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9" status: 404 len: 111 microversion: 2.1 time: 0.030274 Sep 19 15:51:09.984154 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3336/6630] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:09 2022] GET /compute/v2.1/servers/52d85188-8a05-4247-9ad1-691f878852b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:09.988967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.989522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:09.995657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.996168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.996628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:09.997340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:09.997818 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:09.998267 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:10.024126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:51:10.058189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:10.111055 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c3415cd9-8a9b-4cd7-a140-af019d19f5a7 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 204 len: 0 microversion: 2.1 time: 0.125717 Sep 19 15:51:10.111850 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3295/6631] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:51:09 2022] DELETE /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:51:10.120823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:10.121443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:10.128384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:10.128875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:10.129315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:10.130007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:10.130464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:10.130937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:10.259826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:10.268181 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-78f6fb35-c1c5-4270-b43c-27ad95871899 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1511 microversion: 2.1 time: 0.152308 Sep 19 15:51:10.268757 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3337/6632] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:10 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:11.292456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:11.293181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:11.299929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:11.300443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:11.300901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:11.301608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:11.302083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:11.302526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:11.440775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1bda3fd38b43b48ee047ec5facbacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82f0875bb8f4715947e36a60427714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:11.449742 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7194f64c-b04b-4c3d-97a1-f887acd73eed tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 200 len: 1511 microversion: 2.1 time: 0.161671 Sep 19 15:51:11.450322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3296/6633] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:11 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:11.984763 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6944f0b1-c052-48c6-a191-e95c00aae09b req-955cf1f8-d45a-4d37-8e16-b4b948de5db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360435b0-4db1-45cc-9ea0-f7c6d51ae0fc", "name": "network-vif-deleted", "tag": "32af5bba-2844-4c48-aacf-bb805b1e7a34"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:11.996958 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6944f0b1-c052-48c6-a191-e95c00aae09b req-955cf1f8-d45a-4d37-8e16-b4b948de5db0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:11.997444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6944f0b1-c052-48c6-a191-e95c00aae09b req-955cf1f8-d45a-4d37-8e16-b4b948de5db0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:11.997880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6944f0b1-c052-48c6-a191-e95c00aae09b req-955cf1f8-d45a-4d37-8e16-b4b948de5db0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:12.012281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6944f0b1-c052-48c6-a191-e95c00aae09b req-955cf1f8-d45a-4d37-8e16-b4b948de5db0 service nova] Creating event network-vif-deleted:32af5bba-2844-4c48-aacf-bb805b1e7a34 for instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc on n-h1-858384-1 Sep 19 15:51:12.018342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6944f0b1-c052-48c6-a191-e95c00aae09b req-955cf1f8-d45a-4d37-8e16-b4b948de5db0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103035 Sep 19 15:51:12.018990 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3338/6634] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:12.472942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:12.473569 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] [instance: 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:12.480412 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:12.480912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:12.481366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:12.482069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:12.482555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:12.483755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:12.497700 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] HTTP exception thrown: Instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc could not be found. Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Request method failure captured: Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc HTTP/1.1 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKI_W4jJMiOeJ3TnvkBcY2MImv2MXe2uddFeKOisMTlQH-fZ9jwh6zxiig06Pv6k9AgwjJyDyoPVXCHLAGVFlDHlQ36LJRCA7x4uCGYV87TgJg7ONngeY5-UViX-F5J0PGyWwR9_VQ0-s0QSxvEnu2nUVNYWTlmOi9gjTEozN8E0FQAI Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e82f0875bb8f4715947e36a60427714b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e82f0875bb8f4715947e36a60427714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e82f0875bb8f4715947e36a60427714b"}]}] Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: e82f0875bb8f4715947e36a60427714b Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33762427 Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: da1bda3fd38b43b48ee047ec5facbacc Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-ServersNegativeTestJSON-33762427-project Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc could not be found. Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '360435b0-4db1-45cc-9ea0-f7c6d51ae0fc'} Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc could not be found. Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc could not be found. Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:12.499926 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc could not be found. Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] Returning 404 to user: Instance 360435b0-4db1-45cc-9ea0-f7c6d51ae0fc could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5a56423b-8962-4481-a866-5b0402327a56 tempest-ServersNegativeTestJSON-33762427 tempest-ServersNegativeTestJSON-33762427-project] 10.222.0.81 "GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc" status: 404 len: 111 microversion: 2.1 time: 0.032426 Sep 19 15:51:12.504691 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3297/6635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:12 2022] GET /compute/v2.1/servers/360435b0-4db1-45cc-9ea0-f7c6d51ae0fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:43.564129 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:51:43.564764 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.81) !!! Sep 19 15:51:43.569011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:43.570410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=98 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:43.797373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b64bcc65-64bf-47da-ae4b-7e0c7850495e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: .version_select at 0x7fde28d94ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-436297225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfI7m7O3YGZ4kj7HOBAtb23FIFjCYGl+JIG9ROKtSoguc0bA6MMNlaIwKqBKnk5y72bMRLg0GvmmHZqlB1tlVT7sshpKGzOX8I6vTuRX9IiOa6RDTCotl2gXj7MTH4dgw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:43.814466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b64bcc65-64bf-47da-ae4b-7e0c7850495e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:51:43.819946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b64bcc65-64bf-47da-ae4b-7e0c7850495e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for user 8780d01172e44f1bb1aa9a836466fde9 and project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:51:43.851796 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b64bcc65-64bf-47da-ae4b-7e0c7850495e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.301018 Sep 19 15:51:43.852401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3339/6636] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:51:43 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:43.906890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1735496906", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-436297225", "networks": [{"uuid": "17c4026d-aff7-4a68-91dc-e1ea40ac3406"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:43.916098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:43.916915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:43.968769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] validate_networks() for [('17c4026d-aff7-4a68-91dc-e1ea40ac3406', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:51:44.447679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:51:44.448174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:51:44.448660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:51:44.449081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:51:44.449504 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:51:44.459297 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:44.459796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:44.460248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:44.460983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:44.461449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:44.461886 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:44.478836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:51:44.484896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for user 8780d01172e44f1bb1aa9a836466fde9 and project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:51:44.497000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:51:44.500239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:51:44.547773 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-209280f5-8ee9-440a-8471-189451079806 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645629 Sep 19 15:51:44.548353 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3298/6637] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:51:44.559510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3148f52e-bd87-4f5a-857f-f6c72cebe7cb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:44.560975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3148f52e-bd87-4f5a-857f-f6c72cebe7cb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:44.620828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3148f52e-bd87-4f5a-857f-f6c72cebe7cb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:44.629144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3148f52e-bd87-4f5a-857f-f6c72cebe7cb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1262 microversion: 2.1 time: 0.073780 Sep 19 15:51:44.629956 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3340/6638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:44 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:45.653636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:45.654255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:45.664204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:45.665100 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:45.665839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:45.666554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:45.667225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:45.667919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:45.750247 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:45.760701 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9d0ee92c-15e3-408d-901c-fa8662d4e1e9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1332 microversion: 2.1 time: 0.112393 Sep 19 15:51:45.761530 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3299/6639] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:45 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:51:46.785383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:46.786028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:46.796207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:46.797315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:46.798723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:46.800928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:46.801639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:46.802334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:47.063568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:47.071659 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9014b283-c9f2-49dd-b9c3-16156935f2d8 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1362 microversion: 2.1 time: 0.290273 Sep 19 15:51:47.082851 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3341/6640] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:46 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:51:47.248709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-96f56719-3062-4c54-9dd7-c965238bf184 req-cc626d95-cee7-4956-889c-9184682e7f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366cd5f6-ff82-4251-bf8b-c6d480c24e75", "tag": "10a96c2f-5206-4191-a77b-896affd45b87"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:47.259578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-96f56719-3062-4c54-9dd7-c965238bf184 req-cc626d95-cee7-4956-889c-9184682e7f70 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:47.260081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-96f56719-3062-4c54-9dd7-c965238bf184 req-cc626d95-cee7-4956-889c-9184682e7f70 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:47.260548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-96f56719-3062-4c54-9dd7-c965238bf184 req-cc626d95-cee7-4956-889c-9184682e7f70 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:47.273945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-96f56719-3062-4c54-9dd7-c965238bf184 req-cc626d95-cee7-4956-889c-9184682e7f70 service nova] Creating event network-changed:10a96c2f-5206-4191-a77b-896affd45b87 for instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 on n-h2-858384-1 Sep 19 15:51:47.279603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-96f56719-3062-4c54-9dd7-c965238bf184 req-cc626d95-cee7-4956-889c-9184682e7f70 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035668 Sep 19 15:51:47.280569 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3300/6641] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:48.100002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:48.100525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:48.107468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:48.107960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:48.108406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:48.109108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:48.109573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:48.110005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:48.241031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:48.249704 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f9ec5760-c2ad-4b34-a8fd-dd33cccab333 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1362 microversion: 2.1 time: 0.153805 Sep 19 15:51:48.250323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3342/6642] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:48 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:49.274617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:49.275288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:49.281617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:49.282122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:49.282573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:49.283337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:49.283804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:49.284246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:49.413890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:49.422531 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fff65deb-618f-44ad-a101-1fe0939477ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1362 microversion: 2.1 time: 0.153193 Sep 19 15:51:49.423159 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3301/6643] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:49 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:50.445794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:50.446475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:50.454499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:50.455071 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:50.455519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:50.456235 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:50.456697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:50.457133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:50.586181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:50.593917 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-148b97ed-939d-4a4e-b398-1e44f20d970d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1362 microversion: 2.1 time: 0.152309 Sep 19 15:51:50.594512 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3343/6644] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:50 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:51.617150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:51.617786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:51.624817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:51.625328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:51.625794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:51.626505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:51.627014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:51.627468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:51.762013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:51.770612 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bfe4cf7a-705a-4c30-88e5-fc59f60a559b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1362 microversion: 2.1 time: 0.157434 Sep 19 15:51:51.771221 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3302/6645] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:51 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:52.388002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-91f431a1-f3f1-4467-a97f-6818e3abc4da req-731ffdf0-93bf-493c-875a-57b43d57a24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366cd5f6-ff82-4251-bf8b-c6d480c24e75", "name": "network-vif-plugged", "status": "completed", "tag": "10a96c2f-5206-4191-a77b-896affd45b87"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:52.400908 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-91f431a1-f3f1-4467-a97f-6818e3abc4da req-731ffdf0-93bf-493c-875a-57b43d57a24d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:52.401427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-91f431a1-f3f1-4467-a97f-6818e3abc4da req-731ffdf0-93bf-493c-875a-57b43d57a24d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:52.401866 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-91f431a1-f3f1-4467-a97f-6818e3abc4da req-731ffdf0-93bf-493c-875a-57b43d57a24d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:52.414443 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-91f431a1-f3f1-4467-a97f-6818e3abc4da req-731ffdf0-93bf-493c-875a-57b43d57a24d service nova] Creating event network-vif-plugged:10a96c2f-5206-4191-a77b-896affd45b87 for instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 on n-h2-858384-1 Sep 19 15:51:52.420937 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-91f431a1-f3f1-4467-a97f-6818e3abc4da req-731ffdf0-93bf-493c-875a-57b43d57a24d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036716 Sep 19 15:51:52.421558 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3344/6646] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:52.793577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:52.794151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:52.802026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:52.802552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:52.803030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:52.803740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:52.804214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:52.804690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:52.937740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:52.945553 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2ab046c0-82b2-4a7d-8101-d02d099f39ef tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1362 microversion: 2.1 time: 0.155974 Sep 19 15:51:52.946137 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3303/6647] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:52 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:53.969339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:53.970072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:53.977183 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:53.977662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:53.978101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:53.978807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:53.979263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:53.979686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:54.110178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:54.118062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-850d533f-af6f-432d-9e9b-eeb5141fd3da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1553 microversion: 2.1 time: 0.153094 Sep 19 15:51:54.118633 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3345/6648] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:53 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:54.142157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:54.142822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:54.149644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:54.150156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:54.150646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:54.151565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:54.152047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:54.152654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:54.288486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:54.296996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-68547f4a-e3bf-4608-9b4e-c8abf8c3ef79 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1553 microversion: 2.1 time: 0.159651 Sep 19 15:51:54.297581 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3304/6649] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:54 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:55.917184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c7eef4c-9e49-4a66-889d-64e52464d8b1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:55.920262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:55.922220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:55.928285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:55.928777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:55.929217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:55.929907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:55.930364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:55.930837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:56.173427 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dce5d245-f558-418d-86eb-b4a2d455ee7e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260035 Sep 19 15:51:56.174057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3346/6650] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:51:55 2022] POST /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:06.912832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:06.913395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:06.915683 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:06.916474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:06.917120 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:06.917807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=34 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:06.925141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:06.925652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:06.926109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:06.926852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:06.927332 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:06.927780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:07.007792 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lazy-loading 'services' on Instance uuid 366cd5f6-ff82-4251-bf8b-c6d480c24e75 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:52:07.083216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dc7f0072-47c4-43d6-bb45-e55bd6d74637 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments/8c7eef4c-9e49-4a66-889d-64e52464d8b1" status: 202 len: 0 microversion: 2.1 time: 0.174124 Sep 19 15:52:07.083845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3305/6651] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:52:06 2022] DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments/8c7eef4c-9e49-4a66-889d-64e52464d8b1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:52:07.090182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:07.091860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:07.096367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:07.098797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:07.106514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:07.107125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:07.107571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:07.108299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:07.108747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:07.109179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:07.142278 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cc9a4191-d48b-4169-8f17-a159617257bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053921 Sep 19 15:52:07.145146 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3347/6652] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:07 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:08.156914 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:08.159457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:08.166006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:08.166509 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:08.166983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:08.167698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:08.168659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:08.168659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:08.202963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd36a41c-7c26-424a-bbe5-f7ebd930d0f3 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051544 Sep 19 15:52:08.203567 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3306/6653] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:08 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:09.216404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:09.218729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:09.225860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:09.226427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:09.226974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:09.227737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:09.228286 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:09.228780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:09.260173 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0b1ea89f-9fb2-4343-b240-5a8167a1a257 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048352 Sep 19 15:52:09.261063 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3348/6654] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:09 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:10.273425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:10.275770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:10.283244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:10.283753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:10.284214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:10.284929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:10.285408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:10.285857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:10.316546 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d54986d-ea69-4376-a126-8b9d64e09864 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Sep 19 15:52:10.317128 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3307/6655] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:10 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:11.329310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:11.331660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:11.338495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:11.339024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:11.339458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:11.340149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:11.341107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:11.341690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:11.375334 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c519a67f-39e7-42a9-a4cd-938c6d9ad0b6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050221 Sep 19 15:52:11.375924 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3349/6656] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:11 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:12.389134 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:12.391521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:12.399152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:12.399662 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:12.400113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:12.400841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:12.401312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:12.401753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:12.437113 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dcfc3a8b-3cd8-4ac6-9fb2-4899cbeb0a8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053042 Sep 19 15:52:12.437934 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3308/6657] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:12 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:52:12.448493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:12.449041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:12.456648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:12.458121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:12.458586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:12.459332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:12.459789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:12.460403 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:12.543989 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] HTTP exception thrown: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 is not attached to volume 8c7eef4c-9e49-4a66-889d-64e52464d8b1 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Request method failure captured: Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments/8c7eef4c-9e49-4a66-889d-64e52464d8b1 HTTP/1.1 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJAKn47TMddrpbIVAlHmxNDUhCOuD96yYPxoD3Nux6bw_lWLPcxOWS1nKXBMsVTWlhtFfpAt1y9QWSAyy5RidzzCVA4tWiuZ5MWhdcNFiaRdPBVESy_wAvETr4t3o1-rg4ItTDe-zfNyo0Fgrs64NiHSw-7HqQ3EJRlI3uB0c8OH1-E Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1ee0b85705f9486bab03c6838ca854e2"}]}] Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 8780d01172e44f1bb1aa9a836466fde9 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 is not attached to volume 8c7eef4c-9e49-4a66-889d-64e52464d8b1 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '366cd5f6-ff82-4251-bf8b-c6d480c24e75', 'id': '8c7eef4c-9e49-4a66-889d-64e52464d8b1'} Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8c7eef4c-9e49-4a66-889d-64e52464d8b1. Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 is not attached to volume 8c7eef4c-9e49-4a66-889d-64e52464d8b1 Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:12.558930 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 is not attached to volume 8c7eef4c-9e49-4a66-889d-64e52464d8b1 Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Returning 404 to user: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 is not attached to volume 8c7eef4c-9e49-4a66-889d-64e52464d8b1 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e8427b37-82c3-4cfd-8c24-400eb1c27a3f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments/8c7eef4c-9e49-4a66-889d-64e52464d8b1" status: 404 len: 154 microversion: 2.1 time: 0.116126 Sep 19 15:52:12.564059 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3350/6658] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:52:12 2022] DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75/os-volume_attachments/8c7eef4c-9e49-4a66-889d-64e52464d8b1 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:52:15.925889 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:15.926407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:15.935354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:15.935878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:15.936330 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:15.937057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:15.937532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:15.937978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:15.965670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:52:16.045176 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7993c03d-6f58-4d79-b4ea-19673355c6cc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 204 len: 0 microversion: 2.1 time: 0.122966 Sep 19 15:52:16.045777 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3309/6659] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:52:15 2022] DELETE /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:52:16.054448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:16.055009 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:16.063337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:16.063820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:16.064259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:16.064952 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:16.065417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:16.065844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:16.507166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:16.516302 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3accace6-ec02-4db2-b30c-696c4ce53cbc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1559 microversion: 2.1 time: 0.465904 Sep 19 15:52:16.517116 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3351/6660] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:16 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1559 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:17.540441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:17.541199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:17.548757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:17.549263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:17.549718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:17.550438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:17.550942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:17.551390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:17.742589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:17.750603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cf3af45f-c63a-4841-8f42-609831e1e1e7 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 200 len: 1559 microversion: 2.1 time: 0.214426 Sep 19 15:52:17.751215 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3310/6661] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:17 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:18.073397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-0d70f6c9-f396-4239-8351-5ad16f35bb26 req-2dc63f55-afb0-44ba-9a15-3a754317b7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366cd5f6-ff82-4251-bf8b-c6d480c24e75", "name": "network-vif-deleted", "tag": "10a96c2f-5206-4191-a77b-896affd45b87"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:18.088049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0d70f6c9-f396-4239-8351-5ad16f35bb26 req-2dc63f55-afb0-44ba-9a15-3a754317b7b0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:18.088543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0d70f6c9-f396-4239-8351-5ad16f35bb26 req-2dc63f55-afb0-44ba-9a15-3a754317b7b0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:18.089383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-0d70f6c9-f396-4239-8351-5ad16f35bb26 req-2dc63f55-afb0-44ba-9a15-3a754317b7b0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:18.104694 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-0d70f6c9-f396-4239-8351-5ad16f35bb26 req-2dc63f55-afb0-44ba-9a15-3a754317b7b0 service nova] Creating event network-vif-deleted:10a96c2f-5206-4191-a77b-896affd45b87 for instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 on n-h2-858384-1 Sep 19 15:52:18.109913 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-0d70f6c9-f396-4239-8351-5ad16f35bb26 req-2dc63f55-afb0-44ba-9a15-3a754317b7b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040664 Sep 19 15:52:18.110514 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3352/6662] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:18.775187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:18.775745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: 366cd5f6-ff82-4251-bf8b-c6d480c24e75] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:18.783491 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:18.783989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:18.784439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:18.785146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:18.785612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:18.786048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:18.801148 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] HTTP exception thrown: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 could not be found. Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Request method failure captured: Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 HTTP/1.1 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJAKn47TMddrpbIVAlHmxNDUhCOuD96yYPxoD3Nux6bw_lWLPcxOWS1nKXBMsVTWlhtFfpAt1y9QWSAyy5RidzzCVA4tWiuZ5MWhdcNFiaRdPBVESy_wAvETr4t3o1-rg4ItTDe-zfNyo0Fgrs64NiHSw-7HqQ3EJRlI3uB0c8OH1-E Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1ee0b85705f9486bab03c6838ca854e2"}]}] Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8780d01172e44f1bb1aa9a836466fde9 Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 could not be found. Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '366cd5f6-ff82-4251-bf8b-c6d480c24e75'} Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 could not be found. Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 could not be found. Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:18.802852 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 could not be found. Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Returning 404 to user: Instance 366cd5f6-ff82-4251-bf8b-c6d480c24e75 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28882263-f172-4b05-b9b0-1ed07a09aace tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75" status: 404 len: 111 microversion: 2.1 time: 0.033242 Sep 19 15:52:18.807937 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3311/6663] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:18 2022] GET /compute/v2.1/servers/366cd5f6-ff82-4251-bf8b-c6d480c24e75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:52:18.814086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67906410-8f26-416a-a6cb-db0d62b03e48 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '.version_select at 0x7fde28bb21f0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:18.832742 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67906410-8f26-416a-a6cb-db0d62b03e48 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-436297225" status: 202 len: 0 microversion: 2.1 time: 0.022960 Sep 19 15:52:18.833304 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3353/6664] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 15:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-436297225 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:52:18.850571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b74cd88-d633-45e1-9618-30610e89979c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: .version_select at 0x7fde290dc5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1447838304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs+i0meOZ+vy3N5Yqjn4rPbYnGH/btJNcz05SKXhr2tKhh7dd4ULE8lH0iICTco/CoIELlriv5bJnr6U8YzZApEmcQkZFGK6Rl9nHYbgo7CB5QjL8SiVU9EPo6nsOqugA=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:18.866427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b74cd88-d633-45e1-9618-30610e89979c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:52:18.875510 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b74cd88-d633-45e1-9618-30610e89979c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for user 8780d01172e44f1bb1aa9a836466fde9 and project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:52:18.898420 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b74cd88-d633-45e1-9618-30610e89979c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051725 Sep 19 15:52:18.899057 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3312/6665] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:52:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:18.949669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-79060845", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1447838304", "networks": [{"uuid": "17c4026d-aff7-4a68-91dc-e1ea40ac3406"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:19.003310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] validate_networks() for [('17c4026d-aff7-4a68-91dc-e1ea40ac3406', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:52:19.375903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:52:19.376492 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:52:19.376799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:52:19.377238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:52:19.377657 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:52:19.386456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:19.386988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:19.387498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:19.388237 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:19.388697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:19.389126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:19.410385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:52:19.415735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for user 8780d01172e44f1bb1aa9a836466fde9 and project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:52:19.428671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:52:19.431152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:52:19.480227 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-910fbcd3-cbb8-49a4-a82c-cea0b6e09b5f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534455 Sep 19 15:52:19.481016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3354/6666] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:52:19.492908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8611d46d-7c71-4003-aa59-e2bb8b38fa9f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:19.493862 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8611d46d-7c71-4003-aa59-e2bb8b38fa9f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:19.551403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8611d46d-7c71-4003-aa59-e2bb8b38fa9f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:19.559061 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8611d46d-7c71-4003-aa59-e2bb8b38fa9f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1261 microversion: 2.1 time: 0.070209 Sep 19 15:52:19.559760 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3313/6667] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:19 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:20.583555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:20.584250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:20.591631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:20.592486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:20.593005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:20.593788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:20.594551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:20.595313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:20.675077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:20.684718 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d4375bbd-82bf-438c-a27f-726655addbfb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1319 microversion: 2.1 time: 0.106379 Sep 19 15:52:20.685462 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3355/6668] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:20 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:21.708852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:21.709594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:21.716977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:21.717489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:21.717946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:21.718661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:21.719165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:21.719615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:21.928250 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:21.936406 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8efced65-d911-4a5f-8a25-4a7b01fb41fb tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1361 microversion: 2.1 time: 0.231707 Sep 19 15:52:21.937013 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3314/6669] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:21 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:21.986171 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7ed2f3de-1d48-4697-8da3-b1536712d166 req-a9776c81-9015-4c9b-a6cf-f8ce77763b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14a9a3f-c979-4446-a1ed-51ae05bf77a9", "tag": "4bd8c174-6d18-45a7-87e7-4a823c1c83fb"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:22.001936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7ed2f3de-1d48-4697-8da3-b1536712d166 req-a9776c81-9015-4c9b-a6cf-f8ce77763b55 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:22.002585 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7ed2f3de-1d48-4697-8da3-b1536712d166 req-a9776c81-9015-4c9b-a6cf-f8ce77763b55 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:22.003163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7ed2f3de-1d48-4697-8da3-b1536712d166 req-a9776c81-9015-4c9b-a6cf-f8ce77763b55 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:22.017383 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7ed2f3de-1d48-4697-8da3-b1536712d166 req-a9776c81-9015-4c9b-a6cf-f8ce77763b55 service nova] Creating event network-changed:4bd8c174-6d18-45a7-87e7-4a823c1c83fb for instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 on n-h1-858384-1 Sep 19 15:52:22.023055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7ed2f3de-1d48-4697-8da3-b1536712d166 req-a9776c81-9015-4c9b-a6cf-f8ce77763b55 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040766 Sep 19 15:52:22.023674 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3356/6670] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:22.960723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:22.961356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:22.968340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:22.968836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:22.969289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:22.969995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:22.970464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:22.970947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:23.100242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:23.109110 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6afff125-7f75-47df-982a-1aa8703bae6b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1361 microversion: 2.1 time: 0.152094 Sep 19 15:52:23.109701 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3315/6671] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:22 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:52:24.132354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:24.133060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:24.140723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:24.141210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:24.141652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:24.142348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:24.142827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:24.143261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:24.275456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:24.283251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-92093e07-53b6-4295-824c-b649f80fa30b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1361 microversion: 2.1 time: 0.155203 Sep 19 15:52:24.283826 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3357/6672] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:24 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:25.306105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:25.306770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:25.313988 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:25.314495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:25.314989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:25.315699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:25.316174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:25.316635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:25.447566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:25.456222 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5849f8c4-7d56-49d5-9e93-6f299151babe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1361 microversion: 2.1 time: 0.154111 Sep 19 15:52:25.456799 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3316/6673] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:25 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:26.479092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:26.479704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:26.486828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:26.487312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:26.487754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:26.488440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:26.488890 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:26.489310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:26.619811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:26.628056 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7bcd3ab3-cae5-4bc1-ae69-f680e578cedd tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1361 microversion: 2.1 time: 0.152978 Sep 19 15:52:26.628624 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3358/6674] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:26 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:27.357704 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-06462936-62c8-4910-b821-53a61b85d9f4 req-687e4481-0f13-401c-9064-47dda49dad52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14a9a3f-c979-4446-a1ed-51ae05bf77a9", "name": "network-vif-plugged", "status": "completed", "tag": "4bd8c174-6d18-45a7-87e7-4a823c1c83fb"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:27.368879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06462936-62c8-4910-b821-53a61b85d9f4 req-687e4481-0f13-401c-9064-47dda49dad52 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:27.369373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06462936-62c8-4910-b821-53a61b85d9f4 req-687e4481-0f13-401c-9064-47dda49dad52 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:27.369817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-06462936-62c8-4910-b821-53a61b85d9f4 req-687e4481-0f13-401c-9064-47dda49dad52 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:27.382290 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-06462936-62c8-4910-b821-53a61b85d9f4 req-687e4481-0f13-401c-9064-47dda49dad52 service nova] Creating event network-vif-plugged:4bd8c174-6d18-45a7-87e7-4a823c1c83fb for instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 on n-h1-858384-1 Sep 19 15:52:27.387525 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-06462936-62c8-4910-b821-53a61b85d9f4 req-687e4481-0f13-401c-9064-47dda49dad52 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096971 Sep 19 15:52:27.388299 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3317/6675] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:27.650985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:27.651571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:27.658466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:27.659005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:27.659454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:27.660157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:27.660620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:27.661048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:27.788233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:27.796289 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68ed04b2-69c4-4636-9283-c348eb77379d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1361 microversion: 2.1 time: 0.149447 Sep 19 15:52:27.796864 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3359/6676] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:27 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:28.822449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:28.823121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:28.829878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:28.830378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:28.830861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:28.831581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:28.832086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:28.832530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:28.964027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:28.972499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4fc718ee-29fb-4e9c-bdef-e2632469cd13 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1553 microversion: 2.1 time: 0.155442 Sep 19 15:52:28.973080 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3318/6677] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:28 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:28.995917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:28.996623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:29.002702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:29.003240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:29.003676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:29.004358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:29.004836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:29.005260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:29.132776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:29.141214 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1995e44e-4372-4217-8b2c-6d72f7f7ed80 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1553 microversion: 2.1 time: 0.149345 Sep 19 15:52:29.141784 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3360/6678] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:28 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:30.639375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4a616a8-4890-4312-98d3-2a5d2c62929f"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:30.641874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:30.643891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:30.650146 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:30.650659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:30.651144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:30.651856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:30.652335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:30.653000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:30.891044 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a39d7030-9358-4695-ab77-5e2e64b2b452 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256058 Sep 19 15:52:30.891751 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3319/6679] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:52:30 2022] POST /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:41.612248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:41.612754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:41.615789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:41.616442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:41.618457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:41.619290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=66 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:41.625513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:41.625998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:41.626459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:41.627177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:41.627633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:41.628063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:41.716625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lazy-loading 'services' on Instance uuid e14a9a3f-c979-4446-a1ed-51ae05bf77a9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:52:41.788797 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b351fb09-03f2-4932-a3a0-475d752e2317 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments/c4a616a8-4890-4312-98d3-2a5d2c62929f" status: 202 len: 0 microversion: 2.1 time: 0.180398 Sep 19 15:52:41.789438 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3361/6680] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:52:41 2022] DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments/c4a616a8-4890-4312-98d3-2a5d2c62929f => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:52:41.796719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:41.797564 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:41.802066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:41.804429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:41.812836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:41.813351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:41.813812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:41.814658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:41.815169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:41.815621 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:41.850694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e98b467-21a8-4ca8-8156-13e18abbef7f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056638 Sep 19 15:52:41.851307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3320/6681] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:41 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:42.867813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:42.871757 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:42.880811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:42.881344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:42.881809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:42.882562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:42.883396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:42.884127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:42.920126 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b70a43a9-725a-4ca8-a777-fa6f82f2fb70 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060046 Sep 19 15:52:42.921189 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3362/6682] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:42 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:43.933490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:43.935829 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:43.943018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:43.943538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:43.943996 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:43.944728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:43.945208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:43.945655 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:43.978668 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2918adb9-10bb-456c-ba11-7f0d3189e148 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049642 Sep 19 15:52:43.979283 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3321/6683] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:43 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:44.991663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:44.993931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:45.001667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:45.002155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:45.002594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:45.003315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:45.003765 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:45.004190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:45.035702 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c921e7a3-e735-4530-a485-5a7bf9b621bc tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048116 Sep 19 15:52:45.036275 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3363/6684] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:44 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:46.047894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:46.050301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:46.057528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:46.058027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:46.058515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:46.059361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:46.059826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:46.060268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:46.091869 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4aed60c6-cf1e-435c-86df-408176f90aa1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Sep 19 15:52:46.092429 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3322/6685] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:46 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:47.104333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:47.107096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:47.114944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:47.115428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:47.115893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:47.116578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:47.117028 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:47.117451 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:47.148226 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-16810619-ba6a-43ae-881b-6650d046be63 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047985 Sep 19 15:52:47.148780 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3364/6686] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:47 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:52:47.159410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:47.159959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:47.166777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:47.167290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:47.167746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:47.168890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:47.169368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:47.169821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:47.247603 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] HTTP exception thrown: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 is not attached to volume c4a616a8-4890-4312-98d3-2a5d2c62929f Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Request method failure captured: Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments/c4a616a8-4890-4312-98d3-2a5d2c62929f HTTP/1.1 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJAKn47TMddrpbIVAlHmxNDUhCOuD96yYPxoD3Nux6bw_lWLPcxOWS1nKXBMsVTWlhtFfpAt1y9QWSAyy5RidzzCVA4tWiuZ5MWhdcNFiaRdPBVESy_wAvETr4t3o1-rg4ItTDe-zfNyo0Fgrs64NiHSw-7HqQ3EJRlI3uB0c8OH1-E Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1ee0b85705f9486bab03c6838ca854e2"}]}] Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8780d01172e44f1bb1aa9a836466fde9 Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 is not attached to volume c4a616a8-4890-4312-98d3-2a5d2c62929f Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': 'e14a9a3f-c979-4446-a1ed-51ae05bf77a9', 'id': 'c4a616a8-4890-4312-98d3-2a5d2c62929f'} Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c4a616a8-4890-4312-98d3-2a5d2c62929f. Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 is not attached to volume c4a616a8-4890-4312-98d3-2a5d2c62929f Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:47.249578 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 is not attached to volume c4a616a8-4890-4312-98d3-2a5d2c62929f Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Returning 404 to user: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 is not attached to volume c4a616a8-4890-4312-98d3-2a5d2c62929f {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1f3a667-dd15-4bd0-964e-273eb383baac tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments/c4a616a8-4890-4312-98d3-2a5d2c62929f" status: 404 len: 154 microversion: 2.1 time: 0.095699 Sep 19 15:52:47.253933 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3323/6687] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:52:47 2022] DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9/os-volume_attachments/c4a616a8-4890-4312-98d3-2a5d2c62929f => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:52:50.607206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:50.608350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:50.615648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:50.616150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:50.616589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:50.617298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:50.617751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:50.618174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:50.646239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:52:50.724322 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6713d4bb-5017-45b6-afc0-1016598e1e7a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 204 len: 0 microversion: 2.1 time: 0.120908 Sep 19 15:52:50.725655 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3365/6688] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:52:50 2022] DELETE /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:52:50.734406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:50.735150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:50.743628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:50.744140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:50.744598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:50.745310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:50.745783 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:50.746229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:50.883837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:50.892549 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e8e5f7a3-e3a0-4e41-bc06-f88712be4221 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1559 microversion: 2.1 time: 0.162372 Sep 19 15:52:50.893125 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3324/6689] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:50 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:52:51.916836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:51.917544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:51.925428 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:51.925907 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:51.926383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:51.927109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:51.927565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:51.927991 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:52.057713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:52.065699 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13ececbe-4629-4186-a96b-095138f2b949 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1559 microversion: 2.1 time: 0.153118 Sep 19 15:52:52.066272 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3366/6690] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:51 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:52:52.763521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b86b12a9-d791-4b21-b7be-a5db7a2d0cd6 req-a5b87912-96d1-41d4-bf2c-512396bbc7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14a9a3f-c979-4446-a1ed-51ae05bf77a9", "name": "network-vif-deleted", "tag": "4bd8c174-6d18-45a7-87e7-4a823c1c83fb"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:52.776060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b86b12a9-d791-4b21-b7be-a5db7a2d0cd6 req-a5b87912-96d1-41d4-bf2c-512396bbc7e2 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:52.776559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b86b12a9-d791-4b21-b7be-a5db7a2d0cd6 req-a5b87912-96d1-41d4-bf2c-512396bbc7e2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:52.777255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b86b12a9-d791-4b21-b7be-a5db7a2d0cd6 req-a5b87912-96d1-41d4-bf2c-512396bbc7e2 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:52.791928 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b86b12a9-d791-4b21-b7be-a5db7a2d0cd6 req-a5b87912-96d1-41d4-bf2c-512396bbc7e2 service nova] Creating event network-vif-deleted:4bd8c174-6d18-45a7-87e7-4a823c1c83fb for instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 on n-h1-858384-1 Sep 19 15:52:52.798500 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b86b12a9-d791-4b21-b7be-a5db7a2d0cd6 req-a5b87912-96d1-41d4-bf2c-512396bbc7e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039220 Sep 19 15:52:52.799167 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3325/6691] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:53.089568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:53.090935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:53.098382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:53.098912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:53.099358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:53.100054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:53.100514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:53.100943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:53.138201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:53.139394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:53.139841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:53.140299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lazy-loading 'fault' on Instance uuid e14a9a3f-c979-4446-a1ed-51ae05bf77a9 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:52:53.183204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:53.193789 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e99dc4e7-4d60-4625-a1a1-5522d2813afa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 200 len: 1351 microversion: 2.1 time: 0.108188 Sep 19 15:52:53.195177 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3367/6692] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:53 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:54.219594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:54.220317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: e14a9a3f-c979-4446-a1ed-51ae05bf77a9] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:54.226574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:54.227115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:54.227572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:54.228273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:54.228744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:54.229184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:54.246422 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] HTTP exception thrown: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 could not be found. Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Request method failure captured: Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 HTTP/1.1 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJAKn47TMddrpbIVAlHmxNDUhCOuD96yYPxoD3Nux6bw_lWLPcxOWS1nKXBMsVTWlhtFfpAt1y9QWSAyy5RidzzCVA4tWiuZ5MWhdcNFiaRdPBVESy_wAvETr4t3o1-rg4ItTDe-zfNyo0Fgrs64NiHSw-7HqQ3EJRlI3uB0c8OH1-E Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1ee0b85705f9486bab03c6838ca854e2"}]}] Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8780d01172e44f1bb1aa9a836466fde9 Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 could not be found. Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'e14a9a3f-c979-4446-a1ed-51ae05bf77a9'} Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 could not be found. Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 could not be found. Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:54.248379 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 could not be found. Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Returning 404 to user: Instance e14a9a3f-c979-4446-a1ed-51ae05bf77a9 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-98c78592-ab8d-43b7-9047-f66c8c8d272b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9" status: 404 len: 111 microversion: 2.1 time: 0.036066 Sep 19 15:52:54.252456 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3326/6693] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:54 2022] GET /compute/v2.1/servers/e14a9a3f-c979-4446-a1ed-51ae05bf77a9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:52:54.259424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3e5d363-36d3-496e-a620-0e958693826b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '.version_select at 0x7fde29e4a5e0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:54.283794 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3e5d363-36d3-496e-a620-0e958693826b tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1447838304" status: 202 len: 0 microversion: 2.1 time: 0.028409 Sep 19 15:52:54.284404 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3368/6694] 10.222.0.81 () {58 vars in 1278 bytes} [Mon Sep 19 15:52:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1447838304 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:52:54.300186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64f7a17f-6773-46af-a31f-ce3725027f2a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: .version_select at 0x7fde29259b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1364761298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdHULDjPV2RfDSBijCBvcNZqAN5fAqWZvzar9njN3PqUT6+YIsC13ST1ZxVVMHPLNxGBWViFDBTU9AJU6bZZgx5de9ZzG3nqQnAfPxMWkqOvAvGqXP9vuIRfLKtycurIg=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:54.318382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-64f7a17f-6773-46af-a31f-ce3725027f2a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:52:54.325381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-64f7a17f-6773-46af-a31f-ce3725027f2a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for user 8780d01172e44f1bb1aa9a836466fde9 and project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:52:54.351954 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64f7a17f-6773-46af-a31f-ce3725027f2a tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055885 Sep 19 15:52:54.352573 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3327/6695] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:52:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:54.405462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-491066721", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1364761298", "networks": [{"uuid": "17c4026d-aff7-4a68-91dc-e1ea40ac3406"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:54.459574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] validate_networks() for [('17c4026d-aff7-4a68-91dc-e1ea40ac3406', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:52:54.831269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:52:54.831736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:52:54.832219 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:52:54.832632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:52:54.833049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:52:54.842104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:54.842596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:54.843074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:54.843823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:54.844273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:54.844707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:54.862290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:52:54.867860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Getting quotas for user 8780d01172e44f1bb1aa9a836466fde9 and project 1ee0b85705f9486bab03c6838ca854e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:52:54.881038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:52:54.883381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:52:54.930259 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5d7cc64d-ff8c-4660-ab1d-a281a861764c tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529474 Sep 19 15:52:54.930960 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3369/6696] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:52:54.943359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-58b20472-2ec6-4ffa-bb4d-37b26228087f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:54.944093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-58b20472-2ec6-4ffa-bb4d-37b26228087f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:55.002631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-58b20472-2ec6-4ffa-bb4d-37b26228087f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:55.010633 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-58b20472-2ec6-4ffa-bb4d-37b26228087f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1262 microversion: 2.1 time: 0.071274 Sep 19 15:52:55.018791 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3328/6697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:54 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:56.034482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:56.035151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:56.042136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:56.042630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:56.043121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:56.043824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:56.044283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:56.044716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:56.115369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:56.123829 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a00bf9f4-e210-4de5-af98-e1e1f4a4c086 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1320 microversion: 2.1 time: 0.093397 Sep 19 15:52:56.124618 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3370/6698] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:56 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1320 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:57.147620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:57.148312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:57.156110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:57.156653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:57.157110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:57.157845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:57.158361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:57.158845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:57.285715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f2ee46c5-4ab3-496e-b4cf-2b01b6edbca1 req-f3968a9b-ecdd-4f5b-94f4-42b6b4cbbbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd5160c-e31e-40c7-944e-b787a18d5ffa", "tag": "134be03c-dc82-44bb-9c2a-7cc2e3050546"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:57.299812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f2ee46c5-4ab3-496e-b4cf-2b01b6edbca1 req-f3968a9b-ecdd-4f5b-94f4-42b6b4cbbbbf service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:57.300310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f2ee46c5-4ab3-496e-b4cf-2b01b6edbca1 req-f3968a9b-ecdd-4f5b-94f4-42b6b4cbbbbf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:57.300747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f2ee46c5-4ab3-496e-b4cf-2b01b6edbca1 req-f3968a9b-ecdd-4f5b-94f4-42b6b4cbbbbf service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:57.313281 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f2ee46c5-4ab3-496e-b4cf-2b01b6edbca1 req-f3968a9b-ecdd-4f5b-94f4-42b6b4cbbbbf service nova] Creating event network-changed:134be03c-dc82-44bb-9c2a-7cc2e3050546 for instance fbd5160c-e31e-40c7-944e-b787a18d5ffa on n-h1-858384-1 Sep 19 15:52:57.318623 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f2ee46c5-4ab3-496e-b4cf-2b01b6edbca1 req-f3968a9b-ecdd-4f5b-94f4-42b6b4cbbbbf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036605 Sep 19 15:52:57.319285 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3371/6699] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:52:57.709029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:57.717694 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7e82688c-d120-4492-badb-01de2f70db0e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.574038 Sep 19 15:52:57.718571 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3329/6700] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:57 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:58.743350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:58.744057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:58.750872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:58.751363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:58.751807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:58.752499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:58.752953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:58.753389 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:58.975373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:58.985555 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51dc7419-5cb3-4cf2-bf8a-3c13886eeebe tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.247235 Sep 19 15:52:58.986320 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3372/6701] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:58 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:00.014611 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:00.015274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:00.022195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:00.022702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:00.023187 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:00.023900 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:00.024376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:00.024822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:00.154923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:00.162616 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-11f81074-9998-457d-b67c-1eac3a92b016 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.152008 Sep 19 15:53:00.163222 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3330/6702] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:00 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:01.187135 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:01.187759 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:01.194705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:01.195228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:01.195675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:01.196375 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:01.196837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:01.197269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:01.330455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:01.338371 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cadd1caf-4e95-49f6-8368-533016e054a2 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.156281 Sep 19 15:53:01.338981 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3373/6703] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:01 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:02.362248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:02.362906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:02.369936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:02.370451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:02.370952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:02.371672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:02.372153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:02.372602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:02.504343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:02.512269 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-44b6297c-39ef-41bc-b281-c0d7be84d656 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.153895 Sep 19 15:53:02.513335 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3331/6704] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:02 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:03.470731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-22c6cb71-d83a-401d-bda1-794c9e72db8f req-f1e76268-0f67-4ac3-bab4-27ff1ef9d290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd5160c-e31e-40c7-944e-b787a18d5ffa", "name": "network-vif-plugged", "status": "completed", "tag": "134be03c-dc82-44bb-9c2a-7cc2e3050546"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:53:03.482093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22c6cb71-d83a-401d-bda1-794c9e72db8f req-f1e76268-0f67-4ac3-bab4-27ff1ef9d290 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:03.482578 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22c6cb71-d83a-401d-bda1-794c9e72db8f req-f1e76268-0f67-4ac3-bab4-27ff1ef9d290 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:03.483044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-22c6cb71-d83a-401d-bda1-794c9e72db8f req-f1e76268-0f67-4ac3-bab4-27ff1ef9d290 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:03.494280 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-22c6cb71-d83a-401d-bda1-794c9e72db8f req-f1e76268-0f67-4ac3-bab4-27ff1ef9d290 service nova] Creating event network-vif-plugged:134be03c-dc82-44bb-9c2a-7cc2e3050546 for instance fbd5160c-e31e-40c7-944e-b787a18d5ffa on n-h1-858384-1 Sep 19 15:53:03.499450 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-22c6cb71-d83a-401d-bda1-794c9e72db8f req-f1e76268-0f67-4ac3-bab4-27ff1ef9d290 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Sep 19 15:53:03.500058 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3374/6705] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:03.536152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:03.536768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:03.545166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:03.545720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:03.546183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:03.547063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:03.547549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:03.548005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:03.726159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:03.734590 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-044a309f-d690-4bc6-b53a-5e943c12e0fa tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.202511 Sep 19 15:53:03.735201 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3332/6706] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:03 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:04.759175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:04.759926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:04.766941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:04.767431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:04.767870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:04.768562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:04.769014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:04.769437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:04.852198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:04.875058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:04.906967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:04.914801 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d63df4c8-500d-4f73-b541-f2031656c80d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1362 microversion: 2.1 time: 0.160849 Sep 19 15:53:04.915390 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3375/6707] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:04 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:05.939227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:05.939850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:05.942642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:05.948226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:05.948730 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:05.949185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:05.949965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:05.950435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:05.950923 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:06.085567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:06.093931 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1bbcd189-79eb-4faa-840f-7fb1756392ca tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1553 microversion: 2.1 time: 0.158769 Sep 19 15:53:06.094492 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3333/6708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:05 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:06.117179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:06.117788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:06.125129 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:06.125611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:06.126046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:06.126730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:06.127209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:06.127631 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:06.257189 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:06.265617 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67bc96ab-0c64-48d9-902e-dde6fd9d05b9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1553 microversion: 2.1 time: 0.152303 Sep 19 15:53:06.266176 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3376/6709] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:06 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:07.755175 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fff92516-fa66-477e-a00c-eff19b103c00"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:53:07.757590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:07.764363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:07.764860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:07.765307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:07.766016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:07.766476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:07.766943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:08.005611 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b36dab47-c78f-442e-b963-ecba5b40edc6 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "POST /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254124 Sep 19 15:53:08.009203 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3334/6710] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:53:07 2022] POST /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:18.725446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:18.725956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:18.728826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:18.729493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:18.735459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:18.735950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:18.736392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:18.737088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:18.737546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:18.737976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:18.822197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lazy-loading 'services' on Instance uuid fbd5160c-e31e-40c7-944e-b787a18d5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:53:18.895062 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d35e3c21-0b3d-4868-b668-d25c1934756e tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments/fff92516-fa66-477e-a00c-eff19b103c00" status: 202 len: 0 microversion: 2.1 time: 0.173422 Sep 19 15:53:18.895654 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3377/6711] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:53:18 2022] DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments/fff92516-fa66-477e-a00c-eff19b103c00 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:53:18.905525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:18.907974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:18.912048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:18.912840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:18.918046 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:18.919352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:18.919925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:18.920636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:18.921107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:18.921577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:18.956497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-267e747d-7495-42fc-9a4d-2ff77592b3a9 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056150 Sep 19 15:53:18.957062 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3335/6712] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:18 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:19.971000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:19.973400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:19.979871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:19.980362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:19.980803 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:19.981502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:19.981986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:19.982416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:20.013469 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7718e0a-b814-4d05-ba67-fbdfd16a3361 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048466 Sep 19 15:53:20.014247 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3378/6713] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:19 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:21.025023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:21.027358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:21.035057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:21.035568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:21.036022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:21.036731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:21.037200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:21.037641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:21.069403 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8950c3b-c055-4893-8e9e-bc0ac1262810 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048351 Sep 19 15:53:21.069983 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3336/6714] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:21 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:22.082020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:22.084210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:22.091764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:22.092254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:22.092696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:22.093396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:22.093882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:22.094313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:22.124353 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eed8604f-f801-44d0-b320-bf58539691ec tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046503 Sep 19 15:53:22.124925 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3379/6715] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:22 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:23.137346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:23.139646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:23.146560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:23.147111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:23.147572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:23.148292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:23.148772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:23.149223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:23.181430 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-54dedbaf-59d8-4706-9750-55b8d9647b12 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048203 Sep 19 15:53:23.182249 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3337/6716] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:23 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:24.193571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:24.195924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:24.204893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:24.205377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:24.205810 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:24.206499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:24.206983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:24.207407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:24.239268 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-05382f4b-8e7b-465e-a563-4691b9b77c8f tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049643 Sep 19 15:53:24.239820 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3380/6717] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:24 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:53:24.251305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:24.251830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:24.258538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:24.259077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:24.259533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:24.260231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:24.260702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:24.261141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:24.337698 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] HTTP exception thrown: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa is not attached to volume fff92516-fa66-477e-a00c-eff19b103c00 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Request method failure captured: Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: request: DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments/fff92516-fa66-477e-a00c-eff19b103c00 HTTP/1.1 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJAKn47TMddrpbIVAlHmxNDUhCOuD96yYPxoD3Nux6bw_lWLPcxOWS1nKXBMsVTWlhtFfpAt1y9QWSAyy5RidzzCVA4tWiuZ5MWhdcNFiaRdPBVESy_wAvETr4t3o1-rg4ItTDe-zfNyo0Fgrs64NiHSw-7HqQ3EJRlI3uB0c8OH1-E Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1ee0b85705f9486bab03c6838ca854e2"}]}] Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8780d01172e44f1bb1aa9a836466fde9 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa is not attached to volume fff92516-fa66-477e-a00c-eff19b103c00 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'server_id': 'fbd5160c-e31e-40c7-944e-b787a18d5ffa', 'id': 'fff92516-fa66-477e-a00c-eff19b103c00'} Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fff92516-fa66-477e-a00c-eff19b103c00. Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa is not attached to volume fff92516-fa66-477e-a00c-eff19b103c00 Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:24.339346 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa is not attached to volume fff92516-fa66-477e-a00c-eff19b103c00 Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Returning 404 to user: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa is not attached to volume fff92516-fa66-477e-a00c-eff19b103c00 {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-229dcfae-2914-48f9-aafa-51329c1f3fd1 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments/fff92516-fa66-477e-a00c-eff19b103c00" status: 404 len: 154 microversion: 2.1 time: 0.094759 Sep 19 15:53:24.343935 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3338/6718] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:53:24 2022] DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa/os-volume_attachments/fff92516-fa66-477e-a00c-eff19b103c00 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:53:27.697093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:27.697645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:27.705548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:27.706046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:27.706506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:27.707231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:27.707687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:27.708114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:27.735938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:53:27.816294 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5933b780-a04c-475d-815c-47c42c4314da tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 204 len: 0 microversion: 2.1 time: 0.122877 Sep 19 15:53:27.817141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3381/6719] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:53:27 2022] DELETE /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:53:27.826727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:27.827626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:27.834380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:27.835007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:27.835557 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:27.836273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:27.836749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:27.837189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:27.975441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:27.984357 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c343f810-68cd-4d4e-9362-74bd50f8c653 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1559 microversion: 2.1 time: 0.162497 Sep 19 15:53:27.985233 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3339/6720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:27 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:53:29.009159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:29.009863 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:29.016796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:29.017279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:29.017715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:29.018395 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:29.018882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:29.019307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:29.151760 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:29.159916 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a74faed3-c436-4aa6-91dd-356f1a445991 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1559 microversion: 2.1 time: 0.155349 Sep 19 15:53:29.160499 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3382/6721] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:29 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:29.810329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b85279a9-9b3b-47e9-bd5d-a97e40db6fe0 req-ac5ac88f-0cca-486e-80e7-bde4422baa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd5160c-e31e-40c7-944e-b787a18d5ffa", "name": "network-vif-deleted", "tag": "134be03c-dc82-44bb-9c2a-7cc2e3050546"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:53:29.821408 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b85279a9-9b3b-47e9-bd5d-a97e40db6fe0 req-ac5ac88f-0cca-486e-80e7-bde4422baa19 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:29.821915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b85279a9-9b3b-47e9-bd5d-a97e40db6fe0 req-ac5ac88f-0cca-486e-80e7-bde4422baa19 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:29.822370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b85279a9-9b3b-47e9-bd5d-a97e40db6fe0 req-ac5ac88f-0cca-486e-80e7-bde4422baa19 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:29.837077 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b85279a9-9b3b-47e9-bd5d-a97e40db6fe0 req-ac5ac88f-0cca-486e-80e7-bde4422baa19 service nova] Creating event network-vif-deleted:134be03c-dc82-44bb-9c2a-7cc2e3050546 for instance fbd5160c-e31e-40c7-944e-b787a18d5ffa on n-h1-858384-1 Sep 19 15:53:29.842721 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b85279a9-9b3b-47e9-bd5d-a97e40db6fe0 req-ac5ac88f-0cca-486e-80e7-bde4422baa19 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036680 Sep 19 15:53:29.843368 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3340/6722] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:30.183885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:30.184697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:30.191918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:30.192414 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:30.192856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:30.193568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:30.194127 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:30.194561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:30.228415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:30.228903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:30.229351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:30.229798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lazy-loading 'fault' on Instance uuid fbd5160c-e31e-40c7-944e-b787a18d5ffa {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:53:30.273119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8780d01172e44f1bb1aa9a836466fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0b85705f9486bab03c6838ca854e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:30.281353 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7931871-260a-4156-8c4e-688fc68a243d tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 200 len: 1352 microversion: 2.1 time: 0.101694 Sep 19 15:53:30.281936 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3383/6723] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:30 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:31.307016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:31.307646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] [instance: fbd5160c-e31e-40c7-944e-b787a18d5ffa] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:31.314701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:31.315237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:31.315690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:31.316392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:31.316865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:31.317306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:31.331431 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] HTTP exception thrown: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa could not be found. Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Request method failure captured: Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa HTTP/1.1 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJAKn47TMddrpbIVAlHmxNDUhCOuD96yYPxoD3Nux6bw_lWLPcxOWS1nKXBMsVTWlhtFfpAt1y9QWSAyy5RidzzCVA4tWiuZ5MWhdcNFiaRdPBVESy_wAvETr4t3o1-rg4ItTDe-zfNyo0Fgrs64NiHSw-7HqQ3EJRlI3uB0c8OH1-E Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1ee0b85705f9486bab03c6838ca854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1ee0b85705f9486bab03c6838ca854e2"}]}] Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 1ee0b85705f9486bab03c6838ca854e2 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1822991084 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: 8780d01172e44f1bb1aa9a836466fde9 Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestEncryptedCinderVolumes-1822991084-project Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa could not be found. Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'fbd5160c-e31e-40c7-944e-b787a18d5ffa'} Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa could not be found. Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa could not be found. Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:31.333079 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa could not be found. Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Returning 404 to user: Instance fbd5160c-e31e-40c7-944e-b787a18d5ffa could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0088fffe-a60a-48e5-a76b-cea41bb82505 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa" status: 404 len: 111 microversion: 2.1 time: 0.032769 Sep 19 15:53:31.338275 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3341/6724] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:31 2022] GET /compute/v2.1/servers/fbd5160c-e31e-40c7-944e-b787a18d5ffa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:53:31.343953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e835576e-c5e0-43ff-ae84-a425a9111b08 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] Calling method '.version_select at 0x7fde29e4aaf0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:31.364486 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e835576e-c5e0-43ff-ae84-a425a9111b08 tempest-TestEncryptedCinderVolumes-1822991084 tempest-TestEncryptedCinderVolumes-1822991084-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1364761298" status: 202 len: 0 microversion: 2.1 time: 0.025069 Sep 19 15:53:31.365053 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3384/6725] 10.222.0.81 () {58 vars in 1278 bytes} [Mon Sep 19 15:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1364761298 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:53:58.514808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cbfc8953-6861-4b68-97cc-98144e49e341 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'create', calling method: .version_select at 0x7fde298aa0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1787565542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa65DByLjV44lXOCC0QbqFTPDQkPmzTcJo2MXq4qOG9jKuwXFo60IwYY5LarxUsL8WbV0beW4X/YLcx+tZqcCA3V/auOS/j45elHxcvA84qADDsT4iG+gzfCKRb9quEmQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:53:58.520776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=14 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:58.521441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=34 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:58.534433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-cbfc8953-6861-4b68-97cc-98144e49e341 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for project 23867509a97e4539959f7357c320628c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:53:58.539539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-cbfc8953-6861-4b68-97cc-98144e49e341 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for user 86c452841a7a4bdb8649f9f9c870e2b1 and project 23867509a97e4539959f7357c320628c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:53:58.563170 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cbfc8953-6861-4b68-97cc-98144e49e341 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053179 Sep 19 15:53:58.563770 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3342/6726] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:53:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:58.613280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:58.614134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:58.618193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-839707145", "imageRef": "7a9cac7a-04bb-4828-8180-37b66bc6dc96", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1787565542", "networks": [{"uuid": "638eea12-bd82-4757-9b6b-27f82b0e2d8e"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:53:58.673756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] validate_networks() for [('638eea12-bd82-4757-9b6b-27f82b0e2d8e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:53:59.055438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:53:59.055859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:53:59.056342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:53:59.056799 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:53:59.057500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:53:59.069298 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:59.069782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:59.070214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:59.070965 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:59.071418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:59.071838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:59.097834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for project 23867509a97e4539959f7357c320628c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:53:59.098683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for user 86c452841a7a4bdb8649f9f9c870e2b1 and project 23867509a97e4539959f7357c320628c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:53:59.112326 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:53:59.114615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a9cac7a-04bb-4828-8180-37b66bc6dc96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:53:59.160993 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-658ec272-23bc-4e36-9a77-52615132fda9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549489 Sep 19 15:53:59.161647 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3385/6727] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:53:59.173359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-67874891-5100-46be-958d-6f84a5097ff2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:59.174050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-67874891-5100-46be-958d-6f84a5097ff2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:59.229128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67874891-5100-46be-958d-6f84a5097ff2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:59.237352 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-67874891-5100-46be-958d-6f84a5097ff2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1258 microversion: 2.1 time: 0.068001 Sep 19 15:53:59.237928 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3343/6728] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:59 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:00.261741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:00.262351 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:00.270075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:00.270588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:00.271058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:00.271859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:00.272311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:00.272735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:00.348533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:00.357651 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-468573ea-adf3-42d4-81eb-c097c2783065 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1316 microversion: 2.1 time: 0.100866 Sep 19 15:54:00.358093 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3386/6729] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:00 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1316 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:01.381671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:01.382444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:01.391357 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:01.391971 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:01.392539 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:01.393318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:01.393907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:01.394464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:01.553284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:01.562018 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5a3536d3-1d8f-43bc-87a1-14382dda6ae2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.185642 Sep 19 15:54:01.574987 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3344/6730] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:01 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:02.585669 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:02.586252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:02.593593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:02.594069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:02.594503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:02.595239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:02.595689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:02.596113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:02.754046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:02.762393 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2bba3d35-ab06-452b-86ca-ebe2fde7e830 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.180735 Sep 19 15:54:02.763004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3387/6731] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:02 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:03.794261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:03.800664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:03.809526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:03.810374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:03.811173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:03.812235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:03.812879 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:03.813507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:03.989042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:03.997641 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d03492da-6871-4c37-b99d-33c182062015 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.210177 Sep 19 15:54:03.998247 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3345/6732] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:03 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:05.021595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:05.022211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:05.029928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:05.030384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:05.030861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:05.031566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:05.032013 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:05.032622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:05.177271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:05.187497 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7605b40d-02a8-4e20-b3fd-e3af4cec5952 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.169756 Sep 19 15:54:05.203500 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3388/6733] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:05 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:06.216317 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:06.217765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:06.226702 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:06.227325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:06.227877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:06.229465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:06.229930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:06.230561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:06.377972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:06.387171 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dfa06c59-d395-43ee-9013-380e93ff28da tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.178664 Sep 19 15:54:06.387769 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3346/6734] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:06 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:07.409587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:07.410182 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:07.417617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:07.418105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:07.418542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:07.419268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:07.419727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:07.420154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:07.570243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:07.580768 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6ef68e2c-2c27-4016-bdc9-d023493f75eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.174993 Sep 19 15:54:07.581451 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3389/6735] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:07 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:08.605423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:08.606051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:08.613428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:08.613931 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:08.614384 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:08.615129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:08.615607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:08.616052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:08.805448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:08.815377 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f692f61-e722-42c9-a5d1-c798c1b57c98 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.214635 Sep 19 15:54:08.816339 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3347/6736] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:08 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:09.439549 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-861fc0e3-5457-4e4a-9100-dc83aaaa3f42 req-a7513c0a-6583-424f-b82b-d6caf6f26edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:54:09.452678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:09.453455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:09.464340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-861fc0e3-5457-4e4a-9100-dc83aaaa3f42 req-a7513c0a-6583-424f-b82b-d6caf6f26edc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:09.464969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-861fc0e3-5457-4e4a-9100-dc83aaaa3f42 req-a7513c0a-6583-424f-b82b-d6caf6f26edc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:09.465496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-861fc0e3-5457-4e4a-9100-dc83aaaa3f42 req-a7513c0a-6583-424f-b82b-d6caf6f26edc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:09.477340 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-861fc0e3-5457-4e4a-9100-dc83aaaa3f42 req-a7513c0a-6583-424f-b82b-d6caf6f26edc service nova] Creating event network-changed:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:54:09.483073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-861fc0e3-5457-4e4a-9100-dc83aaaa3f42 req-a7513c0a-6583-424f-b82b-d6caf6f26edc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050316 Sep 19 15:54:09.483783 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3390/6737] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:54:09.839348 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:09.840018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:09.843082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:09.849048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:09.849563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:09.850023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:09.850771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:09.851256 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:09.851708 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:09.988170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:09.996185 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de7a273f-6d2a-4111-a2bc-8dd8df732623 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.160844 Sep 19 15:54:09.996780 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3348/6738] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:09 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:11.019140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:11.019898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:11.027754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:11.028260 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:11.028712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:11.029419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:11.029885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:11.030317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:11.207228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:11.215711 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35e87902-b335-4c63-aefb-e68d2f475486 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.201010 Sep 19 15:54:11.216280 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3391/6739] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:11 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:12.238775 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:12.239399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:12.246686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:12.247228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:12.247677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:12.248391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:12.249095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:12.249546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:12.380053 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:12.387843 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0e019cc4-078d-45d9-8426-d7343505ddca tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.153046 Sep 19 15:54:12.388430 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3349/6740] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:12 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:13.411104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:13.411735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:13.419150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:13.419630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:13.420088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:13.420753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:13.421201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:13.421656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:13.552261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:13.560855 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-48544383-7f43-417e-b008-f1b2a15395d0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.153851 Sep 19 15:54:13.561432 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3392/6741] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:13 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:14.583853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:14.584485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:14.591547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:14.592057 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:14.592519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:14.593229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:14.593706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:14.594186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:14.724728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:14.732499 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-41a8ddbe-64d8-4b74-9c3f-ef052883cb15 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.152634 Sep 19 15:54:14.733085 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3350/6742] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:14 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:15.756515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:15.757120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:15.763979 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:15.764472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:15.764911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:15.765612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:15.766069 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:15.766500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:15.783765 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b680c4f8-899d-4483-b4fd-65cd57003f70 req-f3e31dbf-96d9-4218-ab39-7af7c526b303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "name": "network-vif-plugged", "status": "completed", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:54:15.796207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b680c4f8-899d-4483-b4fd-65cd57003f70 req-f3e31dbf-96d9-4218-ab39-7af7c526b303 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:15.796812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b680c4f8-899d-4483-b4fd-65cd57003f70 req-f3e31dbf-96d9-4218-ab39-7af7c526b303 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:15.797325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b680c4f8-899d-4483-b4fd-65cd57003f70 req-f3e31dbf-96d9-4218-ab39-7af7c526b303 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:15.810695 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b680c4f8-899d-4483-b4fd-65cd57003f70 req-f3e31dbf-96d9-4218-ab39-7af7c526b303 service nova] Creating event network-vif-plugged:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:54:15.816814 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b680c4f8-899d-4483-b4fd-65cd57003f70 req-f3e31dbf-96d9-4218-ab39-7af7c526b303 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Sep 19 15:54:15.817857 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3351/6743] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:54:15.939038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:15.947109 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82ad9b90-c565-4bd6-9e12-4930bc892285 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.194698 Sep 19 15:54:15.947706 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3393/6744] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:15 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:16.971047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:16.971797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:16.978055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:16.978560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:16.979049 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:16.979752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:16.980226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:16.980672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:17.123871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:17.131790 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d2460683-627b-466d-84c7-70b09a222f0f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1358 microversion: 2.1 time: 0.166055 Sep 19 15:54:17.132363 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3352/6745] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:16 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:18.155439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:18.155967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:18.162797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.163288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.163728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.164423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.164879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.165347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.294097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:18.301870 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d6a1abb-ffd4-45ea-bc75-07abcd1aa009 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1549 microversion: 2.1 time: 0.150445 Sep 19 15:54:18.302442 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3394/6746] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:18 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:18.324436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:18.325064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:18.332056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.332552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.333003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.333701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.334166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.334601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.466217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:18.473955 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8f1f5b08-2465-491f-af21-21bb9cdeb730 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1549 microversion: 2.1 time: 0.153861 Sep 19 15:54:18.474526 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3353/6747] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:18 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:18.496646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:18.501491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:18.502269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Searching by: {'deleted': False, 'project_id': '23867509a97e4539959f7357c320628c'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 15:54:18.507872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.508381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.508867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.509609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.510073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.510510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.534671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 15:54:18.561552 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7595d020-1312-4959-8cb2-e93d1c463a36 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069007 Sep 19 15:54:18.562133 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3395/6748] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 15:54:18 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:54:18.574206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:18.574865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:18.580856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.581362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.581817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.582522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:18.583031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:18.583480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:18.710405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:18.718794 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6503be6d-99b0-43d8-999b-12209c2ea9f3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1549 microversion: 2.1 time: 0.148961 Sep 19 15:54:18.719379 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3354/6749] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:18 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:20.261241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8383c12f-cc75-47ae-a8b0-2874cd898bd1"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:54:20.263676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:20.270566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:20.271093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:20.271536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:20.272228 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:20.272685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:20.273114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:20.522251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8d2033be-226d-461a-a0e6-303e9ec2cfe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264604 Sep 19 15:54:20.522892 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3396/6750] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:54:20 2022] POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:54:33.568581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:33.569207 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:33.572911 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:54:33.573047 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:54:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b (ip 10.222.0.81) !!! Sep 19 15:54:33.574857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:33.575587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=62 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:33.587922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:33.588521 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:33.588969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:33.589674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:33.590140 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:33.590579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:33.725694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:33.735076 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8295ff32-f969-4c66-b746-33749f48c3b6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1595 microversion: 2.1 time: 0.170479 Sep 19 15:54:33.735669 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3355/6751] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:33 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:35.720562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2a30646b-4df4-4c2b-baad-33eaa061b578 req-a419f1cb-8eda-4e7f-a2a6-5e4bcdc4821e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:54:35.731997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:35.732924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:35.733592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:35.744719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a30646b-4df4-4c2b-baad-33eaa061b578 req-a419f1cb-8eda-4e7f-a2a6-5e4bcdc4821e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:35.745179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a30646b-4df4-4c2b-baad-33eaa061b578 req-a419f1cb-8eda-4e7f-a2a6-5e4bcdc4821e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:35.745619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2a30646b-4df4-4c2b-baad-33eaa061b578 req-a419f1cb-8eda-4e7f-a2a6-5e4bcdc4821e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:35.760438 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2a30646b-4df4-4c2b-baad-33eaa061b578 req-a419f1cb-8eda-4e7f-a2a6-5e4bcdc4821e service nova] Creating event network-changed:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:54:35.765760 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2a30646b-4df4-4c2b-baad-33eaa061b578 req-a419f1cb-8eda-4e7f-a2a6-5e4bcdc4821e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049233 Sep 19 15:54:35.770552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3397/6752] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:54:36.852774 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1050265143"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:54:36.853329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:36.860439 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:36.861004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:36.861464 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:36.862200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:36.862674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:36.863144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:36.993550 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Adding security group d50433de-9bbd-4745-9aeb-0b835e674219 to port c1e838e5-f749-449c-b922-e4b7f087ed6d Sep 19 15:54:37.304538 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5e2e00a7-8de2-4bcf-a5f0-bc9ae76505be tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action" status: 202 len: 0 microversion: 2.1 time: 0.457120 Sep 19 15:54:37.305289 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3356/6753] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:54:36 2022] POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:54:37.314383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:54:37.315238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:54:37.323327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:37.323826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:37.324267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:37.324969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:37.325460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:37.325894 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:37.494134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:54:37.502700 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fdd03970-a118-4d6b-8eb9-203443c40b70 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1759 microversion: 2.1 time: 0.192684 Sep 19 15:54:37.503310 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3398/6754] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:54:37 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1759 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:54:37.787751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f6f27cfd-8130-40b4-9152-3b53e0ea7022 req-c1f90a9f-b1c6-49e8-a872-c4343641ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:54:37.798392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f6f27cfd-8130-40b4-9152-3b53e0ea7022 req-c1f90a9f-b1c6-49e8-a872-c4343641ec5c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:54:37.798915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f6f27cfd-8130-40b4-9152-3b53e0ea7022 req-c1f90a9f-b1c6-49e8-a872-c4343641ec5c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:54:37.799363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f6f27cfd-8130-40b4-9152-3b53e0ea7022 req-c1f90a9f-b1c6-49e8-a872-c4343641ec5c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:54:37.811850 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f6f27cfd-8130-40b4-9152-3b53e0ea7022 req-c1f90a9f-b1c6-49e8-a872-c4343641ec5c service nova] Creating event network-changed:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:54:37.817147 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f6f27cfd-8130-40b4-9152-3b53e0ea7022 req-c1f90a9f-b1c6-49e8-a872-c4343641ec5c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034268 Sep 19 15:54:37.817744 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3357/6755] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:56:14.844501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:56:14.845242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:56:14.847649 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 15:56:14.847977 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action (ip 10.222.0.81) !!! Sep 19 15:56:14.859306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:56:14.862353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:56:14.870289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:56:14.870801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:56:14.871240 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:56:14.871927 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:56:14.872380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:56:14.872796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:56:14.947649 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad549218-3a54-4dba-aec9-49957fa04a64 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action" status: 202 len: 0 microversion: 2.1 time: 0.104883 Sep 19 15:56:14.948288 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3399/6756] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:56:14 2022] POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:56:14.955932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:56:14.956695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:56:14.962169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:56:14.962932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:56:14.971067 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:56:14.971752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:56:14.972213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:56:14.972927 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:56:14.973402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:56:14.973847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:56:15.387341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:56:15.396561 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1953421e-ffe3-41aa-956b-21938780c7fd tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1761 microversion: 2.1 time: 0.443668 Sep 19 15:56:15.397158 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3358/6757] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:56:14 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1761 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:56:16.422016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:56:16.422713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:56:16.429413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:56:16.429895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:56:16.430331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:56:16.431040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:56:16.431497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:56:16.431916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:56:16.636270 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:56:16.645462 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3c9bfc83-68d6-4fb4-8308-92e407b5e672 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1759 microversion: 2.1 time: 0.228800 Sep 19 15:56:16.646026 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3400/6758] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:56:16 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1759 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:29.359420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:57:29.360239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:57:29.364752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1050265143"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:57:29.365337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:29.372588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:29.373104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:29.373559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:29.374293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:29.374794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:29.375245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:29.508505 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Removing security group d50433de-9bbd-4745-9aeb-0b835e674219 from port c1e838e5-f749-449c-b922-e4b7f087ed6d Sep 19 15:57:29.845154 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-202138ef-8130-4165-9e0b-8b9ae3ca9502 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action" status: 202 len: 0 microversion: 2.1 time: 0.487057 Sep 19 15:57:29.845616 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3359/6759] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:57:29 2022] POST /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:57:29.854886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:57:29.859801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:57:29.989458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-55b82f87-1354-406f-856a-dde0833c2cd3 req-9841bccd-f839-4c39-a970-8f7523d97d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:57:30.001649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55b82f87-1354-406f-856a-dde0833c2cd3 req-9841bccd-f839-4c39-a970-8f7523d97d8b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:30.002204 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55b82f87-1354-406f-856a-dde0833c2cd3 req-9841bccd-f839-4c39-a970-8f7523d97d8b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:30.002646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-55b82f87-1354-406f-856a-dde0833c2cd3 req-9841bccd-f839-4c39-a970-8f7523d97d8b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:30.015764 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-55b82f87-1354-406f-856a-dde0833c2cd3 req-9841bccd-f839-4c39-a970-8f7523d97d8b service nova] Creating event network-changed:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:57:30.021452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-55b82f87-1354-406f-856a-dde0833c2cd3 req-9841bccd-f839-4c39-a970-8f7523d97d8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169139 Sep 19 15:57:30.022548 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3401/6760] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:31.904560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:31.905707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:31.912920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:31.913553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:31.914059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:31.914865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:31.915409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:31.915959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:32.001746 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lazy-loading 'services' on Instance uuid cd641921-5530-4973-a302-f109c2aeb18b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:57:32.057233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-572088ac-c827-4188-9172-f6fa8a441197 req-5fb0e5ff-7e0a-42a8-a0b6-17d055646b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:57:32.068325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-572088ac-c827-4188-9172-f6fa8a441197 req-5fb0e5ff-7e0a-42a8-a0b6-17d055646b5a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:32.068920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-572088ac-c827-4188-9172-f6fa8a441197 req-5fb0e5ff-7e0a-42a8-a0b6-17d055646b5a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:32.069423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-572088ac-c827-4188-9172-f6fa8a441197 req-5fb0e5ff-7e0a-42a8-a0b6-17d055646b5a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:32.083391 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-572088ac-c827-4188-9172-f6fa8a441197 req-5fb0e5ff-7e0a-42a8-a0b6-17d055646b5a service nova] Creating event network-changed:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:57:32.089028 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [263a6b4d-198d-477c-8e01-73a63352fa04] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:57:32.089208 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-572088ac-c827-4188-9172-f6fa8a441197 req-5fb0e5ff-7e0a-42a8-a0b6-17d055646b5a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036636 Sep 19 15:57:32.089681 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3402/6761] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:57:33.096856 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [263a6b4d-198d-477c-8e01-73a63352fa04] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 44520. Sep 19 15:57:33.100415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-67c28724-0ba5-4c41-bd8e-35e255a1b546 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments/8383c12f-cc75-47ae-a8b0-2874cd898bd1" status: 202 len: 0 microversion: 2.1 time: 1.200734 Sep 19 15:57:33.101049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3360/6762] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:57:31 2022] DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments/8383c12f-cc75-47ae-a8b0-2874cd898bd1 => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:57:33.111512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:33.113859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:33.121463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:33.123519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:33.123980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:33.125070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:33.125540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:33.125974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:33.162525 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7076988f-cef1-4741-9af3-2b3af261abee tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056874 Sep 19 15:57:33.163421 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3403/6763] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:57:33 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:34.179570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:34.182117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:34.191668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:34.192196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:34.192654 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:34.193373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:34.193965 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:34.194413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:34.224691 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6b9ad92b-8c48-44f2-bbc8-3a811c06ea78 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050789 Sep 19 15:57:34.225269 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3361/6764] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:57:34 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:35.237645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:35.239879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:35.246779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:35.247572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:35.248016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:35.248709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:35.249164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:35.249588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:35.280997 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-23791554-9d40-4bcf-b4fc-373793f5fef7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047309 Sep 19 15:57:35.281561 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3404/6765] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:57:35 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:36.294620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:36.297094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:36.304008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:36.304516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:36.304976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:36.305810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:36.306293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:36.306742 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:36.336152 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-99a57deb-6ba0-403d-b721-ea074443aaff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Sep 19 15:57:36.336720 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3362/6766] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:57:36 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:37.349524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:37.351758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:37.359187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:37.359701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:37.360161 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:37.360859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:37.361313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:37.361737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:37.393162 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4b3cb2b9-ae1d-4903-873a-aeec77bfcafb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047800 Sep 19 15:57:37.393713 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3405/6767] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:57:37 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:38.406414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:38.408753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:38.415772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:38.416275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:38.416728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:38.417434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:38.417908 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:38.418406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:38.450872 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c68931c3-3c17-46e9-be3e-c52f761f75b5 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049110 Sep 19 15:57:38.451445 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3363/6768] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:57:38 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:57:38.462032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:38.462521 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:38.469566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:38.470058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:38.470506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:38.471245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:38.471704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:38.472136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:38.549597 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] HTTP exception thrown: Instance cd641921-5530-4973-a302-f109c2aeb18b is not attached to volume 8383c12f-cc75-47ae-a8b0-2874cd898bd1 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Request method failure captured: Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments/8383c12f-cc75-47ae-a8b0-2874cd898bd1 HTTP/1.1 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJCH1zas8Pdt6PIqGF5OKXMjEzKwlYHJYWfx20BeO-vuOeHHZsxHexFaMKfg8jB9y9z7qRFWlPYgTMpibQNVUqURKCxT1Vn84DkrotOcQLMN5y85fonN8vqgUMSdWGhXs5IQKicyJhHxeS6USYhETG92DeqtsSy44tqQrqe-OzFwh5k Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 23867509a97e4539959f7357c320628c Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23867509a97e4539959f7357c320628c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23867509a97e4539959f7357c320628c"}]}] Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 23867509a97e4539959f7357c320628c Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 86c452841a7a4bdb8649f9f9c870e2b1 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance cd641921-5530-4973-a302-f109c2aeb18b is not attached to volume 8383c12f-cc75-47ae-a8b0-2874cd898bd1 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': 'cd641921-5530-4973-a302-f109c2aeb18b', 'id': '8383c12f-cc75-47ae-a8b0-2874cd898bd1'} Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8383c12f-cc75-47ae-a8b0-2874cd898bd1. Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd641921-5530-4973-a302-f109c2aeb18b is not attached to volume 8383c12f-cc75-47ae-a8b0-2874cd898bd1 Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:57:38.551501 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd641921-5530-4973-a302-f109c2aeb18b is not attached to volume 8383c12f-cc75-47ae-a8b0-2874cd898bd1 Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Returning 404 to user: Instance cd641921-5530-4973-a302-f109c2aeb18b is not attached to volume 8383c12f-cc75-47ae-a8b0-2874cd898bd1 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3335bb50-da0a-4658-bef2-917a52b4bc90 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments/8383c12f-cc75-47ae-a8b0-2874cd898bd1" status: 404 len: 154 microversion: 2.1 time: 0.094994 Sep 19 15:57:38.555841 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3406/6769] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:57:38 2022] DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b/os-volume_attachments/8383c12f-cc75-47ae-a8b0-2874cd898bd1 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:57:41.802035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:41.802563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:41.810091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:41.810594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:41.811085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:41.811793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:41.812266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:41.812711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:41.840219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:57:41.929783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d40c443-b66c-4c12-9872-263235f0d03d tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 204 len: 0 microversion: 2.1 time: 0.131447 Sep 19 15:57:41.930981 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3364/6770] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:57:41 2022] DELETE /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:57:41.939748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:41.940354 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:41.947343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:41.947823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:41.948452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:41.949139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:41.949721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:41.950306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:42.084589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:42.093383 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e53ae2e1-1470-41fc-9827-04d6604b4220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1555 microversion: 2.1 time: 0.157480 Sep 19 15:57:42.094004 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3407/6771] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:41 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:43.117088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:43.117812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:43.124834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:43.125341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:43.125797 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:43.126507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:43.127003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:43.127448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:43.267402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:43.275230 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-01525b2a-fe83-49c7-91c3-d0fba45b1577 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1555 microversion: 2.1 time: 0.162481 Sep 19 15:57:43.275810 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3365/6772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:43 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:43.968209 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c4931292-1967-41e1-af6d-2dc90ef1afe0 req-3076ebbc-5523-4efd-b55a-f9e8614ad9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd641921-5530-4973-a302-f109c2aeb18b", "name": "network-vif-deleted", "tag": "c1e838e5-f749-449c-b922-e4b7f087ed6d"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:57:43.978730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4931292-1967-41e1-af6d-2dc90ef1afe0 req-3076ebbc-5523-4efd-b55a-f9e8614ad9d5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:43.979249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4931292-1967-41e1-af6d-2dc90ef1afe0 req-3076ebbc-5523-4efd-b55a-f9e8614ad9d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:43.979695 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c4931292-1967-41e1-af6d-2dc90ef1afe0 req-3076ebbc-5523-4efd-b55a-f9e8614ad9d5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:43.991911 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c4931292-1967-41e1-af6d-2dc90ef1afe0 req-3076ebbc-5523-4efd-b55a-f9e8614ad9d5 service nova] Creating event network-vif-deleted:c1e838e5-f749-449c-b922-e4b7f087ed6d for instance cd641921-5530-4973-a302-f109c2aeb18b on n-h1-858384-1 Sep 19 15:57:43.997033 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c4931292-1967-41e1-af6d-2dc90ef1afe0 req-3076ebbc-5523-4efd-b55a-f9e8614ad9d5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033037 Sep 19 15:57:43.997634 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3408/6773] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:44.299086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:44.299724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:44.307318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:44.307839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:44.308293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:44.309020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:44.309495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:44.309938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:44.346249 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:44.346776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:44.347271 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:44.347743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lazy-loading 'fault' on Instance uuid cd641921-5530-4973-a302-f109c2aeb18b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:57:44.399089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:44.410845 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71ee773d-aeda-41ba-9fcc-a28154ab3cc6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 200 len: 1348 microversion: 2.1 time: 0.113447 Sep 19 15:57:44.410845 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3366/6774] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:44 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:45.433816 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:45.434678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: cd641921-5530-4973-a302-f109c2aeb18b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:45.440994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:45.441485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:45.441924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:45.442614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:45.443095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:45.443523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:45.456938 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] HTTP exception thrown: Instance cd641921-5530-4973-a302-f109c2aeb18b could not be found. Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Request method failure captured: Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b HTTP/1.1 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJCH1zas8Pdt6PIqGF5OKXMjEzKwlYHJYWfx20BeO-vuOeHHZsxHexFaMKfg8jB9y9z7qRFWlPYgTMpibQNVUqURKCxT1Vn84DkrotOcQLMN5y85fonN8vqgUMSdWGhXs5IQKicyJhHxeS6USYhETG92DeqtsSy44tqQrqe-OzFwh5k Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 23867509a97e4539959f7357c320628c Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23867509a97e4539959f7357c320628c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23867509a97e4539959f7357c320628c"}]}] Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 23867509a97e4539959f7357c320628c Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 86c452841a7a4bdb8649f9f9c870e2b1 Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance cd641921-5530-4973-a302-f109c2aeb18b could not be found. Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'cd641921-5530-4973-a302-f109c2aeb18b'} Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd641921-5530-4973-a302-f109c2aeb18b could not be found. Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd641921-5530-4973-a302-f109c2aeb18b could not be found. Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:57:45.458580 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd641921-5530-4973-a302-f109c2aeb18b could not be found. Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Returning 404 to user: Instance cd641921-5530-4973-a302-f109c2aeb18b could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1ea01419-ce45-4048-b6e0-029c86e1d39a tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b" status: 404 len: 111 microversion: 2.1 time: 0.031460 Sep 19 15:57:45.463920 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3409/6775] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:45 2022] GET /compute/v2.1/servers/cd641921-5530-4973-a302-f109c2aeb18b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:57:45.469204 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3118030b-85e8-40a6-a042-56c988d179e8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '.version_select at 0x7fde29d9aaf0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:45.489777 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3118030b-85e8-40a6-a042-56c988d179e8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1787565542" status: 202 len: 0 microversion: 2.1 time: 0.024885 Sep 19 15:57:45.490348 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3367/6776] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 15:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1787565542 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:57:54.693441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2d03c4da-4497-4654-b3a3-d0fe571c32b0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'create', calling method: .version_select at 0x7fde28cc5430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2126411966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNjBotRz7ccFJlVPO+bl8gfLz3i5zbM5AeZW7yHU7TilbXKzY53Dm7IwGMV6soJ7FAUV5Xb/QFRBvlqYJCDVLe00/l/yerqwrM29AmP69msoLR1ve/E8RsGv8jlXhxfQA=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:57:54.710550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2d03c4da-4497-4654-b3a3-d0fe571c32b0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for project 23867509a97e4539959f7357c320628c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:57:54.717170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2d03c4da-4497-4654-b3a3-d0fe571c32b0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for user 86c452841a7a4bdb8649f9f9c870e2b1 and project 23867509a97e4539959f7357c320628c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:57:54.743060 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2d03c4da-4497-4654-b3a3-d0fe571c32b0 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053583 Sep 19 15:57:54.743664 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3410/6777] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:57:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:57:54.792117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:57:54.796764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1926974442", "imageRef": "48d6a2bd-db04-47ae-85c4-7af126c9d0e4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2126411966", "networks": [{"uuid": "638eea12-bd82-4757-9b6b-27f82b0e2d8e"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:57:54.851198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] validate_networks() for [('638eea12-bd82-4757-9b6b-27f82b0e2d8e', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:57:54.965775 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:57:54.965981 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 15:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! Sep 19 15:57:55.266892 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:57:55.267340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:57:55.267838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:57:55.268321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:57:55.268754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:57:55.278171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:55.278675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:55.279165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:55.279947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:55.280426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:55.280875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:55.300834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for project 23867509a97e4539959f7357c320628c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:57:55.306096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Getting quotas for user 86c452841a7a4bdb8649f9f9c870e2b1 and project 23867509a97e4539959f7357c320628c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:57:55.319169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:57:55.321440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48d6a2bd-db04-47ae-85c4-7af126c9d0e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:57:55.369809 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f49eba13-80cb-433e-8f0a-fdda2977a4ae tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579468 Sep 19 15:57:55.370663 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3368/6778] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:57:55.378932 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:57:55.379114 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 15:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 (ip 10.222.0.81) !!! Sep 19 15:57:55.385470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-42808705-146a-4a90-bfb7-f05cbe48323e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:55.386627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-42808705-146a-4a90-bfb7-f05cbe48323e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:55.445554 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-42808705-146a-4a90-bfb7-f05cbe48323e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:55.447778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=38 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:57:55.454643 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-42808705-146a-4a90-bfb7-f05cbe48323e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1259 microversion: 2.1 time: 0.076897 Sep 19 15:57:55.455247 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3411/6779] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:55 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:56.478500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:56.479428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:56.487522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:56.488031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:56.488481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:56.489196 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:56.489670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:56.490110 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:56.569005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:56.577456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-36d0f380-0bcd-43de-bf42-7ef75a592220 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1319 microversion: 2.1 time: 0.103828 Sep 19 15:57:56.578042 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3369/6780] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:56 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1319 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:57.602249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:57.603604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:57.612841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:57.613448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:57.614242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:57.615132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:57.615670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:57.616179 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:57.784770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:57.794851 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86d75cef-9bf2-40b4-bf87-9e6f4ba63b94 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.197160 Sep 19 15:57:57.795672 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3412/6781] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:57 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:57:58.819599 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:57:58.820396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:57:58.830222 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:58.831039 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:58.831505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:58.832239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:57:58.832719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:57:58.833356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:57:58.997299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:57:59.005623 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4dcca5b5-0a2e-45de-9c78-16a6423f9fff tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.190053 Sep 19 15:57:59.006617 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3370/6782] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:57:58 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:00.030838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:00.032057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:00.034323 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:00.043316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:00.044098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:00.044852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:00.045741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:00.046360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:00.047077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:00.233003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:00.241306 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-01b91495-2278-48be-b4a8-bd878f73daf3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.215444 Sep 19 15:58:00.242100 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3413/6783] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:00 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:01.265133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:01.266554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:01.273444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:01.275458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:01.276051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:01.277298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:01.278532 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:01.279122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:01.279709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:01.444834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:01.455164 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fa19f5c4-3b53-4250-afec-f2726fd7fa86 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.194030 Sep 19 15:58:01.456382 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3371/6784] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:01 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:02.480342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:02.482165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:02.489663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:02.490450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:02.490926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:02.491832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:02.492443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:02.492935 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:02.649732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:02.660325 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1c6b5ad5-d76e-4114-82a6-c0d69cbe646b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.184255 Sep 19 15:58:02.670492 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3414/6785] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:02 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:03.687601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:03.688420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:03.696063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:03.696622 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:03.697257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:03.698699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:03.699212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:03.699747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:03.834353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:03.843276 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9501e289-b248-4af1-bf3b-ac62558dd47b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.160637 Sep 19 15:58:03.843786 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3372/6786] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:03 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:04.865717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:04.866353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:04.874504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:04.875038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:04.875500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:04.876258 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:04.876714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:04.877178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:05.135136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:05.143020 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-09266aa9-834b-4bbb-a1bd-fc0c862d554e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.281249 Sep 19 15:58:05.143702 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3415/6787] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:04 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:05.449883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f230edfa-1374-441c-a392-bd99831cf3e9 req-d00456e6-ef91-42a0-b5d1-8268f517a59b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:05.459826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:05.461016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:05.464810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f230edfa-1374-441c-a392-bd99831cf3e9 req-d00456e6-ef91-42a0-b5d1-8268f517a59b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:05.465549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f230edfa-1374-441c-a392-bd99831cf3e9 req-d00456e6-ef91-42a0-b5d1-8268f517a59b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:05.466176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f230edfa-1374-441c-a392-bd99831cf3e9 req-d00456e6-ef91-42a0-b5d1-8268f517a59b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:05.478682 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f230edfa-1374-441c-a392-bd99831cf3e9 req-d00456e6-ef91-42a0-b5d1-8268f517a59b service nova] Creating event network-changed:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:58:05.484878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f230edfa-1374-441c-a392-bd99831cf3e9 req-d00456e6-ef91-42a0-b5d1-8268f517a59b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040560 Sep 19 15:58:05.485497 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3373/6788] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:58:06.165599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:06.166227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:06.168603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:06.174926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:06.175581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:06.175849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:06.176552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:06.177039 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:06.177447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:06.306486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:06.314900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c03a8dae-c763-4b20-adc7-8c0873297237 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.153224 Sep 19 15:58:06.315483 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3416/6789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:06 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:07.339025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:07.339674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:07.345881 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:07.346381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:07.346875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:07.347577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:07.348052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:07.348497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:07.489351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:07.497710 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f342b9f4-5c5c-4326-af2d-ceca6de6ebe7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.163960 Sep 19 15:58:07.498284 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3374/6790] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:07 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:08.520500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:08.521050 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:08.528198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:08.528690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:08.529246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:08.529882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:08.530343 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:08.530792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:08.661256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:08.669107 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8db79531-8d50-482f-94b0-bcf5ca769fd9 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.152727 Sep 19 15:58:08.669669 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3417/6791] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:08 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:09.693154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:09.693721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:09.701803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:09.702335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:09.702810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:09.703523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:09.703994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:09.704436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:09.833700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:09.842397 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4535ae1c-a1c7-4e10-93f7-b7577c800055 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.153341 Sep 19 15:58:09.843004 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3375/6792] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:09 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:10.865201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:10.865752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:10.872633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:10.873125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:10.873571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:10.874279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:10.874738 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:10.875188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:11.009495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:11.017527 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a682b6f3-48e1-4b61-bf84-85845a4039bf tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.156349 Sep 19 15:58:11.018089 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3418/6793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:10 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:12.041063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:12.042415 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:12.049277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:12.050034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:12.050489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:12.051217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:12.051690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:12.052130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:12.179661 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:12.188361 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de580211-075b-45c8-a68a-f16b822f2cb3 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.151326 Sep 19 15:58:12.188939 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3376/6794] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:12 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:12.696117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a98f7b02-33bc-487c-8b37-674e626a365a req-415d8bdd-4ed1-4972-ac5d-76d2356e69ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "name": "network-vif-plugged", "status": "completed", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:12.707681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a98f7b02-33bc-487c-8b37-674e626a365a req-415d8bdd-4ed1-4972-ac5d-76d2356e69ef service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:12.708168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a98f7b02-33bc-487c-8b37-674e626a365a req-415d8bdd-4ed1-4972-ac5d-76d2356e69ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:12.708607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a98f7b02-33bc-487c-8b37-674e626a365a req-415d8bdd-4ed1-4972-ac5d-76d2356e69ef service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:12.720249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-a98f7b02-33bc-487c-8b37-674e626a365a req-415d8bdd-4ed1-4972-ac5d-76d2356e69ef service nova] Creating event network-vif-plugged:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:58:12.725667 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a98f7b02-33bc-487c-8b37-674e626a365a req-415d8bdd-4ed1-4972-ac5d-76d2356e69ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090632 Sep 19 15:58:12.726277 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3419/6795] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:58:13.211050 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:13.211684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:13.218909 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:13.219422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:13.219876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:13.220617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:13.221087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:13.221531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:13.354480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:13.362181 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2edd011b-827a-46c3-aae3-ef32aabb92e6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1359 microversion: 2.1 time: 0.155141 Sep 19 15:58:13.362795 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3377/6796] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:13 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:14.386482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:14.387227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:14.394239 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.394728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.395187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.395880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.396337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.396768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.533715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:14.541571 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f50b8943-03a9-4616-87f1-8268f22ac7ea tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1550 microversion: 2.1 time: 0.160025 Sep 19 15:58:14.542146 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3420/6797] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:14 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:14.564329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:14.564963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:14.572001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.573173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.573629 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.574342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.574857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.575302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.706312 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:14.714855 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d44805f-c968-4a25-a237-c918cd0a78eb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1550 microversion: 2.1 time: 0.154486 Sep 19 15:58:14.715440 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3378/6798] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:14 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:14.736719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:14.741493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:14.742267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Searching by: {'deleted': False, 'project_id': '23867509a97e4539959f7357c320628c'} {{(pid=128730) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 15:58:14.747784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.748272 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.748710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.749439 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.749897 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.750325 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.773430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.multi_cell_list [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 15:58:14.804077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5ea7e9c1-04ee-4607-a048-1c7525509643 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071160 Sep 19 15:58:14.804659 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3421/6799] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 15:58:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:58:14.816811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:14.817444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:14.823945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.824446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.824902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.825623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:14.826160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:14.826610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:14.953725 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:14.961544 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4b972ad8-0592-4b28-98d8-0fdb9caf2f8c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1550 microversion: 2.1 time: 0.148660 Sep 19 15:58:14.962115 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3379/6800] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:14 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:16.468755 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae89de48-0b33-4eac-8712-75a23f36d7b3"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:16.471210 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:16.478130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:16.479173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:16.479769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:16.480467 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:16.480939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:16.481362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:16.718620 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b44e6a10-7daa-4cf1-84fd-bbf7ba587ecc tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253752 Sep 19 15:58:16.719269 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3422/6801] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 15:58:16 2022] POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:58:27.491327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:27.491999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:27.495206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=17 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:27.495918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=64 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:27.501475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:27.501986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:27.502443 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:27.503184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:27.503664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:27.504112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:27.620906 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] AMQP server on 10.222.0.81:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 19 15:58:27.644474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:27.653816 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08d8653c-b572-44eb-9699-a17fb0ac2c56 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1596 microversion: 2.1 time: 0.166329 Sep 19 15:58:27.654329 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3380/6802] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:27 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1596 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:29.225527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-2fe41ff7-1693-4013-8b94-52f69ee29562 req-b285f6ef-f108-4460-ad69-3227747ab184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:29.236639 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] AMQP server on 10.222.0.81:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 19 15:58:29.237159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:29.238648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=19 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:29.239768 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:29.242383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2fe41ff7-1693-4013-8b94-52f69ee29562 req-b285f6ef-f108-4460-ad69-3227747ab184 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:29.242985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2fe41ff7-1693-4013-8b94-52f69ee29562 req-b285f6ef-f108-4460-ad69-3227747ab184 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:29.243417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-2fe41ff7-1693-4013-8b94-52f69ee29562 req-b285f6ef-f108-4460-ad69-3227747ab184 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:29.262426 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-2fe41ff7-1693-4013-8b94-52f69ee29562 req-b285f6ef-f108-4460-ad69-3227747ab184 service nova] Creating event network-changed:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:58:29.268551 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-2fe41ff7-1693-4013-8b94-52f69ee29562 req-b285f6ef-f108-4460-ad69-3227747ab184 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047477 Sep 19 15:58:29.269536 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3423/6803] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:58:30.260904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1110308059"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:30.261530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:30.271033 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:30.271548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:30.272002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:30.272722 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:30.273191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:30.273636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:30.293027 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 44822. Sep 19 15:58:30.419020 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.network.security_group_api [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Adding security group 373ac42e-c4b1-4a15-9199-4cc2dbc596ad to port 8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b Sep 19 15:58:30.725062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-83234ca2-c5d4-4347-8245-5288f8b508c4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/action" status: 202 len: 0 microversion: 2.1 time: 0.468355 Sep 19 15:58:30.725810 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3381/6804] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:58:30 2022] POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:58:30.734826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:30.735547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:30.750679 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 44826. Sep 19 15:58:30.754455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:30.755241 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:30.755665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:30.756377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:30.756838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:30.757268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:30.918151 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:30.926944 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc899392-4cbe-40b2-b8e4-f484e27c4760 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1761 microversion: 2.1 time: 0.196272 Sep 19 15:58:30.927530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3424/6805] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:30 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1761 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:31.283449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fab49067-db9b-49bc-a4f9-1500dcbd8c1f req-40b20028-efdd-4a25-82f9-2179541a43b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:31.293992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fab49067-db9b-49bc-a4f9-1500dcbd8c1f req-40b20028-efdd-4a25-82f9-2179541a43b1 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:31.294498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fab49067-db9b-49bc-a4f9-1500dcbd8c1f req-40b20028-efdd-4a25-82f9-2179541a43b1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:31.294974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fab49067-db9b-49bc-a4f9-1500dcbd8c1f req-40b20028-efdd-4a25-82f9-2179541a43b1 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:31.314854 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fab49067-db9b-49bc-a4f9-1500dcbd8c1f req-40b20028-efdd-4a25-82f9-2179541a43b1 service nova] Creating event network-changed:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:58:31.319986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fab49067-db9b-49bc-a4f9-1500dcbd8c1f req-40b20028-efdd-4a25-82f9-2179541a43b1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040890 Sep 19 15:58:31.320603 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3382/6806] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:58:45.907834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:58:45.910098 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:45.912867 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:45.913553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=8 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:45.919692 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:45.920174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:45.920603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:45.921287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:45.921734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:45.922155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:45.994546 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e7690171-d609-4943-81e3-0e160846a962 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/action" status: 202 len: 0 microversion: 2.1 time: 0.090789 Sep 19 15:58:45.995258 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3425/6807] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:58:45 2022] POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:58:46.001819 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:46.002582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:58:46.007322 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:46.008072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:46.016298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:46.016802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:46.017258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:46.017966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:46.018437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:46.018925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:46.561687 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:46.569984 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e1f79b06-059e-49e0-b398-ddc70d289633 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1753 microversion: 2.1 time: 0.570245 Sep 19 15:58:46.570677 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3383/6808] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:45 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1753 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:47.593882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:47.594586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:47.601588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:47.602114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:47.602527 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:47.603263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:47.603714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:47.604134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:47.746122 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:47.755407 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd35ac4c-2fc2-437f-8138-d2e8ab13b929 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.165884 Sep 19 15:58:47.755985 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3426/6809] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:47 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:48.834566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:48.835229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:48.843218 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:48.843720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:48.844169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:48.844880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:48.845377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:48.845816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:49.003721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:49.013241 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-34d2100c-aa96-497a-9716-647873170624 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.236872 Sep 19 15:58:49.013832 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3384/6810] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:48 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:50.037543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:50.038169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:50.045708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:50.046201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:50.046646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:50.047371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:50.047835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:50.048269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:50.191996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:50.200756 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d625dfd-f1b6-4cec-b7bf-c89f1bdade2f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.167159 Sep 19 15:58:50.201339 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3427/6811] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:50 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:51.224646 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:51.225270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:51.233252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:51.233778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:51.234221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:51.234972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:51.235450 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:51.235894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:51.387343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:51.395760 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dd94e6fb-1c61-41fc-8e94-ae9c12ad825e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.175277 Sep 19 15:58:51.396551 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3385/6812] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:51 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:52.420153 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:52.420769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:52.427813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:52.428300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:52.428736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:52.429421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:52.430981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:52.431415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:52.572676 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:52.580951 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e0a41944-b033-4fcf-aac1-0f70ccb421ed tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.164779 Sep 19 15:58:52.581526 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3428/6813] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:52 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:53.604772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:53.605432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:53.612601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:53.613117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:53.613587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:53.614306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:53.614847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:53.615326 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:53.757706 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:53.766285 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-532f8e0e-4d5c-4023-b0a5-9cbf5cd10e32 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.166299 Sep 19 15:58:53.766875 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3386/6814] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:53 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:54.790829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:54.791376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:54.798116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:54.798895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:54.799336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:54.800033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:54.800489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:54.800916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:54.945884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:54.954182 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd8cde34-dc63-45d5-ad13-4d976856021c tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.167462 Sep 19 15:58:54.954781 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3429/6815] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:54 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:55.978340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:55.979366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:55.986221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:55.986720 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:55.987198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:55.987896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:55.988366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:55.988808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:56.130161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:56.138598 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-881e8279-e123-48f4-a1fc-e54fbb3279f2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.164286 Sep 19 15:58:56.139217 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3387/6816] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:55 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:57.161627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:57.162320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:57.169438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:57.169921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:57.170356 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:57.171084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:57.171537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:57.171955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:57.316992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:57.325977 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7fd2a1f-7629-4fe0-9e54-22b6e6e63b4e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1758 microversion: 2.1 time: 0.168318 Sep 19 15:58:57.326554 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3430/6817] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:57 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:58:58.348399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:58:58.349037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:58:58.356430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:58.356936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:58.357397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:58.358109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:58:58.358602 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:58:58.359112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:58:58.503762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:58:58.512155 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ebe1239-0a5a-4c73-b893-de56952f3713 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1761 microversion: 2.1 time: 0.167711 Sep 19 15:58:58.512732 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3388/6818] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:58:58 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:27.608392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1110308059"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:59:27.609015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:27.612697 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=12 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.613374 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.619687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:27.620173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:27.620607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:27.621303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:27.621753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:27.622175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:27.755949 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.network.security_group_api [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Removing security group 373ac42e-c4b1-4a15-9199-4cc2dbc596ad from port 8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b Sep 19 15:59:28.055721 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0bacc22-52d2-40e7-88ee-fdfb048c4406 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/action" status: 202 len: 0 microversion: 2.1 time: 0.451872 Sep 19 15:59:28.056551 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3431/6819] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 15:59:27 2022] POST /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:59:28.066334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-ff014c9b-fcf6-4133-8a3f-f0434ea01f6b req-773b1129-1dd4-4484-a4b5-6e770edb32af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:59:28.075944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=12 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.077305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=36 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.079697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ff014c9b-fcf6-4133-8a3f-f0434ea01f6b req-773b1129-1dd4-4484-a4b5-6e770edb32af service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:28.080398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ff014c9b-fcf6-4133-8a3f-f0434ea01f6b req-773b1129-1dd4-4484-a4b5-6e770edb32af service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:28.081260 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-ff014c9b-fcf6-4133-8a3f-f0434ea01f6b req-773b1129-1dd4-4484-a4b5-6e770edb32af service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:28.097024 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-ff014c9b-fcf6-4133-8a3f-f0434ea01f6b req-773b1129-1dd4-4484-a4b5-6e770edb32af service nova] Creating event network-changed:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:59:28.104976 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-ff014c9b-fcf6-4133-8a3f-f0434ea01f6b req-773b1129-1dd4-4484-a4b5-6e770edb32af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042845 Sep 19 15:59:28.107079 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3389/6820] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:29.401082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:29.401608 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:29.407710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:29.408202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:29.408641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:29.409557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:29.410018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:29.410447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:29.494570 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lazy-loading 'services' on Instance uuid 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:59:29.569152 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e62cce0a-fbf6-43fb-89a4-8bff86fd5df7 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments/ae89de48-0b33-4eac-8712-75a23f36d7b3" status: 202 len: 0 microversion: 2.1 time: 0.172359 Sep 19 15:59:29.569759 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3432/6821] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:59:29 2022] DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments/ae89de48-0b33-4eac-8712-75a23f36d7b3 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:59:29.579553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:29.582795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:29.591098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:29.591701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:29.592258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:29.593051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:29.593600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:29.594197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:29.630045 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7617c8a0-f0c2-403b-a7f8-f81b972823c8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055517 Sep 19 15:59:29.631322 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3390/6822] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:59:29 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:30.124571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-cdccf018-94c3-44be-baf4-dcea4cc2cd62 req-ce4f7930-e407-4e33-b1b6-d01cfd5edc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:59:30.141055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cdccf018-94c3-44be-baf4-dcea4cc2cd62 req-ce4f7930-e407-4e33-b1b6-d01cfd5edc89 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:30.141555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cdccf018-94c3-44be-baf4-dcea4cc2cd62 req-ce4f7930-e407-4e33-b1b6-d01cfd5edc89 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:30.141996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-cdccf018-94c3-44be-baf4-dcea4cc2cd62 req-ce4f7930-e407-4e33-b1b6-d01cfd5edc89 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:30.154838 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-cdccf018-94c3-44be-baf4-dcea4cc2cd62 req-ce4f7930-e407-4e33-b1b6-d01cfd5edc89 service nova] Creating event network-changed:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:59:30.159816 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-cdccf018-94c3-44be-baf4-dcea4cc2cd62 req-ce4f7930-e407-4e33-b1b6-d01cfd5edc89 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039346 Sep 19 15:59:30.160788 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3433/6823] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:30.643307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:30.645530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:30.652239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:30.652757 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:30.653216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:30.654150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:30.654817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:30.655440 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:30.687389 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78c543b4-437e-467f-bca2-433ba3de7f45 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048375 Sep 19 15:59:30.687984 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3391/6824] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:59:30 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:31.701732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:31.703953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:31.711007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:31.711490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:31.711931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:31.712620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:31.713075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:31.713494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:31.746603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3281f32f-e575-4d1f-9ca0-8f9a2c97ff62 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050155 Sep 19 15:59:31.747208 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3434/6825] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:59:31 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:32.759290 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:32.761649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:32.768853 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:32.769356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:32.769811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:32.770568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:32.771671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:32.772115 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:32.805267 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-835fbdfc-1167-4a38-8bd6-91fc4add69cb tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050076 Sep 19 15:59:32.805833 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3392/6826] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:59:32 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:33.818371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:33.820557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:33.827505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:33.828000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:33.828444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:33.829152 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:33.829615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:33.830045 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:33.861668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5de1864f-bb2e-4b66-bf48-65b96ffb0fe2 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Sep 19 15:59:33.862236 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3435/6827] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:59:33 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:34.873763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:34.875986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:34.883535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:34.884037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:34.884490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:34.885193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:34.885668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:34.886109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:34.914483 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-42b063d3-abf0-4462-9def-e81230f3f0f1 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044861 Sep 19 15:59:34.915077 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3393/6828] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 15:59:34 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:59:34.925847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:34.926336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:34.933630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:34.934116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:34.934557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:34.935277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:34.935734 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:34.936160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:35.010847 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] HTTP exception thrown: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 is not attached to volume ae89de48-0b33-4eac-8712-75a23f36d7b3 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Request method failure captured: Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: request: DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments/ae89de48-0b33-4eac-8712-75a23f36d7b3 HTTP/1.1 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJCH1zas8Pdt6PIqGF5OKXMjEzKwlYHJYWfx20BeO-vuOeHHZsxHexFaMKfg8jB9y9z7qRFWlPYgTMpibQNVUqURKCxT1Vn84DkrotOcQLMN5y85fonN8vqgUMSdWGhXs5IQKicyJhHxeS6USYhETG92DeqtsSy44tqQrqe-OzFwh5k Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 23867509a97e4539959f7357c320628c Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23867509a97e4539959f7357c320628c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23867509a97e4539959f7357c320628c"}]}] Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 23867509a97e4539959f7357c320628c Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 86c452841a7a4bdb8649f9f9c870e2b1 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 is not attached to volume ae89de48-0b33-4eac-8712-75a23f36d7b3 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'server_id': '1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3', 'id': 'ae89de48-0b33-4eac-8712-75a23f36d7b3'} Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ae89de48-0b33-4eac-8712-75a23f36d7b3. Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 is not attached to volume ae89de48-0b33-4eac-8712-75a23f36d7b3 Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:59:35.012495 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 is not attached to volume ae89de48-0b33-4eac-8712-75a23f36d7b3 Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Returning 404 to user: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 is not attached to volume ae89de48-0b33-4eac-8712-75a23f36d7b3 {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-aeab1695-3179-424e-9997-ed452f0a046e tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments/ae89de48-0b33-4eac-8712-75a23f36d7b3" status: 404 len: 154 microversion: 2.1 time: 0.092351 Sep 19 15:59:35.017178 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3436/6829] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 15:59:34 2022] DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3/os-volume_attachments/ae89de48-0b33-4eac-8712-75a23f36d7b3 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:59:38.270866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:38.271653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:38.279386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:38.279894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:38.280352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:38.281062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:38.281540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:38.281999 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:38.311172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:59:38.395107 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a1d6235f-deca-44fc-a2f3-dcca85ebbb9f tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 204 len: 0 microversion: 2.1 time: 0.127718 Sep 19 15:59:38.399404 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3394/6830] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 15:59:38 2022] DELETE /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:38.405342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:38.410718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:38.420072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:38.420575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:38.421085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:38.421795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:38.422253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:38.422953 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:38.555463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:59:38.563548 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a4d79917-d752-454b-b40f-a3deeb99caa4 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1556 microversion: 2.1 time: 0.163076 Sep 19 15:59:38.564121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3437/6831] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:38 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:39.588065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:39.588791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:39.596466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:39.596969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:39.597426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:39.598128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:39.598600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:39.599268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:39.726947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:59:39.734792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a0494db2-2221-44fb-ac81-db48cfb35c1b tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1556 microversion: 2.1 time: 0.151901 Sep 19 15:59:39.735373 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3395/6832] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:39 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:40.478044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-143052f2-e3e1-49e1-a834-cd9d858d6fbc req-730ecab7-ce2c-495e-b3c6-50169741480e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3", "name": "network-vif-deleted", "tag": "8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:59:40.488709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-143052f2-e3e1-49e1-a834-cd9d858d6fbc req-730ecab7-ce2c-495e-b3c6-50169741480e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:40.489197 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-143052f2-e3e1-49e1-a834-cd9d858d6fbc req-730ecab7-ce2c-495e-b3c6-50169741480e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:40.489644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-143052f2-e3e1-49e1-a834-cd9d858d6fbc req-730ecab7-ce2c-495e-b3c6-50169741480e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:40.501258 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-143052f2-e3e1-49e1-a834-cd9d858d6fbc req-730ecab7-ce2c-495e-b3c6-50169741480e service nova] Creating event network-vif-deleted:8d74f5f2-8ec4-4d1c-85fb-cc102f2f7b2b for instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 on n-h2-858384-1 Sep 19 15:59:40.506946 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-143052f2-e3e1-49e1-a834-cd9d858d6fbc req-730ecab7-ce2c-495e-b3c6-50169741480e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Sep 19 15:59:40.507563 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3438/6833] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 15:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:40.757884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:40.758612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:40.765861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:40.766369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:40.766858 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:40.767580 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:40.768054 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:40.768497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:40.802836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:40.803286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:40.803745 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:40.804221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lazy-loading 'fault' on Instance uuid 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:59:40.852750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c452841a7a4bdb8649f9f9c870e2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23867509a97e4539959f7357c320628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:59:40.861056 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-139f81c9-2bb9-4acb-a05a-37b14ff9a0f8 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 200 len: 1349 microversion: 2.1 time: 0.107253 Sep 19 15:59:40.862006 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3396/6834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:40 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:41.886294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:41.886981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] [instance: 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:41.893253 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:41.893739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:41.894184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:41.894916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:41.895380 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:41.895812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:41.909066 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] HTTP exception thrown: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 could not be found. Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Request method failure captured: Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 HTTP/1.1 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJCH1zas8Pdt6PIqGF5OKXMjEzKwlYHJYWfx20BeO-vuOeHHZsxHexFaMKfg8jB9y9z7qRFWlPYgTMpibQNVUqURKCxT1Vn84DkrotOcQLMN5y85fonN8vqgUMSdWGhXs5IQKicyJhHxeS6USYhETG92DeqtsSy44tqQrqe-OzFwh5k Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 23867509a97e4539959f7357c320628c Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_23867509a97e4539959f7357c320628c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/23867509a97e4539959f7357c320628c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/23867509a97e4539959f7357c320628c"}]}] Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 23867509a97e4539959f7357c320628c Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1961728273 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 86c452841a7a4bdb8649f9f9c870e2b1 Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestMinimumBasicScenario-1961728273-project Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 could not be found. Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3'} Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 could not be found. Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 could not be found. Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:59:41.910719 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 could not be found. Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Returning 404 to user: Instance 1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b36bba6-bc1a-46f7-bf4b-41a61dd757c6 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3" status: 404 len: 111 microversion: 2.1 time: 0.031671 Sep 19 15:59:41.916072 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3439/6835] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:41 2022] GET /compute/v2.1/servers/1ca8a6a4-5cac-4679-bad9-a033ccc2c8b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:59:41.922112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7df9782-99f9-49c5-8858-e4d5bbb00986 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] Calling method '.version_select at 0x7fde29ef48b0>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:41.942303 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7df9782-99f9-49c5-8858-e4d5bbb00986 tempest-TestMinimumBasicScenario-1961728273 tempest-TestMinimumBasicScenario-1961728273-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2126411966" status: 202 len: 0 microversion: 2.1 time: 0.024150 Sep 19 15:59:41.943178 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3397/6836] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 15:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2126411966 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:59:51.294558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7cf86ff7-5c23-4ed7-b8ea-f5dac8f4a579 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: .version_select at 0x7fde29aaab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-441940520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHz2uBMyw8ikhJdL9ZICbgZ9qKw2X3Ka+yTC4MXL2v07X6qQS7TICrq2VX+Cp4o8tqogdN3ht937rYMD0AAbrorxY/pREPx/AZpnQX0jrqbgcwYlC/1nGf6Qc3BTy1Cq2A=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:59:51.311602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7cf86ff7-5c23-4ed7-b8ea-f5dac8f4a579 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:59:51.316689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-7cf86ff7-5c23-4ed7-b8ea-f5dac8f4a579 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:59:51.341980 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7cf86ff7-5c23-4ed7-b8ea-f5dac8f4a579 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.213818 Sep 19 15:59:51.342581 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3440/6837] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 15:59:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:59:56.713186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:56.714455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:56.719727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-177308467", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "a8a3bb61-a1b4-4074-888f-a9c4391832d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-441940520", "security_groups": [{"name": "tempest-secgroup-smoke-2026469572"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:59:56.850617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] validate_networks() for [('a8a3bb61-a1b4-4074-888f-a9c4391832d1', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:59:57.271010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:59:57.271010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:59:57.271010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:59:57.271010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:59:57.271010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:59:57.279919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:57.280423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:57.280875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:57.281855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:57.282328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:57.282851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:57.305149 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:59:57.311225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:59:57.324890 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:59:57.327295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:59:57.379386 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09692778-ee5e-466c-b811-6e2170d3bb4e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668012 Sep 19 15:59:57.384747 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3398/6838] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 15:59:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:59:57.388427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:57.394149 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6ee0baaf-42dc-4ea8-8358-2af5e7fab4ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:57.395444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6ee0baaf-42dc-4ea8-8358-2af5e7fab4ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:57.467528 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6ee0baaf-42dc-4ea8-8358-2af5e7fab4ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:59:57.475329 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6ee0baaf-42dc-4ea8-8358-2af5e7fab4ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1265 microversion: 2.1 time: 0.087487 Sep 19 15:59:57.475886 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3441/6839] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:57 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:59:58.499973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:58.500759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:58.508798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:58.509595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:58.510031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:58.510815 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:58.511298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:58.511749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:58.628470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:59:58.640645 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-51e22912-5c4c-4dfc-8be8-e02a2c2c2067 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1325 microversion: 2.1 time: 0.146831 Sep 19 15:59:58.641498 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3399/6840] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:58 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1325 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:59.666029 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:59:59.666931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:59:59.674974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.683921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:59.684693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:59.685305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:59.686196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:59:59.686839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:59:59.687546 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:59:59.912307 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:59:59.922011 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fad74b29-3bb7-4cfc-bd82-33ca0e70caa8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1391 microversion: 2.1 time: 0.259982 Sep 19 15:59:59.922904 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3442/6841] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 15:59:59 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:00.526313 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-36ed0f1e-b1a0-436e-b8bb-0a38580bd648 req-78b0ebb5-12c5-444a-a1f7-f43cefc1255d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c82f908-6298-40c4-832e-95069ad71ade", "tag": "df057637-52ce-40a3-92d2-ba6638cfaf79"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:00.538528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36ed0f1e-b1a0-436e-b8bb-0a38580bd648 req-78b0ebb5-12c5-444a-a1f7-f43cefc1255d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:00.539086 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36ed0f1e-b1a0-436e-b8bb-0a38580bd648 req-78b0ebb5-12c5-444a-a1f7-f43cefc1255d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:00.539529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36ed0f1e-b1a0-436e-b8bb-0a38580bd648 req-78b0ebb5-12c5-444a-a1f7-f43cefc1255d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:00.552304 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-36ed0f1e-b1a0-436e-b8bb-0a38580bd648 req-78b0ebb5-12c5-444a-a1f7-f43cefc1255d service nova] Creating event network-changed:df057637-52ce-40a3-92d2-ba6638cfaf79 for instance 2c82f908-6298-40c4-832e-95069ad71ade on n-h1-858384-1 Sep 19 16:00:00.558014 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-36ed0f1e-b1a0-436e-b8bb-0a38580bd648 req-78b0ebb5-12c5-444a-a1f7-f43cefc1255d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039378 Sep 19 16:00:00.567345 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3400/6842] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:00:00.945719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:00.946382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:00.953123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:00.953602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:00.954035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:00.954730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:00.955211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:00.955683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:01.093860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:01.102145 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a27542c7-6c2a-4391-b7cf-3ea790afe1b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1391 microversion: 2.1 time: 0.160572 Sep 19 16:00:01.102728 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3443/6843] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:00 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:02.126215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:02.126935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:02.133382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:02.133929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:02.134391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:02.135129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:02.135606 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:02.136052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:02.317182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:02.324978 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b5a813e1-33da-4166-82cf-a8f0c735f4de tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1391 microversion: 2.1 time: 0.204010 Sep 19 16:00:02.325565 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3401/6844] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:02 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:03.348445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:03.349175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:03.355986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:03.356474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:03.356918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:03.357612 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:03.358072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:03.358503 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:03.501337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:03.509991 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3e33c757-3d3f-44fb-bfbd-fc7753c58d80 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1391 microversion: 2.1 time: 0.165654 Sep 19 16:00:03.510597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3444/6845] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:03 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:04.535855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:04.536484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:04.543406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:04.543911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:04.544371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:04.545075 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:04.545555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:04.546032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:04.676583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:04.684295 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-29aac65c-9edf-436a-875b-32aeca18b718 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1391 microversion: 2.1 time: 0.152542 Sep 19 16:00:04.684874 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3402/6846] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:04 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:05.302957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-213bd6d8-6946-48db-bac3-0f7f6df8b8ba req-a8c0dd2c-7017-4e1f-8d73-000b8e8eb0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c82f908-6298-40c4-832e-95069ad71ade", "name": "network-vif-plugged", "status": "completed", "tag": "df057637-52ce-40a3-92d2-ba6638cfaf79"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:05.313752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-213bd6d8-6946-48db-bac3-0f7f6df8b8ba req-a8c0dd2c-7017-4e1f-8d73-000b8e8eb0da service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:05.314329 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-213bd6d8-6946-48db-bac3-0f7f6df8b8ba req-a8c0dd2c-7017-4e1f-8d73-000b8e8eb0da service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:05.314859 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-213bd6d8-6946-48db-bac3-0f7f6df8b8ba req-a8c0dd2c-7017-4e1f-8d73-000b8e8eb0da service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:05.327972 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-213bd6d8-6946-48db-bac3-0f7f6df8b8ba req-a8c0dd2c-7017-4e1f-8d73-000b8e8eb0da service nova] Creating event network-vif-plugged:df057637-52ce-40a3-92d2-ba6638cfaf79 for instance 2c82f908-6298-40c4-832e-95069ad71ade on n-h1-858384-1 Sep 19 16:00:05.334693 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-213bd6d8-6946-48db-bac3-0f7f6df8b8ba req-a8c0dd2c-7017-4e1f-8d73-000b8e8eb0da service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Sep 19 16:00:05.335401 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3445/6847] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:00:05.707533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:05.708166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:05.715114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:05.715628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:05.716088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:05.716804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:05.717311 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:05.717762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:05.849458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:05.857265 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-61c43bee-d867-4a6b-9066-75237a1261ac tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1391 microversion: 2.1 time: 0.154317 Sep 19 16:00:05.857846 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3403/6848] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:05 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:06.882083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:06.882829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:06.891360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:06.891851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:06.892289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:06.892997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:06.893454 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:06.893926 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:07.033852 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:07.042372 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-603ee61b-9b32-4f4a-b302-ec54290d0a4f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1562 microversion: 2.1 time: 0.165379 Sep 19 16:00:07.043062 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3446/6849] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:06 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:07.131515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:07.132185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:07.139388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:07.139897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:07.140351 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:07.141060 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:07.141527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:07.141969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:07.275406 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:07.283421 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e526ce91-65b4-4ad9-acc5-e3319f9a5036 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1562 microversion: 2.1 time: 0.156538 Sep 19 16:00:07.284014 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3404/6850] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:07 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:08.901166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:08.901798 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:08.903094 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-708be90c-b8f4-4a0e-bfb1-7a77751c5db5 req-e028997d-4815-43a1-a013-0c4f1e6eff91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c82f908-6298-40c4-832e-95069ad71ade", "tag": "df057637-52ce-40a3-92d2-ba6638cfaf79"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:08.904924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.908308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.909340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.917903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-708be90c-b8f4-4a0e-bfb1-7a77751c5db5 req-e028997d-4815-43a1-a013-0c4f1e6eff91 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:08.918409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-708be90c-b8f4-4a0e-bfb1-7a77751c5db5 req-e028997d-4815-43a1-a013-0c4f1e6eff91 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:08.918999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:08.919139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-708be90c-b8f4-4a0e-bfb1-7a77751c5db5 req-e028997d-4815-43a1-a013-0c4f1e6eff91 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:08.919511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:08.919973 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:08.922436 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:08.923123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:08.923565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:08.931280 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-708be90c-b8f4-4a0e-bfb1-7a77751c5db5 req-e028997d-4815-43a1-a013-0c4f1e6eff91 service nova] Creating event network-changed:df057637-52ce-40a3-92d2-ba6638cfaf79 for instance 2c82f908-6298-40c4-832e-95069ad71ade on n-h1-858384-1 Sep 19 16:00:08.936968 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-708be90c-b8f4-4a0e-bfb1-7a77751c5db5 req-e028997d-4815-43a1-a013-0c4f1e6eff91 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037465 Sep 19 16:00:08.942473 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3405/6851] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:00:09.176470 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:09.197222 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fb0b0292-a1f2-4e68-8c35-f672a52cfc16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1562 microversion: 2.1 time: 0.300327 Sep 19 16:00:09.203457 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3447/6852] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:08 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1562 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:30.857028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.857813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=36 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.862641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:30.865064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:30.872595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:30.873103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:30.873565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:30.874279 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:30.874787 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:30.875235 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:30.931970 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f0ce5764-aa9c-4278-958f-a0514a574d22 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action" status: 200 len: 24574 microversion: 2.1 time: 0.076687 Sep 19 16:00:30.932653 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3406/6853] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:00:30 2022] POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:00:41.984944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:41.985507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:41.988088 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=11 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:41.988794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=32 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:41.995162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:41.995650 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:41.996091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:41.996784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:41.997242 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:41.997670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:42.063468 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7bbd9feb-a023-4edc-88a2-b1e697e47fed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action" status: 202 len: 0 microversion: 2.1 time: 0.082716 Sep 19 16:00:42.064205 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3448/6854] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:00:41 2022] POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:00:42.073499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:42.074924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:42.078327 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.079017 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=4 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.084993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:42.085494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:42.085946 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:42.086659 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:42.087208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:42.087690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:42.224736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:42.232867 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8e888c0-54e3-46c6-ba4f-367177088f0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1685 microversion: 2.1 time: 0.163731 Sep 19 16:00:42.233461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3407/6855] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:42 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:43.260057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:43.260769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:43.267109 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:43.267603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:43.268211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:43.268920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:43.269383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:43.269815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:43.399107 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:43.407077 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-651c3e7d-37b8-4138-b532-fb37015f8b44 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1665 microversion: 2.1 time: 0.152420 Sep 19 16:00:43.411190 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3449/6856] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:43 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:44.506341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:44.508695 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:44.516363 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:44.516871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:44.517386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:44.518099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:44.518574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:44.519052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:44.568414 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-feab8608-8a8c-4d42-b72f-6889285829bf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action" status: 200 len: 32643 microversion: 2.1 time: 0.066659 Sep 19 16:00:44.569060 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3408/6857] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:00:44 2022] POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action => generated 32643 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:00:44.580964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:44.581603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:44.588677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:44.589168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:44.589607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:44.590302 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:44.590778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:44.591215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:44.659054 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d17f190-3a09-45de-a92a-bf3e0217e8ed tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action" status: 202 len: 0 microversion: 2.1 time: 0.081923 Sep 19 16:00:44.659695 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3450/6858] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:00:44 2022] POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:00:44.668688 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:44.669414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:44.679878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:44.680396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:44.680860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:44.681666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:44.682147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:44.682598 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:44.821648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:44.829828 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bad16e7b-1827-41b4-933f-fc8fdb6548f4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1672 microversion: 2.1 time: 0.165513 Sep 19 16:00:44.830546 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3409/6859] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:44 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:45.857607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:45.858321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:45.865203 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:45.865690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:45.866126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:45.866851 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:45.867309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:45.867735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:46.001396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:46.009141 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea317645-8c2d-4ded-a137-dd3889f0833c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1680 microversion: 2.1 time: 0.156656 Sep 19 16:00:46.009720 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3451/6860] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:45 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:46.102880 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:46.105156 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:46.113180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:46.113632 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:46.114098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:46.114847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:46.115331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:46.115785 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:46.166440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e9e6b8d5-d78e-4a3e-924b-5fc3e1ff487d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action" status: 200 len: 38485 microversion: 2.1 time: 0.067422 Sep 19 16:00:46.167119 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3410/6861] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:00:46 2022] POST /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade/action => generated 38485 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:00:47.458052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:47.458660 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:47.461492 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-b5498578-af81-4ebf-ba8a-053317cfbb10 req-1c0814ed-4747-470b-8080-9f365993d248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c82f908-6298-40c4-832e-95069ad71ade", "tag": "df057637-52ce-40a3-92d2-ba6638cfaf79"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:47.465974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:47.466604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:47.467117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:47.468060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:47.468634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:47.469070 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:47.474431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b5498578-af81-4ebf-ba8a-053317cfbb10 req-1c0814ed-4747-470b-8080-9f365993d248 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:47.475354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b5498578-af81-4ebf-ba8a-053317cfbb10 req-1c0814ed-4747-470b-8080-9f365993d248 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:47.476035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-b5498578-af81-4ebf-ba8a-053317cfbb10 req-1c0814ed-4747-470b-8080-9f365993d248 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:47.488908 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-b5498578-af81-4ebf-ba8a-053317cfbb10 req-1c0814ed-4747-470b-8080-9f365993d248 service nova] Creating event network-changed:df057637-52ce-40a3-92d2-ba6638cfaf79 for instance 2c82f908-6298-40c4-832e-95069ad71ade on n-h1-858384-1 Sep 19 16:00:47.494523 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-b5498578-af81-4ebf-ba8a-053317cfbb10 req-1c0814ed-4747-470b-8080-9f365993d248 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037549 Sep 19 16:00:47.495550 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3411/6862] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:00:47.497778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:00:47.586911 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-57903aec-e036-4b14-9c5b-926b0d1f2730 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 204 len: 0 microversion: 2.1 time: 0.133447 Sep 19 16:00:47.588289 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3452/6863] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:00:47 2022] DELETE /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:47.597441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:47.598173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:47.605200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:47.606024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:47.606476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:47.607470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:47.607948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:47.608398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:47.769942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:47.778401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d61bd1b1-1c5e-4482-96ba-aeec9250eee8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1686 microversion: 2.1 time: 0.185335 Sep 19 16:00:47.779104 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3412/6864] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:47 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:48.806254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:48.807446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:48.819652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:48.820167 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:48.820911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:48.821629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:48.822094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:48.822532 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:48.989791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:48.997737 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8cd1b88f-3ce6-48c8-8201-35f864c3502e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1686 microversion: 2.1 time: 0.196211 Sep 19 16:00:48.998310 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3453/6865] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:48 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:49.663329 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-36be84a2-a937-4e64-b6ba-70beb9ca86ce req-b9ebc4cc-3627-433d-a626-7f0609be2f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c82f908-6298-40c4-832e-95069ad71ade", "name": "network-vif-deleted", "tag": "df057637-52ce-40a3-92d2-ba6638cfaf79"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:49.679198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36be84a2-a937-4e64-b6ba-70beb9ca86ce req-b9ebc4cc-3627-433d-a626-7f0609be2f2a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:49.679628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36be84a2-a937-4e64-b6ba-70beb9ca86ce req-b9ebc4cc-3627-433d-a626-7f0609be2f2a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:49.680153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-36be84a2-a937-4e64-b6ba-70beb9ca86ce req-b9ebc4cc-3627-433d-a626-7f0609be2f2a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:49.692157 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-36be84a2-a937-4e64-b6ba-70beb9ca86ce req-b9ebc4cc-3627-433d-a626-7f0609be2f2a service nova] Creating event network-vif-deleted:df057637-52ce-40a3-92d2-ba6638cfaf79 for instance 2c82f908-6298-40c4-832e-95069ad71ade on n-h1-858384-1 Sep 19 16:00:49.697365 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-36be84a2-a937-4e64-b6ba-70beb9ca86ce req-b9ebc4cc-3627-433d-a626-7f0609be2f2a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 Sep 19 16:00:49.697995 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3413/6866] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:00:50.022054 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:50.022767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:50.030021 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:50.030614 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:50.031140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:50.031842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:50.032296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:50.033254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:50.068315 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:50.069076 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:50.069513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:50.069960 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lazy-loading 'fault' on Instance uuid 2c82f908-6298-40c4-832e-95069ad71ade {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:00:50.114833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:00:50.122703 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8937f6bf-aac1-4286-94fd-7a3223ca2406 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 200 len: 1355 microversion: 2.1 time: 0.104836 Sep 19 16:00:50.123339 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3454/6867] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:50 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:51.148960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:51.149681 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 2c82f908-6298-40c4-832e-95069ad71ade] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:00:51.155945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:51.156449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:51.156896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:51.157636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:00:51.158347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:00:51.158838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:00:51.172583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] HTTP exception thrown: Instance 2c82f908-6298-40c4-832e-95069ad71ade could not be found. Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Request method failure captured: Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade HTTP/1.1 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJH2TUr0hBls95GIz5nyIwGbiSEnpShi_6DeLYZ5CM3J3Q1S0MxG7SNPVjV8qoG-qm0FjtEHrLh52-EttT3IZfbCjs-efRdk--jbWEbt1W_FT9UjcmMXPTvZprvq1-iUaN7NivvEROA-TR-heBki4pEAg4tVDUYYnbh10A29JcRtrwM Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ce7335518ac84046a1a430ad41c14e6c"}]}] Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a8ec11528b34470cb46f5f35259b4ebc Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 2c82f908-6298-40c4-832e-95069ad71ade could not be found. Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '2c82f908-6298-40c4-832e-95069ad71ade'} Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82f908-6298-40c4-832e-95069ad71ade could not be found. Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82f908-6298-40c4-832e-95069ad71ade could not be found. Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:00:51.175109 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82f908-6298-40c4-832e-95069ad71ade could not be found. Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Returning 404 to user: Instance 2c82f908-6298-40c4-832e-95069ad71ade could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-46a40646-e0fc-4276-a706-c2808f55c529 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade" status: 404 len: 111 microversion: 2.1 time: 0.032668 Sep 19 16:00:51.180525 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3414/6868] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:00:51 2022] GET /compute/v2.1/servers/2c82f908-6298-40c4-832e-95069ad71ade => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:00:54.320680 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4f248cc-1498-4c6c-b9b0-1127966c1a85 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '.version_select at 0x7fde299c9b80>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:00:54.352397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4f248cc-1498-4c6c-b9b0-1127966c1a85 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-441940520" status: 202 len: 0 microversion: 2.1 time: 0.035595 Sep 19 16:00:54.353362 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3455/6869] 10.222.0.81 () {58 vars in 1281 bytes} [Mon Sep 19 16:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-441940520 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:00:54.382673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0b682d00-5216-4075-83d6-370b7f2d2a67 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: .version_select at 0x7fde2a73a160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-646509368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBOh62c+LERrGz4dvhwlRLifTLY+1RVUwqMHlJvXZcrM/AdCck+GSZ85B28N96/2lQEd02NPuTf0hX6o4UZdxLhoGsPKoL+WMHwN2SOIu5LuNqQ0hbyUjtkeQmM8HC1LQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:00:54.401353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b682d00-5216-4075-83d6-370b7f2d2a67 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:00:54.407935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0b682d00-5216-4075-83d6-370b7f2d2a67 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:00:54.432565 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0b682d00-5216-4075-83d6-370b7f2d2a67 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053720 Sep 19 16:00:54.433086 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3415/6870] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:00:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:01:00.111461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-653653389", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e46b57dd-276f-4517-9bee-8313f5aa22fd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-646509368", "security_groups": [{"name": "tempest-secgroup-smoke-493281690"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:01:00.121891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:00.227474 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] validate_networks() for [('e46b57dd-276f-4517-9bee-8313f5aa22fd', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:01:00.756418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:01:00.757079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:01:00.757562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:01:00.758007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:01:00.758459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:01:00.768548 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:00.769975 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:00.770634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:00.771659 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:00.772496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:00.773038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:00.798871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:01:00.806901 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:01:00.827905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:01:00.831005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:01:00.900404 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:01:01.909153 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [e7ba8700-19f9-47b9-983d-5abb09ecf33f] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 45272. Sep 19 16:01:01.914976 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c89f9c39-4b0e-486d-9c75-7a9b09dc9dde tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.806912 Sep 19 16:01:01.940873 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8f7ace80-e86f-4ebd-bc6e-b6a04dcd12a0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:01.943089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8f7ace80-e86f-4ebd-bc6e-b6a04dcd12a0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:01.946447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3456/6871] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:01:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:01:01.956842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:02.017833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8f7ace80-e86f-4ebd-bc6e-b6a04dcd12a0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:02.026209 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8f7ace80-e86f-4ebd-bc6e-b6a04dcd12a0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1265 microversion: 2.1 time: 0.101763 Sep 19 16:01:02.043248 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3416/6872] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:01 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:03.052667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:03.054074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:03.062104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:03.063003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:03.064223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:03.065199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:03.065909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:03.066656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:03.168056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:03.177631 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-60e658fc-ac19-4d6b-ab7f-9b24a4360374 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1335 microversion: 2.1 time: 0.131475 Sep 19 16:01:03.178504 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3457/6873] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:03 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1335 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:04.203308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:04.204082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:04.212832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:04.213380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:04.213838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:04.214770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:04.215404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:04.216010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:04.445093 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:04.453071 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-35f5ac8d-60dc-4141-b03d-5d358e6ea068 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1390 microversion: 2.1 time: 0.254393 Sep 19 16:01:04.453714 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3417/6874] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:04 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:04.578188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f7f715d6-0bf7-4b6b-9339-64e59abe67a1 req-c5a8092e-b848-4913-b18f-58c12a3d588c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b00f95d-26f3-48b5-b4f8-9e651132aafc", "tag": "7a83fa52-c38e-4ea9-9ba6-5367985597f0"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:01:04.591720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f7f715d6-0bf7-4b6b-9339-64e59abe67a1 req-c5a8092e-b848-4913-b18f-58c12a3d588c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:04.600598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f7f715d6-0bf7-4b6b-9339-64e59abe67a1 req-c5a8092e-b848-4913-b18f-58c12a3d588c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:04.603049 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f7f715d6-0bf7-4b6b-9339-64e59abe67a1 req-c5a8092e-b848-4913-b18f-58c12a3d588c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:04.615384 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f7f715d6-0bf7-4b6b-9339-64e59abe67a1 req-c5a8092e-b848-4913-b18f-58c12a3d588c service nova] Creating event network-changed:7a83fa52-c38e-4ea9-9ba6-5367985597f0 for instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc on n-h1-858384-1 Sep 19 16:01:04.620635 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f7f715d6-0bf7-4b6b-9339-64e59abe67a1 req-c5a8092e-b848-4913-b18f-58c12a3d588c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046196 Sep 19 16:01:04.621399 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3458/6875] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:01:05.476419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:05.477085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:05.484079 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:05.484528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:05.485121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:05.485924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:05.486403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:05.486885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:05.621253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:05.629583 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c6409199-13e5-471e-83b4-508a724c9c16 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1390 microversion: 2.1 time: 0.157265 Sep 19 16:01:05.630162 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3418/6876] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:05 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:01:06.654184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:06.654923 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:06.661547 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:06.662026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:06.662461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:06.663173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:06.664007 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:06.664420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:06.798691 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:06.806478 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fa523a1f-0af5-49ef-ba49-5568e6802255 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1390 microversion: 2.1 time: 0.157410 Sep 19 16:01:06.807092 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3459/6877] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:06 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:07.830223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:07.831006 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:07.837875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:07.838628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:07.839179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:07.840108 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:07.840626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:07.841437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:07.976424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:07.984534 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ae72831-9044-4f9a-8844-84fc447573f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1390 microversion: 2.1 time: 0.158909 Sep 19 16:01:07.985196 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3419/6878] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:07 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:09.006854 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:09.007475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:09.014910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:09.015398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:09.015839 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:09.016710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:09.017159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:09.017591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:09.155922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:09.165149 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8c83bdab-9030-4d41-903a-43ea76c87605 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1390 microversion: 2.1 time: 0.162170 Sep 19 16:01:09.165734 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3460/6879] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:09 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:09.569838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-7c8ec127-9075-4580-86bc-b5008fd745ff req-46d21fa5-2fb2-4605-a770-fce6c323aa13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b00f95d-26f3-48b5-b4f8-9e651132aafc", "name": "network-vif-plugged", "status": "completed", "tag": "7a83fa52-c38e-4ea9-9ba6-5367985597f0"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:01:09.581112 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c8ec127-9075-4580-86bc-b5008fd745ff req-46d21fa5-2fb2-4605-a770-fce6c323aa13 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:09.581716 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c8ec127-9075-4580-86bc-b5008fd745ff req-46d21fa5-2fb2-4605-a770-fce6c323aa13 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:09.582162 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-7c8ec127-9075-4580-86bc-b5008fd745ff req-46d21fa5-2fb2-4605-a770-fce6c323aa13 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:09.593374 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-7c8ec127-9075-4580-86bc-b5008fd745ff req-46d21fa5-2fb2-4605-a770-fce6c323aa13 service nova] Creating event network-vif-plugged:7a83fa52-c38e-4ea9-9ba6-5367985597f0 for instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc on n-h1-858384-1 Sep 19 16:01:09.598485 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-7c8ec127-9075-4580-86bc-b5008fd745ff req-46d21fa5-2fb2-4605-a770-fce6c323aa13 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032422 Sep 19 16:01:09.599112 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3420/6880] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:01:10.190438 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:10.191096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:10.198433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:10.198987 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:10.199437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:10.200140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:10.200602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:10.201034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:10.336023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:10.343795 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dfc108af-fefa-4151-bb73-8042a9feca12 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1390 microversion: 2.1 time: 0.158289 Sep 19 16:01:10.344507 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3461/6881] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:10 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:11.368605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:11.369369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:11.375831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:11.376314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:11.376773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:11.377487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:11.377966 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:11.378413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:11.511210 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:11.519241 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a16d7b10-2acc-4fe2-b33d-fcf11073ac1b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1561 microversion: 2.1 time: 0.155787 Sep 19 16:01:11.519819 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3421/6882] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:11 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:11.541721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:11.542398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:11.544393 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.545180 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.553106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:11.553596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:11.554033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:11.554725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:11.555207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:11.555640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:11.684139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:11.692253 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eec85136-f821-45e0-aacc-1e02975d59a3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1561 microversion: 2.1 time: 0.154151 Sep 19 16:01:11.692836 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3462/6883] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:11 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:13.607274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-aa094c45-7d8a-4515-ba16-3d836da45ee4 req-b7832a06-9c24-4fa4-9388-c806da9926ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b00f95d-26f3-48b5-b4f8-9e651132aafc", "tag": "7a83fa52-c38e-4ea9-9ba6-5367985597f0"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:01:13.613073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:13.617583 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:13.618224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:13.620282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:13.621990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:13.630739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aa094c45-7d8a-4515-ba16-3d836da45ee4 req-b7832a06-9c24-4fa4-9388-c806da9926ec service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:13.631248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aa094c45-7d8a-4515-ba16-3d836da45ee4 req-b7832a06-9c24-4fa4-9388-c806da9926ec service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:13.631687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aa094c45-7d8a-4515-ba16-3d836da45ee4 req-b7832a06-9c24-4fa4-9388-c806da9926ec service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:13.638434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:13.639011 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:13.639474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:13.640231 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:13.640726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:13.641747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:13.659817 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-aa094c45-7d8a-4515-ba16-3d836da45ee4 req-b7832a06-9c24-4fa4-9388-c806da9926ec service nova] Creating event network-changed:7a83fa52-c38e-4ea9-9ba6-5367985597f0 for instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc on n-h1-858384-1 Sep 19 16:01:13.665229 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-aa094c45-7d8a-4515-ba16-3d836da45ee4 req-b7832a06-9c24-4fa4-9388-c806da9926ec service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061669 Sep 19 16:01:13.666031 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3463/6884] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:01:13.882613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:13.890480 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-67fdfa64-9790-49a6-b746-40e010cf1cad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1561 microversion: 2.1 time: 0.289886 Sep 19 16:01:13.891170 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3422/6885] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:13 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1561 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:35.187588 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.192091 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:01:35.194372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:35.201648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:35.202820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:35.203430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:35.204119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:35.204576 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:35.205004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:35.254824 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7f077e35-247e-4852-9484-3d1e066fd13a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc/action" status: 200 len: 24567 microversion: 2.1 time: 0.070283 Sep 19 16:01:35.255485 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3464/6886] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:01:35 2022] POST /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc/action => generated 24567 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:46.353612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:01:46.355952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:46.359176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:46.359951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:46.366366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:46.366882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:46.367338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:46.368051 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:46.368522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:46.368963 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:46.446058 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-00916824-ad6a-4119-9552-adaf808c522a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc/action" status: 202 len: 0 microversion: 2.1 time: 0.096523 Sep 19 16:01:46.446730 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3423/6887] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:01:46 2022] POST /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:01:46.456055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:46.456801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:46.459820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:46.460488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:46.466947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:46.467486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:46.467931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:46.468715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:46.469176 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:46.469605 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:46.773828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:46.782053 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-43ce2b41-1383-4b8e-bedf-838342647789 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1672 microversion: 2.1 time: 0.330857 Sep 19 16:01:46.782860 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3465/6888] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:46 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1672 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:47.808691 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:47.809416 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:47.815887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:47.816398 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:47.816868 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:47.817556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:47.818030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:47.818476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:48.001928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:48.009752 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-63e9228f-071b-432f-9e2e-c59dc40f7ac8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.206419 Sep 19 16:01:48.010325 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3424/6889] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:47 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:49.033453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:49.034099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:49.041831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:49.042320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:49.042774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:49.043466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:49.043922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:49.044348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:49.172696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:49.180476 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eaa16c0f-b52a-46ef-96c6-05dfcc581a71 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.151181 Sep 19 16:01:49.181055 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3466/6890] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:49 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:50.204836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:50.205476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:50.212381 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:50.212897 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:50.213356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:50.214070 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:50.214549 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:50.215028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:50.348285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:50.356400 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-972e083e-8610-451f-9065-b9ff1eed9e1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.156213 Sep 19 16:01:50.356982 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3425/6891] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:50 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:51.379776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:51.380399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:51.387304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:51.387797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:51.388243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:51.389565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:51.390128 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:51.390566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:51.522442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:51.531009 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-51151e72-419b-4343-92f0-9f72885df802 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.155225 Sep 19 16:01:51.531597 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3467/6892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:51 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:52.555306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:52.555863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:52.562899 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:52.563403 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:52.563856 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:52.564669 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:52.565185 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:52.565644 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:52.699852 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:52.708216 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7be8e962-6c38-4edb-aa11-048ab02d44fd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.157162 Sep 19 16:01:52.708833 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3426/6893] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:52 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:53.733704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:53.734589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:53.741921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:53.742411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:53.743227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:53.744268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:53.744728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:53.745327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:53.895115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:53.903390 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2906b852-de6e-4822-881f-f25b9aa594be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.174919 Sep 19 16:01:53.903975 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3468/6894] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:53 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:54.938071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:54.938701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:54.945579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:54.946083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:54.946526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:54.947257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:54.947727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:54.948166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:55.080257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:55.088036 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-57852815-748f-4373-896b-e667632ac8e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.154280 Sep 19 16:01:55.088618 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3427/6895] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:54 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:56.112913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:56.113515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:56.120383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:56.120870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:56.121309 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:56.121999 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:56.122458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:56.122966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:56.259644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:56.267431 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b7b0f366-44d9-4dd2-bbc3-31b0fa5205bc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.158511 Sep 19 16:01:56.268009 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3469/6896] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:56 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:57.291321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:57.291969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:57.299811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:57.300319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:57.300782 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:57.301494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:57.301972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:57.302421 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:57.436651 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:57.444647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-56cf1436-39ba-4ba8-9d33-ebec45d9e943 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.157289 Sep 19 16:01:57.445263 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3428/6897] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:57 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:58.469002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:58.469558 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:58.476834 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:58.477324 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:58.477766 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:58.478464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:58.478962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:58.479394 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:58.615622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:58.623883 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b90e3d9f-72bb-419d-b0a6-fee9e5b78a5a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.159224 Sep 19 16:01:58.624461 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3470/6898] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:58 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:01:59.648032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:01:59.648567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:01:59.655529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:59.656034 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:59.656486 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:59.657195 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:01:59.657671 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:01:59.658147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:01:59.787477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:01:59.796159 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d7652eb-b27d-4627-9dbe-670659b22ea1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.151875 Sep 19 16:01:59.796744 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3429/6899] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:01:59 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:00.819873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:00.820407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:00.827668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:00.828170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:00.828584 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:00.829268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:00.829722 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:00.830139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:00.964781 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:00.972591 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d21ae522-62b0-4342-8514-b625679ed75d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.156884 Sep 19 16:02:00.973169 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3471/6900] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:00 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:01.996148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:01.996758 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:02.003480 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:02.003975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:02.004427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:02.005122 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:02.005587 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:02.006020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:02.136805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:02.145409 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b8f207b-a194-429c-ab29-3b57da35f902 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1677 microversion: 2.1 time: 0.153204 Sep 19 16:02:02.145990 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3430/6901] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:01 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:03.168457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:03.169102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:03.176416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:03.176906 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:03.177346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:03.178036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:03.178497 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:03.178959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:03.309099 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:03.317039 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5847f22f-735c-42a8-9fe5-a7240a830978 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1680 microversion: 2.1 time: 0.152529 Sep 19 16:02:03.317601 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3472/6902] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:03 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:27.502516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:27.504864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:27.507713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:27.508389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:27.514262 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:27.514771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:27.515243 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:27.520127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:27.520604 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:27.521052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:27.592137 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7c1b5ee2-386c-4b0d-9f79-1a58c9bc2744 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc/action" status: 200 len: 68946 microversion: 2.1 time: 0.093656 Sep 19 16:02:27.592793 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3431/6903] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:02:27 2022] POST /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc/action => generated 68946 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:02:34.933133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:34.934304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:34.936675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=16 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:34.938196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=48 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:34.944333 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:34.944911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:34.945427 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:34.946226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:34.946769 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:34.947294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:34.975061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:02:34.997603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-facb8c79-52ec-4592-86d9-a2a7abcbe41d req-dd32fd08-4a19-43ae-9931-f8e505db6d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b00f95d-26f3-48b5-b4f8-9e651132aafc", "tag": "7a83fa52-c38e-4ea9-9ba6-5367985597f0"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:35.009238 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-facb8c79-52ec-4592-86d9-a2a7abcbe41d req-dd32fd08-4a19-43ae-9931-f8e505db6d1d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:35.009748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-facb8c79-52ec-4592-86d9-a2a7abcbe41d req-dd32fd08-4a19-43ae-9931-f8e505db6d1d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:35.010339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-facb8c79-52ec-4592-86d9-a2a7abcbe41d req-dd32fd08-4a19-43ae-9931-f8e505db6d1d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:35.021880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-facb8c79-52ec-4592-86d9-a2a7abcbe41d req-dd32fd08-4a19-43ae-9931-f8e505db6d1d service nova] Creating event network-changed:7a83fa52-c38e-4ea9-9ba6-5367985597f0 for instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc on n-h1-858384-1 Sep 19 16:02:35.027555 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-facb8c79-52ec-4592-86d9-a2a7abcbe41d req-dd32fd08-4a19-43ae-9931-f8e505db6d1d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096046 Sep 19 16:02:35.028769 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3432/6904] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:02:35.069105 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb867a63-22ac-4594-a577-401b3d2db92d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 204 len: 0 microversion: 2.1 time: 0.139287 Sep 19 16:02:35.069564 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3473/6905] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:02:34 2022] DELETE /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:02:35.079915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:35.080673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:35.086941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:35.087445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:35.087930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:35.088636 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:35.089111 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:35.089552 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:35.262084 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:35.270182 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-76ac2348-0017-4f0e-a006-defd6aa37318 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1686 microversion: 2.1 time: 0.195497 Sep 19 16:02:35.271526 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3433/6906] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:35 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:36.296172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:36.296874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:36.303805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:36.304299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:36.304725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:36.305421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:36.305873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:36.306295 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:36.539277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:36.548766 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e00cdaf1-15ca-45cf-8668-65c242591245 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1686 microversion: 2.1 time: 0.257585 Sep 19 16:02:36.549275 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3474/6907] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:36 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1686 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:37.213167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-939dd6f9-346c-4abe-a932-395c0482545a req-d18159d5-77fe-40c3-9aba-fa36b8932940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b00f95d-26f3-48b5-b4f8-9e651132aafc", "name": "network-vif-deleted", "tag": "7a83fa52-c38e-4ea9-9ba6-5367985597f0"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:37.222791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-939dd6f9-346c-4abe-a932-395c0482545a req-d18159d5-77fe-40c3-9aba-fa36b8932940 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:37.223389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-939dd6f9-346c-4abe-a932-395c0482545a req-d18159d5-77fe-40c3-9aba-fa36b8932940 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:37.223844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-939dd6f9-346c-4abe-a932-395c0482545a req-d18159d5-77fe-40c3-9aba-fa36b8932940 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:37.236105 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-939dd6f9-346c-4abe-a932-395c0482545a req-d18159d5-77fe-40c3-9aba-fa36b8932940 service nova] Creating event network-vif-deleted:7a83fa52-c38e-4ea9-9ba6-5367985597f0 for instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc on n-h1-858384-1 Sep 19 16:02:37.241028 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-939dd6f9-346c-4abe-a932-395c0482545a req-d18159d5-77fe-40c3-9aba-fa36b8932940 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087802 Sep 19 16:02:37.241817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3434/6908] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:02:37.572297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:37.573046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:37.581764 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:37.582248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:37.582709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:37.583432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:37.583885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:37.584310 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:37.620886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:37.622198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:37.622637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:37.623121 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lazy-loading 'fault' on Instance uuid 0b00f95d-26f3-48b5-b4f8-9e651132aafc {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:02:37.665150 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:37.675078 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcce3cd1-654e-4956-8721-5f9a3b8ef476 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 200 len: 1355 microversion: 2.1 time: 0.106721 Sep 19 16:02:37.675733 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3475/6909] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:37 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:38.702374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:38.703105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 0b00f95d-26f3-48b5-b4f8-9e651132aafc] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:38.709388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:38.709878 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:38.710336 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:38.711085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:38.711565 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:38.712010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:38.725879 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] HTTP exception thrown: Instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc could not be found. Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Request method failure captured: Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc HTTP/1.1 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJH2TUr0hBls95GIz5nyIwGbiSEnpShi_6DeLYZ5CM3J3Q1S0MxG7SNPVjV8qoG-qm0FjtEHrLh52-EttT3IZfbCjs-efRdk--jbWEbt1W_FT9UjcmMXPTvZprvq1-iUaN7NivvEROA-TR-heBki4pEAg4tVDUYYnbh10A29JcRtrwM Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ce7335518ac84046a1a430ad41c14e6c"}]}] Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a8ec11528b34470cb46f5f35259b4ebc Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc could not be found. Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '0b00f95d-26f3-48b5-b4f8-9e651132aafc'} Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc could not be found. Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc could not be found. Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:02:38.727576 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc could not be found. Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Returning 404 to user: Instance 0b00f95d-26f3-48b5-b4f8-9e651132aafc could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-e7d6de61-54a5-4561-b3f3-42df6fcf4891 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc" status: 404 len: 111 microversion: 2.1 time: 0.032567 Sep 19 16:02:38.733945 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3435/6910] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:38 2022] GET /compute/v2.1/servers/0b00f95d-26f3-48b5-b4f8-9e651132aafc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:02:42.049085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-febcc676-738b-4a73-ac11-981661a6d9cf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '.version_select at 0x7fde29935dc0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:42.070723 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-febcc676-738b-4a73-ac11-981661a6d9cf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-646509368" status: 202 len: 0 microversion: 2.1 time: 0.025548 Sep 19 16:02:42.071607 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3476/6911] 10.222.0.81 () {58 vars in 1281 bytes} [Mon Sep 19 16:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-646509368 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:02:42.100325 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0aab509e-cf9e-4254-b8f8-21e2c545752e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: .version_select at 0x7fde298a84c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1667983100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYf6cJh5dvecTHcSlcNthWGLXXqqheqvZq7WtqwE29Nro3r92Gm+KEXw0d3MzdgNxjrGH8OMP+3OMo2PJZYqN42zwNF3CUubXSdFB4UYrz5Anezd4iUUSIRd0u23p70sA=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:42.120234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0aab509e-cf9e-4254-b8f8-21e2c545752e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:02:42.126078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-0aab509e-cf9e-4254-b8f8-21e2c545752e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:02:42.150108 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0aab509e-cf9e-4254-b8f8-21e2c545752e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053578 Sep 19 16:02:42.150646 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3436/6912] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:02:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:02:47.345133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-476585862", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "e83f9ae5-1f3d-4cb7-95b1-5eb7cb1a5ac6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1667983100", "security_groups": [{"name": "tempest-secgroup-smoke-714062707"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:47.492059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] validate_networks() for [('e83f9ae5-1f3d-4cb7-95b1-5eb7cb1a5ac6', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:02:47.671075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:47.921265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:02:47.921736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:02:47.922285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:02:47.922713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:02:47.923173 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:02:47.933486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:47.933934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:47.934381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:47.935163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:47.935628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:47.936061 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:47.955100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:02:47.960447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:02:47.973508 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:02:47.975910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:02:48.025942 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2f3c237b-197c-441c-a22f-73b1e8f72513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688067 Sep 19 16:02:48.033355 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3477/6913] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:02:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:02:48.039939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ae66a32-2429-4c93-b897-9c3b8399a5f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:48.041223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ae66a32-2429-4c93-b897-9c3b8399a5f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:48.101924 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ae66a32-2429-4c93-b897-9c3b8399a5f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:48.109582 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ae66a32-2429-4c93-b897-9c3b8399a5f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1266 microversion: 2.1 time: 0.074663 Sep 19 16:02:48.110181 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3437/6914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:48 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:49.134408 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:49.135720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:49.143263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:49.143770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:49.144256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:49.144928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:49.145384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:49.145807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:49.211316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:49.219605 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f34791ce-bd5c-4539-8417-ef08f1ca0bab tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1336 microversion: 2.1 time: 0.090431 Sep 19 16:02:49.220216 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3478/6915] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:49 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:50.244483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:50.245248 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:50.248319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:50.256846 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:50.257460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:50.258004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:50.263786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:50.264507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:50.264984 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:50.846371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:50.855876 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8e4c5eab-a45a-4fbd-a08f-3e3e93e18f60 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.615346 Sep 19 16:02:50.856474 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3438/6916] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:50 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:51.049671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bf601bbd-712f-4e26-97d7-d8a995cc474e req-5caf941a-a2ab-40fe-9752-506c47245b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:51.060079 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bf601bbd-712f-4e26-97d7-d8a995cc474e req-5caf941a-a2ab-40fe-9752-506c47245b7b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:51.060968 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bf601bbd-712f-4e26-97d7-d8a995cc474e req-5caf941a-a2ab-40fe-9752-506c47245b7b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:51.061518 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bf601bbd-712f-4e26-97d7-d8a995cc474e req-5caf941a-a2ab-40fe-9752-506c47245b7b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:51.073652 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bf601bbd-712f-4e26-97d7-d8a995cc474e req-5caf941a-a2ab-40fe-9752-506c47245b7b service nova] Creating event network-changed:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h2-858384-1 Sep 19 16:02:51.078618 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bf601bbd-712f-4e26-97d7-d8a995cc474e req-5caf941a-a2ab-40fe-9752-506c47245b7b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034590 Sep 19 16:02:51.079446 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3479/6917] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:02:51.880144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:51.880693 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:51.888438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:51.888940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:51.889393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:51.890091 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:51.890560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:51.891030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:52.030113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:52.037783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-59bc3b3b-79eb-4eb5-823d-569b735ab77e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.161792 Sep 19 16:02:52.038357 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3439/6918] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:51 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:53.063030 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:53.063671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:53.069924 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:53.070412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:53.070880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:53.071579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:53.072043 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:53.072477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:53.204478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:53.212242 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bcef0f41-3d86-4d02-937e-41dbe344af4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.155200 Sep 19 16:02:53.212808 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3480/6919] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:53 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:54.236400 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:54.237036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:54.243990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:54.244494 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:54.244952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:54.246258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:54.246838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:54.247291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:54.377837 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:54.385630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c1eca965-84d7-4ad9-9bf3-7c7aa281eace tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.153175 Sep 19 16:02:54.386413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3440/6920] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:54 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:55.408102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:55.408728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:55.415747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:55.416243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:55.416687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:55.418037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:55.418498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:55.418955 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:55.556784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:55.565232 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-15190e64-536b-4f86-8137-c57fabb0cdbb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.161018 Sep 19 16:02:55.565810 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3481/6921] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:55 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:56.588422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:56.588995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:56.595989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:56.596495 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:56.596952 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:56.597656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:56.598133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:56.598578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:56.729337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:56.737183 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-614955e8-9668-4890-9040-e4013c732cb3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.152782 Sep 19 16:02:56.737755 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3441/6922] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:56 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:57.661572 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7126c721-066c-416c-8eda-0295611dc295 req-1ad9d602-5335-4f20-8bbd-71eb6626a827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "name": "network-vif-plugged", "status": "completed", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:02:57.673635 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7126c721-066c-416c-8eda-0295611dc295 req-1ad9d602-5335-4f20-8bbd-71eb6626a827 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:57.674245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7126c721-066c-416c-8eda-0295611dc295 req-1ad9d602-5335-4f20-8bbd-71eb6626a827 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:57.674727 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7126c721-066c-416c-8eda-0295611dc295 req-1ad9d602-5335-4f20-8bbd-71eb6626a827 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:57.686701 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7126c721-066c-416c-8eda-0295611dc295 req-1ad9d602-5335-4f20-8bbd-71eb6626a827 service nova] Creating event network-vif-plugged:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h2-858384-1 Sep 19 16:02:57.691615 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7126c721-066c-416c-8eda-0295611dc295 req-1ad9d602-5335-4f20-8bbd-71eb6626a827 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033914 Sep 19 16:02:57.692212 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3482/6923] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:02:57.760014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:57.760689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:57.763575 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:57.769780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:57.770296 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:57.770770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:57.771512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:57.771994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:57.772453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:57.931397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:57.939742 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-788a4bc5-3680-45f7-b806-ed738ef20ac9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1391 microversion: 2.1 time: 0.183709 Sep 19 16:02:57.940316 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3442/6924] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:57 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:58.960381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:58.961155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:58.966865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:58.967568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:58.974661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:58.975117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:58.975557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:58.976250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:58.976710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:58.977136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:59.110822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:59.118555 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ed5bde46-47c1-4c4f-a894-bbcc26a58831 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1562 microversion: 2.1 time: 0.159183 Sep 19 16:02:59.119163 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3483/6925] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:58 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:02:59.141930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:02:59.142560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:02:59.144481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:59.150441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:59.150977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:59.151750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:59.152527 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:02:59.152991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:02:59.153433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:02:59.296178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:02:59.304080 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fd5b4762-09ac-4597-9809-88b36df6fbcf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1562 microversion: 2.1 time: 0.166162 Sep 19 16:02:59.304703 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3443/6926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:02:59 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:01.217040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-40ccf0e9-6f20-48cb-b5ea-28239736a1ec req-0c56b1f3-2cbb-4ea5-9785-b2cbef651c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:01.221830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:01.222460 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:01.230892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:01.231719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:01.232175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:01.233003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:01.233646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:01.234084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:01.235144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-40ccf0e9-6f20-48cb-b5ea-28239736a1ec req-0c56b1f3-2cbb-4ea5-9785-b2cbef651c41 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:01.235647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-40ccf0e9-6f20-48cb-b5ea-28239736a1ec req-0c56b1f3-2cbb-4ea5-9785-b2cbef651c41 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:01.236095 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-40ccf0e9-6f20-48cb-b5ea-28239736a1ec req-0c56b1f3-2cbb-4ea5-9785-b2cbef651c41 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:01.247854 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-40ccf0e9-6f20-48cb-b5ea-28239736a1ec req-0c56b1f3-2cbb-4ea5-9785-b2cbef651c41 service nova] Creating event network-changed:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h2-858384-1 Sep 19 16:03:01.252936 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-40ccf0e9-6f20-48cb-b5ea-28239736a1ec req-0c56b1f3-2cbb-4ea5-9785-b2cbef651c41 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040447 Sep 19 16:03:01.253557 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3444/6927] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:03:01.449311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:01.461510 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1346d401-bafe-4029-a447-afe63832b441 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1562 microversion: 2.1 time: 0.248564 Sep 19 16:03:01.462278 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3484/6928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:01 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:24.724447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:24.725129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=38 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:24.729479 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:24.731830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:24.738741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:24.739269 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:24.739723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:24.740429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:24.740904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:24.741345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:24.793780 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1c6f6cb7-ad35-4450-841c-489960249b6c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action" status: 200 len: 24565 microversion: 2.1 time: 0.071249 Sep 19 16:03:24.794444 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3445/6929] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:03:24 2022] POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:03:31.164440 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:31.167591 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:31.170130 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:31.170873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:31.177602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:31.178080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:31.178513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:31.179222 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:31.179673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:31.180093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:31.221946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:31.227838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128730) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 19 16:03:31.235442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:03:31.235860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:03:31.236328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:03:31.236731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:03:31.237136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:03:31.301333 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6104c4ac-e62f-4244-9099-8cd6d24e932f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action" status: 202 len: 0 microversion: 2.1 time: 0.140663 Sep 19 16:03:31.305136 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3485/6930] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:03:31 2022] POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:03:31.310768 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:31.311512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:31.314479 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:03:31.314620 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c (ip 10.222.0.81) !!! Sep 19 16:03:31.323473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:31.323991 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:31.324455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:31.325179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:31.325670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:31.326116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:31.474639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:31.482774 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a9402f56-10f9-41c6-9c7f-8eedd4a02aa4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1689 microversion: 2.1 time: 0.176274 Sep 19 16:03:31.483376 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3446/6931] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:31 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:32.507410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:32.508134 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:32.515537 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:32.516026 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:32.516464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:32.517164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:32.517620 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:32.518040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:32.656254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:32.664055 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a7c07f53-a44d-47d4-829a-7dc444c0ff3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1689 microversion: 2.1 time: 0.161680 Sep 19 16:03:32.664622 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3486/6932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:32 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:33.689370 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:33.690065 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:33.697667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:33.698174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:33.698631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:33.699518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:33.700025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:33.700485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:33.833193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:33.841631 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-21cc2717-bec0-4000-bb80-61dfd4638d8b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.156229 Sep 19 16:03:33.842208 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3447/6933] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:33 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:03:34.865632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:34.866231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:34.873288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:34.873786 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:34.874255 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:34.874980 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:34.875450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:34.875881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:35.008712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:35.016434 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a0b4d03b-6528-4750-8220-e7dc8dc5f02b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.154874 Sep 19 16:03:35.017002 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3487/6934] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:34 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:36.040240 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:36.041157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:36.048471 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:36.048979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:36.049474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:36.050193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:36.050676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:36.051176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:36.181711 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:36.189514 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d348abd4-e911-4252-bc9a-d4846de7919b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.153261 Sep 19 16:03:36.190096 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3448/6935] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:36 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:37.213496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:37.214397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:37.221214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:37.221700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:37.222133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:37.222843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:37.223299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:37.223721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:37.361496 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:37.369866 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-514249db-1af1-40cd-8ecb-ce94208b744e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.160325 Sep 19 16:03:37.370447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3488/6936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:37 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:38.393700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:38.394337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:38.401643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:38.402150 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:38.402605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:38.403379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:38.403855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:38.404302 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:38.537913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:38.546408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0ce6e305-4704-4695-9137-96e746d804b8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.156675 Sep 19 16:03:38.547011 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3449/6937] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:38 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:39.569526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:39.570104 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:39.577836 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:39.578336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:39.578804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:39.579504 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:39.579998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:39.580432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:39.708940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:39.716725 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2874524e-1f66-4513-b227-302697740886 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.151244 Sep 19 16:03:39.717299 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3489/6938] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:39 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:40.740130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:40.740719 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:40.747866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:40.748373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:40.748832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:40.749540 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:40.750019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:40.750466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:40.888977 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:40.896676 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7cb1d80a-7a22-4d42-8d35-7b6c30499863 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.160571 Sep 19 16:03:40.897268 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3450/6939] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:40 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:41.920055 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:41.920671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:41.927600 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:41.928087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:41.928526 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:41.929220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:41.929681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:41.930111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:42.065905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:42.074221 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68dce78d-b3f3-4904-88d7-3a4038a9158c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.159061 Sep 19 16:03:42.074821 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3490/6940] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:41 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:43.099838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:43.100497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:43.107334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:43.107833 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:43.108286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:43.108983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:43.109454 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:43.110161 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:43.243822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:43.251956 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4c0f9dd-4f30-42f0-a845-bbbb9bc4871a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.155866 Sep 19 16:03:43.252581 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3451/6941] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:43 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:44.276126 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:44.276723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:44.283639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:44.284125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:44.284568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:44.285261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:44.285717 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:44.286142 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:44.416479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:44.424488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ec9641b9-2c3a-4b89-b9c8-9b88e955e381 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1694 microversion: 2.1 time: 0.152459 Sep 19 16:03:44.425050 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3491/6942] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:44 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:45.448981 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:45.449614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:45.456501 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:45.457008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:45.457467 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:45.458189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:45.458665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:45.459153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:45.671685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:45.679715 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-08f299ff-5887-40e8-b97e-a32e65edf799 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1693 microversion: 2.1 time: 0.235261 Sep 19 16:03:45.680838 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3452/6943] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:45 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:45.769058 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "name": "network-vif-unplugged", "status": "completed", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:45.779648 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:45.780116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:45.780552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:45.792999 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] Creating event network-vif-unplugged:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h1-858384-1 Sep 19 16:03:45.798632 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 16:03:45.810715 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-13c40da6-aa5f-46d0-83d6-b56e1e827f78 req-952c206d-dcdd-4e59-841c-a61f7bd6217f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045320 Sep 19 16:03:45.811539 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3492/6944] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:03:46.704410 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:46.705072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:46.712723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:46.713229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:46.713685 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:46.714435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:46.714938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:46.715390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:46.922276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:46.930207 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a09d7f48-c0dc-4289-bf4c-a6d3e119c8f0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1693 microversion: 2.1 time: 0.229710 Sep 19 16:03:46.930905 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3453/6945] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:46 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1693 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:47.854443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:47.864190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:47.864675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:47.865184 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:47.877872 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] Creating event network-changed:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h1-858384-1 Sep 19 16:03:47.884001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-1', 'n-h1-858384-1'} {{(pid=128730) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Sep 19 16:03:47.894681 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-aea6beb5-59f5-4fa7-a97e-695258450bfc req-5f57a0c5-17a7-4256-a803-4e94850a0bc9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045477 Sep 19 16:03:47.895316 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3493/6946] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:03:47.953740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:47.954579 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:47.962219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:47.963037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:47.963500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:47.964214 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:47.964692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:47.965133 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:48.172005 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:48.179881 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bbc83483-c108-450f-8081-677fc5cce2be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1691 microversion: 2.1 time: 0.230247 Sep 19 16:03:48.180502 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3454/6947] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:47 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:49.207292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:49.208018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:49.214936 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.215422 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.215865 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.216551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.217004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.217426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.357059 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:49.364846 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-159523a9-830c-4c31-8ee7-db382ec7463b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1688 microversion: 2.1 time: 0.162707 Sep 19 16:03:49.365590 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3494/6948] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:49 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:49.388266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:49.388816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:49.395843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.396350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.396807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.397558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.398062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.398531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.457288 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8eadf8c9-ed20-4051-b89c-9919d29127be tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action" status: 204 len: 0 microversion: 2.1 time: 0.073219 Sep 19 16:03:49.457991 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3455/6949] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:03:49 2022] POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:03:49.466555 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:49.467213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:49.473288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.473707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.474358 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.475116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.475718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.476188 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.690957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:49.699034 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ca1af16b-dbce-45b5-9e3b-edf65b55bac1 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1688 microversion: 2.1 time: 0.236552 Sep 19 16:03:49.699609 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3495/6950] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:49 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:49.722657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:49.723373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:49.730505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.731059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.731515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.732386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:49.732855 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:49.733383 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:49.949143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:49.956888 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-821d92f2-602a-4db1-aaae-158402f52a57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1688 microversion: 2.1 time: 0.238713 Sep 19 16:03:49.960943 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3456/6951] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:49 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:03:50.982433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:03:50.983136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:03:50.989808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:50.990301 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:50.990740 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:50.991520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:50.991984 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:50.992413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:51.128042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:03:51.135835 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f51c65f7-619d-46c0-ab27-4db25d56b4bb tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1680 microversion: 2.1 time: 0.157730 Sep 19 16:03:51.136399 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3496/6952] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:03:50 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:03:52.499723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-75e936cf-0ec7-454a-b00f-937ef0f11e58 req-b5f6a551-982e-4423-9b2d-a1e019c71924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "name": "network-vif-plugged", "status": "completed", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:03:52.509666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-75e936cf-0ec7-454a-b00f-937ef0f11e58 req-b5f6a551-982e-4423-9b2d-a1e019c71924 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:03:52.510170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-75e936cf-0ec7-454a-b00f-937ef0f11e58 req-b5f6a551-982e-4423-9b2d-a1e019c71924 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:03:52.510619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-75e936cf-0ec7-454a-b00f-937ef0f11e58 req-b5f6a551-982e-4423-9b2d-a1e019c71924 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:03:52.522191 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-75e936cf-0ec7-454a-b00f-937ef0f11e58 req-b5f6a551-982e-4423-9b2d-a1e019c71924 service nova] Creating event network-vif-plugged:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h1-858384-1 Sep 19 16:03:52.527647 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-75e936cf-0ec7-454a-b00f-937ef0f11e58 req-b5f6a551-982e-4423-9b2d-a1e019c71924 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089671 Sep 19 16:03:52.528553 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3457/6953] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:04:13.313662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:13.316023 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:13.318223 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=28 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:13.318915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:13.325140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:13.325641 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:13.326082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:13.326800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:13.327261 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:13.327690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:13.385673 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac0f1b43-e196-4ea5-9dc7-719d11668e4a tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action" status: 200 len: 24578 microversion: 2.1 time: 0.076089 Sep 19 16:04:13.386351 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3497/6954] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:04:13 2022] POST /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c/action => generated 24578 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:04:20.371286 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=26 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:20.372208 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:20.376821 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:20.377441 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:20.382215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d1bebe0a-608a-4768-b761-3beac895cda6 req-0deb175e-bf97-48e8-8b7a-c1262c1e3d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:20.394812 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1bebe0a-608a-4768-b761-3beac895cda6 req-0deb175e-bf97-48e8-8b7a-c1262c1e3d9e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:20.395297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1bebe0a-608a-4768-b761-3beac895cda6 req-0deb175e-bf97-48e8-8b7a-c1262c1e3d9e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:20.395733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d1bebe0a-608a-4768-b761-3beac895cda6 req-0deb175e-bf97-48e8-8b7a-c1262c1e3d9e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:20.404147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:20.404672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:20.405135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:20.405901 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:20.406390 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:20.406860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:20.423064 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d1bebe0a-608a-4768-b761-3beac895cda6 req-0deb175e-bf97-48e8-8b7a-c1262c1e3d9e service nova] Creating event network-changed:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h1-858384-1 Sep 19 16:04:20.428212 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d1bebe0a-608a-4768-b761-3beac895cda6 req-0deb175e-bf97-48e8-8b7a-c1262c1e3d9e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060376 Sep 19 16:04:20.430409 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3498/6955] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:04:20.447653 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:04:20.540300 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd100396-6351-442a-86cc-598f9fe08c3b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 204 len: 0 microversion: 2.1 time: 0.175798 Sep 19 16:04:20.541420 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3458/6956] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:04:20 2022] DELETE /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:04:20.552452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:20.553425 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:20.562064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:20.562507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:20.563102 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:20.563944 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:20.564251 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:20.564656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:20.714271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:20.722291 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d7f246d5-73aa-425a-9dee-fa20a5384959 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1686 microversion: 2.1 time: 0.175829 Sep 19 16:04:20.722902 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3499/6957] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:20 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:04:21.748229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:21.749045 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:21.755935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:21.756442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:21.757035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:21.757751 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:21.758233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:21.758667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:22.075350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:22.082878 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-75add907-dde2-4d3f-9dea-be6980e7c017 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 200 len: 1686 microversion: 2.1 time: 0.338991 Sep 19 16:04:22.097525 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3459/6958] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:21 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 1686 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:22.445593 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ecf3f50a-3e7a-4e3b-ab9f-820772b9e626 req-66d54d95-f9fd-4e99-9f89-10281d943470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf775-7486-4de7-bf5b-0d392d5ef99c", "name": "network-vif-deleted", "tag": "e22c7ad2-fb0c-43c9-920a-b672e12d60f6"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:22.457243 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ecf3f50a-3e7a-4e3b-ab9f-820772b9e626 req-66d54d95-f9fd-4e99-9f89-10281d943470 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:22.457721 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ecf3f50a-3e7a-4e3b-ab9f-820772b9e626 req-66d54d95-f9fd-4e99-9f89-10281d943470 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:22.458145 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ecf3f50a-3e7a-4e3b-ab9f-820772b9e626 req-66d54d95-f9fd-4e99-9f89-10281d943470 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:22.471174 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ecf3f50a-3e7a-4e3b-ab9f-820772b9e626 req-66d54d95-f9fd-4e99-9f89-10281d943470 service nova] Creating event network-vif-deleted:e22c7ad2-fb0c-43c9-920a-b672e12d60f6 for instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c on n-h1-858384-1 Sep 19 16:04:22.476241 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ecf3f50a-3e7a-4e3b-ab9f-820772b9e626 req-66d54d95-f9fd-4e99-9f89-10281d943470 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034870 Sep 19 16:04:22.477317 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3500/6959] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:04:23.108346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:23.108895 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: 5bfaf775-7486-4de7-bf5b-0d392d5ef99c] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:23.115995 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:23.117193 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:23.117791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:23.118502 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:23.119000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:23.119448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:23.134042 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] HTTP exception thrown: Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c could not be found. Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Request method failure captured: Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c HTTP/1.1 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJH2TUr0hBls95GIz5nyIwGbiSEnpShi_6DeLYZ5CM3J3Q1S0MxG7SNPVjV8qoG-qm0FjtEHrLh52-EttT3IZfbCjs-efRdk--jbWEbt1W_FT9UjcmMXPTvZprvq1-iUaN7NivvEROA-TR-heBki4pEAg4tVDUYYnbh10A29JcRtrwM Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ce7335518ac84046a1a430ad41c14e6c"}]}] Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a8ec11528b34470cb46f5f35259b4ebc Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c could not be found. Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': '5bfaf775-7486-4de7-bf5b-0d392d5ef99c'} Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c could not be found. Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c could not be found. Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:04:23.135841 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c could not be found. Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Returning 404 to user: Instance 5bfaf775-7486-4de7-bf5b-0d392d5ef99c could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-33cbbd2d-dc83-4ef4-a9bb-4206f3029b7d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c" status: 404 len: 111 microversion: 2.1 time: 0.033060 Sep 19 16:04:23.141121 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3460/6960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:23 2022] GET /compute/v2.1/servers/5bfaf775-7486-4de7-bf5b-0d392d5ef99c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:04:26.148873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-13c61d04-f13d-4871-80c3-04ef4eb54988 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '.version_select at 0x7fde2a0a7280>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:26.173869 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-13c61d04-f13d-4871-80c3-04ef4eb54988 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1667983100" status: 202 len: 0 microversion: 2.1 time: 0.029276 Sep 19 16:04:26.180245 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3501/6961] 10.222.0.81 () {58 vars in 1284 bytes} [Mon Sep 19 16:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1667983100 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:04:26.201769 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5b37bd73-f7bd-4cc3-9e67-d5307fbae384 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: .version_select at 0x7fde29ad84c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1601978248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8eni7hMymEqHc/YCaZpeaoT83gy/R+JHGvHlLYeOr/PMcyGiirqwdGvGKr/UlHZ106IPll+bNoo/Fs9T/LXqvO5oIw6OIzzzpktSO9cJZLLkI8LWxVnh3PZDSy/WlbQ=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:26.219543 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5b37bd73-f7bd-4cc3-9e67-d5307fbae384 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:04:26.224743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-5b37bd73-f7bd-4cc3-9e67-d5307fbae384 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:04:26.249368 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5b37bd73-f7bd-4cc3-9e67-d5307fbae384 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051453 Sep 19 16:04:26.249961 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3461/6962] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:04:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:04:32.372745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-815662082", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "c7f8cc47-945d-4532-9772-1a168649b8e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1601978248", "security_groups": [{"name": "tempest-secgroup-smoke-418935239"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:32.464746 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=14 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:32.494095 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] validate_networks() for [('c7f8cc47-945d-4532-9772-1a168649b8e1', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:04:32.935052 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:04:32.935905 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:04:32.936602 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:04:32.937491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:04:32.938140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:04:32.949996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:32.951072 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:32.951776 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:32.952916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:32.953609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:32.954535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:32.977870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:04:32.984119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:04:32.999120 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:04:33.002289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:04:33.056857 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87ee88df-3e0c-40a3-8cca-064758bad393 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688090 Sep 19 16:04:33.058921 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3502/6963] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:04:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:04:33.070420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-275eb813-8c82-41b3-ae64-a156be4da820 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:33.071816 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-275eb813-8c82-41b3-ae64-a156be4da820 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:33.124839 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:33.146448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-275eb813-8c82-41b3-ae64-a156be4da820 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:33.158806 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-275eb813-8c82-41b3-ae64-a156be4da820 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1266 microversion: 2.1 time: 0.092442 Sep 19 16:04:33.159748 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3462/6964] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:33 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:34.186645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:34.196590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:34.203857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:34.204710 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:34.205365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:34.206305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:34.207034 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:34.208319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:34.333985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:34.347239 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b98e41cc-4344-4868-8c37-c79e04f4394b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1326 microversion: 2.1 time: 0.167550 Sep 19 16:04:34.359248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3503/6965] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:34 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:35.372957 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:35.374152 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:35.386264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:35.386805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:35.387529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:35.388488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:35.389198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:35.389920 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:35.653234 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:35.660986 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8cb82cad-faa4-40e7-bde2-2c7b3065c314 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1391 microversion: 2.1 time: 0.292127 Sep 19 16:04:35.661564 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3463/6966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:35 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:35.853767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-7092f5b6-eb0d-462a-ab86-78fbdc68fcf8 req-3269c3a7-6003-41b6-920a-6b4737f7b197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe35296-e3ff-4669-bd85-88c104661105", "tag": "f5acc6c0-d12d-4798-9e07-4049b9582e98"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:35.866318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7092f5b6-eb0d-462a-ab86-78fbdc68fcf8 req-3269c3a7-6003-41b6-920a-6b4737f7b197 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:35.867271 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7092f5b6-eb0d-462a-ab86-78fbdc68fcf8 req-3269c3a7-6003-41b6-920a-6b4737f7b197 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:35.867947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-7092f5b6-eb0d-462a-ab86-78fbdc68fcf8 req-3269c3a7-6003-41b6-920a-6b4737f7b197 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:35.880939 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-7092f5b6-eb0d-462a-ab86-78fbdc68fcf8 req-3269c3a7-6003-41b6-920a-6b4737f7b197 service nova] Creating event network-changed:f5acc6c0-d12d-4798-9e07-4049b9582e98 for instance dfe35296-e3ff-4669-bd85-88c104661105 on n-h1-858384-1 Sep 19 16:04:35.887709 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-7092f5b6-eb0d-462a-ab86-78fbdc68fcf8 req-3269c3a7-6003-41b6-920a-6b4737f7b197 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037997 Sep 19 16:04:35.888691 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3504/6967] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:04:36.684477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:36.685114 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:36.692127 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:36.692631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:36.693124 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:36.694411 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:36.694934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:36.695380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:36.827289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:36.835750 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7a9feef0-bd56-4164-b0fc-3fdd263f44b6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1391 microversion: 2.1 time: 0.155082 Sep 19 16:04:36.836338 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3464/6968] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:36 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:37.859723 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:37.860350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:37.867011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:37.867505 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:37.867949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:37.868642 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:37.869103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:37.869531 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:38.005245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:38.013927 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cbb9138f-17ed-4e9a-83a2-6e84294d1270 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1391 microversion: 2.1 time: 0.159689 Sep 19 16:04:38.014502 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3505/6969] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:37 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:04:39.036845 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:39.038004 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:39.045354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:39.045840 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:39.046321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:39.047040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:39.047516 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:39.047970 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:39.180227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:39.187933 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-cc3e19a3-3d1a-4ab4-ac67-fa685182d150 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1391 microversion: 2.1 time: 0.155081 Sep 19 16:04:39.188516 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3465/6970] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:39 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:40.211124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:40.211663 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:40.218494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:40.219024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:40.219468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:40.220159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:40.220626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:40.221053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:40.358086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:40.366073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-80b3af60-968b-4ed2-be3c-7d29ae375e9b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1391 microversion: 2.1 time: 0.159415 Sep 19 16:04:40.366663 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3506/6971] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:40 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:40.671113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cd54a390-70a3-431f-8360-c74754582eb9 req-f3362dca-e13a-445e-9eb6-66581d99b2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe35296-e3ff-4669-bd85-88c104661105", "name": "network-vif-plugged", "status": "completed", "tag": "f5acc6c0-d12d-4798-9e07-4049b9582e98"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:40.682028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd54a390-70a3-431f-8360-c74754582eb9 req-f3362dca-e13a-445e-9eb6-66581d99b2f0 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:40.682776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd54a390-70a3-431f-8360-c74754582eb9 req-f3362dca-e13a-445e-9eb6-66581d99b2f0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:40.683242 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cd54a390-70a3-431f-8360-c74754582eb9 req-f3362dca-e13a-445e-9eb6-66581d99b2f0 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:40.695310 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cd54a390-70a3-431f-8360-c74754582eb9 req-f3362dca-e13a-445e-9eb6-66581d99b2f0 service nova] Creating event network-vif-plugged:f5acc6c0-d12d-4798-9e07-4049b9582e98 for instance dfe35296-e3ff-4669-bd85-88c104661105 on n-h1-858384-1 Sep 19 16:04:40.700402 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cd54a390-70a3-431f-8360-c74754582eb9 req-f3362dca-e13a-445e-9eb6-66581d99b2f0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033531 Sep 19 16:04:40.701005 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3466/6972] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:04:41.388815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:41.389468 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:41.396346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:41.396873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:41.397320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:41.398016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:41.398478 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:41.398949 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:41.531731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:41.540035 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bd771a76-f332-4a0f-bde6-9b097224bdf7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1391 microversion: 2.1 time: 0.155206 Sep 19 16:04:41.540615 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3507/6973] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:41 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:42.565228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:42.565877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:42.572885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:42.573391 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:42.573898 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:42.574608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:42.575109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:42.575551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:42.710402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:42.718562 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f965471c-cb42-4fd9-8816-c7d0a7c4124b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1563 microversion: 2.1 time: 0.158564 Sep 19 16:04:42.719199 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3467/6974] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:42 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:42.742517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:42.743163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:42.749964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:42.750452 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:42.750928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:42.751619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:42.752084 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:42.752512 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:42.881878 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:42.889603 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8c5053c1-8497-4ffe-9ce7-359c4deec12c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1563 microversion: 2.1 time: 0.151603 Sep 19 16:04:42.890169 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3508/6975] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:42 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:04:44.783806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:04:44.784717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:04:44.785318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-c2cbfbd1-3b90-4256-b536-df9d44ad1d63 req-6acd611d-7a27-4f99-a159-aa408e9e1811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe35296-e3ff-4669-bd85-88c104661105", "tag": "f5acc6c0-d12d-4798-9e07-4049b9582e98"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:04:44.788686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:44.794613 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:44.795168 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:44.795559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:44.795760 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:44.796537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:44.796728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:44.797014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:44.797728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:44.798559 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:44.801250 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c2cbfbd1-3b90-4256-b536-df9d44ad1d63 req-6acd611d-7a27-4f99-a159-aa408e9e1811 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:04:44.801729 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c2cbfbd1-3b90-4256-b536-df9d44ad1d63 req-6acd611d-7a27-4f99-a159-aa408e9e1811 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:04:44.802401 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-c2cbfbd1-3b90-4256-b536-df9d44ad1d63 req-6acd611d-7a27-4f99-a159-aa408e9e1811 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:04:44.816634 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-c2cbfbd1-3b90-4256-b536-df9d44ad1d63 req-6acd611d-7a27-4f99-a159-aa408e9e1811 service nova] Creating event network-changed:f5acc6c0-d12d-4798-9e07-4049b9582e98 for instance dfe35296-e3ff-4669-bd85-88c104661105 on n-h1-858384-1 Sep 19 16:04:44.822641 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-c2cbfbd1-3b90-4256-b536-df9d44ad1d63 req-6acd611d-7a27-4f99-a159-aa408e9e1811 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040934 Sep 19 16:04:44.823667 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3509/6976] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:04:45.028830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:04:45.038352 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-94c89145-2d5e-42fc-97e0-41472ea589e9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1563 microversion: 2.1 time: 0.258563 Sep 19 16:04:45.039257 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3468/6977] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:04:44 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:06.318332 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:06.368912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:05:06.371346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:06.377515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:06.378002 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:06.378442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:06.379165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:06.379627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:06.380143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:06.431835 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-eeb55236-f999-4b6c-ade7-2666120d1271 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action" status: 200 len: 24575 microversion: 2.1 time: 0.115829 Sep 19 16:05:06.432465 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3510/6978] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:05:06 2022] POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action => generated 24575 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:05:17.554012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d4d54217-ce64-4fa3-a71b-c9f9fef93202 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:05:17.556282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:17.557143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=32 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:17.564773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d54217-ce64-4fa3-a71b-c9f9fef93202 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:17.565282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d54217-ce64-4fa3-a71b-c9f9fef93202 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:17.565743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d4d54217-ce64-4fa3-a71b-c9f9fef93202 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:17.589577 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d4d54217-ce64-4fa3-a71b-c9f9fef93202 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Going to try to stop instance {{(pid=128731) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 16:05:17.632661 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d4d54217-ce64-4fa3-a71b-c9f9fef93202 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action" status: 202 len: 0 microversion: 2.1 time: 0.083345 Sep 19 16:05:17.633187 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3469/6979] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:05:17 2022] POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 16:05:17.642065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:17.642934 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:17.646455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:17.647212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:17.654046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:17.654541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:17.655010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:17.655713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:17.656170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:17.656599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:17.792603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:17.800651 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-4dd71bcc-3fa4-4aa8-8d3c-4b8cd869e9e4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.162877 Sep 19 16:05:17.801299 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3511/6980] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:17 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:18.826082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:18.826717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:18.834451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:18.834983 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:18.835433 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:18.836138 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:18.836607 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:18.837047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:18.976228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:18.984248 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78aa7439-72b8-489d-8b22-202a1a44a426 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.162509 Sep 19 16:05:18.984825 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3470/6981] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:18 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:20.008732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:20.009350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:20.016226 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:20.016711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:20.017154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:20.017846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:20.018311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:20.018739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:20.154363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:20.162939 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1cd7eb3e-bb48-4eef-b7c7-5b357bb7ff8c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.158140 Sep 19 16:05:20.163530 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3512/6982] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:20 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:21.187647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:21.188282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:21.195851 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:21.196354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:21.196841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:21.197553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:21.198030 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:21.198477 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:21.336321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:21.347695 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5712c120-b373-485f-8e67-fb7b2d7d19ef tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.163569 Sep 19 16:05:21.349265 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3471/6983] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:21 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:22.374507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:22.375108 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:22.382814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:22.383317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:22.383762 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:22.384457 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:22.384917 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:22.385348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:22.517132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:22.525069 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-40824dbf-c54c-4f40-be8a-4e94a7b005fa tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.154579 Sep 19 16:05:22.525651 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3513/6984] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:22 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:23.549106 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:23.549737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:23.557299 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:23.557806 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:23.558263 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:23.559002 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:23.559505 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:23.559948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:23.696232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:23.704047 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4f762d11-826d-4d67-8a5b-fa542504aec7 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.158905 Sep 19 16:05:23.704632 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3472/6985] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:23 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:24.727674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:24.728202 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:24.735274 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:24.735770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:24.736216 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:24.736914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:24.737384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:24.737817 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:24.868035 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:24.875825 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-761e05b9-43d9-4dd3-b43a-7b465090c9a8 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.152392 Sep 19 16:05:24.876399 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3514/6986] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:24 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:25.899430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:25.900062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:25.906955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:25.907462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:25.907919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:25.908626 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:25.909103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:25.909553 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:26.039318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:26.047406 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c68a5940-76b1-4609-ad8a-de7d01b04641 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.151922 Sep 19 16:05:26.047994 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3473/6987] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:25 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:27.072462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:27.073057 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:27.080113 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:27.080598 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:27.081036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:27.081732 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:27.082214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:27.082910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:27.215797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:27.223654 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8fec1c12-e869-4ff9-a5cc-4557c7dfda1d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.155106 Sep 19 16:05:27.224236 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3515/6988] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:27 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:28.247319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:28.247955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:28.255024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:28.255535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:28.255994 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:28.256707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:28.257182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:28.257630 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:28.388259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:28.396792 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-baceaaf1-3e27-4999-8756-e5b50913becf tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.153466 Sep 19 16:05:28.397371 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3474/6989] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:28 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:29.420677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:29.421290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:29.428502 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:29.428994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:29.429437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:29.430132 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:29.430586 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:29.431048 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:29.566780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:29.574618 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-98c9fb4c-a787-4871-a64a-7be627b48236 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.158110 Sep 19 16:05:29.575224 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3516/6990] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:29 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:30.599435 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:30.600064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:30.606778 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:30.607307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:30.607761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:30.608473 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:30.608951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:30.609399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:30.740281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:30.748082 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b7eb8ffb-2c02-4244-9fbe-38112fac93e6 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.153382 Sep 19 16:05:30.748674 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3475/6991] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:30 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:31.771446 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:31.772063 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:31.778831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:31.779352 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:31.779790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:31.780484 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:31.780959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:31.781382 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:31.916339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:31.924329 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-038114d2-23db-4b40-b1f4-dbc9ee5d84b3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.156964 Sep 19 16:05:31.924903 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3517/6992] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:31 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:32.948056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:32.948801 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:32.955767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:32.956283 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:32.956739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:32.957992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:32.958561 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:32.959041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:33.093591 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:33.102292 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b825508a-76b0-41a8-ba22-d4af64755abd tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1691 microversion: 2.1 time: 0.158213 Sep 19 16:05:33.102896 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3476/6993] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:32 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:34.125748 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:34.126346 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:34.133340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:34.133832 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:34.134275 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:34.134998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:34.135455 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:34.135887 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:34.268850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:34.277013 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-28fee527-0234-40d0-b082-a40e0ee0189b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1668 microversion: 2.1 time: 0.155422 Sep 19 16:05:34.277593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3518/6994] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:34 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:05:35.374199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:05:35.376689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:35.384251 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:35.384759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:35.385219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:35.385929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:35.386404 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:35.386883 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:35.439741 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-208c59df-bcfe-4ef1-b99b-0593d67743f3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action" status: 200 len: 38412 microversion: 2.1 time: 0.069379 Sep 19 16:05:35.440941 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3477/6995] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:05:35 2022] POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action => generated 38412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:05:35.453262 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-562b67ea-6c8e-46b3-8244-33c59c16eb47 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:05:35.460361 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-562b67ea-6c8e-46b3-8244-33c59c16eb47 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:35.460849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-562b67ea-6c8e-46b3-8244-33c59c16eb47 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:35.461289 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-562b67ea-6c8e-46b3-8244-33c59c16eb47 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:35.484362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-562b67ea-6c8e-46b3-8244-33c59c16eb47 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Going to try to start instance {{(pid=128730) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 16:05:35.531242 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-562b67ea-6c8e-46b3-8244-33c59c16eb47 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action" status: 202 len: 0 microversion: 2.1 time: 0.081721 Sep 19 16:05:35.531875 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3519/6996] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:05:35 2022] POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:05:35.541103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:35.541826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:35.550126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:35.551934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:35.552434 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:35.553362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:35.553887 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:35.554340 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:35.775221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:35.783035 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a4e1e8f1-5f8d-4c2c-b80e-fa017a3e72d4 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1677 microversion: 2.1 time: 0.246126 Sep 19 16:05:35.783610 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3478/6997] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:35 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:05:36.808771 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:05:36.809423 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:05:36.815573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:36.816154 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:36.816606 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:36.817294 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:05:36.817751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:05:36.818181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:05:36.956036 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:05:36.964342 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-787d0d69-3759-4fde-8eb7-4d54002d170f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1681 microversion: 2.1 time: 0.160709 Sep 19 16:05:36.965015 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3520/6998] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:05:36 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:01.209341 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:01.211656 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:01.214382 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=20 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:01.215209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:01.220710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:01.221723 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:01.222331 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:01.223074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:01.223563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:01.224008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:01.281453 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7bdcdc1f-93d5-4107-8eac-13da97b21d24 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action" status: 200 len: 62979 microversion: 2.1 time: 0.076079 Sep 19 16:06:01.282022 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3479/6999] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:06:01 2022] POST /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105/action => generated 62979 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:06:08.524447 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:08.525603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:08.526891 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fd1b417e-8fa3-43ad-bcb2-5917e2e386d6 req-28b82ca6-2230-4cad-a4a5-79dca3f67d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe35296-e3ff-4669-bd85-88c104661105", "tag": "f5acc6c0-d12d-4798-9e07-4049b9582e98"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:08.535883 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=20 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:08.537116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:08.538646 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:08.539726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:08.540417 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:08.540865 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fd1b417e-8fa3-43ad-bcb2-5917e2e386d6 req-28b82ca6-2230-4cad-a4a5-79dca3f67d22 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:08.541399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fd1b417e-8fa3-43ad-bcb2-5917e2e386d6 req-28b82ca6-2230-4cad-a4a5-79dca3f67d22 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:08.542068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:08.542198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fd1b417e-8fa3-43ad-bcb2-5917e2e386d6 req-28b82ca6-2230-4cad-a4a5-79dca3f67d22 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:08.542544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:08.543019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:08.557505 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fd1b417e-8fa3-43ad-bcb2-5917e2e386d6 req-28b82ca6-2230-4cad-a4a5-79dca3f67d22 service nova] Creating event network-changed:f5acc6c0-d12d-4798-9e07-4049b9582e98 for instance dfe35296-e3ff-4669-bd85-88c104661105 on n-h1-858384-1 Sep 19 16:06:08.564702 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fd1b417e-8fa3-43ad-bcb2-5917e2e386d6 req-28b82ca6-2230-4cad-a4a5-79dca3f67d22 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041674 Sep 19 16:06:08.565524 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3480/7000] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:06:08.584920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:06:08.676791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-de241348-b7c8-496e-8dc2-f4aaea58beec tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 204 len: 0 microversion: 2.1 time: 0.156837 Sep 19 16:06:08.677823 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3521/7001] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:06:08 2022] DELETE /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:06:08.687282 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:08.688125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:08.707371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:08.708027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:08.708573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:08.709436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:08.709950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:08.710481 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:08.883700 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:08.891631 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c078ff9-6bb2-418a-802a-d6b2c67e8b30 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1687 microversion: 2.1 time: 0.208810 Sep 19 16:06:08.892425 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3481/7002] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:08 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1687 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:09.916910 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:09.917520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:09.925849 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:09.927147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:09.927712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:09.928536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:09.929024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:09.929487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:10.108266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:10.116546 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-67912bd9-0c2f-46ed-aa68-c14c139ece9f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1687 microversion: 2.1 time: 0.204383 Sep 19 16:06:10.117122 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3522/7003] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:09 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1687 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:06:10.748781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-91aeb8c3-193d-4894-9cb7-361d5b6f157a req-8de34695-d9fb-4b39-b94d-b05d846ca62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe35296-e3ff-4669-bd85-88c104661105", "name": "network-vif-deleted", "tag": "f5acc6c0-d12d-4798-9e07-4049b9582e98"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:10.760520 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-91aeb8c3-193d-4894-9cb7-361d5b6f157a req-8de34695-d9fb-4b39-b94d-b05d846ca62d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:10.761027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-91aeb8c3-193d-4894-9cb7-361d5b6f157a req-8de34695-d9fb-4b39-b94d-b05d846ca62d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:10.761684 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-91aeb8c3-193d-4894-9cb7-361d5b6f157a req-8de34695-d9fb-4b39-b94d-b05d846ca62d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:10.773884 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-91aeb8c3-193d-4894-9cb7-361d5b6f157a req-8de34695-d9fb-4b39-b94d-b05d846ca62d service nova] Creating event network-vif-deleted:f5acc6c0-d12d-4798-9e07-4049b9582e98 for instance dfe35296-e3ff-4669-bd85-88c104661105 on n-h1-858384-1 Sep 19 16:06:10.778908 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-91aeb8c3-193d-4894-9cb7-361d5b6f157a req-8de34695-d9fb-4b39-b94d-b05d846ca62d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Sep 19 16:06:10.779512 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3482/7004] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:06:11.140565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:11.141214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:11.149378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:11.150400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:11.151191 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:11.152341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:11.153288 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:11.153637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:11.191693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:11.192200 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:11.192634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:11.193074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lazy-loading 'fault' on Instance uuid dfe35296-e3ff-4669-bd85-88c104661105 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:06:11.242565 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:11.250190 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ffbccbbf-65dc-42ba-9dd3-ea623499a465 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 200 len: 1356 microversion: 2.1 time: 0.113244 Sep 19 16:06:11.250388 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3523/7005] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:11 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:12.276810 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:12.277530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: dfe35296-e3ff-4669-bd85-88c104661105] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:12.284427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:12.284922 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:12.285374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:12.286076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:12.286545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:12.287013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:12.300764 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] HTTP exception thrown: Instance dfe35296-e3ff-4669-bd85-88c104661105 could not be found. Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Request method failure captured: Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 HTTP/1.1 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJH2TUr0hBls95GIz5nyIwGbiSEnpShi_6DeLYZ5CM3J3Q1S0MxG7SNPVjV8qoG-qm0FjtEHrLh52-EttT3IZfbCjs-efRdk--jbWEbt1W_FT9UjcmMXPTvZprvq1-iUaN7NivvEROA-TR-heBki4pEAg4tVDUYYnbh10A29JcRtrwM Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ce7335518ac84046a1a430ad41c14e6c"}]}] Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: a8ec11528b34470cb46f5f35259b4ebc Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance dfe35296-e3ff-4669-bd85-88c104661105 could not be found. Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'dfe35296-e3ff-4669-bd85-88c104661105'} Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe35296-e3ff-4669-bd85-88c104661105 could not be found. Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe35296-e3ff-4669-bd85-88c104661105 could not be found. Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:06:12.302422 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe35296-e3ff-4669-bd85-88c104661105 could not be found. Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Returning 404 to user: Instance dfe35296-e3ff-4669-bd85-88c104661105 could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6d7b2bbe-ea6c-4920-a34c-58f025d26c4c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105" status: 404 len: 111 microversion: 2.1 time: 0.032506 Sep 19 16:06:12.307884 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3483/7006] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:12 2022] GET /compute/v2.1/servers/dfe35296-e3ff-4669-bd85-88c104661105 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:06:15.600410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-75fa8d4a-f97c-4aff-b969-6a30eeec177d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '.version_select at 0x7fde28cc5820>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:15.621835 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-75fa8d4a-f97c-4aff-b969-6a30eeec177d tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1601978248" status: 202 len: 0 microversion: 2.1 time: 0.028211 Sep 19 16:06:15.622447 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3524/7007] 10.222.0.81 () {58 vars in 1284 bytes} [Mon Sep 19 16:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1601978248 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:06:15.656690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-732892a0-5d79-4c4c-bf3c-7e14a28f569c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: .version_select at 0x7fde29ae50d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-250834266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4Gp1kUSAbRwCdeEBZBHjdxcoH61kyW0AvlbPVxxSYvKqfGsG1I8H3M4xkU+7Uwp54AmSe5rjf2xK65qoI1w1FAVYKhr5CoaiCpOJ4K1TuZRfJUdq5Iue9tEXdEWKo0A=="}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:15.683022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-732892a0-5d79-4c4c-bf3c-7e14a28f569c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:06:15.688172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-732892a0-5d79-4c4c-bf3c-7e14a28f569c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'key_pairs'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:06:15.713408 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-732892a0-5d79-4c4c-bf3c-7e14a28f569c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060678 Sep 19 16:06:15.714016 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3484/7008] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:06:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:06:21.661840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:21.667453 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1272392373", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "networks": [{"uuid": "9376e1a9-74bf-4029-80cd-1c2f8fc4ca4e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-250834266", "security_groups": [{"name": "tempest-secgroup-smoke-595987014"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:21.807201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] validate_networks() for [('9376e1a9-74bf-4029-80cd-1c2f8fc4ca4e', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:06:22.243339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:06:22.243845 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:06:22.244431 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:06:22.244919 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:06:22.245411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:06:22.255381 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:22.255970 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:22.256842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:22.257770 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:22.258232 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:22.258668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:22.280961 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:06:22.286488 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Getting quotas for user a8ec11528b34470cb46f5f35259b4ebc and project ce7335518ac84046a1a430ad41c14e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:06:22.300225 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:06:22.302599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:06:22.350436 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b58e15f0-f906-45a6-a0dd-b54bf0c82513 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.690374 Sep 19 16:06:22.351428 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3525/7009] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:06:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:06:22.360802 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:22.366522 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c324bff0-72e2-4bb1-986f-5c11e6410ae0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:22.367199 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c324bff0-72e2-4bb1-986f-5c11e6410ae0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:22.436975 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c324bff0-72e2-4bb1-986f-5c11e6410ae0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:22.445723 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c324bff0-72e2-4bb1-986f-5c11e6410ae0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1266 microversion: 2.1 time: 0.086858 Sep 19 16:06:22.446499 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3485/7010] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:22 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:23.470640 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:23.472545 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:23.486882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:23.494633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:23.497199 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:23.498668 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:23.502940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:23.504056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:23.620943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:23.631907 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7d640be2-8cb7-4081-b2ef-2d9998bcca5f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1336 microversion: 2.1 time: 0.165157 Sep 19 16:06:23.632612 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3526/7011] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:23 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:24.655664 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:24.656301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:24.664767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:24.665281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:24.665740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:24.666463 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:24.667023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:24.667472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:24.901993 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:24.910304 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2b9c0f08-bfca-48f4-9e97-079b73448ac2 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.258633 Sep 19 16:06:24.910925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3486/7012] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:24 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:25.053350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-ad9a6f6e-e3e6-413a-827b-fba39111384a req-0bc3fcf0-4747-4813-97aa-b7c8f13dd02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63498d0-38c2-4873-a6e3-79b5aacd4407", "tag": "502aa2a5-e812-4eb1-8af9-167848efbd68"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:25.084566 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ad9a6f6e-e3e6-413a-827b-fba39111384a req-0bc3fcf0-4747-4813-97aa-b7c8f13dd02c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:25.085144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ad9a6f6e-e3e6-413a-827b-fba39111384a req-0bc3fcf0-4747-4813-97aa-b7c8f13dd02c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:25.085590 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-ad9a6f6e-e3e6-413a-827b-fba39111384a req-0bc3fcf0-4747-4813-97aa-b7c8f13dd02c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:25.098058 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-ad9a6f6e-e3e6-413a-827b-fba39111384a req-0bc3fcf0-4747-4813-97aa-b7c8f13dd02c service nova] Creating event network-changed:502aa2a5-e812-4eb1-8af9-167848efbd68 for instance d63498d0-38c2-4873-a6e3-79b5aacd4407 on n-h1-858384-1 Sep 19 16:06:25.103457 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-ad9a6f6e-e3e6-413a-827b-fba39111384a req-0bc3fcf0-4747-4813-97aa-b7c8f13dd02c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058099 Sep 19 16:06:25.104067 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3527/7013] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:06:25.937345 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:25.938001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:25.945066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:25.945576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:25.946032 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:25.946870 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:25.947402 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:25.947863 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:26.087289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:26.094996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6588394-7813-4b75-8e32-5593d4029454 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.164483 Sep 19 16:06:26.096119 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3487/7014] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:25 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:27.121019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:27.121644 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:27.127882 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:27.128362 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:27.128805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:27.129499 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:27.129954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:27.130384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:27.260827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:27.269297 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d146a814-0389-43ac-9b69-ef48e16421c9 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.153605 Sep 19 16:06:27.269869 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3528/7015] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:27 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:28.292485 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:28.293109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:28.301090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:28.301589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:28.302036 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:28.302737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:28.303230 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:28.303670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:28.432850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:28.441687 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-908112f5-31b9-42d6-9e31-640b748a46ad tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.152935 Sep 19 16:06:28.442049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3488/7016] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:28 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:29.465290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:29.465911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:29.473077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:29.473571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:29.474017 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:29.474718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:29.475206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:29.475647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:29.614715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:29.622411 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-2281f42e-3fd9-4993-84d2-4884389dc3e5 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.161262 Sep 19 16:06:29.623029 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3529/7017] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:29 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:30.645938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:30.646488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:30.653008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:30.653513 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:30.653972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:30.654678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:30.655178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:30.655625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:30.788237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:30.796752 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ff5e30f2-8b8f-4fe2-be5a-b5ef64dda340 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.155173 Sep 19 16:06:30.797377 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3489/7018] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:30 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:31.119813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-f46c995d-757c-4fad-96e9-e2656cd03a1e req-03c46b20-26c4-4892-b045-4d0fc1236bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63498d0-38c2-4873-a6e3-79b5aacd4407", "name": "network-vif-plugged", "status": "completed", "tag": "502aa2a5-e812-4eb1-8af9-167848efbd68"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:31.131885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f46c995d-757c-4fad-96e9-e2656cd03a1e req-03c46b20-26c4-4892-b045-4d0fc1236bd5 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:31.132390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f46c995d-757c-4fad-96e9-e2656cd03a1e req-03c46b20-26c4-4892-b045-4d0fc1236bd5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:31.132842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-f46c995d-757c-4fad-96e9-e2656cd03a1e req-03c46b20-26c4-4892-b045-4d0fc1236bd5 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:31.145415 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-f46c995d-757c-4fad-96e9-e2656cd03a1e req-03c46b20-26c4-4892-b045-4d0fc1236bd5 service nova] Creating event network-vif-plugged:502aa2a5-e812-4eb1-8af9-167848efbd68 for instance d63498d0-38c2-4873-a6e3-79b5aacd4407 on n-h1-858384-1 Sep 19 16:06:31.150766 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-f46c995d-757c-4fad-96e9-e2656cd03a1e req-03c46b20-26c4-4892-b045-4d0fc1236bd5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034784 Sep 19 16:06:31.151607 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3530/7019] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:06:31.820919 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:31.821554 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:31.824323 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:31.830574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:31.831126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:31.831589 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:31.832308 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:31.832789 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:31.833237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:31.965967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:31.973833 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ffa8bcfa-b99a-477f-9abf-179d0945c93f tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1391 microversion: 2.1 time: 0.156902 Sep 19 16:06:31.974413 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3490/7020] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:31 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:32.994886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:32.995587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:33.000092 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:33.000805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:33.008550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:33.009041 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:33.009507 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:33.010190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:33.010654 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:33.011114 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:33.150292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:33.158197 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-1f932b1b-d10d-4ba9-9ffa-afafe244b2e3 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1563 microversion: 2.1 time: 0.165208 Sep 19 16:06:33.158822 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3531/7021] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:32 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:33.180665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:33.181347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:33.183465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:33.190842 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:33.191369 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:33.191864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:33.192615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:33.193109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:33.193568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:33.329019 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:33.337458 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0230d0ef-a45e-467d-ba61-49049b5dba35 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1563 microversion: 2.1 time: 0.160882 Sep 19 16:06:33.338046 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3491/7022] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:33 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:35.329896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-2dcc3ccc-6f81-4c1e-833d-d4e3177442d2 req-98d71522-2e76-4306-b6ae-b87d138154dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63498d0-38c2-4873-a6e3-79b5aacd4407", "tag": "502aa2a5-e812-4eb1-8af9-167848efbd68"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:35.333902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:06:35.334536 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:35.341868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:35.342384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:35.342978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:35.343219 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2dcc3ccc-6f81-4c1e-833d-d4e3177442d2 req-98d71522-2e76-4306-b6ae-b87d138154dd service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:35.343693 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:35.343929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2dcc3ccc-6f81-4c1e-833d-d4e3177442d2 req-98d71522-2e76-4306-b6ae-b87d138154dd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:35.344345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:35.344558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-2dcc3ccc-6f81-4c1e-833d-d4e3177442d2 req-98d71522-2e76-4306-b6ae-b87d138154dd service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:35.345100 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:35.356914 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-2dcc3ccc-6f81-4c1e-833d-d4e3177442d2 req-98d71522-2e76-4306-b6ae-b87d138154dd service nova] Creating event network-changed:502aa2a5-e812-4eb1-8af9-167848efbd68 for instance d63498d0-38c2-4873-a6e3-79b5aacd4407 on n-h1-858384-1 Sep 19 16:06:35.363036 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-2dcc3ccc-6f81-4c1e-833d-d4e3177442d2 req-98d71522-2e76-4306-b6ae-b87d138154dd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037224 Sep 19 16:06:35.363659 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3492/7023] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:06:35.576868 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:06:35.586146 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b36d1564-2b1e-48b2-8371-0c894250abc0 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1563 microversion: 2.1 time: 0.263196 Sep 19 16:06:35.594868 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3532/7024] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:06:35 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:06:56.882087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:06:56.884375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:06:56.887337 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=5 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:56.888061 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=38 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:56.894950 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:56.895460 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:56.895915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:56.896625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:06:56.897097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:06:56.897538 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:06:56.953593 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-add9fdcc-acb0-481c-a77c-2ed8af1521ee tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action" status: 200 len: 24574 microversion: 2.1 time: 0.075727 Sep 19 16:06:56.954533 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3493/7025] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:06:56 2022] POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:07:03.292864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:03.293705 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:03.295778 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:03.296441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=36 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:03.304087 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:03.304573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:03.305018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:03.305702 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:03.306215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:03.306665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:03.331752 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.objects.instance [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lazy-loading 'flavor' on Instance uuid d63498d0-38c2-4873-a6e3-79b5aacd4407 {{(pid=128730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:07:03.398488 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7192e661-54b2-4de1-a6ec-c61a6ec9949e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action" status: 202 len: 0 microversion: 2.1 time: 0.109728 Sep 19 16:07:03.399173 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3533/7026] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:07:03 2022] POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:07:03.410274 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:03.411041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:03.415134 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:07:03.415285 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 (ip 10.222.0.81) !!! Sep 19 16:07:03.431515 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:03.432016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:03.432468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:03.433176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:03.433652 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:03.434198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:03.613018 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:03.620811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-401ea07d-faa7-4d02-a85e-43fcffd19b57 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1689 microversion: 2.1 time: 0.217137 Sep 19 16:07:03.621392 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3494/7027] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:03 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:04.647311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:04.648027 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:04.654269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:04.654780 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:04.655231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:04.655928 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:04.656962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:04.657434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:04.830509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:04.838536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ddc52147-0f93-409d-b874-b2f5bea4d423 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1672 microversion: 2.1 time: 0.196911 Sep 19 16:07:04.839146 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3534/7028] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:04 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:05.940422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:05.942697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:05.949799 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:05.950315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:05.950803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:05.951525 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:05.952003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:05.952453 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:06.003683 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bcb3557a-9a6e-48c6-9760-09eccae5b7ff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action" status: 200 len: 35288 microversion: 2.1 time: 0.067884 Sep 19 16:07:06.004318 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3495/7029] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:07:05 2022] POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action => generated 35288 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:07:06.016801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:06.017337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:06.024172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:06.024662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:06.025106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:06.025800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:06.026259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:06.026689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:06.091828 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-da7ea97d-5f2f-4607-9e7e-ee32f2db6095 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action" status: 202 len: 0 microversion: 2.1 time: 0.079315 Sep 19 16:07:06.092520 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3535/7030] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:07:06 2022] POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:07:06.101578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:06.102315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:06.109570 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:06.110118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:06.110567 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:06.111457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:06.111941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:06.112397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:06.331896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:06.339894 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1be12b79-9e83-4162-8117-6e3021b53d0b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1678 microversion: 2.1 time: 0.242671 Sep 19 16:07:06.340487 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3496/7031] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:06 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:07:07.365756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:07.366472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:07.372736 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:07.373231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:07.373675 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:07.374369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:07.374864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:07.375303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:07.519280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:07.527177 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-99ecd4c9-eba9-4fe6-907f-7ed9f6ecc10c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1678 microversion: 2.1 time: 0.166595 Sep 19 16:07:07.527748 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3536/7032] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:07 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:08.551625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:08.552166 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:08.559224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:08.559726 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:08.560171 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:08.560876 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:08.561343 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:08.561780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:08.694295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:08.702308 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c954c758-eae1-4ba4-a662-c883568dabff tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1681 microversion: 2.1 time: 0.155574 Sep 19 16:07:08.703596 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3497/7033] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:08 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:08.809390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:08.811671 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:08.819175 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:08.819319 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:08.819950 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:08.820419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:08.820880 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:08.821312 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:08.863214 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-86d76dcf-2095-4029-a40e-8d2aaeb64a31 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action" status: 200 len: 35288 microversion: 2.1 time: 0.057615 Sep 19 16:07:08.864909 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3537/7034] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:07:08 2022] POST /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407/action => generated 35288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 16:07:09.928348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-6a51f89b-b8f6-4382-89b9-d4fa62bb12bf req-01668b7a-4dfe-4429-bdc5-0005561bdeda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63498d0-38c2-4873-a6e3-79b5aacd4407", "tag": "502aa2a5-e812-4eb1-8af9-167848efbd68"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:09.932457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:09.932982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:09.940442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:09.941277 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:09.941986 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:09.942866 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:09.943318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:09.943941 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:09.949862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6a51f89b-b8f6-4382-89b9-d4fa62bb12bf req-01668b7a-4dfe-4429-bdc5-0005561bdeda service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:09.950413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6a51f89b-b8f6-4382-89b9-d4fa62bb12bf req-01668b7a-4dfe-4429-bdc5-0005561bdeda service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:09.951080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-6a51f89b-b8f6-4382-89b9-d4fa62bb12bf req-01668b7a-4dfe-4429-bdc5-0005561bdeda service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:09.963965 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-6a51f89b-b8f6-4382-89b9-d4fa62bb12bf req-01668b7a-4dfe-4429-bdc5-0005561bdeda service nova] Creating event network-changed:502aa2a5-e812-4eb1-8af9-167848efbd68 for instance d63498d0-38c2-4873-a6e3-79b5aacd4407 on n-h1-858384-1 Sep 19 16:07:09.974590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:07:09.975273 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-6a51f89b-b8f6-4382-89b9-d4fa62bb12bf req-01668b7a-4dfe-4429-bdc5-0005561bdeda service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044905 Sep 19 16:07:09.976818 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3538/7035] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:07:10.065318 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-332cae3e-8fdb-4dfe-994e-cb4b87e9637c tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 204 len: 0 microversion: 2.1 time: 0.144728 Sep 19 16:07:10.066123 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3498/7036] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:07:09 2022] DELETE /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 16:07:10.076434 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:10.077426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:10.084405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:10.085123 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:10.085744 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:10.086998 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:10.087615 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:10.088337 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:10.252409 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:10.268251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-fd038ecc-9294-4b0c-8dcf-c3fde4da730e tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1687 microversion: 2.1 time: 0.197407 Sep 19 16:07:10.268835 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3539/7037] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:10 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:07:11.295172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:11.295916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:11.302812 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:11.303316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:11.303766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:11.304484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:11.304935 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:11.305374 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:11.509068 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:11.517748 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2e13229c-465f-46e4-8b1d-9801c9862f73 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1687 microversion: 2.1 time: 0.227190 Sep 19 16:07:11.518390 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3499/7038] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:11 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:12.214005 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-d6493c38-0993-4d24-a517-d7afb9914dd5 req-4f11cc7a-3589-4d02-94d6-c0737dbaf025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63498d0-38c2-4873-a6e3-79b5aacd4407", "name": "network-vif-deleted", "tag": "502aa2a5-e812-4eb1-8af9-167848efbd68"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:12.223573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d6493c38-0993-4d24-a517-d7afb9914dd5 req-4f11cc7a-3589-4d02-94d6-c0737dbaf025 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:12.224064 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d6493c38-0993-4d24-a517-d7afb9914dd5 req-4f11cc7a-3589-4d02-94d6-c0737dbaf025 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:12.224494 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-d6493c38-0993-4d24-a517-d7afb9914dd5 req-4f11cc7a-3589-4d02-94d6-c0737dbaf025 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:12.235876 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-d6493c38-0993-4d24-a517-d7afb9914dd5 req-4f11cc7a-3589-4d02-94d6-c0737dbaf025 service nova] Creating event network-vif-deleted:502aa2a5-e812-4eb1-8af9-167848efbd68 for instance d63498d0-38c2-4873-a6e3-79b5aacd4407 on n-h1-858384-1 Sep 19 16:07:12.240586 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-d6493c38-0993-4d24-a517-d7afb9914dd5 req-4f11cc7a-3589-4d02-94d6-c0737dbaf025 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031129 Sep 19 16:07:12.241180 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3540/7039] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:07:12.541614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:12.542244 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:12.550109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:12.550620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:12.551109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:12.551835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:12.552309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:12.552755 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:12.587164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:12.587678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:12.588144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:12.588615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lazy-loading 'fault' on Instance uuid d63498d0-38c2-4873-a6e3-79b5aacd4407 {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:07:12.635470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ec11528b34470cb46f5f35259b4ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7335518ac84046a1a430ad41c14e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:12.644399 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6c1fa03a-d46f-4dcc-bdf1-e385ed0b2fdc tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 200 len: 1356 microversion: 2.1 time: 0.106682 Sep 19 16:07:12.644995 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3500/7040] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:12 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:13.668751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:13.669419 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] [instance: d63498d0-38c2-4873-a6e3-79b5aacd4407] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:13.676515 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:13.677003 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:13.677445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:13.678140 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:13.678603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:13.679062 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:13.692317 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] HTTP exception thrown: Instance d63498d0-38c2-4873-a6e3-79b5aacd4407 could not be found. Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Request method failure captured: Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 HTTP/1.1 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJH2TUr0hBls95GIz5nyIwGbiSEnpShi_6DeLYZ5CM3J3Q1S0MxG7SNPVjV8qoG-qm0FjtEHrLh52-EttT3IZfbCjs-efRdk--jbWEbt1W_FT9UjcmMXPTvZprvq1-iUaN7NivvEROA-TR-heBki4pEAg4tVDUYYnbh10A29JcRtrwM Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ce7335518ac84046a1a430ad41c14e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ce7335518ac84046a1a430ad41c14e6c"}]}] Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: ce7335518ac84046a1a430ad41c14e6c Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-467501038 Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: a8ec11528b34470cb46f5f35259b4ebc Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestNetworkAdvancedServerOps-467501038-project Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance d63498d0-38c2-4873-a6e3-79b5aacd4407 could not be found. Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'd63498d0-38c2-4873-a6e3-79b5aacd4407'} Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63498d0-38c2-4873-a6e3-79b5aacd4407 could not be found. Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63498d0-38c2-4873-a6e3-79b5aacd4407 could not be found. Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:07:13.693941 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63498d0-38c2-4873-a6e3-79b5aacd4407 could not be found. Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Returning 404 to user: Instance d63498d0-38c2-4873-a6e3-79b5aacd4407 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-92a676c0-2e76-4282-904f-56156ee44498 tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407" status: 404 len: 111 microversion: 2.1 time: 0.032371 Sep 19 16:07:13.699498 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3541/7041] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:13 2022] GET /compute/v2.1/servers/d63498d0-38c2-4873-a6e3-79b5aacd4407 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:07:16.718010 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d9fb28e7-c2eb-4952-a8ac-fb1ec57aa49b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] Calling method '.version_select at 0x7fde28e02f70>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:16.739064 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d9fb28e7-c2eb-4952-a8ac-fb1ec57aa49b tempest-TestNetworkAdvancedServerOps-467501038 tempest-TestNetworkAdvancedServerOps-467501038-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-250834266" status: 202 len: 0 microversion: 2.1 time: 0.024901 Sep 19 16:07:16.740012 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3501/7042] 10.222.0.81 () {58 vars in 1281 bytes} [Mon Sep 19 16:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-250834266 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:07:27.951016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=18 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:27.951871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:28.120918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-dc533a26-11a1-4401-b401-3326cf26eaa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'create', calling method: .version_select at 0x7fde29aaa3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1708980505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdgRyOclj2G7zIbdAHOiGnnKMxmWrr4VY0RM9a17UrZ4KO++3d7o3e6o3Ge4p9o/6mJxCZXwpHWeXlALAWtqNGxiXOc8dMUp15ZnazGJCkjb6fxpV1yg5Fh0i51bQYrsA=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:28.137421 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-dc533a26-11a1-4401-b401-3326cf26eaa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for project 09c618aafbc04ea1aef8616bc840296c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:07:28.144369 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-dc533a26-11a1-4401-b401-3326cf26eaa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for user 983abd8b0b774bb7b64106595446e1d0 and project 09c618aafbc04ea1aef8616bc840296c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:07:28.170776 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-dc533a26-11a1-4401-b401-3326cf26eaa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.225367 Sep 19 16:07:28.171995 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3542/7043] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:07:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:07:29.230822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:29.231601 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:29.237043 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1281491071", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1708980505", "security_groups": [{"name": "tempest-secgroup-smoke-1521579956"}], "networks": [{"uuid": "69ef1f18-5db1-41b2-9d2d-61435e573cca"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:29.352426 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] validate_networks() for [('69ef1f18-5db1-41b2-9d2d-61435e573cca', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:07:29.887781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:07:29.888253 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:07:29.888743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:07:29.889200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:07:29.890377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:07:29.899660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:29.900164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:29.900616 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:29.901359 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:29.901835 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:29.902276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:29.920982 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for project 09c618aafbc04ea1aef8616bc840296c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:07:29.926275 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for user 983abd8b0b774bb7b64106595446e1d0 and project 09c618aafbc04ea1aef8616bc840296c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:07:29.939089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:07:29.941470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:07:29.991714 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b2d5024e-7338-44f6-adb2-a04850eb1b2f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762710 Sep 19 16:07:29.992394 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3502/7044] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:07:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:07:30.006627 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-196dde54-dd8f-40a3-97ba-5243e20f7fb9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:30.007424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-196dde54-dd8f-40a3-97ba-5243e20f7fb9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:30.064567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-196dde54-dd8f-40a3-97ba-5243e20f7fb9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:30.071539 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-196dde54-dd8f-40a3-97ba-5243e20f7fb9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1247 microversion: 2.1 time: 0.071134 Sep 19 16:07:30.072379 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3543/7045] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:29 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:31.097605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:31.098437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:31.105628 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:31.106229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:31.106973 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:31.107932 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:31.108530 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:31.109368 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:31.185179 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:31.198897 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-14c9001f-6b10-4058-90dc-ef382df13d3d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1299 microversion: 2.1 time: 0.106467 Sep 19 16:07:31.200222 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3503/7046] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:31 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:32.233165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:32.235900 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:32.250873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:32.251997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:32.252472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:32.253186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:32.253645 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:32.255724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:32.473739 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:32.484607 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-40ad53c2-b7e0-4211-8487-4c05c7c851f0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1373 microversion: 2.1 time: 0.262868 Sep 19 16:07:32.485584 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3544/7047] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:32 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1373 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:32.837319 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-830eb7f4-8525-4907-941a-8dd16b607433 req-ec0f8472-65a9-4df4-ace2-f6884f945f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:32.849233 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-830eb7f4-8525-4907-941a-8dd16b607433 req-ec0f8472-65a9-4df4-ace2-f6884f945f14 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:32.850507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-830eb7f4-8525-4907-941a-8dd16b607433 req-ec0f8472-65a9-4df4-ace2-f6884f945f14 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:32.850727 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-830eb7f4-8525-4907-941a-8dd16b607433 req-ec0f8472-65a9-4df4-ace2-f6884f945f14 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:32.863630 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-830eb7f4-8525-4907-941a-8dd16b607433 req-ec0f8472-65a9-4df4-ace2-f6884f945f14 service nova] Creating event network-changed:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h1-858384-1 Sep 19 16:07:32.868674 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-830eb7f4-8525-4907-941a-8dd16b607433 req-ec0f8472-65a9-4df4-ace2-f6884f945f14 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035267 Sep 19 16:07:32.869692 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3504/7048] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:07:33.509940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:33.510552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:33.517860 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:33.518353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:33.518808 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:33.519510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:33.519956 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:33.520557 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:33.671815 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:33.679548 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3909b08a-37ac-458b-a66e-669b1adf66a4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1373 microversion: 2.1 time: 0.173570 Sep 19 16:07:33.680121 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3545/7049] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:33 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:34.704497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:34.705225 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:34.711588 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:34.712096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:34.712550 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:34.713259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:34.713734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:34.714178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:34.929641 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:34.937496 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a52b27ec-729a-4ee5-ac40-433a510f5a59 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1373 microversion: 2.1 time: 0.238593 Sep 19 16:07:34.938077 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3505/7050] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:34 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1373 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:35.961458 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:35.962083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:35.969441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:35.969932 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:35.970383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:35.971124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:35.971574 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:35.972006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:36.107629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:36.116135 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-82208bbf-5171-4915-b234-4fb5fc705ecb tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1373 microversion: 2.1 time: 0.158594 Sep 19 16:07:36.116705 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3546/7051] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:35 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:37.139081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:37.139874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:37.146904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:37.147417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:37.147877 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:37.148594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:37.149078 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:37.149526 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:37.282519 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:37.290497 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-df02e91e-e203-4c77-9249-57c310ed8276 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1373 microversion: 2.1 time: 0.155531 Sep 19 16:07:37.291131 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3506/7052] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:37 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:37.481016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-5b3900e3-56b9-412f-ae20-4aa8aa38a29f req-e8f0cc02-0e44-4355-922d-b56e2174b71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "name": "network-vif-plugged", "status": "completed", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:37.491881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5b3900e3-56b9-412f-ae20-4aa8aa38a29f req-e8f0cc02-0e44-4355-922d-b56e2174b71d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:37.492364 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5b3900e3-56b9-412f-ae20-4aa8aa38a29f req-e8f0cc02-0e44-4355-922d-b56e2174b71d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:37.492796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-5b3900e3-56b9-412f-ae20-4aa8aa38a29f req-e8f0cc02-0e44-4355-922d-b56e2174b71d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:37.505079 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-5b3900e3-56b9-412f-ae20-4aa8aa38a29f req-e8f0cc02-0e44-4355-922d-b56e2174b71d service nova] Creating event network-vif-plugged:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h1-858384-1 Sep 19 16:07:37.510479 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-5b3900e3-56b9-412f-ae20-4aa8aa38a29f req-e8f0cc02-0e44-4355-922d-b56e2174b71d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033419 Sep 19 16:07:37.511102 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3547/7053] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:07:38.315353 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:38.315974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:38.322867 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:38.323753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:38.324211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:38.324907 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:38.325375 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:38.325808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:38.457476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:38.465207 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-17719c76-e72d-470f-94b3-92371af211e8 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1373 microversion: 2.1 time: 0.156185 Sep 19 16:07:38.465779 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3507/7054] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:38 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:39.489561 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:39.490206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:39.497824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:39.498321 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:39.499384 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:39.500080 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:39.500543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:39.500985 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:39.635848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:39.643731 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-68a7b33e-866a-4e9a-b235-2372c76b5392 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1556 microversion: 2.1 time: 0.158571 Sep 19 16:07:39.644323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3548/7055] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:39 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:07:39.665953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:07:39.666617 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:07:39.674273 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:39.674807 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:39.675264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:39.675972 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:39.676444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:39.676888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:39.811025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:07:39.818996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2a91795a-e613-4954-81af-de4afa454ad1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1556 microversion: 2.1 time: 0.156921 Sep 19 16:07:39.819569 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3508/7056] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:07:39 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:07:41.460670 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:41.524187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-903fffa2-c74b-439f-be8a-f1a33dafadde req-eac359b3-bdc3-4ad0-a77b-5eae48e79a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:07:41.533807 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-903fffa2-c74b-439f-be8a-f1a33dafadde req-eac359b3-bdc3-4ad0-a77b-5eae48e79a6d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:07:41.534282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-903fffa2-c74b-439f-be8a-f1a33dafadde req-eac359b3-bdc3-4ad0-a77b-5eae48e79a6d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:07:41.534715 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-903fffa2-c74b-439f-be8a-f1a33dafadde req-eac359b3-bdc3-4ad0-a77b-5eae48e79a6d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:07:41.546251 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-903fffa2-c74b-439f-be8a-f1a33dafadde req-eac359b3-bdc3-4ad0-a77b-5eae48e79a6d service nova] Creating event network-changed:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h1-858384-1 Sep 19 16:07:41.551535 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-903fffa2-c74b-439f-be8a-f1a33dafadde req-eac359b3-bdc3-4ad0-a77b-5eae48e79a6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095743 Sep 19 16:07:41.552147 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3549/7057] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:09:36.945220 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 16:09:36.946113 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:36.946938 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:36.948648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:36.949397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=34 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:36.950650 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 16:09:36.950831 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf/action (ip 10.222.0.81) !!! Sep 19 16:09:36.956771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:09:36.957316 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:36.967221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:36.967721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:36.968167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:36.968864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:36.969328 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:36.969764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:36.993062 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lazy-loading 'flavor' on Instance uuid e18baece-8814-4f27-838a-96950cb4aecf {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:09:37.180667 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3f893d22-fadc-4b39-a652-6ab07e403766 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf/action" status: 202 len: 0 microversion: 2.1 time: 0.237082 Sep 19 16:09:37.183528 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3509/7058] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:09:36 2022] POST /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:09:37.188560 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:09:37.189372 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:09:37.189974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:37.190701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:37.192091 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:09:37.192301 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf (ip 10.222.0.81) !!! Sep 19 16:09:37.199398 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:37.200112 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:37.208348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:37.208841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:37.209282 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:37.209983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:37.210442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:37.210909 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:37.344976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:37.352791 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7af16155-669f-42b4-82d3-8b5c768bce1c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.166094 Sep 19 16:09:37.353602 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3550/7059] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:37 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:09:38.378148 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:38.378930 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:38.388047 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:38.388555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:38.389012 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:38.389748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:38.390227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:38.390674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:38.396126 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46240. Sep 19 16:09:38.528736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:38.536518 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ad606425-ef9d-423f-b8d0-7d46d5cd4f35 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.163946 Sep 19 16:09:38.537083 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3510/7060] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:38 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:39.560341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:39.561443 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:39.573117 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:39.573624 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:39.574077 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:39.574889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:39.576463 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:39.576911 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:39.587404 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46246. Sep 19 16:09:39.588822 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46244. Sep 19 16:09:39.722266 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:39.730338 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7ebfb901-1174-4930-8c67-5c29d20a44ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.174150 Sep 19 16:09:39.730934 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3551/7061] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:39 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:40.753989 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:40.754568 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:40.762184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:40.762692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:40.763170 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:40.763874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:40.764352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:40.764798 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:40.899197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:40.907025 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-d34e6785-5ccb-4d0f-b1ce-a482c03bfb01 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.157047 Sep 19 16:09:40.907602 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3511/7062] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:40 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:41.930019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:41.930639 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:41.937690 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:41.938177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:41.938617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:41.939342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:41.939800 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:41.940227 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:42.069500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:42.078787 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6d62c25a-1f15-4eda-8213-a6b8dd4dc219 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.152643 Sep 19 16:09:42.079417 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3552/7063] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:41 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:43.101529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:43.102186 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:43.109597 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:43.110098 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:43.110546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:43.111264 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:43.111734 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:43.112172 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:43.248692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:43.256360 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-af8908de-ec1f-416f-b0e6-359a611d9012 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.158811 Sep 19 16:09:43.256932 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3512/7064] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:43 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:44.281331 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:44.282047 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:44.288844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:44.289339 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:44.289779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:44.291206 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:44.291707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:44.292133 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:44.506837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:44.514670 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-964b8f99-4a3a-43a7-b858-4149a2a7e52a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.237349 Sep 19 16:09:44.515307 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3553/7065] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:44 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:45.537531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:45.538163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:45.545507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:45.546008 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:45.546457 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:45.547183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:45.547658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:45.548135 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:45.677533 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:45.685369 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-64a02eb1-a74f-453f-959c-770f5f8799b3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.151788 Sep 19 16:09:45.685935 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3513/7066] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:45 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:46.709299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:46.709841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:46.717348 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:46.717831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:46.718273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:46.719000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:46.719490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:46.719920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:46.856506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:46.864466 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5111c399-0a86-4912-abb5-42c1394b6466 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.159239 Sep 19 16:09:46.865057 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3554/7067] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:46 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:47.889294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:47.889953 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:47.897257 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:47.897905 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:47.898361 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:47.899117 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:47.899595 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:47.900642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:48.032913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:48.041132 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6194ec2-337d-44c2-90b8-47c22a3ea854 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1702 microversion: 2.1 time: 0.156509 Sep 19 16:09:48.041722 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3514/7068] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:47 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:49.065741 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:49.066415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:49.073376 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:49.073874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:49.074317 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:49.075040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:49.075506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:49.075940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:49.214163 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:49.222004 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-17757f8b-d409-4946-a559-822e3f258aca tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1702 microversion: 2.1 time: 0.160172 Sep 19 16:09:49.222577 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3555/7069] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:49 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:50.164181 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4389b8c4-efa7-48ed-8e50-d4720c211cfd req-471946f9-f878-49ae-a1db-c0d989476686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "name": "network-vif-plugged", "status": "completed", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:09:50.175139 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4389b8c4-efa7-48ed-8e50-d4720c211cfd req-471946f9-f878-49ae-a1db-c0d989476686 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:50.175643 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4389b8c4-efa7-48ed-8e50-d4720c211cfd req-471946f9-f878-49ae-a1db-c0d989476686 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:50.176088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4389b8c4-efa7-48ed-8e50-d4720c211cfd req-471946f9-f878-49ae-a1db-c0d989476686 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:50.191990 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4389b8c4-efa7-48ed-8e50-d4720c211cfd req-471946f9-f878-49ae-a1db-c0d989476686 service nova] Creating event network-vif-plugged:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h1-858384-1 Sep 19 16:09:50.198521 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4389b8c4-efa7-48ed-8e50-d4720c211cfd req-471946f9-f878-49ae-a1db-c0d989476686 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132946 Sep 19 16:09:50.199262 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3515/7070] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:09:50.248008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:50.248609 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:50.255976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:50.256472 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:50.256913 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:50.257622 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:50.258081 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:50.258513 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:50.413477 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:50.422140 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c22576ee-eb6c-4293-b152-45c719d0059c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.180243 Sep 19 16:09:50.422729 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3556/7071] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:50 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:51.449405 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:51.450780 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:51.463698 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:51.466153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:51.466665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:51.467444 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:51.467928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:51.468379 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:51.633055 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:51.644086 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-8d966426-81b2-4e83-9d9e-9f4e470ff904 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.200568 Sep 19 16:09:51.644811 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3516/7072] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:51 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:52.670862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:52.672610 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:52.679487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:52.679981 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:52.680661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:52.682285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:52.682789 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:52.683386 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:52.840831 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:52.849387 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3fdc7c98-551d-486a-8566-25933950748e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.182917 Sep 19 16:09:52.850157 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3557/7073] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:52 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:53.875673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:53.877377 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:53.886864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:53.887767 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:53.888456 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:53.889419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:53.890109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:53.890929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:54.050645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:54.061669 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a8b7bafe-3e3f-487e-9d7d-d3511f2e1a36 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.189922 Sep 19 16:09:54.062460 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3517/7074] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:53 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:55.085303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:55.086097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:55.093847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:55.094359 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:55.094822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:55.095551 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:55.096016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:55.096475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:55.254603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:55.265083 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3514786a-26bd-4acd-8834-d3764779a03b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.183826 Sep 19 16:09:55.279040 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3558/7075] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:55 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:56.289535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:56.291058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:56.301040 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:56.301559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:56.302020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:56.302759 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:56.303291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:56.303744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:56.459709 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:56.468967 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c077c7b3-284e-47d9-984c-fad2b1abce7c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.183254 Sep 19 16:09:56.469790 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3518/7076] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:56 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:57.496115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:57.496747 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:57.504435 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:57.504957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:57.505424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:57.506201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:57.506661 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:57.507111 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:57.662571 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:57.672018 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-374a03e7-09cb-496c-8a4a-6e73d0dbc100 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.181967 Sep 19 16:09:57.672636 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3559/7077] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:57 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:58.695985 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:58.696808 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:58.703888 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:58.704422 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:58.704871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:58.705576 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:58.706048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:58.706489 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:58.840608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:09:58.848498 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dd415e57-8d87-4e56-8966-8867b609f212 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1697 microversion: 2.1 time: 0.156485 Sep 19 16:09:58.849089 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3519/7078] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:58 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:09:59.872273 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:09:59.872886 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:09:59.879994 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:59.880485 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:59.881157 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:09:59.881853 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:09:59.882311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:09:59.882737 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:00.022941 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:00.031219 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-5dd7b8d7-5f1a-484f-83d1-5a5b6fd83126 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1679 microversion: 2.1 time: 0.162889 Sep 19 16:10:00.031803 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3560/7079] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:09:59 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:01.056396 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:01.057029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:01.065315 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:01.065830 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:01.066293 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:01.067284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:01.067772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:01.068220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:01.204942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:01.214061 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-78e63fe3-de33-40e3-9f19-56d58a47f94f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1682 microversion: 2.1 time: 0.161499 Sep 19 16:10:01.214655 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3520/7080] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:01 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:01.236881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:10:01.237483 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:01.244426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:01.244840 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:01.245269 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:01.245947 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:01.246396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:01.246846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:01.288040 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128730) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 16:10:01.358823 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ad47166b-1415-4069-ae08-fce19e505f6b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf/action" status: 202 len: 0 microversion: 2.1 time: 0.125201 Sep 19 16:10:01.359453 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3561/7081] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:10:01 2022] POST /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:10:01.367943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:01.369511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:01.375697 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:01.376289 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:01.376844 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:01.377642 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:01.378129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:01.378584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:01.527420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:01.535596 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f31530aa-43b4-4597-9358-b28df2c80acc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1690 microversion: 2.1 time: 0.171598 Sep 19 16:10:01.536178 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3521/7082] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:01 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:10:02.083791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-a90487bc-32c2-4f90-b720-62b6bbb2f41e req-c67a0025-cc89-4c1f-a69e-140fafa6f78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "name": "network-vif-unplugged", "status": "completed", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:10:02.096246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a90487bc-32c2-4f90-b720-62b6bbb2f41e req-c67a0025-cc89-4c1f-a69e-140fafa6f78d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:02.096246 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a90487bc-32c2-4f90-b720-62b6bbb2f41e req-c67a0025-cc89-4c1f-a69e-140fafa6f78d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:02.096534 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-a90487bc-32c2-4f90-b720-62b6bbb2f41e req-c67a0025-cc89-4c1f-a69e-140fafa6f78d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:02.109067 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.server_external_events [req-a90487bc-32c2-4f90-b720-62b6bbb2f41e req-c67a0025-cc89-4c1f-a69e-140fafa6f78d service nova] Unable to find a host for instance e18baece-8814-4f27-838a-96950cb4aecf. Dropping event network-vif-unplugged {{(pid=128730) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 16:10:02.109970 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-a90487bc-32c2-4f90-b720-62b6bbb2f41e req-c67a0025-cc89-4c1f-a69e-140fafa6f78d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030471 Sep 19 16:10:02.110731 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3562/7083] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 16:10:02.561739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:02.562291 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:02.569126 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:02.569620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:02.570069 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:02.570791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:02.571428 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:02.572064 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:02.709639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:02.718184 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-06c4acbd-11e2-4a5e-bf84-d756700cd5b7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.160434 Sep 19 16:10:02.718890 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3522/7084] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:02 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:03.648004 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:10:03.659498 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:03.660196 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:03.660724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:03.673165 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] Creating event network-changed:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h2-858384-1 Sep 19 16:10:03.677017 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] [d934f019-937b-445c-96c0-1cfbfef39b75] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:10:03.741677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:03.742354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:03.749743 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:03.750255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:03.750712 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:03.751468 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:03.751943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:03.752392 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:03.988425 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:03.998768 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3cb9e0ab-dacb-47f5-a9c4-2043a8b98b29 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.260994 Sep 19 16:10:03.999375 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3523/7085] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:03 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:10:04.688420 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] [d934f019-937b-445c-96c0-1cfbfef39b75] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46394. Sep 19 16:10:04.694288 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-59aefc47-85f4-4019-98d0-a32ea5640dd7 req-c3b47f2a-4698-4cd4-91f5-93dbc73dcbde service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.049832 Sep 19 16:10:04.695325 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3563/7086] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:10:05.024099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:05.025144 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:05.032229 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:05.033097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:05.033786 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:05.035371 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:05.036072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:05.036728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:05.042542 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:10:05.188874 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:05.197733 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b598867c-5a18-4010-b906-5d9fe7c0ee76 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.177453 Sep 19 16:10:05.198336 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3524/7087] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:05 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:06.223042 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:06.223756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:06.230143 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:06.230630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:06.231097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:06.231809 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:06.232259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:06.232687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:06.376318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:06.385116 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0f990821-285f-41bf-9e30-7a0d7c33f7cf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.167186 Sep 19 16:10:06.385901 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3564/7088] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:06 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:07.412130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:07.413052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:07.416796 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=33 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:10:07.422678 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:07.423321 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:07.423832 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:07.424625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:07.425164 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:07.425694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:07.570610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:07.580682 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f73acaa0-5bfa-4daa-b0c7-64e119d37316 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.175247 Sep 19 16:10:07.581570 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3525/7089] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:07 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:08.605335 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:08.605856 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:08.608912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:10:08.614709 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:08.615750 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:08.616268 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:08.617103 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:08.618338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:08.619701 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:08.625287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:10:08.781828 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:08.796141 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87db761b-a91b-4cfe-92c6-18106d50085d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.195312 Sep 19 16:10:08.799011 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3565/7090] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:08 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:09.821747 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:09.822373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:09.829342 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:09.829929 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:09.830430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:09.832546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:09.833097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:09.833518 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:09.991605 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:10.000440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3b9ac4e-4d00-4cae-8504-e09b3a815e8c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.183755 Sep 19 16:10:10.001029 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3526/7091] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:09 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:11.024804 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:11.025509 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:11.031959 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:11.032449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:11.032884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:11.033871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:11.034327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:11.034779 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:11.194383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:11.203956 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d69cb60e-a9c4-4158-9413-09115cb7f375 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.183962 Sep 19 16:10:11.204548 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3566/7092] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:11 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:12.229559 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:12.230198 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:12.238153 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:12.238776 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:12.239232 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:12.239940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:12.240414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:12.240913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:12.381731 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:12.389880 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-20be514e-b7bd-4f88-84bc-c903ccadce60 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.164615 Sep 19 16:10:12.390465 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3527/7093] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:12 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:13.412607 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:13.413217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:13.421385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:13.422011 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:13.422491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:13.423263 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:13.423915 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:13.424379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:13.561686 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:13.569351 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74cd7088-a647-485a-9f80-848e6755d7d4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.160720 Sep 19 16:10:13.569925 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3567/7094] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:13 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:14.591804 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:14.592431 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:14.599266 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:14.599761 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:14.600209 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:14.600937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:14.601407 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:14.602388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:14.735752 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:14.743965 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-bd455402-9f85-4331-ae03-78d9212ac017 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.156080 Sep 19 16:10:14.744533 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3528/7095] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:14 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:15.767276 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:15.767893 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:15.774797 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:15.775292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:15.775730 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:15.776426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:15.776895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:15.777303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:15.910714 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:15.919295 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bff20829-4fae-433f-9417-f50df0626ac5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.155983 Sep 19 16:10:15.919863 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3568/7096] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:15 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:16.943860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:16.944488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:16.952028 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:16.952529 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:16.952979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:16.953674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:16.954142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:16.954578 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:17.088933 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:17.096712 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-c345081e-303d-40fa-83bf-057c54a52a88 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.156837 Sep 19 16:10:17.097286 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3529/7097] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:16 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:17.737085 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-8e3183fc-224b-4143-bd89-b04aea6ae0b2 req-b767fb5b-4879-4f21-b8eb-760ec7bcd6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "name": "network-vif-plugged", "status": "completed", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:10:17.748519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e3183fc-224b-4143-bd89-b04aea6ae0b2 req-b767fb5b-4879-4f21-b8eb-760ec7bcd6aa service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:17.749015 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e3183fc-224b-4143-bd89-b04aea6ae0b2 req-b767fb5b-4879-4f21-b8eb-760ec7bcd6aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:17.749479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-8e3183fc-224b-4143-bd89-b04aea6ae0b2 req-b767fb5b-4879-4f21-b8eb-760ec7bcd6aa service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:17.760758 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-8e3183fc-224b-4143-bd89-b04aea6ae0b2 req-b767fb5b-4879-4f21-b8eb-760ec7bcd6aa service nova] Creating event network-vif-plugged:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h2-858384-1 Sep 19 16:10:17.765822 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-8e3183fc-224b-4143-bd89-b04aea6ae0b2 req-b767fb5b-4879-4f21-b8eb-760ec7bcd6aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Sep 19 16:10:17.766639 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3569/7098] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:10:18.119272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:18.119906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:18.126836 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:18.127344 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:18.127803 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:18.128514 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:18.128992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:18.129437 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:18.257674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:18.265466 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-2d7ed70e-8f53-4d44-91cd-e87f193ee426 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.150164 Sep 19 16:10:18.266049 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3530/7099] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:18 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:19.291487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:19.292220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:19.298788 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:19.299280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:19.299716 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:19.300406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:19.300864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:19.301290 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:19.442313 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:19.450351 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-29094b8e-4ba5-4a52-9738-b604bb2e1ef2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1688 microversion: 2.1 time: 0.164719 Sep 19 16:10:19.450947 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3570/7100] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:19 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:10:20.473498 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:10:20.474143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:10:20.481192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:20.481699 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:20.482173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:20.482925 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:10:20.483399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:10:20.483843 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:10:20.617076 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:10:20.625745 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-472bcb8c-c105-4d33-9931-3a5afbac9b99 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1675 microversion: 2.1 time: 0.156160 Sep 19 16:10:20.626333 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3531/7101] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:10:20 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:29.851639 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=13 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:29.852372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=11 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:29.854285 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=31 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:29.854795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=46 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:29.855733 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:11:29.855879 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:11:29.855972 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:11:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 16:11:29.856156 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:11:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf (ip 10.222.0.81) !!! Sep 19 16:11:29.858149 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:11:29.858149 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:11:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 16:11:29.862063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-cc836b64-6913-43c8-9941-55a64a2b6718 req-bee670b7-23b1-48e4-923e-4daef9ae5ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:11:29.863265 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:29.863777 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:29.874470 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc836b64-6913-43c8-9941-55a64a2b6718 req-bee670b7-23b1-48e4-923e-4daef9ae5ed9 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:29.875610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc836b64-6913-43c8-9941-55a64a2b6718 req-bee670b7-23b1-48e4-923e-4daef9ae5ed9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:29.875895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:29.876397 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:29.876777 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-cc836b64-6913-43c8-9941-55a64a2b6718 req-bee670b7-23b1-48e4-923e-4daef9ae5ed9 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:29.876898 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:29.877539 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:29.877997 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:29.878430 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:29.893609 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-cc836b64-6913-43c8-9941-55a64a2b6718 req-bee670b7-23b1-48e4-923e-4daef9ae5ed9 service nova] Creating event network-changed:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h2-858384-1 Sep 19 16:11:29.900821 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-cc836b64-6913-43c8-9941-55a64a2b6718 req-bee670b7-23b1-48e4-923e-4daef9ae5ed9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049824 Sep 19 16:11:29.901925 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3532/7102] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:11:29.915464 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:11:30.000022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-206f5941-a5f4-4abf-a6b1-9cbcee71865b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 204 len: 0 microversion: 2.1 time: 0.153308 Sep 19 16:11:30.004400 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3571/7103] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:11:29 2022] DELETE /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:11:30.011362 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:30.012442 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:30.021949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:30.022813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:30.023497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:30.024226 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:30.025906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:30.026474 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:30.177355 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:30.186167 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2b19350-5589-42f7-aeb0-8eccc406e936 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.180159 Sep 19 16:11:30.186771 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3533/7104] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:30 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:31.210139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:31.210873 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:31.217870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:31.218360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:31.218824 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:31.219525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:31.219988 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:31.220420 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:31.400552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:31.415348 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e1e357c9-a957-4616-8a7e-ccbdd0478254 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1681 microversion: 2.1 time: 0.209390 Sep 19 16:11:31.416655 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3572/7105] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:31 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:32.444699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:32.445977 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:32.453677 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:32.454207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:32.454664 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:32.455500 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:32.455967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:32.456487 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:32.495939 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-0f646327-24f9-4f26-a75b-8473c1173e01 req-8b7e2fb8-d60b-4f38-b7d5-b72cd362b476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18baece-8814-4f27-838a-96950cb4aecf", "name": "network-vif-deleted", "tag": "725de211-4c07-481b-9b4e-f8a7da6ba8ec"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:11:32.511507 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0f646327-24f9-4f26-a75b-8473c1173e01 req-8b7e2fb8-d60b-4f38-b7d5-b72cd362b476 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:32.514177 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0f646327-24f9-4f26-a75b-8473c1173e01 req-8b7e2fb8-d60b-4f38-b7d5-b72cd362b476 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:32.516087 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-0f646327-24f9-4f26-a75b-8473c1173e01 req-8b7e2fb8-d60b-4f38-b7d5-b72cd362b476 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:32.528147 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:32.533742 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-0f646327-24f9-4f26-a75b-8473c1173e01 req-8b7e2fb8-d60b-4f38-b7d5-b72cd362b476 service nova] Creating event network-vif-deleted:725de211-4c07-481b-9b4e-f8a7da6ba8ec for instance e18baece-8814-4f27-838a-96950cb4aecf on n-h2-858384-1 Sep 19 16:11:32.537490 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04320a2c-f3f6-4859-a8df-fe54e18180f2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 200 len: 1332 microversion: 2.1 time: 0.097391 Sep 19 16:11:32.538134 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3573/7106] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:32 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:32.541702 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-0f646327-24f9-4f26-a75b-8473c1173e01 req-8b7e2fb8-d60b-4f38-b7d5-b72cd362b476 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116099 Sep 19 16:11:32.542321 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3534/7107] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:11:33.561666 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:33.562284 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: e18baece-8814-4f27-838a-96950cb4aecf] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:33.569186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:33.569673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:33.570118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:33.570846 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:33.571311 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:33.572257 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:33.585358 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] HTTP exception thrown: Instance e18baece-8814-4f27-838a-96950cb4aecf could not be found. Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Request method failure captured: Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf HTTP/1.1 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJO7RznL0aBtbvTvXaU87_RCJK-RoQpPnGBiY2F_BEzVbo2QO0-MdHhoYdYlwSse7WUtmOjBgdckIw0IhjhMjH9wXiNE13T1Xj6n8QpnOXOq3XoSLpoLwjURaUfiU-_60hBjbLeDZZ3DyIRKXSH6i0WqeJoF5TQpTcKyh-gq6eXVMus Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 09c618aafbc04ea1aef8616bc840296c Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestShelveInstance-618473885 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_09c618aafbc04ea1aef8616bc840296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/09c618aafbc04ea1aef8616bc840296c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/09c618aafbc04ea1aef8616bc840296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/09c618aafbc04ea1aef8616bc840296c"}]}] Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestShelveInstance-618473885 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 09c618aafbc04ea1aef8616bc840296c Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestShelveInstance-618473885 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestShelveInstance-618473885-project Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 983abd8b0b774bb7b64106595446e1d0 Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestShelveInstance-618473885-project Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance e18baece-8814-4f27-838a-96950cb4aecf could not be found. Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'e18baece-8814-4f27-838a-96950cb4aecf'} Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18baece-8814-4f27-838a-96950cb4aecf could not be found. Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18baece-8814-4f27-838a-96950cb4aecf could not be found. Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:11:33.587022 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18baece-8814-4f27-838a-96950cb4aecf could not be found. Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Returning 404 to user: Instance e18baece-8814-4f27-838a-96950cb4aecf could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-35e1ad14-bcef-4302-aaff-933a1ad93df7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf" status: 404 len: 111 microversion: 2.1 time: 0.031424 Sep 19 16:11:33.593155 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3574/7108] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:33 2022] GET /compute/v2.1/servers/e18baece-8814-4f27-838a-96950cb4aecf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:11:33.748940 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6597914c-a1e5-483d-9018-db8943eff738 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '.version_select at 0x7fde29a88550>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:33.779902 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6597914c-a1e5-483d-9018-db8943eff738 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1708980505" status: 202 len: 0 microversion: 2.1 time: 0.035111 Sep 19 16:11:33.780634 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3535/7109] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 16:11:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1708980505 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:11:33.804791 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62057487-21d2-43a6-8d00-34170dfb14c9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'create', calling method: .version_select at 0x7fde28bff670>, body: {"keypair": {"name": "tempest-TestShelveInstance-604959593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE/s6MYFSrPXu/I9hA0krWfUPIjNlMftu49sLvrVeLxIvZL2EFLlOX8sUF5fOILdLAl62LCgsdUgWnv7wLRadW+1rKsHnSEqgHSzzlH/zyKUo4xkfs/R61/qBYW1MRv5w=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:11:33.820918 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-62057487-21d2-43a6-8d00-34170dfb14c9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for project 09c618aafbc04ea1aef8616bc840296c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:11:33.826303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-62057487-21d2-43a6-8d00-34170dfb14c9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for user 983abd8b0b774bb7b64106595446e1d0 and project 09c618aafbc04ea1aef8616bc840296c. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:11:33.856192 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62057487-21d2-43a6-8d00-34170dfb14c9 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.055332 Sep 19 16:11:33.856810 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3575/7110] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:11:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:11:50.015143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=10 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:50.015916 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:50.020686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1193623156", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-604959593", "security_groups": [{"name": "tempest-secgroup-smoke-623420606"}], "networks": [{"uuid": "69ef1f18-5db1-41b2-9d2d-61435e573cca"}], "block_device_mapping_v2": [{"uuid": "ff458792-d623-4fa9-9337-2445d0f67f31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:11:50.137212 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] validate_networks() for [('69ef1f18-5db1-41b2-9d2d-61435e573cca', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:11:50.507097 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:11:50.507537 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:11:50.508024 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:11:50.508451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:11:50.509420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:11:50.518859 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:50.519354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:50.519805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:50.520535 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:50.521003 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:50.521438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:50.539610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for project 09c618aafbc04ea1aef8616bc840296c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:11:50.545183 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Getting quotas for user 983abd8b0b774bb7b64106595446e1d0 and project 09c618aafbc04ea1aef8616bc840296c. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:11:50.604059 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:11:50.606306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff458792-d623-4fa9-9337-2445d0f67f31',volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:11:50.745466 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-951cff42-8edc-4caf-ab50-3a71c9a322a6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732182 Sep 19 16:11:50.746136 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3536/7111] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:11:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:11:50.757629 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b14d6c13-44f7-4370-aa64-9b38dcb0f41b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:50.758207 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b14d6c13-44f7-4370-aa64-9b38dcb0f41b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:50.761300 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:50.762159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=4 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:50.762879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:50.821628 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b14d6c13-44f7-4370-aa64-9b38dcb0f41b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:50.828565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b14d6c13-44f7-4370-aa64-9b38dcb0f41b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1088 microversion: 2.1 time: 0.075196 Sep 19 16:11:50.829132 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3576/7112] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:50 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:51.852619 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:51.853419 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:51.861603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:51.862101 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:51.862555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:51.863294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:51.863944 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:51.864387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:51.967967 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:51.975922 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1bcb2a4e-bad0-40ac-99ee-55af6994d2fa tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1204 microversion: 2.1 time: 0.128546 Sep 19 16:11:51.977010 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3537/7113] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:51 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1204 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:53.000575 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:53.001194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:53.008523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:53.009444 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:53.009892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:53.010603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:53.011089 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:53.011520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:53.222625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:53.231823 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ba45dabb-ae45-428e-a2e5-ca631a2095c6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1271 microversion: 2.1 time: 0.235240 Sep 19 16:11:53.232552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3577/7114] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:52 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:53.256056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e9c588c5-5aa3-466a-b198-5b943c91c7b4 req-09e180d3-e97e-4f22-a4cf-c5d43d33da16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:11:53.294237 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9c588c5-5aa3-466a-b198-5b943c91c7b4 req-09e180d3-e97e-4f22-a4cf-c5d43d33da16 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:53.294913 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9c588c5-5aa3-466a-b198-5b943c91c7b4 req-09e180d3-e97e-4f22-a4cf-c5d43d33da16 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:53.295449 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e9c588c5-5aa3-466a-b198-5b943c91c7b4 req-09e180d3-e97e-4f22-a4cf-c5d43d33da16 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:53.309109 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e9c588c5-5aa3-466a-b198-5b943c91c7b4 req-09e180d3-e97e-4f22-a4cf-c5d43d33da16 service nova] Creating event network-changed:c11271a9-f9dd-4371-a5d9-2368aae68a81 for instance c3220266-771f-4521-aded-b00404a24a4b on n-h1-858384-1 Sep 19 16:11:53.316454 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e9c588c5-5aa3-466a-b198-5b943c91c7b4 req-09e180d3-e97e-4f22-a4cf-c5d43d33da16 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064132 Sep 19 16:11:53.318862 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3538/7115] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:11:54.257411 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:54.257940 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:54.265707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:54.266194 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:54.266626 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:54.267342 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:54.267796 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:54.268217 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:54.411159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:54.419301 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d049a6d6-822a-480d-875b-48de7877f988 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1271 microversion: 2.1 time: 0.165823 Sep 19 16:11:54.420060 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3578/7116] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:54 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:55.444020 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:55.444753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:55.452623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:55.453129 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:55.453586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:55.454298 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:55.454791 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:55.455246 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:55.592217 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:55.600116 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-73edf4ef-7f75-4a59-8672-901b0b081c94 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1271 microversion: 2.1 time: 0.160336 Sep 19 16:11:55.600704 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3539/7117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:55 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:56.623599 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:56.624316 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:56.630795 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:56.631412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:56.631847 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:56.632542 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:56.632990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:56.633412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:56.779416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:56.787249 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-91e3b897-dc42-4a17-b275-f96bf6f13cb1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1271 microversion: 2.1 time: 0.167441 Sep 19 16:11:56.787834 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3579/7118] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:56 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:57.810356 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:57.810978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:57.817754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:57.818258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:57.818707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:57.819432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:57.819906 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:57.820349 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:57.952280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:57.960048 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-49a2d4eb-ac0c-4fe2-8704-6bd275c5378f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.153710 Sep 19 16:11:57.960620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3540/7119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:57 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:11:58.983336 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:11:58.984031 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:11:58.990835 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:58.991318 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:58.991749 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:58.992432 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:11:58.992884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:11:58.994000 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:11:59.121707 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:11:59.129398 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94e2dbc0-60d2-41f9-ab91-5488ff5bd9af tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.149919 Sep 19 16:11:59.129972 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3580/7120] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:11:58 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:00.153016 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:00.153686 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:00.160581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:00.161088 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:00.161547 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:00.162255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:00.162736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:00.163206 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:00.528347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:12:00.551318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:12:00.604258 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:00.611988 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-71ca92b2-8529-4568-a99f-e6ecf08c3bde tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.463147 Sep 19 16:12:00.612574 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3541/7121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:00 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:01.635589 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:01.636213 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:01.639038 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:12:01.644493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:01.644983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:01.645416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:01.646115 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:01.646568 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:01.647018 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:01.779805 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:01.787584 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-62362a72-3424-48f4-a33d-ddd46e4a71f4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.156755 Sep 19 16:12:01.788179 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3581/7122] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:01 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:02.811825 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:02.812364 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:02.819306 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:02.819813 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:02.820270 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:02.820979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:02.821488 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:02.821934 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:02.958376 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:02.966783 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-de4ca6e1-2372-4dbf-afcd-0aad7a380778 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.158967 Sep 19 16:12:02.967363 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3542/7123] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:02 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:03.990304 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:03.990954 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:03.998486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:03.999014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:03.999461 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:04.000159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:04.000617 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:04.001046 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:04.130158 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:04.138245 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9a6cd868-2ef7-478e-abe2-112d498ef0cd tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.151987 Sep 19 16:12:04.138843 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3582/7124] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:03 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:05.164025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:05.164805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:05.171724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:05.172221 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:05.172668 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:05.173366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:05.173834 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:05.174272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:05.386014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:05.393798 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-09aba17c-6566-483b-ad5e-7b1965e0379f tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.236221 Sep 19 16:12:05.394390 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3543/7125] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:05 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:06.417562 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:06.418441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:06.425662 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:06.426146 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:06.426583 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:06.427297 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:06.427751 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:06.428170 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:06.604960 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4111095a-9bd0-48b8-a8a7-ace731ad431b req-39c43ff6-34f4-4410-9aab-e2a952f07129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "name": "network-vif-plugged", "status": "completed", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:12:06.622694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4111095a-9bd0-48b8-a8a7-ace731ad431b req-39c43ff6-34f4-4410-9aab-e2a952f07129 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:06.623531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4111095a-9bd0-48b8-a8a7-ace731ad431b req-39c43ff6-34f4-4410-9aab-e2a952f07129 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:06.624165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4111095a-9bd0-48b8-a8a7-ace731ad431b req-39c43ff6-34f4-4410-9aab-e2a952f07129 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:06.637518 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4111095a-9bd0-48b8-a8a7-ace731ad431b req-39c43ff6-34f4-4410-9aab-e2a952f07129 service nova] Creating event network-vif-plugged:c11271a9-f9dd-4371-a5d9-2368aae68a81 for instance c3220266-771f-4521-aded-b00404a24a4b on n-h1-858384-1 Sep 19 16:12:06.643719 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4111095a-9bd0-48b8-a8a7-ace731ad431b req-39c43ff6-34f4-4410-9aab-e2a952f07129 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044872 Sep 19 16:12:06.644341 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3544/7126] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:12:06.647254 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:06.659900 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a66c9f36-f856-4fac-91f0-06393a06816a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.246653 Sep 19 16:12:06.667552 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3583/7127] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:06 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:12:07.687499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:07.688216 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:07.694500 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:07.695025 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:07.695475 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:07.696754 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:07.697223 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:07.697660 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:07.834268 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:07.842862 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-31d63747-759c-4a36-a19f-ba246b925c85 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1259 microversion: 2.1 time: 0.160348 Sep 19 16:12:07.843461 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3545/7128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:07 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:08.865556 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:08.866174 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:08.873925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:08.874418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:08.874889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:08.875592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:08.876053 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:08.876482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:09.017449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:09.025862 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-295a3585-9423-4185-9a82-98d62dcb0160 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1442 microversion: 2.1 time: 0.164276 Sep 19 16:12:09.026516 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3584/7129] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:08 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:12:09.048497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:12:09.049128 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:12:09.056674 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:09.057163 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:09.057608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:09.058307 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:09.058857 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:09.059301 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:09.198176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:12:09.206164 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f3d164fb-45d5-492b-bd59-95e94e737f1e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1442 microversion: 2.1 time: 0.161605 Sep 19 16:12:09.207108 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3546/7130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:12:09 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:12:10.810872 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-bb624f00-53c0-4c3e-8d53-80061bd14dc9 req-10c86c76-7955-4546-bf59-9f64a5c233a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:12:10.820525 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb624f00-53c0-4c3e-8d53-80061bd14dc9 req-10c86c76-7955-4546-bf59-9f64a5c233a4 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:12:10.821652 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb624f00-53c0-4c3e-8d53-80061bd14dc9 req-10c86c76-7955-4546-bf59-9f64a5c233a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:12:10.822259 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-bb624f00-53c0-4c3e-8d53-80061bd14dc9 req-10c86c76-7955-4546-bf59-9f64a5c233a4 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:12:10.833470 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-bb624f00-53c0-4c3e-8d53-80061bd14dc9 req-10c86c76-7955-4546-bf59-9f64a5c233a4 service nova] Creating event network-changed:c11271a9-f9dd-4371-a5d9-2368aae68a81 for instance c3220266-771f-4521-aded-b00404a24a4b on n-h1-858384-1 Sep 19 16:12:10.839551 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-bb624f00-53c0-4c3e-8d53-80061bd14dc9 req-10c86c76-7955-4546-bf59-9f64a5c233a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032765 Sep 19 16:12:10.840216 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3585/7131] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:14:06.287199 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6188fd0-6218-4fed-a16d-90446dd5c672] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 16:14:06.288330 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 16:14:06.288912 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:06.289666 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=54 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:06.342503 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:14:06.343089 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:06.354677 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:06.355215 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:06.355667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:06.356373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:06.356841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:06.357280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:06.381478 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.objects.instance [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lazy-loading 'flavor' on Instance uuid c3220266-771f-4521-aded-b00404a24a4b {{(pid=128731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 16:14:06.456677 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-251de329-c9ae-482f-895a-b0956a81c3ec tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b/action" status: 202 len: 0 microversion: 2.1 time: 0.171165 Sep 19 16:14:06.457279 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3547/7132] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:14:06 2022] POST /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:14:06.465149 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:14:06.466589 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:14:06.467097 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=22 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:06.467963 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=50 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:06.468928 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:14:06.469139 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b (ip 10.222.0.81) !!! Sep 19 16:14:06.479699 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:06.480445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:06.491020 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:06.491552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:06.492010 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:06.492753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:06.493238 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:06.493674 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:06.631848 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:06.639717 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7e4096ff-de60-442f-9200-2a7dc217ba31 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.176896 Sep 19 16:14:06.640291 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3586/7133] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:06 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:07.666571 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:07.667395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:07.677401 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:07.677942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:07.678423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:07.679228 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:07.679710 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:07.680160 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:07.685928 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6188fd0-6218-4fed-a16d-90446dd5c672] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46776. Sep 19 16:14:07.686646 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46778. Sep 19 16:14:07.841499 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:07.850231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1e2f2727-9d6e-4df1-83e4-057eb99a205e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.189323 Sep 19 16:14:07.850834 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3548/7134] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:07 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:08.882595 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:08.883377 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:08.902424 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:08.902946 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:08.903385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:08.904086 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:08.904543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:08.904964 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:08.905587 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46782. Sep 19 16:14:08.915127 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46784. Sep 19 16:14:09.049687 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:09.059144 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-3cc4b772-8e8d-4a32-9b12-8b0e1a7568fe tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.181427 Sep 19 16:14:09.059861 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3587/7135] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:08 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:10.085073 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:10.085707 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:10.092517 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:10.093014 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:10.093462 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:10.094159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:10.094627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:10.095096 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:10.235893 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:10.244657 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-da05a505-f057-4f55-a9b2-d47b043f72f5 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.163963 Sep 19 16:14:10.245223 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3549/7136] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:10 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:11.271682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:11.272479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:11.279193 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:11.279683 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:11.280124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:11.280820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:11.281283 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:11.281711 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:11.414388 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:11.422509 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d1422562-da3a-47fe-8cc5-65b036c2b8e7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.155367 Sep 19 16:14:11.423127 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3588/7137] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:11 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:12.447276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:12.447903 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:12.454673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:12.455205 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:12.455657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:12.456354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:12.456824 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:12.457259 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:12.592001 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:12.601920 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-fbd630db-6d2c-4648-aab4-832bb84ca92a tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.159406 Sep 19 16:14:12.602637 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3550/7138] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:12 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:14:13.626784 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:13.627405 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:13.634363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:13.634891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:13.635338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:13.636093 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:13.636592 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:13.637025 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:13.770550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:13.778465 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-74bd7aff-6fd8-4116-8567-975e08f02f13 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.155753 Sep 19 16:14:13.779073 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3589/7139] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:13 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:14.803409 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:14.804048 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:14.810943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:14.811448 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:14.811902 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:14.812609 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:14.813083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:14.813528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:14.949137 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:14.956992 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1edf4475-ba9c-410f-8278-dc33ee736f0c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.158342 Sep 19 16:14:14.957581 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3551/7140] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:14 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:15.981673 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:15.982296 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:15.989177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:15.989667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:15.990672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:15.991396 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:15.991850 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:15.992277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:16.121489 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:16.129397 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ab047733-971b-438c-8135-b524aa8ee239 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.151675 Sep 19 16:14:16.129979 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3590/7141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:15 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:17.154417 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:17.155386 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:17.162679 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:17.163224 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:17.163673 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:17.164373 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:17.164841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:17.165280 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:17.306007 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:17.313811 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-03a0dbea-8798-4c3e-9b3e-16194c6017ce tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.163488 Sep 19 16:14:17.314389 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3552/7142] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:17 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:18.338826 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:18.339465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:18.346482 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:18.347016 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:18.347462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:18.348160 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:18.348623 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:18.349594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:18.485587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:18.493455 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b702aa15-82ad-4c9f-a866-e4a100f9f935 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.158584 Sep 19 16:14:18.494027 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3591/7143] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:18 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:19.517713 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:19.518447 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:19.525936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:19.526446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:19.526943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:19.527676 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:19.528142 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:19.528590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:19.668620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:19.676961 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1ef8e128-490f-4108-ac4e-6fe45c4f1a3c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.163806 Sep 19 16:14:19.678343 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3553/7144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:19 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:20.700820 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:20.701449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:20.708363 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:20.708871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:20.709314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:20.710022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:20.710480 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:20.711032 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:20.855248 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:20.863536 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8b69ad22-bf7d-4b40-8bcc-32ab517d1071 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1568 microversion: 2.1 time: 0.166666 Sep 19 16:14:20.864147 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3592/7145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:20 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:20.888245 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:14:20.888861 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:20.896717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:20.897241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:20.897763 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:20.898472 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:20.898978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:20.899423 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:20.983648 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128731) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 16:14:21.051172 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-28123abc-2b30-47e2-b136-6ef2fa543b06 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "POST /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b/action" status: 202 len: 0 microversion: 2.1 time: 0.167079 Sep 19 16:14:21.051973 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3554/7146] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:14:20 2022] POST /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:14:21.069713 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:21.072075 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:21.082247 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:21.082943 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:21.083708 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:21.084682 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:21.085166 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:21.086633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:21.224493 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:21.233175 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-25444c36-5b4b-4985-a8b5-3a2294edbec1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1516 microversion: 2.1 time: 0.173861 Sep 19 16:14:21.233947 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3593/7147] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:21 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:22.258949 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:22.259566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:22.265811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:22.266324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:22.266811 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:22.267548 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:22.268027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:22.268490 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:22.414640 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:22.423298 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-81ee5503-ba51-463c-87e3-4121eb9c7aa6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1518 microversion: 2.1 time: 0.169878 Sep 19 16:14:22.423919 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3555/7148] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:22 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:23.155619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-adb064e5-0327-42ca-b173-de3d1d241a5c req-2d6f6634-68f3-4922-895e-ea4b33d0f00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "name": "network-vif-unplugged", "status": "completed", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:14:23.167511 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-adb064e5-0327-42ca-b173-de3d1d241a5c req-2d6f6634-68f3-4922-895e-ea4b33d0f00b service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:23.168073 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-adb064e5-0327-42ca-b173-de3d1d241a5c req-2d6f6634-68f3-4922-895e-ea4b33d0f00b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:23.168841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-adb064e5-0327-42ca-b173-de3d1d241a5c req-2d6f6634-68f3-4922-895e-ea4b33d0f00b service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:23.185144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.compute.server_external_events [req-adb064e5-0327-42ca-b173-de3d1d241a5c req-2d6f6634-68f3-4922-895e-ea4b33d0f00b service nova] Unable to find a host for instance c3220266-771f-4521-aded-b00404a24a4b. Dropping event network-vif-unplugged {{(pid=128730) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 16:14:23.186132 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-adb064e5-0327-42ca-b173-de3d1d241a5c req-2d6f6634-68f3-4922-895e-ea4b33d0f00b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035958 Sep 19 16:14:23.186855 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3594/7149] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 16:14:23.447314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:23.447954 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:23.455042 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:23.455560 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:23.456022 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:23.456744 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:23.457429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:23.457884 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:23.593083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:23.601407 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-5fdc5475-006c-4d7c-8479-272e53c896df tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1518 microversion: 2.1 time: 0.158613 Sep 19 16:14:23.601998 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3556/7150] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:23 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:24.624862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:24.625522 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:24.632871 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:24.633371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:24.633813 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:24.634524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:24.635012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:24.635445 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:24.782024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:24.790668 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cb283032-07ed-48a0-a799-ea422c6d7cc3 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1518 microversion: 2.1 time: 0.169755 Sep 19 16:14:24.791323 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3595/7151] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:24 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:25.816625 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:25.817182 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:25.824692 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:25.825197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:25.825647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:25.826352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:25.826915 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:25.827354 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:25.968395 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:25.978081 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-f6801398-f6b5-4c5b-b7a5-6789a163d46d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1518 microversion: 2.1 time: 0.165567 Sep 19 16:14:25.979162 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3557/7152] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:25 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:27.002844 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:27.003465 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:27.010437 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:27.011044 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:27.011700 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:27.012418 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:27.012874 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:27.013299 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:27.219479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:27.228171 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-edfc78ee-e04c-4216-ad56-0d16c474ebe2 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.229447 Sep 19 16:14:27.228754 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3596/7153] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:26 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:28.262211 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:28.262875 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:28.270305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:28.271458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:28.272072 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:28.272793 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:28.273276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:28.273729 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:28.410649 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:28.420186 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-eca95333-e142-4065-b773-da6279a0da17 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.162029 Sep 19 16:14:28.420823 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3558/7154] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:28 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:29.446178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:29.446819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:29.453726 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:29.454211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:29.454634 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:29.455344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:29.455793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:29.456215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:29.591327 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:29.599497 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-87089ef6-2cf8-42c6-95c5-95af105935bf tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.157908 Sep 19 16:14:29.600082 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3597/7155] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:29 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:30.622955 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:30.623590 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:30.630484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:30.631023 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:30.631483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:30.632190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:30.632667 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:30.633109 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:30.767013 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:30.774885 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-916f3ac3-3625-419b-a45f-a4f01bd17320 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.155909 Sep 19 16:14:30.775472 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3559/7156] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:30 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:14:31.798181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:31.798823 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:31.806367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:31.806895 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:31.807345 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:31.808056 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:31.808506 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:31.808939 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:31.939594 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:31.947975 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b123491e-f2ad-4eeb-be9b-ea8a43b91b4c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.153786 Sep 19 16:14:31.948549 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3598/7157] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:31 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:32.971675 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:32.972309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:32.979276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:32.979781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:32.980239 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:32.980943 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:32.981420 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:32.981864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:33.000594 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:33.121771 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:33.129517 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-347df05d-bea5-4565-8948-556914d54cda tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.161942 Sep 19 16:14:33.130104 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3560/7158] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:32 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:34.152656 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:34.153303 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:34.160139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:34.160625 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:34.161214 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:34.161920 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:34.162378 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:34.162827 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:34.294529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:34.303216 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-94dfbee8-298c-47a7-817b-3ce981cd39d6 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.154275 Sep 19 16:14:34.303795 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3599/7159] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:34 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:35.327831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:35.328657 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:35.336645 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:35.337159 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:35.337623 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:35.338339 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:35.338847 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:35.339295 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:35.473365 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:35.481258 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b00c93df-adca-42f0-8a03-900da319f1ed tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.158227 Sep 19 16:14:35.481836 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3561/7160] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:35 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:36.504579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:36.505198 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:36.507885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=29 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:36.513633 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:36.514292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:36.514931 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:36.515643 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:36.516106 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:36.516540 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:36.520596 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=81 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:36.649441 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:36.657200 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-c28b0ec7-cb39-4928-ab55-923665f16405 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.156540 Sep 19 16:14:36.657789 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3600/7161] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:36 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:37.255338 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a35e17e4-962e-434c-9f21-cc74ec9e6cab req-48d50628-bae1-48da-b098-50e2e5c1b916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "name": "network-vif-plugged", "status": "completed", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:14:37.261309 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:37.268614 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a35e17e4-962e-434c-9f21-cc74ec9e6cab req-48d50628-bae1-48da-b098-50e2e5c1b916 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:37.269131 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a35e17e4-962e-434c-9f21-cc74ec9e6cab req-48d50628-bae1-48da-b098-50e2e5c1b916 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:37.269585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a35e17e4-962e-434c-9f21-cc74ec9e6cab req-48d50628-bae1-48da-b098-50e2e5c1b916 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:37.283301 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a35e17e4-962e-434c-9f21-cc74ec9e6cab req-48d50628-bae1-48da-b098-50e2e5c1b916 service nova] Creating event network-vif-plugged:c11271a9-f9dd-4371-a5d9-2368aae68a81 for instance c3220266-771f-4521-aded-b00404a24a4b on n-h1-858384-1 Sep 19 16:14:37.289278 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a35e17e4-962e-434c-9f21-cc74ec9e6cab req-48d50628-bae1-48da-b098-50e2e5c1b916 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038324 Sep 19 16:14:37.289889 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3562/7162] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:14:37.681172 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:37.681819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:37.688696 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:37.689136 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:37.689573 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:37.690267 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:37.690724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:37.691177 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:37.823728 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:37.831452 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-04cb0645-9506-46cb-9be4-051b99ec2e15 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1574 microversion: 2.1 time: 0.154257 Sep 19 16:14:37.832033 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3601/7163] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:37 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:14:38.858145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:14:38.858871 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:14:38.866430 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:38.867074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:38.867593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:38.868294 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:14:38.868762 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:14:38.869201 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:14:39.009429 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:14:39.017315 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-32804be2-11da-4c94-b570-7cd7b293572b tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1561 microversion: 2.1 time: 0.164948 Sep 19 16:14:39.017893 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3563/7164] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:14:38 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:15:53.015181 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:53.015937 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=11 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:53.016758 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:15:53.016911 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b (ip 10.222.0.81) !!! Sep 19 16:15:53.021436 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:53.022288 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=16 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:53.023262 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:15:53.023644 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 16:15:53.025536 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:15:53.025667 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b (ip 10.222.0.81) !!! Sep 19 16:15:53.031145 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-fc14837d-5f53-4f09-a4b9-720400670b9e req-05db7907-ae53-4de9-b86f-329ffa50f897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:15:53.049875 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:53.050387 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:53.054154 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc14837d-5f53-4f09-a4b9-720400670b9e req-05db7907-ae53-4de9-b86f-329ffa50f897 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:53.054672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc14837d-5f53-4f09-a4b9-720400670b9e req-05db7907-ae53-4de9-b86f-329ffa50f897 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:53.055157 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-fc14837d-5f53-4f09-a4b9-720400670b9e req-05db7907-ae53-4de9-b86f-329ffa50f897 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:53.060082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:53.061014 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:53.061456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:53.062169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:53.062903 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:53.063340 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:53.068299 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-fc14837d-5f53-4f09-a4b9-720400670b9e req-05db7907-ae53-4de9-b86f-329ffa50f897 service nova] Creating event network-changed:c11271a9-f9dd-4371-a5d9-2368aae68a81 for instance c3220266-771f-4521-aded-b00404a24a4b on n-h1-858384-1 Sep 19 16:15:53.073751 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-fc14837d-5f53-4f09-a4b9-720400670b9e req-05db7907-ae53-4de9-b86f-329ffa50f897 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054272 Sep 19 16:15:53.074718 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3564/7165] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:15:53.095078 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:15:53.182716 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ebf5ba83-3e58-4f20-a599-6d0e032d234e tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 204 len: 0 microversion: 2.1 time: 0.169422 Sep 19 16:15:53.186489 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3602/7166] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:15:53 2022] DELETE /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:15:53.193817 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:53.195197 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:53.202178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:53.202764 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:53.203418 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:53.204393 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:53.205904 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:53.206773 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:53.651366 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:15:53.660019 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-1adbac58-2a49-43dc-a14e-2587ffb96fa4 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.471673 Sep 19 16:15:53.660856 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3565/7167] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:15:53 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:15:54.688841 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:54.689962 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:54.698245 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:54.699211 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:54.699922 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:54.700884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:54.701412 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:54.701843 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:54.948698 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:15:54.957334 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-d28e8af4-744f-497f-958b-3dae614aac0d tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1567 microversion: 2.1 time: 0.272994 Sep 19 16:15:54.957913 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3603/7168] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:15:54 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:15:55.302718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-61c243db-115b-4983-a248-4d7419e20c64 req-0d59d707-23f2-474f-b026-27926f6ddf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3220266-771f-4521-aded-b00404a24a4b", "name": "network-vif-deleted", "tag": "c11271a9-f9dd-4371-a5d9-2368aae68a81"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:15:55.313581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-61c243db-115b-4983-a248-4d7419e20c64 req-0d59d707-23f2-474f-b026-27926f6ddf7d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:55.314077 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-61c243db-115b-4983-a248-4d7419e20c64 req-0d59d707-23f2-474f-b026-27926f6ddf7d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:55.314928 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-61c243db-115b-4983-a248-4d7419e20c64 req-0d59d707-23f2-474f-b026-27926f6ddf7d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:55.326332 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-61c243db-115b-4983-a248-4d7419e20c64 req-0d59d707-23f2-474f-b026-27926f6ddf7d service nova] Creating event network-vif-deleted:c11271a9-f9dd-4371-a5d9-2368aae68a81 for instance c3220266-771f-4521-aded-b00404a24a4b on n-h1-858384-1 Sep 19 16:15:55.332206 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-61c243db-115b-4983-a248-4d7419e20c64 req-0d59d707-23f2-474f-b026-27926f6ddf7d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088927 Sep 19 16:15:55.332968 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3566/7169] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:15:55.980811 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:55.981667 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:55.988914 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:55.989399 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:55.989838 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:55.990535 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:55.991019 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:55.991442 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:56.055550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:15:56.064036 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9027c92d-30c4-4a72-b41b-57a62b7450c7 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1219 microversion: 2.1 time: 0.087084 Sep 19 16:15:56.065248 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3604/7170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:15:55 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:15:57.089558 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:57.090305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:57.097998 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:57.098487 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:57.098978 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:57.099694 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:57.100169 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:57.100612 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:57.164041 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:15:57.172288 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-a2c9fc6f-1f74-4068-8cfe-833f54718db1 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1219 microversion: 2.1 time: 0.087976 Sep 19 16:15:57.172867 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3567/7171] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:15:57 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:15:58.196704 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:58.197347 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:58.204293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:58.204782 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:58.205916 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:58.206621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:58.207105 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:58.207533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:58.270220 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:15:58.278195 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e93a88f9-c890-4900-9f87-7fb0aa2c9837 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1219 microversion: 2.1 time: 0.085448 Sep 19 16:15:58.278859 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3605/7172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:15:58 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:15:59.302969 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:15:59.303584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:15:59.309545 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:59.310052 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:59.310508 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:59.311261 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:15:59.311736 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:15:59.312178 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:15:59.381026 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983abd8b0b774bb7b64106595446e1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c618aafbc04ea1aef8616bc840296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:15:59.389288 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-caa66ee1-06ea-445a-891e-1eda4abacb6c tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 200 len: 1219 microversion: 2.1 time: 0.091641 Sep 19 16:15:59.396308 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3568/7173] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:15:59 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:00.413616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:00.414344 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] [instance: c3220266-771f-4521-aded-b00404a24a4b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:00.421665 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:00.422164 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:00.422604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:00.423392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:00.425581 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:00.426022 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:00.442984 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] HTTP exception thrown: Instance c3220266-771f-4521-aded-b00404a24a4b could not be found. Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Request method failure captured: Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b HTTP/1.1 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJO7RznL0aBtbvTvXaU87_RCJK-RoQpPnGBiY2F_BEzVbo2QO0-MdHhoYdYlwSse7WUtmOjBgdckIw0IhjhMjH9wXiNE13T1Xj6n8QpnOXOq3XoSLpoLwjURaUfiU-_60hBjbLeDZZ3DyIRKXSH6i0WqeJoF5TQpTcKyh-gq6eXVMus Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 09c618aafbc04ea1aef8616bc840296c Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestShelveInstance-618473885 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_09c618aafbc04ea1aef8616bc840296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/09c618aafbc04ea1aef8616bc840296c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/09c618aafbc04ea1aef8616bc840296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/09c618aafbc04ea1aef8616bc840296c"}]}] Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestShelveInstance-618473885 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 09c618aafbc04ea1aef8616bc840296c Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestShelveInstance-618473885 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestShelveInstance-618473885-project Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: 983abd8b0b774bb7b64106595446e1d0 Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestShelveInstance-618473885-project Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance c3220266-771f-4521-aded-b00404a24a4b could not be found. Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': 'c3220266-771f-4521-aded-b00404a24a4b'} Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3220266-771f-4521-aded-b00404a24a4b could not be found. Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3220266-771f-4521-aded-b00404a24a4b could not be found. Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:16:00.444672 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3220266-771f-4521-aded-b00404a24a4b could not be found. Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Returning 404 to user: Instance c3220266-771f-4521-aded-b00404a24a4b could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a89bd22c-d145-4749-8e36-e1188b7ba4dc tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b" status: 404 len: 111 microversion: 2.1 time: 0.036674 Sep 19 16:16:00.449400 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3606/7174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:00 2022] GET /compute/v2.1/servers/c3220266-771f-4521-aded-b00404a24a4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:16:00.615104 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-136e229d-a570-40fd-b665-9f96abbe93c0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] Calling method '.version_select at 0x7fde2e290310>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:00.645065 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-136e229d-a570-40fd-b665-9f96abbe93c0 tempest-TestShelveInstance-618473885 tempest-TestShelveInstance-618473885-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-604959593" status: 202 len: 0 microversion: 2.1 time: 0.034267 Sep 19 16:16:00.645871 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3569/7175] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 16:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-604959593 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 16:16:18.493252 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:18.494524 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:18.766118 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a4519375-8950-4323-a704-03caadd78e56 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Action: 'create', calling method: .version_select at 0x7fde28df4e50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-678571308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHh7tv0L7gMJyoj/jav5h3v1ebIezx59UCqJHft0sBuovvVupSqNp9ht+N/aXZIBLORzu1btaefvwPrWFvdzs4wdULhpDsHqvZtDwSxsLAcS50Eu/AAx3f0D4nT/Osiniw=="}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:16:18.784292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a4519375-8950-4323-a704-03caadd78e56 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Getting quotas for project 394e3552784246d48cf3feaf246eedd9. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:16:18.789510 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-a4519375-8950-4323-a704-03caadd78e56 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Getting quotas for user fe21e6f85c854e2b975e47dc4c382cdd and project 394e3552784246d48cf3feaf246eedd9. Resources: {'key_pairs'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:16:18.822489 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a4519375-8950-4323-a704-03caadd78e56 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.334173 Sep 19 16:16:18.823129 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3607/7176] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 16:16:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:16:19.834689 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-990706731", "imageRef": "65e17483-129b-4a3b-97d8-49cd96ae0799", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-678571308", "security_groups": [{"name": "tempest-secgroup-smoke-377738236"}], "networks": [{"uuid": "69754136-4cd8-4db7-85bd-c7a2237b28be"}]}} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:16:19.844882 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=22 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:19.846092 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:19.964663 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.network.neutron [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] validate_networks() for [('69754136-4cd8-4db7-85bd-c7a2237b28be', None, None, None, None, None)] {{(pid=128731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:16:20.370350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Flavor limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:16:20.370822 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Image limits 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:16:20.371318 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Flavor pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:16:20.371750 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Image pref 0:0:0 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:16:20.372180 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.virt.hardware [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:16:20.382573 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:20.383130 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:20.383582 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:20.384555 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:20.385031 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:20.385476 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:20.403083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Getting quotas for project 394e3552784246d48cf3feaf246eedd9. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:16:20.413647 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.quota [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Getting quotas for user fe21e6f85c854e2b975e47dc4c382cdd and project 394e3552784246d48cf3feaf246eedd9. Resources: {'cores', 'instances', 'ram'} {{(pid=128731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:16:20.428387 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Going to run 1 instances... {{(pid=128731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:16:20.430728 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e17483-129b-4a3b-97d8-49cd96ae0799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:16:20.480038 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3bd88013-200a-4824-a52d-2cbf2d84e634 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.650233 Sep 19 16:16:20.480699 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3570/7177] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:16:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 16:16:20.492305 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-8a7a2d0b-ef8d-4860-b3ea-f429aa5762d9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:20.492925 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-8a7a2d0b-ef8d-4860-b3ea-f429aa5762d9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:20.551904 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-8a7a2d0b-ef8d-4860-b3ea-f429aa5762d9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:20.559382 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-8a7a2d0b-ef8d-4860-b3ea-f429aa5762d9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1247 microversion: 2.1 time: 0.070954 Sep 19 16:16:20.559953 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3608/7178] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:20 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:21.584029 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:21.584805 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:21.591556 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:21.592346 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:21.592951 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:21.593749 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:21.594432 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:21.595705 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:21.706451 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:21.715301 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ecd488a6-c17a-4eef-89d7-407ee36b3cf6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1307 microversion: 2.1 time: 0.136944 Sep 19 16:16:21.716068 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3571/7179] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:21 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1307 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:22.741373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:22.741995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:22.749450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:22.749957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:22.750407 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:22.751165 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:22.751619 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:22.752426 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:22.974473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:22.984632 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-08e310ef-fa57-4533-a73a-fb841171c7b7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.246825 Sep 19 16:16:22.985387 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3609/7180] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:22 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:23.277397 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5d597e17-6565-4fe2-8ddb-36ad2ebb188b req-9c4a26ea-9269-4e7c-8bc5-6e68e2b34690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:16:23.289184 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d597e17-6565-4fe2-8ddb-36ad2ebb188b req-9c4a26ea-9269-4e7c-8bc5-6e68e2b34690 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:23.289841 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d597e17-6565-4fe2-8ddb-36ad2ebb188b req-9c4a26ea-9269-4e7c-8bc5-6e68e2b34690 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:23.290399 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5d597e17-6565-4fe2-8ddb-36ad2ebb188b req-9c4a26ea-9269-4e7c-8bc5-6e68e2b34690 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:23.302440 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5d597e17-6565-4fe2-8ddb-36ad2ebb188b req-9c4a26ea-9269-4e7c-8bc5-6e68e2b34690 service nova] Creating event network-changed:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:16:23.307589 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5d597e17-6565-4fe2-8ddb-36ad2ebb188b req-9c4a26ea-9269-4e7c-8bc5-6e68e2b34690 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034348 Sep 19 16:16:23.308294 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3572/7181] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:16:24.014139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:24.015006 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:24.022992 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:24.023689 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:24.024277 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:24.025144 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:24.025774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:24.026379 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:24.181753 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:24.190073 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-a3ecdb7c-8391-42b8-a277-0e9d9b8c3345 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.181492 Sep 19 16:16:24.190649 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3610/7182] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:24 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:25.214992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:25.215721 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:25.222724 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:25.223276 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:25.223737 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:25.224458 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:25.224942 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:25.225389 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:25.375581 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:25.383304 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-82d945ca-38c8-4d13-91c8-8343405fd533 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.173495 Sep 19 16:16:25.383899 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3573/7183] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:25 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:26.406870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:26.408429 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:26.415178 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:26.415678 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:26.416125 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:26.416829 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:26.417287 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:26.417712 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:26.554367 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:26.562101 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0fe08789-e3da-4121-afa5-3963a14404a4 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.159266 Sep 19 16:16:26.562679 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3611/7184] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:26 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:27.586143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:27.586794 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:27.593572 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:27.594105 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:27.594634 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:27.596123 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:27.596593 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:27.597035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:27.734947 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:27.743693 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-ed1e9105-f2f2-475c-8c23-75444be2d42c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.161460 Sep 19 16:16:27.744276 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3574/7185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:27 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:28.767996 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:28.768543 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:28.775529 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:28.776024 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:28.776469 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:28.777168 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:28.777637 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:28.778068 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:28.908383 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:28.916961 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-50ec6737-45e7-4b00-9531-eb0e3c238e4e tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.153675 Sep 19 16:16:28.917540 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3612/7186] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:28 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:29.941979 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:29.942615 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:29.949631 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:29.950147 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:29.950603 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:29.951347 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:29.951826 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:29.952272 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:30.061976 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-1e4f592a-8736-485f-8304-8e08769ecf6b req-51b97cd0-5126-4e6b-b2af-bca515e15b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "name": "network-vif-plugged", "status": "completed", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:16:30.078774 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1e4f592a-8736-485f-8304-8e08769ecf6b req-51b97cd0-5126-4e6b-b2af-bca515e15b62 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:30.080215 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1e4f592a-8736-485f-8304-8e08769ecf6b req-51b97cd0-5126-4e6b-b2af-bca515e15b62 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:30.080553 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-1e4f592a-8736-485f-8304-8e08769ecf6b req-51b97cd0-5126-4e6b-b2af-bca515e15b62 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:30.092356 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-1e4f592a-8736-485f-8304-8e08769ecf6b req-51b97cd0-5126-4e6b-b2af-bca515e15b62 service nova] Creating event network-vif-plugged:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:16:30.097833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-1e4f592a-8736-485f-8304-8e08769ecf6b req-51b97cd0-5126-4e6b-b2af-bca515e15b62 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102700 Sep 19 16:16:30.098518 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3613/7187] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:16:30.114082 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:30.123700 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-4c14e9f0-e969-451c-b9f4-8c7a1a65a429 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.186416 Sep 19 16:16:30.124290 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3575/7188] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:29 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:31.148116 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:31.148814 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:31.150793 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:31.157833 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:31.158413 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:31.158885 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:31.159587 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:31.160037 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:31.160462 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:31.302334 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:31.310372 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-03867c6e-6c26-413e-8e33-e5ae709c30f9 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1372 microversion: 2.1 time: 0.166242 Sep 19 16:16:31.311141 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3614/7189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:31 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:32.336864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:32.337872 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:32.339936 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:32.340637 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=6 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:32.349107 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:32.349608 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:32.350058 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:32.350781 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:32.351255 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:32.351690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:32.491116 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:32.499062 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-3c3b5497-f9f0-434f-b59e-e2207c4ba217 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1558 microversion: 2.1 time: 0.167599 Sep 19 16:16:32.499647 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3576/7190] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:32 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:32.522190 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:16:32.522842 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:16:32.529735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:32.530231 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:32.530685 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:32.531415 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:32.531989 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:32.532514 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:32.665060 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:16:32.673760 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ea6ef7a5-7e89-4495-82bf-2d0c103c9f7a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1558 microversion: 2.1 time: 0.155230 Sep 19 16:16:32.674491 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3615/7191] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:16:32 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:16:34.434027 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-f5d81cdd-a882-49a4-97bc-2cb066b6288c req-6e9f5716-989a-4885-92b6-f45f9414e119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:16:34.444511 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f5d81cdd-a882-49a4-97bc-2cb066b6288c req-6e9f5716-989a-4885-92b6-f45f9414e119 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:16:34.445037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f5d81cdd-a882-49a4-97bc-2cb066b6288c req-6e9f5716-989a-4885-92b6-f45f9414e119 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:16:34.445483 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-f5d81cdd-a882-49a4-97bc-2cb066b6288c req-6e9f5716-989a-4885-92b6-f45f9414e119 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:16:34.457456 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-f5d81cdd-a882-49a4-97bc-2cb066b6288c req-6e9f5716-989a-4885-92b6-f45f9414e119 service nova] Creating event network-changed:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:16:34.462482 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-f5d81cdd-a882-49a4-97bc-2cb066b6288c req-6e9f5716-989a-4885-92b6-f45f9414e119 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092298 Sep 19 16:16:34.463182 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3577/7192] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:18:29.608186 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 16:18:29.609080 n-d-858384-1 devstack@n-api.service[128730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 16:18:29.609801 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:29.610767 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=38 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:29.611664 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:18:29.611817 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b/action (ip 10.222.0.81) !!! Sep 19 16:18:29.616825 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-191696035"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:18:29.619233 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:29.629870 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:29.630360 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:29.630818 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:29.631523 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:29.631978 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:29.632404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:29.935151 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e3e4f5e8-576c-4cc6-aaad-77ce73fa15b5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "POST /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b/action" status: 202 len: 0 microversion: 2.1 time: 0.328484 Sep 19 16:18:29.936348 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3616/7193] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:18:29 2022] POST /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 16:18:36.455471 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6188fd0-6218-4fed-a16d-90446dd5c672] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:18:36.458058 n-d-858384-1 devstack@n-api.service[128731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 16:18:36.458937 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:36.460281 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=36 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:36.462311 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 16:18:36.462575 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 16:18:36.479176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-015de0ad-e44c-4c22-9eae-277b37aac795 req-ee487469-4e5c-4113-9ff5-03d697fcfa6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "name": "network-vif-plugged", "status": "completed", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:18:36.491563 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-015de0ad-e44c-4c22-9eae-277b37aac795 req-ee487469-4e5c-4113-9ff5-03d697fcfa6e service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:36.492506 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-015de0ad-e44c-4c22-9eae-277b37aac795 req-ee487469-4e5c-4113-9ff5-03d697fcfa6e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:36.493220 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-015de0ad-e44c-4c22-9eae-277b37aac795 req-ee487469-4e5c-4113-9ff5-03d697fcfa6e service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:36.526149 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-015de0ad-e44c-4c22-9eae-277b37aac795 req-ee487469-4e5c-4113-9ff5-03d697fcfa6e service nova] Creating event network-vif-plugged:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:18:36.532592 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-015de0ad-e44c-4c22-9eae-277b37aac795 req-ee487469-4e5c-4113-9ff5-03d697fcfa6e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079611 Sep 19 16:18:36.533277 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3578/7194] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:18:43.496139 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-952695114", "imageRef": "d79a2b0b-4785-44c9-943f-bcdcda1c8896", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-678571308", "security_groups": [{"name": "tempest-secgroup-smoke-377738236"}], "networks": [{"uuid": "69754136-4cd8-4db7-85bd-c7a2237b28be"}]}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:18:43.506604 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:43.507320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:43.526081 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [d364a937-01d0-4065-a572-99d777bc6ee4] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 47278. Sep 19 16:18:43.531191 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] [c965fe4d-3944-443f-bb6a-01fe31686153] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 47280. Sep 19 16:18:43.613008 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.network.neutron [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] validate_networks() for [('69754136-4cd8-4db7-85bd-c7a2237b28be', None, None, None, None, None)] {{(pid=128730) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 16:18:44.040861 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Flavor limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 16:18:44.041320 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Image limits 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 16:18:44.041881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Flavor pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 16:18:44.042236 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Image pref 0:0:0 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 16:18:44.042647 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.virt.hardware [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 16:18:44.051974 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:44.052456 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:44.052891 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:44.053611 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:44.054065 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:44.054486 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:44.072187 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Getting quotas for project 394e3552784246d48cf3feaf246eedd9. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 16:18:44.078186 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.quota [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Getting quotas for user fe21e6f85c854e2b975e47dc4c382cdd and project 394e3552784246d48cf3feaf246eedd9. Resources: {'cores', 'instances', 'ram'} {{(pid=128730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 16:18:44.090552 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Going to run 1 instances... {{(pid=128730) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 16:18:44.093074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d79a2b0b-4785-44c9-943f-bcdcda1c8896',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 16:18:44.142698 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b89702df-df65-4477-8de5-5a73f4919dfe tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.650486 Sep 19 16:18:44.143980 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3617/7195] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 16:18:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 16:18:44.160167 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-7f398f45-7fc8-4da7-8001-9a88168daa4a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:44.160992 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-7f398f45-7fc8-4da7-8001-9a88168daa4a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:44.201546 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [735589a1-051b-4bb4-8bdc-40c511292c05] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 47296. Sep 19 16:18:44.202294 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6188fd0-6218-4fed-a16d-90446dd5c672] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 47294. Sep 19 16:18:44.290770 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-7f398f45-7fc8-4da7-8001-9a88168daa4a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:44.298963 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-7f398f45-7fc8-4da7-8001-9a88168daa4a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1247 microversion: 2.1 time: 0.143105 Sep 19 16:18:44.299543 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3579/7196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:44 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1247 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:45.322718 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:45.323385 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:45.330724 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:45.331249 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:45.331792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:45.332491 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:45.332948 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:45.333372 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:45.401096 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:45.410313 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-69b6cd93-5efe-40f0-bb13-03d8f5f07e0c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1305 microversion: 2.1 time: 0.092516 Sep 19 16:18:45.411125 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3618/7197] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:45 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:46.434200 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:46.444191 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:46.452795 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:46.453314 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:46.453784 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:46.454766 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:46.455227 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:46.455850 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:46.492892 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-09832029-1c2e-49c6-8691-52f3c7c7ce3d req-2be5b617-26d3-448c-8878-4f1ac649678d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "name": "network-vif-unplugged", "status": "completed", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:18:46.512519 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-09832029-1c2e-49c6-8691-52f3c7c7ce3d req-2be5b617-26d3-448c-8878-4f1ac649678d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:46.513391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-09832029-1c2e-49c6-8691-52f3c7c7ce3d req-2be5b617-26d3-448c-8878-4f1ac649678d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:46.514579 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-09832029-1c2e-49c6-8691-52f3c7c7ce3d req-2be5b617-26d3-448c-8878-4f1ac649678d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:46.528330 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-09832029-1c2e-49c6-8691-52f3c7c7ce3d req-2be5b617-26d3-448c-8878-4f1ac649678d service nova] Creating event network-vif-unplugged:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:18:46.534108 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-09832029-1c2e-49c6-8691-52f3c7c7ce3d req-2be5b617-26d3-448c-8878-4f1ac649678d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045303 Sep 19 16:18:46.535390 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3619/7198] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:18:46.618151 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:46.627123 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6013813c-45ed-479e-b4bb-3204ad4eb9dc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.197339 Sep 19 16:18:46.628009 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3580/7199] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:46 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:47.651822 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:47.652896 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:47.659365 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:47.659857 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:47.660292 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:47.660995 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:47.661450 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:47.661879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:47.819921 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:47.828126 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-6341e938-32b1-443d-83fe-747e6f3a699b tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.181874 Sep 19 16:18:47.828722 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3620/7200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:47 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:48.853926 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:48.854497 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:48.862445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:48.863000 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:48.863465 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:48.864190 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:48.864670 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:48.865118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:49.013066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:49.021699 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-b1c34554-28a2-41b6-af60-10e2a004a244 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.171825 Sep 19 16:18:49.022307 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3581/7201] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:48 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 16:18:50.046733 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:50.047293 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:50.054719 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:50.055448 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:50.055967 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:50.056731 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:50.057476 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:50.057966 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:50.231475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:50.239565 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-9b7c38d5-563c-4857-8d72-cf8f1585e4fc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.197987 Sep 19 16:18:50.240511 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3621/7202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:50 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:51.264141 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:51.264831 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:51.272056 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:51.272574 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:51.273038 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:51.273772 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:51.274252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:51.274701 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:51.428118 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:51.437598 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-af753b6b-0a45-4060-9cc8-0fd033ef4401 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.177441 Sep 19 16:18:51.446795 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3582/7203] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:51 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:52.462137 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:52.462794 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:52.470466 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:52.471001 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:52.471449 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:52.472159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:52.472618 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:52.473306 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:52.622902 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:52.632094 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-cd5e93b3-b336-40d7-9cbc-9e3155b841e7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.173407 Sep 19 16:18:52.633016 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3622/7204] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:52 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:53.656074 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:53.656690 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:53.663512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:53.664015 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:53.664466 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:53.665165 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:53.665635 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:53.666071 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:53.800974 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:53.809232 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-69fd0792-86bd-4a5d-9b5d-c7d24cbb4cdf tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.156932 Sep 19 16:18:53.809817 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3583/7205] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:53 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:54.093101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [req-602d3cb1-cf11-45fc-8fac-4721f733fcef req-6a134552-b12c-4e5b-ac33-1b2311542853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa8e3ce-db58-4058-bea6-861f0961f9a1", "tag": "905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba"}]} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:18:54.100390 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:54.101101 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell0:SELECT=6 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:54.107720 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-602d3cb1-cf11-45fc-8fac-4721f733fcef req-6a134552-b12c-4e5b-ac33-1b2311542853 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:54.108201 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-602d3cb1-cf11-45fc-8fac-4721f733fcef req-6a134552-b12c-4e5b-ac33-1b2311542853 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:54.108636 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [req-602d3cb1-cf11-45fc-8fac-4721f733fcef req-6a134552-b12c-4e5b-ac33-1b2311542853 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:54.119833 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.compute.server_external_events [req-602d3cb1-cf11-45fc-8fac-4721f733fcef req-6a134552-b12c-4e5b-ac33-1b2311542853 service nova] Creating event network-changed:905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba for instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 on n-h2-858384-1 Sep 19 16:18:54.125523 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [req-602d3cb1-cf11-45fc-8fac-4721f733fcef req-6a134552-b12c-4e5b-ac33-1b2311542853 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 Sep 19 16:18:54.126453 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3623/7206] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:18:54.832945 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:54.833493 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:54.835378 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell0:SELECT=2 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:54.842414 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:54.842948 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:54.843438 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:54.844143 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:54.844620 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:54.845066 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:54.979334 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:54.987314 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-dbd6ecbe-3f1c-4306-8ec3-bbbea84d8ea3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.158409 Sep 19 16:18:54.987895 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3584/7207] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:54 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:56.013124 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:56.013754 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:56.020185 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:56.020679 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:56.021119 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:56.021821 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:56.022280 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:56.022706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:56.159371 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:56.167022 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-e87aa64c-2fbf-4f8b-bfd4-9a11a38e9370 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.160450 Sep 19 16:18:56.167593 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3624/7208] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:56 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:57.190424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:57.191083 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:57.197980 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:57.198512 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:57.199658 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:57.200610 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:57.201085 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:57.201531 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:57.331894 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:57.340160 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-6ba12549-5689-4542-8a23-e2df52743e6a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.153171 Sep 19 16:18:57.340744 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3585/7209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:57 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:58.362567 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:58.363212 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:58.365335 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e74702b0-a534-4a94-a5ef-0c7353391db8 req-acf33493-d1d3-4475-953a-64cd9e7a4c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa8e3ce-db58-4058-bea6-861f0961f9a1", "name": "network-vif-plugged", "status": "completed", "tag": "905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:18:58.370353 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:58.371416 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:58.371858 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:58.372706 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:58.373350 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:58.373772 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:58.377585 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e74702b0-a534-4a94-a5ef-0c7353391db8 req-acf33493-d1d3-4475-953a-64cd9e7a4c2a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:58.378446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e74702b0-a534-4a94-a5ef-0c7353391db8 req-acf33493-d1d3-4475-953a-64cd9e7a4c2a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:58.378976 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e74702b0-a534-4a94-a5ef-0c7353391db8 req-acf33493-d1d3-4475-953a-64cd9e7a4c2a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:58.391401 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e74702b0-a534-4a94-a5ef-0c7353391db8 req-acf33493-d1d3-4475-953a-64cd9e7a4c2a service nova] Creating event network-vif-plugged:905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba for instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 on n-h2-858384-1 Sep 19 16:18:58.396823 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e74702b0-a534-4a94-a5ef-0c7353391db8 req-acf33493-d1d3-4475-953a-64cd9e7a4c2a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035537 Sep 19 16:18:58.397680 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3586/7210] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:18:58.518162 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:58.525909 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f119ea85-02b5-496b-bcbb-5ba35704ce15 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1372 microversion: 2.1 time: 0.167495 Sep 19 16:18:58.526492 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3625/7211] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:58 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:59.550192 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:59.551596 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:59.558665 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:59.559284 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:59.559748 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:59.560672 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:59.561103 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:59.561741 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:59.698352 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:59.706657 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-db42b740-0a7c-49f5-b11a-c2b28cc9d0d7 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1557 microversion: 2.1 time: 0.162098 Sep 19 16:18:59.707282 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3587/7212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:59 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:18:59.729341 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:18:59.730012 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:18:59.736889 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:59.737355 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:59.737792 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:59.738479 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:18:59.738969 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:18:59.739391 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:18:59.874837 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:18:59.882441 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-f67702e2-ae82-43ff-ac1c-6b35b47047c3 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1557 microversion: 2.1 time: 0.157081 Sep 19 16:18:59.883041 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3626/7213] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:18:59 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:19:01.779125 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-1ee5cafa-bf77-4b37-be35-4b730df5843b req-1cc731ac-231d-4de4-acbc-98d97d970490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa8e3ce-db58-4058-bea6-861f0961f9a1", "tag": "905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:19:01.789236 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1ee5cafa-bf77-4b37-be35-4b730df5843b req-1cc731ac-231d-4de4-acbc-98d97d970490 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:19:01.789740 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1ee5cafa-bf77-4b37-be35-4b730df5843b req-1cc731ac-231d-4de4-acbc-98d97d970490 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:19:01.790189 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-1ee5cafa-bf77-4b37-be35-4b730df5843b req-1cc731ac-231d-4de4-acbc-98d97d970490 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:19:01.801789 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-1ee5cafa-bf77-4b37-be35-4b730df5843b req-1cc731ac-231d-4de4-acbc-98d97d970490 service nova] Creating event network-changed:905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba for instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 on n-h2-858384-1 Sep 19 16:19:01.806884 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-1ee5cafa-bf77-4b37-be35-4b730df5843b req-1cc731ac-231d-4de4-acbc-98d97d970490 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032330 Sep 19 16:19:01.807494 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3588/7214] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:20:29.957582 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:29.958328 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=48 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:29.959579 n-d-858384-1 devstack@n-api.service[128730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:20:29.959732 n-d-858384-1 devstack@n-api.service[128730]: Mon Sep 19 16:20:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1/action (ip 10.222.0.81) !!! Sep 19 16:20:29.965338 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-405051326"}} {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:20:29.967621 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:29.976986 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:29.977475 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:29.977912 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:29.978603 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:29.979094 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:29.979517 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:30.189485 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-b4e194ec-727c-439b-aae1-fd488cbde1db tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "POST /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.233705 Sep 19 16:20:30.190149 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3627/7215] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 16:20:29 2022] POST /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 19 16:20:34.861586 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_api:SELECT=24 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:34.865099 n-d-858384-1 devstack@n-api.service[128731]: DEBUG dbcounter [-] [128731] Writing DB stats nova_cell1:SELECT=48 {{(pid=128731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:34.868865 n-d-858384-1 devstack@n-api.service[128731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 16:20:34.870146 n-d-858384-1 devstack@n-api.service[128731]: Mon Sep 19 16:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 16:20:34.893718 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-a4ff9063-04a3-4582-9ed2-57d3cec0d69e req-5a3ad495-f96d-478a-a2dc-d019403b7517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa8e3ce-db58-4058-bea6-861f0961f9a1", "name": "network-vif-plugged", "status": "completed", "tag": "905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:20:34.911380 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a4ff9063-04a3-4582-9ed2-57d3cec0d69e req-5a3ad495-f96d-478a-a2dc-d019403b7517 service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:34.912427 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a4ff9063-04a3-4582-9ed2-57d3cec0d69e req-5a3ad495-f96d-478a-a2dc-d019403b7517 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:34.913285 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-a4ff9063-04a3-4582-9ed2-57d3cec0d69e req-5a3ad495-f96d-478a-a2dc-d019403b7517 service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:34.935231 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-a4ff9063-04a3-4582-9ed2-57d3cec0d69e req-5a3ad495-f96d-478a-a2dc-d019403b7517 service nova] Creating event network-vif-plugged:905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba for instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 on n-h2-858384-1 Sep 19 16:20:34.940996 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-a4ff9063-04a3-4582-9ed2-57d3cec0d69e req-5a3ad495-f96d-478a-a2dc-d019403b7517 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084424 Sep 19 16:20:34.941620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3589/7216] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:20:43.855520 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_api:SELECT=2 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:43.856433 n-d-858384-1 devstack@n-api.service[128730]: DEBUG dbcounter [-] [128730] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:43.860879 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:43.861063 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-8c7044c8-7a9d-4b1c-977f-90370ebd544e req-660a0706-52ca-4a27-bcf8-3d6ffb7f297d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa8e3ce-db58-4058-bea6-861f0961f9a1", "tag": "905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:20:43.861630 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:43.870406 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:43.870938 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:43.871373 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:43.872279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:43.872735 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:43.873159 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:43.873534 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8c7044c8-7a9d-4b1c-977f-90370ebd544e req-660a0706-52ca-4a27-bcf8-3d6ffb7f297d service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:43.874035 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8c7044c8-7a9d-4b1c-977f-90370ebd544e req-660a0706-52ca-4a27-bcf8-3d6ffb7f297d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:43.874484 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-8c7044c8-7a9d-4b1c-977f-90370ebd544e req-660a0706-52ca-4a27-bcf8-3d6ffb7f297d service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:43.888419 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-8c7044c8-7a9d-4b1c-977f-90370ebd544e req-660a0706-52ca-4a27-bcf8-3d6ffb7f297d service nova] Creating event network-changed:905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba for instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 on n-h2-858384-1 Sep 19 16:20:43.894168 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-8c7044c8-7a9d-4b1c-977f-90370ebd544e req-660a0706-52ca-4a27-bcf8-3d6ffb7f297d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038263 Sep 19 16:20:43.894937 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3590/7217] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:20:43.905550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Going to try to terminate instance {{(pid=128730) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:20:43.998896 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-bc6a3f3d-5808-4384-bfba-f90b67dfff1d tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 204 len: 0 microversion: 2.1 time: 0.145605 Sep 19 16:20:43.999737 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3628/7218] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:20:43 2022] DELETE /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:20:44.008310 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:44.009324 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:44.015739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:44.016241 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:44.016739 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:44.017446 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:44.017918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:44.018358 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:44.161627 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:20:44.170415 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-419c1903-2d86-4169-a895-4d514ec0b33a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1682 microversion: 2.1 time: 0.166406 Sep 19 16:20:44.171029 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3591/7219] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:44 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:20:45.196990 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:45.197790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:45.207616 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:45.208314 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:45.208756 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:45.209745 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:45.210490 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:45.211830 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:45.375819 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:20:45.384218 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-0d0f109b-f9bf-46b4-b4a2-ca65d0e9995a tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 200 len: 1682 microversion: 2.1 time: 0.193186 Sep 19 16:20:45.384796 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3629/7220] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:45 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:20:45.921252 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-5421b9d2-0a16-4b47-9cb1-e33daa369e9d req-f341f42c-ac19-4973-8e08-a03274cc362c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa8e3ce-db58-4058-bea6-861f0961f9a1", "name": "network-vif-deleted", "tag": "905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:20:45.933455 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5421b9d2-0a16-4b47-9cb1-e33daa369e9d req-f341f42c-ac19-4973-8e08-a03274cc362c service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:45.933959 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5421b9d2-0a16-4b47-9cb1-e33daa369e9d req-f341f42c-ac19-4973-8e08-a03274cc362c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:45.934413 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-5421b9d2-0a16-4b47-9cb1-e33daa369e9d req-f341f42c-ac19-4973-8e08-a03274cc362c service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:45.945912 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-5421b9d2-0a16-4b47-9cb1-e33daa369e9d req-f341f42c-ac19-4973-8e08-a03274cc362c service nova] Creating event network-vif-deleted:905d5f6b-d4f1-4aca-bdb0-2e43b0ddfbba for instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 on n-h2-858384-1 Sep 19 16:20:45.951117 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-5421b9d2-0a16-4b47-9cb1-e33daa369e9d req-f341f42c-ac19-4973-8e08-a03274cc362c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Sep 19 16:20:45.951753 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3592/7221] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 16:20:46.408074 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:46.408787 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: 6fa8e3ce-db58-4058-bea6-861f0961f9a1] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:46.417790 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:46.418279 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:46.418725 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:46.419541 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:46.420256 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:46.420884 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:46.440191 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.wsgi [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] HTTP exception thrown: Instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 could not be found. Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Request method failure captured: Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: request: GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 HTTP/1.1 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Accept: application/json Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Accept-Encoding: identity Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Connection: close Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Content-Length: 0 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Content-Type: application/json Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Host: 10.222.0.81 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: Openstack-System-Scope: None Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: User-Agent: python-urllib3/1.26.12 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Auth-Token: gAAAAABjKJXNGpWq0x9gelucnFzXp2OgPieMD33mmpF4O4kjofVfouahCuQYfjw9z_RXL2w5o-DYug_tSOMqMumDjm2Bl_NswCTlx7kNY-e3dp2yKKT3iVBkYkbNyCP1gX9hzcDPZMfcMoy4SlnmltBHdAx8JhxMcmMs24m3oV5RNvO2DM25MRo Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Id: None Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Domain-Name: None Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Identity-Status: Confirmed Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Is-Admin-Project: True Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Id: default Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Domain-Name: Default Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Id: 394e3552784246d48cf3feaf246eedd9 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Project-Name: tempest-TestSnapshotPattern-507291161 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Role: member,reader Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Roles: member,reader Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_394e3552784246d48cf3feaf246eedd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/394e3552784246d48cf3feaf246eedd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/394e3552784246d48cf3feaf246eedd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/394e3552784246d48cf3feaf246eedd9"}]}] Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant: tempest-TestSnapshotPattern-507291161 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Id: 394e3552784246d48cf3feaf246eedd9 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-Tenant-Name: tempest-TestSnapshotPattern-507291161 Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-User: tempest-TestSnapshotPattern-507291161-project Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Id: default Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-User-Domain-Name: Default Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-User-Id: fe21e6f85c854e2b975e47dc4c382cdd Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: X-User-Name: tempest-TestSnapshotPattern-507291161-project Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: method: > Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: exception: Instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 could not be found. Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: action_args: {'id': '6fa8e3ce-db58-4058-bea6-861f0961f9a1'} Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 could not be found. Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 could not be found. Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:20:46.441864 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 could not be found. Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: ERROR nova.api.openstack.wsgi Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Returning 404 to user: Instance 6fa8e3ce-db58-4058-bea6-861f0961f9a1 could not be found. {{(pid=128730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-299e1d33-b2b1-4aae-bc28-d21683ff40d5 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1" status: 404 len: 111 microversion: 2.1 time: 0.039606 Sep 19 16:20:46.447649 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3630/7222] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:46 2022] GET /compute/v2.1/servers/6fa8e3ce-db58-4058-bea6-861f0961f9a1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:20:47.788523 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:47.789173 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:47.795911 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:47.796424 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:47.796885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:47.797600 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:47.798081 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:47.798528 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:47.824918 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Going to try to terminate instance {{(pid=128731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 16:20:47.905009 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-89b4935a-c05f-49db-a8e6-20f9a67535bc tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 204 len: 0 microversion: 2.1 time: 0.121193 Sep 19 16:20:47.905628 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3593/7223] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 16:20:47 2022] DELETE /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 16:20:47.916758 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:47.917404 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:47.924473 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:47.924957 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:47.925392 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:47.926082 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:47.926533 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:47.926983 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:47.966990 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-e8429085-b25f-47de-be6f-d9ed6d935ef2 req-5285250d-01c6-4aa6-a09f-6e0289df6e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:20:47.976584 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e8429085-b25f-47de-be6f-d9ed6d935ef2 req-5285250d-01c6-4aa6-a09f-6e0289df6e1a service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:47.977090 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e8429085-b25f-47de-be6f-d9ed6d935ef2 req-5285250d-01c6-4aa6-a09f-6e0289df6e1a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:47.977864 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-e8429085-b25f-47de-be6f-d9ed6d935ef2 req-5285250d-01c6-4aa6-a09f-6e0289df6e1a service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:47.989860 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-e8429085-b25f-47de-be6f-d9ed6d935ef2 req-5285250d-01c6-4aa6-a09f-6e0289df6e1a service nova] Creating event network-changed:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:20:47.995579 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-e8429085-b25f-47de-be6f-d9ed6d935ef2 req-5285250d-01c6-4aa6-a09f-6e0289df6e1a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032739 Sep 19 16:20:47.996187 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3594/7224] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:20:48.067881 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:20:48.076524 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7aa06353-13bd-4b59-a594-411a61473ca8 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1683 microversion: 2.1 time: 0.166372 Sep 19 16:20:48.077101 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3631/7225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:47 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:20:49.106896 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:49.107546 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:49.113680 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:49.114176 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:49.114624 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:49.115350 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:49.115820 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:49.116254 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:49.284292 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.policy [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:20:49.292896 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-9cb7ce5f-e546-492c-b746-2e61c8b10437 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1683 microversion: 2.1 time: 0.196028 Sep 19 16:20:49.293479 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3595/7226] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:49 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:20:50.316862 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:50.318410 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.compute.api [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128730) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:50.326550 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:50.327169 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:50.327681 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:50.328481 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:50.329033 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:50.329544 n-d-858384-1 devstack@n-api.service[128730]: DEBUG oslo_concurrency.lockutils [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:50.521037 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [req-4188d3e1-be8f-4fea-b25b-fe758613755e req-1687a542-b51a-4f53-a6c7-07e7d3e2dbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b", "name": "network-vif-deleted", "tag": "2b3af7a7-645a-461b-956a-6451f928b963"}]} {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 16:20:50.535213 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4188d3e1-be8f-4fea-b25b-fe758613755e req-1687a542-b51a-4f53-a6c7-07e7d3e2dbdc service nova] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:50.535717 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4188d3e1-be8f-4fea-b25b-fe758613755e req-1687a542-b51a-4f53-a6c7-07e7d3e2dbdc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:50.536174 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [req-4188d3e1-be8f-4fea-b25b-fe758613755e req-1687a542-b51a-4f53-a6c7-07e7d3e2dbdc service nova] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:50.549459 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.policy [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe21e6f85c854e2b975e47dc4c382cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e3552784246d48cf3feaf246eedd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128730) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 16:20:50.552520 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.compute.server_external_events [req-4188d3e1-be8f-4fea-b25b-fe758613755e req-1687a542-b51a-4f53-a6c7-07e7d3e2dbdc service nova] Creating event network-vif-deleted:2b3af7a7-645a-461b-956a-6451f928b963 for instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b on n-h1-858384-1 Sep 19 16:20:50.558650 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [req-4188d3e1-be8f-4fea-b25b-fe758613755e req-1687a542-b51a-4f53-a6c7-07e7d3e2dbdc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041600 Sep 19 16:20:50.559180 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-7a0e6ca7-4894-460b-9da1-5b2fc732299c tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 200 len: 1564 microversion: 2.1 time: 0.246668 Sep 19 16:20:50.559620 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3596/7227] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 16:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 16:20:50.576437 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3632/7228] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:50 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 16:20:51.583860 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '>' {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:51.585305 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.compute.api [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] [instance: ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b] Fetching instance by UUID {{(pid=128731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 16:20:51.594885 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:51.595388 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:51.595838 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:51.596551 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Acquiring lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 16:20:51.597009 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 16:20:51.597445 n-d-858384-1 devstack@n-api.service[128731]: DEBUG oslo_concurrency.lockutils [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Lock "bc6b4e06-eb4a-4786-9d91-49c729d2b807" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 16:20:51.613405 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.wsgi [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] HTTP exception thrown: Instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b could not be found. Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Request method failure captured: Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: request: GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b HTTP/1.1 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Accept: application/json Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Accept-Encoding: identity Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Connection: close Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Content-Length: 0 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Content-Type: application/json Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Host: 10.222.0.81 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: Openstack-System-Scope: None Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: User-Agent: python-urllib3/1.26.12 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Auth-Token: gAAAAABjKJXNGpWq0x9gelucnFzXp2OgPieMD33mmpF4O4kjofVfouahCuQYfjw9z_RXL2w5o-DYug_tSOMqMumDjm2Bl_NswCTlx7kNY-e3dp2yKKT3iVBkYkbNyCP1gX9hzcDPZMfcMoy4SlnmltBHdAx8JhxMcmMs24m3oV5RNvO2DM25MRo Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Id: None Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Domain-Name: None Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Identity-Status: Confirmed Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Is-Admin-Project: True Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Id: default Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Domain-Name: Default Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Id: 394e3552784246d48cf3feaf246eedd9 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Project-Name: tempest-TestSnapshotPattern-507291161 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Role: member,reader Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Roles: member,reader Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.81:8080", "publicURL": "http://10.222.0.81:8080/v1/AUTH_394e3552784246d48cf3feaf246eedd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/394e3552784246d48cf3feaf246eedd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/394e3552784246d48cf3feaf246eedd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/394e3552784246d48cf3feaf246eedd9"}]}] Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant: tempest-TestSnapshotPattern-507291161 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Id: 394e3552784246d48cf3feaf246eedd9 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-Tenant-Name: tempest-TestSnapshotPattern-507291161 Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-User: tempest-TestSnapshotPattern-507291161-project Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Id: default Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-User-Domain-Name: Default Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-User-Id: fe21e6f85c854e2b975e47dc4c382cdd Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: X-User-Name: tempest-TestSnapshotPattern-507291161-project Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: method: > Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: exception: Instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b could not be found. Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: action_args: {'id': 'ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b'} Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: {{(pid=128731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b could not be found. Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b could not be found. Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 16:20:51.616566 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b could not be found. Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: ERROR nova.api.openstack.wsgi Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: DEBUG nova.api.openstack.wsgi [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Returning 404 to user: Instance ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b could not be found. {{(pid=128731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: INFO nova.api.openstack.requestlog [None req-0f904c5d-05e0-4356-8ecb-0c77e17409b6 tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b" status: 404 len: 111 microversion: 2.1 time: 0.039570 Sep 19 16:20:51.621753 n-d-858384-1 devstack@n-api.service[128731]: [pid: 128731|app: 0|req: 3597/7229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 16:20:51 2022] GET /compute/v2.1/servers/ca6acb18-cdd9-4138-9a9a-fe1d6d8f819b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 16:20:51.802083 n-d-858384-1 devstack@n-api.service[128730]: DEBUG nova.api.openstack.wsgi [None req-ac274df8-37eb-4703-a2fe-c472b230082f tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] Calling method '.version_select at 0x7fde28b9cee0>' {{(pid=128730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 16:20:51.827154 n-d-858384-1 devstack@n-api.service[128730]: INFO nova.api.openstack.requestlog [None req-ac274df8-37eb-4703-a2fe-c472b230082f tempest-TestSnapshotPattern-507291161 tempest-TestSnapshotPattern-507291161-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-678571308" status: 202 len: 0 microversion: 2.1 time: 0.029092 Sep 19 16:20:51.827745 n-d-858384-1 devstack@n-api.service[128730]: [pid: 128730|app: 0|req: 3633/7230] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 16:20:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-678571308 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)